When it comes to the best time to visit Japan, the common answer is March and May for the cherry blossoms and pleasant temperatures.