Here's the plan - the hermit turns whenever he smells nice things, and the direction he faces determines what time it is.
The statue is currently off limits while it's being painted, so if we turn time forward, that'll see that the painting work is completed quickly and the statue will become accessible again.