Guybrush makes that pretty clear.
Whenever you go the wrong way, he tells you to go the church.
Maybe you should listen to him.
You have to break up LeChuck and Elaine's wedding.
Go to the church.
It's past the main village area with the clock, near the middle of the back part of town.