When you try going on water with the ladder, sometimes it just goes in the wrong direction. And sometimes it goes where it's not suppose to. I think there's some times where you just can't go along water. You'd be stopped in your tracks and have to move away from it.
In fact, in this quest demonstrating this, you can GET STUCK using the ladder!