If the Ladder is in a room where the 6 blocks and Firerobes are with traps, either I'm totally missing it or you forgot a flag. They only seem to open doors. You might need to check that place out, or it's off the map and I have no clue of where it is.

-James