When I get the map, compass, and/or boss key, they still have the actual effects only on their corresponding level number, but the "current item" tiles show up on the subscreen all the time, even after switching level numbers.
293: Map/compass/boss key items showing up on subscreen for every level number
Fixed in the next build.