I agree it is somewhat counter-intuitive. I believe it is done this way for a reason though. If by navigating around you would happen upon a directory with hundreds of icons/graphic files that you would have to wait for to be displayed, you can see how that could become annoying quite quickly.
So this is just one of those little compromises in user-friendliness that we have to live with I guess.
Bookmarks