I have utter chaos in my collection, very little is filed in any order with only Miles, Dylan, Blue Note, Impulse, and Bethlehem really filed properly together. That's how I like it, I hunt and peck and get a variety of listening as a result.
I think it's our tastes and listening habits, I don't have any "genre" separation or classification. I don't listen at all to soundtracks, "international jet set singers," or anything exotic or lounge related, and don't drink so there's no "party" music. And I don't have any "Brazilian bags" . . . I might play a Brazilian artist after a Chicago style record or a Blue Note album.