I think it all comes down to what you grew up with and how you hear the songs in your head. For example, I was listening to My Generation a couple of days ago and after hearing the title song, I was expecting The Kids Are Allright and so it followed. Mind you, I probably haven’t listened to the album in 30 years.
The same discussion happens with albums like Rubber Soul and Revolver.