I understand what you're saying, but I get a hell of a lot more out of say, SY, Dinosaur Jr., etc. now than I ever did in high school, when that music was at its zenith. I don't really think about how great getting stoned in the back parking lot listening to "Suck You Dry" was when I throw on a Mudhoney record. Funny, too, I remember my dad playing Anthony Braxton recs when I was a kid, but listening to Conference of the Birds doesn't evoke recollections of homework at the kitchen table.
To bring it more recently, I got into the Incredible String Band after college when I was living in New York. Now, my recollections of that time have nothing to do with ISB and all to do with the time/place outside of tastes. Also, I can't understand why I even listened to that shit, but didn't get rid of the albums for whatever reason... but anyway, I guess we're different in that respect.