I still don't think your ears are bad. Don't forget that SUPER HIGH-END equipment can reveal every single flaw in the recording process. As far as I'm concerned, the latter is a good reason not to invest in a system like that!
Of course, like you say, audio quality matters. But, at some point, a line gets crossed and things get silly. (I suppose each person has to decide where that line is for themselves.)
I'd rather get my system set up and then forget about it -- so I can focus on the music.