The problem isn't the stereo, it's the way that the stereo image is used, particularly in the early days. The stereo mix of Thelonious Monk with Art Blakey and the Jazz Messengers had Monk in one channel, and the Messengers in the other- not a pleasant listening experience (especially with headphones), particularly as Monk goes long stretches without playing (bassist Spanky DeBrest is practically inaudible, too). The mono version is fuller, punchier and more integrated.
I had a similar experience recently when i bought The Straight Horn of Steve Lacy, the sound of which irked me so much I did my own 'remix', boosting the bass frequencies and narrowing the stereo image (not quite to mono, though).