I like cover art very much and therefore have some books, though most have been previously mentioned by Big Beat Steve. I'm also a great fan of Taschen, of which I have some books, like the iconic Rock Dreams, although that is not a cover book. I have California Cool, the Taschen book on Alex Steinweiss, a Jazz Covers book by Taschen, another about Prestige covers published by Concord, In the groove, a Taschen book called 1000 covers and The 100 best-selling albums of the 50s, another little book on record covers with Kind of blue and Come fly with me. And also a couple of books on book jacket or covers. One of them titled Penguin by design by Penguin and about the design history behind the Penguin paperbacks. And a BN cover book by Graham Marsh I didn't think of yesterday. And yes, there was a Taschen edition of Rock Dreams, but only of Guy Peellaert's drawings and Nick Cohn's texts, not of the Rock Album that used to go bundled with it.
And I also agree that the Steinweiss book was a bit of let down. There was I think about 2005 or 2006 a second and cheaper edition of that book for 50 €.