The passage is in this thesis here, just search for "white woman"
https://andybleaden.blogspot.com/2007/07/thesis-on-john-patton-by-javier.html?m=1
It says clearly that Patton was offended by the cover of That Certain Feeling...(It's even implied that the cover made him so bitter he left the music scene for a while)