From his NYT obit:
He ran his apartment, on Seventh Street in the East Village, as a bohemian salon, attracting a loose collective that included the ethnomusicologist Harry Smith, the photographer Robert Frank and the jazz musician Thelonious Monk, who would drop by for meals between sets at the Five Spot. Bob Dylan paid the occasional visit.
http://www.nytimes.com/2009/03/21/arts/21z...?ref=obituaries