Yes, it is described in Golson' autobiography, pages 92-93.
However, it is very unlikely that such meeting ever happened, taking into consideration the well known agendas of Louis Armstrong and the Lionel Hampton Orchestra (for which Brownie played during several months during that year), as demonstrated by Spanish trumpetist Joan Mar Sauqué in his article 'Clifford Brown with Tadd Dameron: chronicle of the summer of 1953', published in the jazz research periodical Jazz-hitz (#04, 2021).
http://jazz-hitz.musikene.eus/index.php/jazz-hitz/article/view/87/51
(the article is in Spanish, but you can find and abstract in English)
Sauqué concludes that an encounter similar to what Golson describes is likely to have happened, but with a different trumpet player (Idrees Sulieman or Johnny Coles).