A lot of the early record companies were owned by firms in the furniture business. Generally, gramophones were sold in furniture shops, as pieces of furniture. Brunswick was owned by a firm of billiard table manufacturers; Vocalion and Gennett by (different) piano manufacturers.
In Paramount's case, what gave them an edge was that they had the services of one H C Speir, who owned a store (it doesn't say what he sold) in Jackson Miss. Speir knew what his black customers wanted and would arrange for blues singers and others to go to Chicago (where Wisconsin Chair had their recording operation) to record. In Chicago itself, Paramount was managed by Mayo Wiliams, about the first black executive in the recording industry. Between them, and one or two other contacts in the South, I imagine, they put Paramount in the lead for what was then called "Race music".
If you can find a book in your local library called "Little labels - big sound", by Rick Kennedy and Randy McNutt (Indiana U Press, 1999) ISBN0-253-335548-5, that gives potted histories of
Gennett
Paramount
Dial
King
Duke-Peacock
Sun
Riverside
Ace (New Orleans, not London)
Monument
Delmark
MG