well, as Walter Benjamin maintained, there is no such thing as an audience - given that the meaning of the term is so complicated as to really be meaningless - who is the audience? It's different for everyone, for every genre and every niche - there is no single and identifiable entity.
still, some (if not most) of us crave SOME audience, if only to be liberated from that which we hate (various day-job anchors) into a situation of freedom to do what we love to do. But personally, though I believe the music I perform is quite accessible, it would not exist without those who took many more chances than I take, who pushed things along in ways which were, given the times and the "audiences," much riskier - and that fringe which gets so critcized - from Albert Ayler to Cecil Taylor - freed all of us, from beboppers to new music-ites, to do what we want to do without being slave to certain formal and generic assumptions. So we owe them an enormous debt.