I re-watched this recently on Tubi and had the same issue with subtitles. When I first saw it decades ago, it was via VHS and the movie's subtitles were sufficient (but I'm also a native a English speaker), and I'm pretty sure those subtitles are baked into the movie itself. Unless one is fluent in Jamaican patois, it's difficult to completely understand otherwise. I plan on watching again and will turn the streaming platform's subtitles off because I thought they were distracting and unnecessary as well.
I've seen The Harder they Come but not Smile Orange. Another one I highly recommend is Countryman, which I rank up there with Rockers, and slightly better than The Harder they Come: