This closely resembles my situation. Outdoors I don’t wear them but when I go to the gym, which doesn’t require them anymore because of Governor Murphy’s rollback of regulations, I still wear them. Usually I’m the only person doing so.
Also, the vaccines are 90-95% effective, not 100%, so you still need to exercise some care.