Today on my way home from NY I stopped by the local [35 miles from my town] vinyl-only shop called the Mystic Disc, in beautiful Mystic, Connecticut.
http://www.mysticseaport.org/
This was my second time browsing there in the last 5 years. Last time I scored a couple of good LPs, found nothing of interest jazz-wise this time; lots of 1970s-1980s rock/pop LPs in the stacks, some obscure. There were about 10 youths hanging out in and outside the store, talking music and vinyl, which was heartwarming to see.
How this place stays in business is a mystery to me. Nevertheless, it's there, and has been for years.
Not too far from Mystic is the Book Barn, the second largest used bookstore I've been to, after the Strand in NY. If you are driving down this stretch of I-95, make sure to stop by there, unless you're severely allergic to cats. Prices are insanely low, they carry hundreds of art books, among thousands of other titles. A wonderful, unusual place.