I have a cabinet where I have put most of the single and double CDs that I've ripped in very thin plastic sleeves. As I rip them I give them a number and put them at the end of the drawer. So the drawer is in "when I ripped it" order. I actually spent the last year or so ripping and filing because I had done some, but not most, of what I owned before and then sort of gave up. Now pretty much everything is in that one cabinet except...
I have various boxed sets (anything with 4+ disks) scattered around the house. But I isolate the ones I have not ripped yet in one cabinet so I can usually find them.
I keep track of the serial numbers in iTunes/Apple Music, which stores all the ripped files.
Now ... LPs are a different story.