I used to swap out audio components all the time. Then about 6 years ago, I stopped hearing many differences so I decided to stick with what I have. Sure, when they break, I'll replace them, but I'm done with getting the latest audio toy.
FWIW, one of my biggest mistakes was moving into tubes for a while. To my ears, there was no discernable audio difference but they were very nice looking. If they weren't so damn hot, I probably would've kept them just on looks alone. But when I switched back to solid state and heard no difference, I felt like a fool for spending thousands of dollars thinking that tubes sound better.