I know, that's why I first bought a solid amp + CDP, vinyl requires much more investing(additional phono pre-amp, turntable, cartridge, etc.). But you can still find good and cheap stuff if you buy vintage, you just have to buy a new cartridge for it and it's as good as new. Plus, there are some new manufacturers that make excellent turntables for decent amount of money, like Pro-ject.
But the sound that vinyl gives is worth all that and I'm glad it's coming back into fashion. Vinyl is definetly my next investment.