I am a huge fan of Vinyl, my girl bought me this record player that is portable (like 60 bucks or something). It is great also you can rip the music from any record into your computer with this player. I keep my records in a dry area away from direct sunlight. I make sure they are standing up or laying flat because on an angel they will bend and become warped.
If you live in Boston or the greater Boston area, there is a great record store called Looney Tunes. They have thousands of records new and used for cheap.