It's easy to get into some of the classic rock from the late 60s, but I found it more difficult to get into other older music. These are some great albums I discovered after I searched more extensively:
Arbee Stidham - Tired of Wandering Barbara Dane - On My Way Kay Martin - Kay Martin and Her Body Guards Janis Ian - ...For All the Seasons of Your Mind Jimmy Witherspoon - Evenin' Blues Julie London - Julie Is Her Name Julie London - About the Blues Junior Wells' Chicago Blues Band - Hoodoo Man Blues
If you like weird electronic and industrial noise music, you can find some really crazy early stuff such as these:
Karel Appel - Musique barbare Desmond Leslie - Music of the Future Tom Dissevelt & Kid Baltan - The Fascinating World of Electronic Music Cromagnon - Orgasm