Liberry of Congress just launched it. It's the largest collection of public domain music and whatnots in the world, all for free online:
http://www.loc.gov/jukebox/ (http://www.loc.gov/jukebox/)
Scan around for presidential recordings and other historical audio, but you can get some neat original recordings of Pre-WWII music