Wikipedia has a “list of full length copyleft/public domain songs available on Wikipedia or the Commons.” The works are primarily classical, but there’s a lot of neat stuff available for free download in the .ogg format (open source alternative to mp3).
