Added a button for iPodder to my blog. While the name suggests you need an Apple iPod, you certainly don't. However, you'll probably need iTunes to start. I just use iPodder and iTunes myself. Give it a try.
There is directory of podcast available. I'll recommend Trade Secrets to find out about the fast moving world of podcast. But look at the directory for a wide variety of content.