That's not the whole story though, some edited podcasts I find hard to listen to _because_ they're (heavily?) edited. Some people-having-a-chat-podcasts work well for me.
I guess I can't stand too much 'energy' in the audio, be it from editing into something fast paced, or overly enthusiastic and dramatic voice (acting). I'm looking for something where content speaks for itself, rather than the voices.