Why is refresh rate critical? It's not like an xterm has a lot of animation. Maybe scrolling in vim would be awkward. The only problem with refresh I see is that when you type, there would be a delay before the characters appear.

BTW: Someone has got linux running on a Kindle (well, it runs linux anyway... they got access to it).