That's one of the things I still miss about my Palm Pilot Pro. It ran on 1 (or 2??) AA batteries, and it lasted a month (seemingly regardless of how much I used it; which is just my imagination, but regardless that's still the impression I have).
The other thing I dearly miss: being able to read it in full sunlight.
Thats pretty much how I remember them as well. And you could use plucker to crawl all the news site and compile a single archive of todays news, to read on the train - offline ofcourse. Everything was offline back then and I kind of begin to miss that :) - I read several books on a palm - all of Harry Potter, some A. C. Clarke and HHGTTG. The thing could go on forever.
In contrast to my old Sega Game Gear which ran on on 6 AA batteries and would last less than 2 hours. Though to its credit it, it came out about a year after the original Gameboy but had a backlit, color screen. Too bad so many of the games were terrible.