#4, solving multiple games with one agent, seems like a reasonably interesting step towards more general intelligence. An agent that can play a new game without any game-specific information other than "what can I do" and "what should I value" starts to sound a lot more like an agent that can solve non-game problems. Especially if that agent can play games that model real-world problems.