> OK now what sequences would you like to present to the algorithm for training? Ones from the environment? Great, but those will take time to collect. Simulated ones? It takes a lot of knowledge to generate good ones.
With AIXI and variants, since they are universal predictors, it doesn't really matter what sequences you supply so long as they have some connection. Heck, just your algorithm access to an email server or something.
The computable versions of AIXI have such enormous constant factors that the indirection of email->real-world is as less than a grain of dust in the Ganges.
That indirection's constant factor cost might matter for any feasible AIXI-inspired AI, but since none has yet to be created or even designed, it's hard to say...
With AIXI and variants, since they are universal predictors, it doesn't really matter what sequences you supply so long as they have some connection. Heck, just your algorithm access to an email server or something.