> What are we going to train such a learner with, if we ourselves don't fully know the rules of the domain, as you point out?

This does not make any sense if you assume general intelligence. A physicist who makes a discovery also was not trained to know about this new law or rule beforehand (how could he?).