I guess you could say that there is an objective function to maximize and instead of thinking about generations you could consider the same individuals over and over again... That's my intuition of the similarities they could consider, but I agree with you that GAs are not RL.