Funnily I am interested in this semantic argument.
Do LLM trainers actually feed their « beast » with prompts from the past? Especially ones that are human corrections upon false assumptions hallucinated by the LLM?
As a non-specialist I would definitely see a lot of value in doing so, but I let you, experts, clarify that point.