> There are many non-technical people who claim they have experience "training" LLMs, when they are just an end user who added a lot of tokens to the context window during inference.
Since in-context learning is a thing, “adding tokens to the context window”, at least with the intent and effect of having a particular impact on capabilities when inference is run on the context to which they were added, is, arguably, a kind of training.
Since in-context learning is a thing, “adding tokens to the context window”, at least with the intent and effect of having a particular impact on capabilities when inference is run on the context to which they were added, is, arguably, a kind of training.