The LLM is sampled to make just one-token continuation with the context. Presented a sequence of tokens, only one token is drawn from the distribution of possible subsequent tokens. This token is appended to your context, and the method is then repeated. There could well be a distinction righ