LLM code generation is explicitly framed as interpolation/style transfer within the training distribution — capable of high-fidelity next-token prediction on a corpus but lacking out-of-distribution generalization, so code generation succeeds precisely because coding is a style-transfer problem that matches LLM strengths.
It gives an architectural boundary rule: delegate tasks whose solution space is densely covered by training data (idiomatic code, known compiler patterns, boilerplate) and keep human ownership of tasks requiring novel architecture or out-of-distribution design.
Any agentic system's competence should be scoped by coverage of its training/interpolation manifold rather than by apparent fluency; fluency is not evidence of generalization.
LLMs cosplay understanding by generating likely token sequences based on statistical correlations.
Fine-tuning models on a corpus allows them to predict the next word or token with high fidelity, but they lack out-of-distribution generalization.
Coding is a style-transfer and interpolation problem, which fits LLM strengths well within their training distribution.