It turns out that Garbage In, Garbage Out, when applied to garbage code, just yields more garbage. In addition to making stuff up, the LLMs are now getting “compounding errors,” little errors turning into big errors as the made-up stuff is used as an input. Throwing more data at the problem, and throwing more computing power at the problem, just makes the problem worse.