formachines / errata

Errata / npm

graphql: outdated calls AI models write

1 correction for graphql 17.0.2 (npm): code that gemini-3.8-flash wrote in our sandbox runs for 16.13.2 and earlier, which fails on 17.0.2. Each one is verified on both versions.

Corrections
1
Fails on
17.0.2
Works on
16.13.2
Released
2026-07-03
Corrections for graphql 17.0.2
Changed APIChangeModels wroteCorrectErrorSeen inWorked
isValidNameErrorremovedconst { isValidNameError } = require('graphql');const { assertName } = require('graphql');TypeErrorgemini-3.8-flash1/1

Wide table: scroll it sideways to see every column.

Sandbox runs per model for graphql (answers that ran; counts, not a quality score)
ModelAnswers runOutdated code foundShare
claude-sonnet-5-51200 %
gpt-6.1-sol1200 %
gemini-3.8-flash12217 %

For agents