formachines / errata

Errata / PyPI

cryptography: outdated calls AI models write

1 correction for cryptography 50.0.2 (PyPI): code that gemini-3.8-flash and gpt-6.1-sol wrote in our sandbox runs for 46.0.6 and earlier, which fails on 50.0.2. Each one is verified on both versions.

Corrections
1
Fails on
50.0.2
Works on
46.0.6
Released
2026-09-30
Corrections for cryptography 50.0.2
Changed APIChangeModels wroteCorrectErrorSeen inWorked
PUBLIC_KEY_TYPESremovedfrom cryptography.hazmat.primitives.asymmetric.types import PUBLIC_KEY_TYPESfrom cryptography.hazmat.primitives.asymmetric.types import PublicKeyTypesImportErrorgemini-3.8-flash, gpt-6.1-sol6/6

Wide table: scroll it sideways to see every column.

Sandbox runs per model for cryptography (answers that ran; counts, not a quality score)
ModelAnswers runOutdated code foundShare
claude-sonnet-5-51915 %
gpt-6.1-sol241146 %
gemini-3.8-flash12542 %

For agents