Ailyre

Service update · OpenAI

OpenAI details coding gains in low-resource languages and open-sources MultiLangBench

Review updated

In an article dated October 19, 2026, OpenAI released the MultiLangBench evaluation setup and test suite on GitHub. The benchmark tests whether models can build a SQLite-compatible database engine across 20 programming languages. At maximum reasoning effort, GPT-6 Astra averaged an 87.4% test pass rate, compared with 26.8% for GPT-5.6 Sol. In a separate COBOL migration evaluation, GPT-6.1 Sol reached 97.9% accuracy at higher reasoning effort. These are OpenAI’s evaluation results, not a new model launch; production migrations still require expert review and testing.

Source trace

Reviewed by Ailyre. Source evidence is presented separately from our summary.

Source excerpt

openai.com

Source checked:

Source excerpt

x.com

Source checked: