JavaScript code review: which models catch the bugs
Of the 17 models ranked on JavaScript code, 4 models tied for the most known bugs: 100%. 7 of the other 13 models have 95% intervals that overlap theirs. Gemma 4 26B A4B and Gemini 3.5 Flash-Lite tied for the fewest, 0%.
| Model | Caught here | Every bug | Difference |
|---|---|---|---|
| Claude Opus 5.5 | 100% | 90% | +10 pts |
| GPT-6.1 Sol | 100% | 89% | +11 pts |
| Claude Sonnet 5.5 | 100% | 77% | +23 pts |
| GPT-5.6 Sol | 100% | 72% | +28 pts |
| Gemini 4 Argon | 67%[0%–100%] | 82% | −15 pts |
| Gemini 3.8 Flash | 67%[0%–100%] | 68% | −1 pt |
| GPT-6 Luna | 67%[0%–100%] | 67% | 0 pts |
| GLM-5.3 Flash (Workers AI) | 67%[33%–100%] | 61% | +6 pts |
| DeepSeek V4 Flash (Workers AI) | 56%[0%–100%] | 49% | +7 pts |
| Claude Haiku 5.5 | 33%[0%–100%] | 64% | −31 pts |
| Gemini 3.1 Pro | 33%[0%–100%] | 67% | −34 pts |
| GLM-5.3 (Workers AI) | 33%[0%–67%] | 61% | −28 pts |
| DeepSeek V4 Pro (Workers AI) | 17%[0%–50%] | 54% | −37 pts |
| GPT-OSS 120B (Workers AI) | 11%[0%–33%] | 40% | −29 pts |
| Kimi K2.7 Code (Workers AI) | 8%[0%–25%] | 38% | −30 pts |
| Gemma 4 26B A4B (Workers AI) | 0% | 26% | −26 pts |
| Gemini 3.5 Flash-Lite | 0% | 11% | −11 pts |
On average these models caught 50% of known bugs in JavaScript code, less often than the 60% the same 17 caught across the whole benchmark: the second-hardest of the 12 languages.
GPT-5.6 Sol gains the most here: 100%, against 72% over every bug.
DeepSeek V4 Pro (Workers AI) drops the most: 17%, against 54% over every bug.
The change “Add `weight` option” in sindresorhus/p-throttle, a change of 100 to 300 lines that landed in November 2025, introduced a logic bug that a later upstream commit fixed.
Claude Opus 5.5, GPT-6.1 Sol, Gemini 4 Argon, Claude Sonnet 5.5, GPT-5.6 Sol and Gemini 3.8 Flash caught it; GLM-5.3 Flash caught it in part; GPT-6 Luna, Claude Haiku 5.5, Gemini 3.1 Pro, GLM-5.3, DeepSeek V4 Pro (Workers AI), DeepSeek V4 Flash (Workers AI), GPT-OSS 120B (Workers AI), Kimi K2.7 Code (Workers AI), Gemma 4 26B A4B and Gemini 3.5 Flash-Lite missed it.