CodePanel

Gemma 4 26B A4B (Workers AI) vs Gemini 4 Argon

Reading a 26.2K-token pull request costs $0.0524 on Gemini 4 Argon, 20× the $0.0026 it costs on Gemma 4 26B A4B (Workers AI). Gemma 4 26B A4B (Workers AI) is a economy model and Gemini 4 Argon a mid-range one. In the benchmark Gemini 4 Argon caught 56 percentage points more of the known defects than Gemma 4 26B A4B (Workers AI) (95% interval −69 pts to −42 pts, a − b).

Side by side

Gemma 4 26B A4B (Workers AI) and Gemini 4 Argon side by side
FigureGemma 4 26B A4B (Workers AI)Gemini 4 Argon
Price tierEconomyMid-range
Bugs caughtshare of known bugs26%82% (better)
False alarmsper clean PR0.4 (better)1.1
Cost per reviewmeasured$0.0048 (better)$0.0527
Cost per bug caught$0.0209 (better)$0.0706
Exact linecatches on the expected lines91% (better)78%
Review timemean308s99s (better)
Typical review calllist price$0.0033 (better)$0.0766
Input / 1M tokens$0.10 (better)$2.00
Output / 1M tokens$0.30 (better)$10.00
Context window256K1M

Head to head

The known bugs both were scored on, by who caught each in at least one run.

Of 42 known bugs both were scored on: Both 16Only Gemma 4 26B A4B (Workers AI) 0Only Gemini 4 Argon 20Neither 6

By language

Share of known bugs each model caught, by language
ModelAllTypeScript6 bugsGo4 bugsJava4 bugsRust4 bugsC#3 bugsJavaScript3 bugsKotlin3 bugsPHP3 bugsPython3 bugsRuby3 bugsSwift3 bugsC++2 bugsC1 bug
Gemma 4 26B A4B (Workers AI)26%33%0%30%38%7%0%56%33%44%67%0%0%0%
Gemini 4 Argon82%83%50%83%75%89%67%100%100%83%100%100%100%0%

Where they differ

Of the 42 known bugs both were scored on, both caught 16 and neither caught 6. Gemini 4 Argon caught 20 bugs that Gemma 4 26B A4B (Workers AI) missed: 3 in Swift, 2 in C++, 2 in C#, 2 in Go, 2 in Java, 2 in JavaScript, 2 in PHP, 2 in TypeScript, 1 in Python, 1 in Ruby and 1 in Rust.

On pull requests with no known bug, Gemma 4 26B A4B (Workers AI) raised 0.4 false alarms per review and Gemini 4 Argon 1.1. A measured review cost $0.0048 on Gemma 4 26B A4B (Workers AI), 91% less than $0.0527 on Gemini 4 Argon.

Each known bug, and how often each model caught it
Pull requestLanguage · kindGemma 4 26B A4B (Workers AI)Gemini 4 Argon
OrchardCMS/OrchardCoreSimplify using `StringValues` in Liquid templatesC# · Security0/31/1
TanStack/queryfix(query-core): fix hydration bugs for already resolved promisesTypeScript · Logic0/21/1
aio-libs/aiohttpkeep websocket compression state across interleaved control framesPython · Logic0/31/1
better-auth/better-authfix(saml): IdP-Initiated Callback RoutingTypeScript · Security0/22/2
doctrine/ormFix collection filtering API for IN/NOT IN comparisons that require type conversionsPHP · Logic0/31/1
dotnet/orleansfix(serialization): cap codec allocationsC# · Logic0/41/1
duckdb/duckdbFix vsize = 2 issue in JSON createC++ · Concurrency0/31/1
ggml-org/llama.cpprpc : cache and reuse compute graphsC++ · Security0/31/1
go-chi/chifeat: middleware.ClientIP, a replacement for middleware.RealIPGo · Security0/31/1
groue/GRDB.swiftDatabaseQueue and DatabaseSnapshot reads can access task localsSwift · Concurrency0/21/1
jhy/jsoupStore cached child els in Attributes, not fieldJava · Concurrency0/81/2
mockito/mockitoAdd core API to enable Kotlin singleton mockingJava · API misuse0/31/1
pinojs/thread-streamrefactor: replace setTimeout with Atomics.waitAsyncJavaScript · Concurrency0/41/1
pointfreeco/swift-composable-architectureRemove child store from parent when invalidatedSwift · Resource handling0/41/1
pointfreeco/swift-navigationUIKit: Fix switch presented child double dismissSwift · Logic0/41/1
sindresorhus/p-throttleAdd `weight` optionJavaScript · Logic0/31/1
socketry/asyncBarrier wait in completion order + `Queue#close`.Ruby · Concurrency0/31/1
symfony/symfony[Security] Allow multiple OIDC discovery endpointsPHP · Security0/31/1
tokio-rs/tokiotime: move lazy-registration state into `Sleep`Rust · Logic0/21/1
traefik/traefikAdd the option to define custom cipher suites for backend serversTransportGo · API misuse0/31/1

Defects caught over all runs: a PR reviewed three times with one known bug shows 3/3 when it was caught every time.

Every bug each was scored on: Gemma 4 26B A4B (Workers AI) and Gemini 4 Argon.