CodePanel

Gemma 4 26B A4B (Workers AI) vs GPT-6 Luna

Gemma 4 26B A4B (Workers AI) and GPT-6 Luna charge practically the same to read a 26.2K-token pull request ($0.0026). Above 272K tokens long-context rates apply, and Gemma 4 26B A4B (Workers AI) becomes the cheaper one. Both sit in the economy price tier, so the choice between them is about review quality more than budget. In the benchmark GPT-6 Luna caught 41 percentage points more of the known defects than Gemma 4 26B A4B (Workers AI) (95% interval −56 pts to −26 pts, a − b).

Side by side

Gemma 4 26B A4B (Workers AI) and GPT-6 Luna side by side
FigureGemma 4 26B A4B (Workers AI)GPT-6 Luna
Price tierEconomyEconomy
Bugs caughtshare of known bugs26%67% (better)
False alarmsper clean PR0.4 (better)0.7
Cost per reviewmeasured$0.0048$0.0028 (better)
Cost per bug caught$0.0209$0.0046 (better)
Exact linecatches on the expected lines91%97% (better)
Review timemean308s29s (better)
Typical review calllist price$0.0033 (better)$0.0038
Input / 1M tokens$0.10$0.10
Output / 1M tokens$0.30 (better)$0.50
Context window256K1.1M
  • Above 272K tokens, long-context rates mean Gemma 4 26B A4B (Workers AI) is the cheaper of the two.

Head to head

The known bugs both were scored on, by who caught each in at least one run.

Of 42 known bugs both were scored on: Both 14Only Gemma 4 26B A4B (Workers AI) 2Only GPT-6 Luna 15Neither 11

By language

Share of known bugs each model caught, by language
ModelAllTypeScript6 bugsGo4 bugsJava4 bugsRust4 bugsC#3 bugsJavaScript3 bugsKotlin3 bugsPHP3 bugsPython3 bugsRuby3 bugsSwift3 bugsC++2 bugsC1 bug
Gemma 4 26B A4B (Workers AI)26%33%0%30%38%7%0%56%33%44%67%0%0%0%
GPT-6 Luna67%83%25%65%75%56%67%67%67%100%67%100%50%0%

Where they differ

Of the 42 known bugs both were scored on, both caught 14 and neither caught 11. Gemma 4 26B A4B (Workers AI) caught 2 bugs that GPT-6 Luna missed: 1 in Kotlin and 1 in TypeScript, all of them logic bugs. GPT-6 Luna caught 15 bugs that Gemma 4 26B A4B (Workers AI) missed: 3 in Swift, 3 in TypeScript, 2 in JavaScript, 1 in C++, 1 in C#, 1 in Go, 1 in Java, 1 in PHP, 1 in Python and 1 in Rust.

On pull requests with no known bug, Gemma 4 26B A4B (Workers AI) raised 0.4 false alarms per review and GPT-6 Luna 0.7. A measured review cost $0.0048 on Gemma 4 26B A4B (Workers AI), 68% more than $0.0028 on GPT-6 Luna.

Each known bug, and how often each model caught it
Pull requestLanguage · kindGemma 4 26B A4B (Workers AI)GPT-6 Luna
withastro/astroPort Go's csrf protectionTypeScript · Logic1/20/1
kotest/kotestFix DataClassEq comparatorKotlin · Logic1/30/1
OrchardCMS/OrchardCoreSimplify using `StringValues` in Liquid templatesC# · Security0/31/1
TanStack/queryfix(query-core): fix hydration bugs for already resolved promisesTypeScript · Logic0/21/1
aio-libs/aiohttpkeep websocket compression state across interleaved control framesPython · Logic0/31/1
better-auth/better-authfix(saml): IdP-Initiated Callback RoutingTypeScript · Security0/22/2
colinhacks/zodfeat(v4): parse input containing reference cyclesTypeScript · Resource handling0/21/1
doctrine/ormFix collection filtering API for IN/NOT IN comparisons that require type conversionsPHP · Logic0/31/1
duckdb/duckdbFix vsize = 2 issue in JSON createC++ · Concurrency0/31/1
go-chi/chifeat: middleware.ClientIP, a replacement for middleware.RealIPGo · Security0/31/1
groue/GRDB.swiftDatabaseQueue and DatabaseSnapshot reads can access task localsSwift · Concurrency0/21/1
mockito/mockitoAdd core API to enable Kotlin singleton mockingJava · API misuse0/31/1
nodejs/undicifeat: add configurable maxPayloadSize for WebSocketJavaScript · Security0/31/1
pinojs/thread-streamrefactor: replace setTimeout with Atomics.waitAsyncJavaScript · Concurrency0/41/1
pointfreeco/swift-composable-architectureRemove child store from parent when invalidatedSwift · Resource handling0/41/1
pointfreeco/swift-navigationUIKit: Fix switch presented child double dismissSwift · Logic0/41/1
tokio-rs/tokiotime: move lazy-registration state into `Sleep`Rust · Logic0/21/1

Defects caught over all runs: a PR reviewed three times with one known bug shows 3/3 when it was caught every time.

Every bug each was scored on: Gemma 4 26B A4B (Workers AI) and GPT-6 Luna.