CodePanel

Gemini 3.8 Flash vs Kimi K2.7 Code (Workers AI)

Gemini 3.8 Flash reads a 26.2K-token pull request for $0.0197, 21% less than Kimi K2.7 Code (Workers AI) ($0.0249). From 2027-01-01, after a scheduled reprice, Kimi K2.7 Code (Workers AI) becomes the cheaper one. Both sit in the mid-range price tier, so the choice between them is about review quality more than budget. In the benchmark Gemini 3.8 Flash caught 30 percentage points more of the known defects than Kimi K2.7 Code (Workers AI) (95% interval +16 pts to +44 pts, a − b).

Side by side

Gemini 3.8 Flash and Kimi K2.7 Code (Workers AI) side by side
FigureGemini 3.8 FlashKimi K2.7 Code (Workers AI)
Price tierMid-rangeMid-range
Bugs caughtshare of known bugs68% (better)38%
False alarmsper clean PR1.0 (better)2.6
Cost per reviewmeasured$0.0862$0.0567 (better)
Cost per bug caught$0.1166$0.0805 (better)
Exact linecatches on the expected lines94% (better)79%
Review timemean427s (better)610s
Typical review calllist price$0.0287 (better)$0.0346
Input / 1M tokens$0.75 (better)$0.95
Output / 1M tokens$3.75 (better)$4.00
Context window1M262.1K
  • From 2027-01-01, after a scheduled reprice, Kimi K2.7 Code (Workers AI) is the cheaper of the two.

Head to head

The known bugs both were scored on, by who caught each in at least one run.

Of 42 known bugs both were scored on: Both 24Only Gemini 3.8 Flash 7Only Kimi K2.7 Code (Workers AI) 9Neither 2

By language

Share of known bugs each model caught, by language
ModelAllTypeScript6 bugsGo4 bugsJava4 bugsRust4 bugsC#3 bugsJavaScript3 bugsKotlin3 bugsPHP3 bugsPython3 bugsRuby3 bugsSwift3 bugsC++2 bugsC1 bug
Gemini 3.8 Flash68%83%75%43%75%78%67%0%50%83%100%100%50%50%
Kimi K2.7 Code (Workers AI)38%75%26%31%46%19%8%14%42%62%33%46%6%40%

Where they differ

Of the 42 known bugs both were scored on, both caught 24 and neither caught 2. Gemini 3.8 Flash caught 7 bugs that Kimi K2.7 Code (Workers AI) missed: 2 in JavaScript, 2 in Ruby, 1 in C#, 1 in Go and 1 in Rust. Kimi K2.7 Code (Workers AI) caught 9 bugs that Gemini 3.8 Flash missed: 3 in Kotlin, 1 in Go, 1 in Java, 1 in JavaScript, 1 in PHP, 1 in Rust and 1 in TypeScript.

On pull requests with no known bug, Gemini 3.8 Flash raised 1 false alarms per review and Kimi K2.7 Code (Workers AI) 2.6. A measured review cost $0.0862 on Gemini 3.8 Flash, 52% more than $0.0567 on Kimi K2.7 Code (Workers AI).

Each known bug, and how often each model caught it
Pull requestLanguage · kindGemini 3.8 FlashKimi K2.7 Code (Workers AI)
denoland/denoperf(libs/core): poll only ready handles and yield between I/O batchesRust · Concurrency1/10/5
dotnet/orleansfix(serialization): cap codec allocationsC# · Logic1/10/7
go-chi/chifeat: middleware.ClientIP, a replacement for middleware.RealIPGo · Security1/10/8
pinojs/thread-streamrefactor: replace setTimeout with Atomics.waitAsyncJavaScript · Concurrency2/20/8
rails/railsReimplement Action Cable redis adapter with redis-clientRuby · Logic1/10/5
sindresorhus/p-throttleAdd `weight` optionJavaScript · Logic1/10/8
socketry/asyncBarrier wait in completion order + `Queue#close`.Ruby · Concurrency1/10/5
colinhacks/zodfeat(v4): parse input containing reference cyclesTypeScript · Resource handling0/11/3
go-gitea/giteaperf(gitdiff): optimize inline diff highlighting using cacheGo · Error handling0/11/4
kotest/kotestFix DataClassEq comparatorKotlin · Logic0/11/7
kotest/kotestRefactor eventually to ensure wall-clock time usageKotlin · Error handling0/11/8
ktorio/ktorKTOR-9171 Redesign ByteReadChannel.readUTF8Line APIKotlin · Logic0/11/7
mockito/mockitoAdd core API to enable Kotlin singleton mockingJava · API misuse0/11/8
nodejs/undicifeat: add configurable maxPayloadSize for WebSocketJavaScript · Security0/11/4
nushell/nushellreorganize nushell configurationRust · Error handling0/12/3
symfony/symfony[Security] Allow multiple OIDC discovery endpointsPHP · Security0/11/4

Defects caught over all runs: a PR reviewed three times with one known bug shows 3/3 when it was caught every time.

Every bug each was scored on: Gemini 3.8 Flash and Kimi K2.7 Code (Workers AI).