CodePanel

DeepSeek V4 Pro (Workers AI) vs Kimi K2.7 Code (Workers AI)

Kimi K2.7 Code (Workers AI) reads a 26.2K-token pull request for $0.0249, 28% less than DeepSeek V4 Pro (Workers AI) ($0.0346). Both sit in the mid-range price tier, so the choice between them is about review quality more than budget. The benchmark cannot separate their recall: DeepSeek V4 Pro (Workers AI) minus Kimi K2.7 Code (Workers AI) is +16 pts (95% interval +8 pts to +24 pts).

Side by side

DeepSeek V4 Pro (Workers AI) and Kimi K2.7 Code (Workers AI) side by side
FigureDeepSeek V4 Pro (Workers AI)Kimi K2.7 Code (Workers AI)
Price tierMid-rangeMid-range
Bugs caughtshare of known bugs54% (better)38%
False alarmsper clean PR2.92.6 (better)
Cost per reviewmeasured$0.0643$0.0567 (better)
Cost per bug caught$0.0872$0.0805 (better)
Exact linecatches on the expected lines89% (better)79%
Review timemean390s (better)610s
Typical review calllist price$0.0442$0.0346 (better)
Input / 1M tokens$1.32$0.95 (better)
Output / 1M tokens$3.96 (better)$4.00
Context window1M262.1K

Head to head

The known bugs both were scored on, by who caught each in at least one run.

Of 42 known bugs both were scored on: Both 30Only DeepSeek V4 Pro (Workers AI) 4Only Kimi K2.7 Code (Workers AI) 3Neither 5

By language

Share of known bugs each model caught, by language
ModelAllTypeScript6 bugsGo4 bugsJava4 bugsRust4 bugsC#3 bugsJavaScript3 bugsKotlin3 bugsPHP3 bugsPython3 bugsRuby3 bugsSwift3 bugsC++2 bugsC1 bug
DeepSeek V4 Pro (Workers AI)54%79%25%49%54%59%17%30%69%72%67%75%38%33%
Kimi K2.7 Code (Workers AI)38%75%26%31%46%19%8%14%42%62%33%46%6%40%

Where they differ

Of the 42 known bugs both were scored on, both caught 30 and neither caught 5. DeepSeek V4 Pro (Workers AI) caught 4 bugs that Kimi K2.7 Code (Workers AI) missed: 2 in Ruby, 1 in C++ and 1 in Java. Kimi K2.7 Code (Workers AI) caught 3 bugs that DeepSeek V4 Pro (Workers AI) missed: 2 in Go and 1 in TypeScript.

On pull requests with no known bug, DeepSeek V4 Pro (Workers AI) raised 2.9 false alarms per review and Kimi K2.7 Code (Workers AI) 2.6. A measured review cost $0.0643 on DeepSeek V4 Pro (Workers AI), 13% more than $0.0567 on Kimi K2.7 Code (Workers AI).

Each known bug, and how often each model caught it
Pull requestLanguage · kindDeepSeek V4 Pro (Workers AI)Kimi K2.7 Code (Workers AI)
jhy/jsoupStore cached child els in Attributes, not fieldJava · Concurrency3/60/16
rails/railsReimplement Action Cable redis adapter with redis-clientRuby · Logic2/40/5
socketry/asyncBarrier wait in completion order + `Queue#close`.Ruby · Concurrency2/40/5
ggml-org/llama.cpprpc : cache and reuse compute graphsC++ · Security1/40/5
colinhacks/zodfeat(v4): parse input containing reference cyclesTypeScript · Resource handling0/41/3
go-gitea/giteaperf(gitdiff): optimize inline diff highlighting using cacheGo · Error handling0/31/4
golang/gocrypto/tls: add LocalCertificate to ConnectionStateGo · Logic0/42/4

Defects caught over all runs: a PR reviewed three times with one known bug shows 3/3 when it was caught every time.

Every bug each was scored on: DeepSeek V4 Pro (Workers AI) and Kimi K2.7 Code (Workers AI).