Gemini 4 Argon
Claude Opus 5.5
Muse Wonder
MiMo-V2.6-Pro
Qwen3.8-Max
Kimi K3
GLM-5.3
GPT-5.5
ERNIE 5.1
DeepSeek-V4.1-Flash-20260910
Grok 4.20 Beta
amazon-nova-experimental-chat
Dola Seed 2.0 Pro
NVIDIA-Nemotron-3-Ultra-550B-A55B
Gemma 4 31B
Step 5 PreviewGemini 3 Pro vs Kimi K3
- Gemini 3 Pro and Kimi K3 are level on LMArena’s text leaderboard (1480 and 1475).
- On the 7 Vals AI benchmarks both have taken, Gemini 3 Pro wins 2 and Kimi K3 wins 5 (Gemini 3 Pro: MedCode, MMLU-Pro).
LatestGemini 3 Pro 1480Kimi K3 1475
Side by side
Models (2/6)
- Gemini 3 Pro
- Kimi K3
| Benchmark | Gemini 3 Pro | Kimi K3 |
|---|---|---|
| The model | ||
| Lab | Moonshot AI | |
| Released | — | 2026-07-16 |
| Weights | Proprietary | Open |
| Context window | — | 1M |
| Input, per 1M tokens | — | $0.24 |
| Output, per 1M tokens | — | $10.80 |
| LMArena, people’s votes | ||
| LMArena TextMillions of people compare two anonymous models side by side and vote for the better answer | 1480#21 of 351 | 1475#25 of 351 |
| LMArena WebDevPeople ask two anonymous models to build the same web app, try both and vote for the better one | 1440#80 of 124 | 1655#17 of 124 |
| LMArena VisionSide-by-side votes on prompts that include an image | 1305#16 of 146 | — |
| LMArena CodingLMArena’s text votes on prompts that ask for code | 1481#55 of 346 | 1508#16 of 346 |
| LMArena MathLMArena’s text votes on math prompts | 1476#38 of 339 | 1493#20 of 339 |
| LMArena Creative writingLMArena’s text votes on stories, poems and other creative writing | 1483#13 of 349 | 1456#28 of 349 |
| LMArena Hard promptsLMArena’s text votes on the hardest prompts | 1480#39 of 351 | 1495#17 of 351 |
| LMArena Instruction followingLMArena’s text votes on prompts with specific instructions to follow | 1458#43 of 351 | 1485#16 of 351 |
| Vals AI, overall | ||
| Vals IndexVals AI’s headline score | — | 52.95%#20 of 27 |
| Vals AI, coding | ||
| Terminal-Bench 4.0Frontier-difficulty tasks an agent completes in a real terminal | — | 17.17%#34 of 55 |
| SWE-benchReal GitHub issues from open-source projects | 76.40%#37 of 85 | 93.40%#8 of 85 |
| Vibe Code BenchBuilding complete web apps from a plain-language brief, graded on whether the app works | 14.30%#91 of 115 | 84.97%#16 of 115 |
| Code MigrationRewriting working programs in a new language, graded on whether the new program still passes its tests | — | 28.59%#23 of 28 |
| LiveCodeBenchFresh competitive programming problems, collected after models’ training cut-offs to avoid contamination | 86.41%#23 of 143 | 87.19%#18 of 143 |
| Vals AI, finance | ||
| Finance AgentThe core tasks of a financial analyst, done as an agent with research tools | — | 60.01%#21 of 31 |
| Finance IndexVals AI’s composite of finance tasks | — | 57.95%#11 of 31 |
| Tax Agent BenchAgentic research into US corporate tax questions | — | 33.37%#15 of 76 |
| Vals AI, law | ||
| Legal IndexVals AI’s composite of legal tasks | — | 71.72%#10 of 28 |
| Legal Research BenchAgentic US legal research | — | 46.15%#16 of 85 |
| Vals AI, medicine | ||
| MedCodeAssigning the right medical billing codes from clinical notes | 52.20%#14 of 107 | 49.36%#23 of 107 |
| MedQAMedical licensing exam questions, measured on accuracy and on robustness to bias | 96.03%#8 of 92 | — |
| Vals AI, reasoning | ||
| GPQA DiamondGraduate-level questions in biology, physics and chemistry that experts answer well and search does not | 91.67%#19 of 138 | 92.93%#12 of 138 |
| MMLU-ProHarder, reasoning-focused multiple choice across 14 subjects, from law to engineering | 90.10%#7 of 138 | 87.97%#22 of 138 |
| AIMEProblems from the American Invitational Mathematics Examination, a qualifier for the US Math Olympiad | 96.68%#4 of 96 | — |
| MMMUCollege-level questions that need both an image and text | 87.51%#14 of 93 | 88.15%#11 of 93 |
| Terminal-Bench ScienceExpert-written scientific research workflows, run by an agent in a terminal | — | 1.43%#38 of 42 |
Add models in the compare tool.
Questions
Which is better, Gemini 3 Pro or Kimi K3?
Gemini 3 Pro and Kimi K3 are level on LMArena’s text leaderboard (1480 and 1475). On the 7 Vals AI benchmarks both have taken, Gemini 3 Pro wins 2 and Kimi K3 wins 5 (Gemini 3 Pro: MedCode, MMLU-Pro).