Gemini 4 Argon
Claude Opus 5.5
Muse Wonder
MiMo-V2.6-Pro
Qwen3.8-Max
Kimi K3
GLM-5.3
GPT-5.5
ERNIE 5.1
DeepSeek-V4.1-Flash-20260910
Grok 4.20 Beta
amazon-nova-experimental-chat
Dola Seed 2.0 Pro
NVIDIA-Nemotron-3-Ultra-550B-A55B
Gemma 4 31B
Step 5 PreviewMuse Spark 1.2 vs Gemini 3.1 Pro Preview
- Muse Spark 1.2 and Gemini 3.1 Pro Preview are level on LMArena’s text leaderboard (1482 and 1480).
- Muse Spark 1.2 is cheaper: $1.25 / $4.25 per million input / output tokens, against $2 / $12 for Gemini 3.1 Pro Preview.
- On the 8 Vals AI benchmarks both have taken, Muse Spark 1.2 wins 5 and Gemini 3.1 Pro Preview wins 3 (Muse Spark 1.2: Terminal-Bench 4.0, SWE-bench, Vibe Code Bench).
LatestMuse Spark 1.2 1482Gemini 3.1 Pro Preview 1480
Side by side
Models (2/6)
- Muse Spark 1.2
- Gemini 3.1 Pro Preview
| Benchmark | Muse Spark 1.2 | Gemini 3.1 Pro Preview |
|---|---|---|
| The model | ||
| Lab | Meta | |
| Released | 2026-08-05 | 2026-02-19 |
| Weights | Proprietary | Proprietary |
| Context window | 1M | 1M |
| Input, per 1M tokens | $1.25 | $2 |
| Output, per 1M tokens | $4.25 | $12 |
| LMArena, people’s votes | ||
| LMArena TextMillions of people compare two anonymous models side by side and vote for the better answer | 1482#17 of 351 | 1480#19 of 351 |
| LMArena WebDevPeople ask two anonymous models to build the same web app, try both and vote for the better one | 1533#52 of 124 | 1447#78 of 124 |
| LMArena VisionSide-by-side votes on prompts that include an image | 1304#17 of 146 | 1296#22 of 146 |
| LMArena CodingLMArena’s text votes on prompts that ask for code | 1505#18 of 346 | 1484#48 of 346 |
| LMArena MathLMArena’s text votes on math prompts | 1483#31 of 339 | 1486#28 of 339 |
| LMArena Creative writingLMArena’s text votes on stories, poems and other creative writing | 1435#56 of 349 | 1482#14 of 349 |
| LMArena Hard promptsLMArena’s text votes on the hardest prompts | 1490#20 of 351 | 1485#30 of 351 |
| LMArena Instruction followingLMArena’s text votes on prompts with specific instructions to follow | 1463#39 of 351 | 1466#35 of 351 |
| Vals AI, coding | ||
| Terminal-Bench 4.0Frontier-difficulty tasks an agent completes in a real terminal | 6.06%#46 of 55 | 2.52%#49 of 55 |
| SWE-benchReal GitHub issues from open-source projects | 86.60%#14 of 85 | 78.80%#28 of 85 |
| Vibe Code BenchBuilding complete web apps from a plain-language brief, graded on whether the app works | 79.10%#27 of 115 | 32.03%#72 of 115 |
| LiveCodeBenchFresh competitive programming problems, collected after models’ training cut-offs to avoid contamination | — | 88.48%#6 of 143 |
| Vals AI, finance | ||
| Tax Agent BenchAgentic research into US corporate tax questions | 32.80%#17 of 76 | 9.29%#62 of 76 |
| Vals AI, law | ||
| Legal Research BenchAgentic US legal research | 43.75%#22 of 85 | 20.67%#62 of 85 |
| Vals AI, medicine | ||
| MedCodeAssigning the right medical billing codes from clinical notes | 49.35%#24 of 107 | 59.06%#2 of 107 |
| MedQAMedical licensing exam questions, measured on accuracy and on robustness to bias | — | 96.37%#3 of 92 |
| Vals AI, reasoning | ||
| GPQA DiamondGraduate-level questions in biology, physics and chemistry that experts answer well and search does not | — | 95.45%#1 of 138 |
| MMLU-ProHarder, reasoning-focused multiple choice across 14 subjects, from law to engineering | 88.28%#20 of 138 | 90.99%#4 of 138 |
| AIMEProblems from the American Invitational Mathematics Examination, a qualifier for the US Math Olympiad | — | 98.13%#1 of 96 |
| MMMUCollege-level questions that need both an image and text | 86.13%#22 of 93 | 88.21%#10 of 93 |
| Terminal-Bench ScienceExpert-written scientific research workflows, run by an agent in a terminal | — | 1.43%#35 of 42 |
Add models in the compare tool.
Questions
Which is better, Muse Spark 1.2 or Gemini 3.1 Pro Preview?
Muse Spark 1.2 and Gemini 3.1 Pro Preview are level on LMArena’s text leaderboard (1482 and 1480). Muse Spark 1.2 is cheaper: $1.25 / $4.25 per million input / output tokens, against $2 / $12 for Gemini 3.1 Pro Preview. On the 8 Vals AI benchmarks both have taken, Muse Spark 1.2 wins 5 and Gemini 3.1 Pro Preview wins 3 (Muse Spark 1.2: Terminal-Bench 4.0, SWE-bench, Vibe Code Bench).
Which is cheaper, Muse Spark 1.2 or Gemini 3.1 Pro Preview?
Muse Spark 1.2 is cheaper: $1.25 / $4.25 per million input / output tokens, against $2 / $12 for Gemini 3.1 Pro Preview.