ERNIE 5.1
amazon-nova-experimental-chat
Dola Seed 2.0 Pro
Gemma 4 31BVibe Code Bench leaderboard
Building complete web apps from a plain-language brief, graded on whether the app works. Claude Sonnet 5.5 leads with 92.39%.
- Models
- 110
- Leader
- Claude Sonnet 5.5
- Source
- Vals AI
- As of
- Oct 24, 2026
- 1
Claude Sonnet 5.592.4% - 2
Gemini 4 Argon91.9% - 3Claude Haiku 5.590.4%
- 4Claude Fable 590.3%
- 5Claude Opus 5.590.3%
- 6Claude Fable 5.190.3%
- 7
GPT-6 Astra89.6% - 8GPT-6.1 Sol88.9%
- 9Claude Opus 588.4%
- 10GPT-6 Sol87.8%
Open weightsProprietaryBest for the price
Full leaderboard
| Rank | Model | Lab | Accuracy | Cost / test | Harness | Price in / out |
|---|---|---|---|---|---|---|
| 1 | Claude Sonnet 5.5 | Anthropic | 92.39% | $31.25 | OpenHands | $2 / $10 |
| 2 | Gemini 4 Argon | 91.91% | $8.11 | OpenHands | $2 / $10 | |
| 3 | Claude Haiku 5.5 | Anthropic | 90.44% | $6.07 | OpenHands | $0.10 / $0.50 |
| 4 | Claude Fable 5 | Anthropic | 90.35% | $41.71 | OpenHands | $10 / $50 |
| 5 | Claude Opus 5.5 | Anthropic | 90.29% | $57.92 | OpenHands | $4 / $20 |
| 6 | Claude Fable 5.1 | Anthropic | 90.26% | $33.37 | OpenHands | $10 / $50 |
| 7 | GPT-6 Astra | OpenAI | 89.59% | $38.51 | OpenHands | $10 / $50 |
| 8 | GPT-6.1 Sol | OpenAI | 88.93% | $6.23 | OpenHands | $2 / $10 |
| 9 | Claude Opus 5 | Anthropic | 88.40% | $33.88 | OpenHands | $5 / $25 |
| 10 | GPT-6 Sol | OpenAI | 87.82% | $26.36 | OpenHands | $2 / $10 |
| 12 |  Grok 4.7 | xAI | 86.17% | $15.83 | OpenHands | $2 / $6 |
| 13 |  Muse Wonder Full | Meta | 86.00% | $2.29 | OpenHands | — |
| 14 | Muse Spark 1.3 Max | Meta | 85.86% | $2.54 | OpenHands | — |
| 15 |  MiMo-V2.6-Pro | Xiaomi | 85.22% | $1.04 | OpenHands | $0.43 / $0.87 |
| 16 |  Kimi K3 | Moonshot AI | 84.97% | $10.01 | OpenHands | $0.24 / $11 |
| 17 | Kimi K3.1 Pro | Moonshot AI | 84.89% | $7.49 | OpenHands | $2 / $10 |
| 18 |  DeepSeek-V4.1-Flash-20260910 | DeepSeek | 84.74% | $0.41 | OpenHands | $0.15 / $0.60 |
| 19 | EEmber-1 | Fireworks AI | 83.87% | $8.56 | OpenHands | $3 / $15 |
| 20 | Muse Wonder | Meta | 83.09% | $1.80 | OpenHands | $4 / $20 |
| 21 | Muse Spark 1.3 | Meta | 82.86% | $2.10 | OpenHands | $1.25 / $4.25 |
| 22 | Claude Opus 4.8 | Anthropic | 82.72% | $26.88 | OpenHands | $5 / $25 |
| 24 | GPT-6 Luna | OpenAI | 81.65% | $1.35 | OpenHands | $0.10 / $0.50 |
| 25 | Claude Sonnet 5 | Anthropic | 81.33% | $25.39 | OpenHands | $2 / $10 |
| 26 | GPT-5.6 Sol | OpenAI | 80.50% | $33.40 | OpenHands | $4 / $20 |
| 27 | Muse Spark 1.2 | Meta | 79.10% | $1.53 | OpenHands | $1.25 / $4.25 |
| 28 | MiMo-V2.6-Flash | Xiaomi | 78.96% | $0.56 | OpenHands | $0.14 / $0.28 |
| 29 | Gemini 3.8 Flash | 78.65% | $6.87 | OpenHands | $0.82 / $4.13 | |
| 30 |  Mistral Large 4 | Mistral AI | 78.40% | $39.46 | OpenHands | $1.36 / $4.18 |
| 31 |  GLM-5.3 | Z.ai | 78.13% | $12.45 | OpenHands | $0.079 / $1.40 |
| 32 |  Hy4 preview | Tencent | 77.48% | $2.18 | OpenHands | $0.75 / $2.25 |
| 34 | GPT-5.6 Luna | OpenAI | 77.06% | $0.73 | OpenHands | $0.20 / $1.20 |
| 35 | Grok 4.6 | xAI | 76.24% | $4.88 | OpenHands | $2 / $6 |
| 36 | Muse Spark Open | Meta | 76.19% | $1.66 | OpenHands | $1.25 / $4.25 |
| 37 | DeepSeek-V4-Flash | DeepSeek | 74.74% | $0.91 | OpenHands | $0.042 / $0.18 |
| 38 | GPT-5.6 Terra | OpenAI | 74.59% | $7.89 | OpenHands | $2 / $12 |
| 39 |  MiniMax-M3.1-Flash | MiniMax | 73.94% | $1.15 | OpenHands | $0.15 / $0.60 |
| 40 | Muse Spark 1.1 | Meta | 72.16% | $0.92 | OpenHands | $1.25 / $4.25 |
| 41 | Claude Opus 4.7 | Anthropic | 71.00% | $21.41 | OpenHands | $5 / $25 |
| 42 |  Step 5 Preview | StepFun | 70.40% | $5.86 | OpenHands | $1 / $2.70 |
| 43 | Gemini 3.7 Flash | 70.39% | $4.83 | OpenHands | $0.75 / $3.75 | |
| 44 | GPT-5.5 | OpenAI | 69.85% | $16.66 | OpenHands | $5 / $30 |
| 45 | Grok 4.5 | xAI | 69.00% | $4.10 | OpenHands | $2 / $6 |
| 47 | BBeam 1.0 | Reflection AI | 66.44% | N/A | OpenHands | — |
| 48 |  Qwen3.8-27B | Alibaba | 64.85% | $23.46 | OpenHands | $0.20 / $2.50 |
| 49 | Qwen3.8-Max | Alibaba | 64.70% | $8.24 | OpenHands | $2 / $6 |
| 50 | Gemini 3.6 Flash | 64.00% | $3.04 | OpenHands | $0.75 / $3.75 | |
| 51 | GLM-5.2 | Z.ai | 63.96% | $8.49 | OpenHands | $0.034 / $7 |
| 52 | GPT-5.3-Codex | OpenAI | 61.77% | $11.91 | OpenHands | $1.75 / $14 |
| 53 |  Mercury 3 | Inception | 60.93% | $0.63 | OpenHands | $0.10 / $0.35 |
| 55 | Claude Sonnet 4.6 | Anthropic | 55.77% | $7.35 | Claude Code | $3 / $15 |
| 56 | GPT-5.2 | OpenAI | 53.50% | $17.75 | OpenHands | $1.75 / $14 |
| 57 | Claude Opus 4.6 | Anthropic | 53.50% | $8.28 | OpenHands | $5 / $25 |
| 58 | DeepSeek-V4-Pro | DeepSeek | 49.93% | $2.21 | OpenHands | $0.66 / $1.98 |
| 59 | CComposer 2.5 | — | 49.61% | $0.50 | Cursor CLI | — |
| 60 | Gemini 3.5 Flash | 48.68% | $2.54 | OpenHands | $1.50 / $9 | |
| 61 | GPT-5.4 | OpenAI | 48.47% | $7.51 | Codex | $2.50 / $15 |
| 62 | GPT-5.4 mini | OpenAI | 47.97% | $1.19 | OpenHands | $0.75 / $4.50 |
| 63 | Qwen3.7-Max-Preview | Alibaba | 47.67% | $11.40 | OpenHands | $1.48 / $4.42 |
| 64 | MiniMax-M3 | MiniMax | 47.57% | $6.45 | OpenHands | $0.30 / $1.20 |
| 65 | Kimi K2.7 Code | Moonshot AI | 47.21% | $3.84 | OpenHands | $0.67 / $3.35 |
| 66 | Qwen3.7-Plus | Alibaba | 46.39% | $1.08 | OpenHands | $0.32 / $1.28 |
| 67 | MiMo-V2.5 | Xiaomi | 42.17% | $0.07 | OpenHands | $0.12 / $0.24 |
| 68 | GPT-5.2-Codex | OpenAI | 37.91% | $4.15 | OpenHands | $1.75 / $14 |
| 69 | Kimi K2.6 | Moonshot AI | 37.89% | $1.93 | OpenHands | $0.65 / $3.41 |
| 70 | Gemini 3.5 Flash-Lite | 37.16% | $0.83 | OpenHands | $0.30 / $2.50 | |
| 71 | MiMo-V2.5-Pro | Xiaomi | 34.11% | $0.17 | OpenHands | $0.30 / $0.61 |
| 72 | Gemini 3.1 Pro Preview | 32.03% | $3.83 | OpenHands | $2 / $12 | |
| 73 | GLM-5.1 | Z.ai | 31.46% | $2.89 | OpenHands | $1.40 / $4.40 |
| 74 | GLM-5.3-Flash | Z.ai | 30.76% | $2.35 | OpenHands | $0.15 / $0.50 |
| 75 | GPT-5.4 nano | OpenAI | 26.10% | $1.28 | OpenHands | $0.20 / $1.25 |
| 76 | Qwen3.6-Plus | Alibaba | 25.57% | $5.45 | OpenHands | $0.33 / $1.95 |
| 77 | GPT-5.1 | OpenAI | 24.61% | $2.57 | OpenHands | $1.25 / $10 |
| 78 | GLM-5 | Z.ai | 23.36% | $40.27 | OpenHands | $1 / $3.20 |
| 79 | Claude Sonnet 4.5 | Anthropic | 22.62% | $6.66 | OpenHands | $3 / $15 |
| 80 | GPT 5.1 Codex Max | OpenAI | 22.17% | $7.32 | OpenHands | $1.25 / $10 |
| 81 | Claude Opus 4.5 | Anthropic | 20.63% | $32.87 | OpenHands | $5 / $25 |
| 82 | Gemini 3 Flash | 20.20% | $0.94 | OpenHands | $0.50 / $3 | |
| 83 | GPT-5 | OpenAI | 20.09% | $1.53 | OpenHands | $1.25 / $10 |
| 84 | Muse Spark | Meta | 19.67% | N/A | OpenHands | — |
| 85 | Grok 4.3 | xAI | 19.40% | $1.28 | OpenHands | $1.25 / $2.50 |
| 86 | IInkling | Thinky | 19.21% | $1.61 | OpenHands | $1 / $4.05 |
| 87 | IInkling-Small | Thinky | 19.05% | $0.43 | OpenHands | $0.45 / $1.20 |
| 88 | Kimi K2.5 | Moonshot AI | 17.54% | $0.88 | OpenHands | $0.50 / $2.50 |
| 89 | Qwen 3.5 Plus | Alibaba | 15.74% | $3.80 | OpenHands | $0.30 / $1.80 |
| 90 | MiniMax-M2.5 | MiniMax | 14.85% | $2.20 | OpenHands | $0.30 / $1.20 |
| 91 | Gemini 3 Pro | 14.30% | $6.42 | OpenHands | — | |
| 92 | GPT-5 mini | OpenAI | 14.17% | $0.25 | OpenHands | $0.25 / $2 |
| 93 | Grok Build 0.1 | xAI | 13.35% | N/A | Grok Build | $1 / $2 |
| 94 | GPT-5.1-Codex | OpenAI | 13.12% | $3.80 | OpenHands | $1.25 / $10 |
| 95 | Qwen 3.6 27B | Alibaba | 11.94% | $4.66 | OpenHands | $0.25 / $2 |
| 96 | MiniMax-M2.7 | MiniMax | 11.93% | $2.82 | OpenHands | $0.30 / $1.20 |
| 97 | Claude Haiku 4.5 | Anthropic | 11.39% | $1.31 | OpenHands | $1 / $5 |
| 98 | LLaguna M.1 | Poolside | 11.04% | N/A | OpenHands | — |
| 99 |  Nemotron 3 Ultra | NVIDIA | 7.64% | N/A | OpenHands | $0.60 / $2.40 |
| 100 | SSWE-1.6 Fast | — | 7.22% | N/A | Devin CLI | — |
| 101 | LLaguna XS.2 | Poolside | 5.21% | N/A | OpenHands | — |
| 102 | DeepSeek-V3.2-Exp | DeepSeek | 5.11% | $2.47 | OpenHands | $0.28 / $0.42 |
| 103 | Grok 4.20 | xAI | 4.06% | $0.77 | OpenHands | $1.25 / $2.50 |
| 104 | Mercury 2.5 | Inception | 3.68% | $0.38 | OpenHands | $0.04 / $0.15 |
| 105 | Qwen3-Max-Preview | Alibaba | 3.51% | $6.02 | OpenHands | — |
| 106 | LLing 3.0 Flash Fin | — | 3.40% | $0.23 | OpenHands | — |
| 107 | GLM-4.6 | Z.ai | 3.09% | $10.85 | OpenHands | $0.55 / $2.20 |
| 108 | LLing 3.0 Flash | inclusionAI | 2.91% | $0.29 | OpenHands | $0.021 / $0.063 |
| 109 | Mistral Medium 3.5 | Mistral AI | 2.89% | $16.74 | OpenHands | $1.50 / $7.50 |
| 110 | Grok 4.1 Fast | xAI | 1.20% | $0.21 | OpenHands | — |
| 111 | Gemini 2.5 Pro | 0.40% | $1.22 | OpenHands | $1.25 / $10 | |
| 112 | Gemini 3.1 Flash-Lite Preview | 0.00% | $0.51 | OpenHands | $0.25 / $1.50 | |
| 113 | Nemotron 3.5 Lightning | Fireworks AI | 0.00% | $0.13 | OpenHands | $0.07 / $0.20 |
| 114 | Grok 4 Fast | xAI | 0.00% | $0.13 | OpenHands | — |
| 115 | Mistral Small 4 | Mistral AI | 0.00% | $6.47 | OpenHands | $0.15 / $0.60 |