ERNIE 5.1
amazon-nova-experimental-chat
Dola Seed 2.0 Pro
Gemma 4 31B
Step 5 PreviewLiveCodeBench leaderboard
Fresh competitive programming problems, collected after models’ training cut-offs to avoid contamination. Claude Fable 5.1 leads with 90.52%.
- Models
- 126
- Leader
- Claude Fable 5.1
- Source
- Vals AI
- As of
- Oct 24, 2026
- 1
Claude Fable 5.190.5% - 2Claude Fable 589.8%
- 3
Gemini 3.8 Flash89.5% - 4Claude Opus 589.0%
- 5Gemini 3.7 Flash88.7%
- 6Gemini 3.1 Pro Preview88.5%
- 7
Grok 4.688.2% - 8Gemini 3.6 Flash88.1%
- 9
GPT-5.2-Codex88.0% - 10
Qwen3.8-Max87.8%
Open weightsProprietaryBest for the price
Full leaderboard
| Rank | Model | Lab | Accuracy | Cost / test | Harness | Price in / out |
|---|---|---|---|---|---|---|
| 1 | Claude Fable 5.1 | Anthropic | 90.52% | $10 / $50 | — | $10 / $50 |
| 2 | Claude Fable 5 | Anthropic | 89.78% | $10 / $50 | — | $10 / $50 |
| 3 | Gemini 3.8 Flash | 89.48% | $1.5 / $7.5 | — | $0.82 / $4.13 | |
| 4 | Claude Opus 5 | Anthropic | 89.03% | $5 / $25 | — | $5 / $25 |
| 5 | Gemini 3.7 Flash | 88.65% | $1.5 / $7.5 | — | $0.75 / $3.75 | |
| 6 | Gemini 3.1 Pro Preview | 88.48% | $2 / $12 | — | $2 / $12 | |
| 7 | Grok 4.6 | xAI | 88.22% | $2 / $6 | — | $2 / $6 |
| 8 | Gemini 3.6 Flash | 88.08% | $1.5 / $7.5 | — | $0.75 / $3.75 | |
| 9 | GPT-5.2-Codex | OpenAI | 87.99% | $1.75 / $14 | — | $1.75 / $14 |
| 10 | Qwen3.8-Max | Alibaba | 87.85% | $2 / $6 | — | $2 / $6 |
| 11 | Claude Opus 4.8 | Anthropic | 87.82% | $5 / $25 | — | $5 / $25 |
| 12 | Gemini 3.5 Flash | 87.60% | $1.5 / $9 | — | $1.50 / $9 | |
| 14 |  DeepSeek-V4-Pro | DeepSeek | 87.48% | $1.32 / $3.96 | — | $0.66 / $1.98 |
| 15 | Grok 4.5 | xAI | 87.35% | $2 / $6 | — | $2 / $6 |
| 16 | GPT-5.3-Codex | OpenAI | 87.31% | $1.75 / $14 | — | $1.75 / $14 |
| 17 | DeepSeek-V4-Flash | DeepSeek | 87.26% | $0.44 / $1.32 | — | $0.042 / $0.18 |
| 18 |  Kimi K3 | Moonshot AI | 87.19% | $3 / $15 | — | $0.24 / $11 |
| 19 | Qwen3.7-Max-Preview | Alibaba | 87.06% | $2.5 / $7.5 | — | $1.48 / $4.42 |
| 20 | Kimi K2.6 | Moonshot AI | 86.77% | $0.95 / $4 | — | $0.65 / $3.41 |
| 21 | GPT-5 mini | OpenAI | 86.61% | $0.25 / $2 | — | $0.25 / $2 |
| 22 | GPT-5.1 | OpenAI | 86.49% | $1.25 / $10 | — | $1.25 / $10 |
| 23 | Gemini 3 Pro | 86.41% | $2 / $12 | — | — | |
| 24 |  Nemotron 3 Ultra | NVIDIA | 85.98% | N/A | — | $0.60 / $2.40 |
| 25 | Qwen3.6-Plus | Alibaba | 85.95% | $0.5 / $3 | — | $0.33 / $1.95 |
| 26 | IInkling-Small | Thinky | 85.93% | $0.3 / $1.2 | — | $0.45 / $1.20 |
| 27 | GPT-5.6 Terra | OpenAI | 85.93% | $2 / $12 | — | $2 / $12 |
| 28 | GPT-5 | OpenAI | 85.91% | $1.25 / $10 | — | $1.25 / $10 |
| 29 |  Muse Spark 1.1 | Meta | 85.91% | $1.25 / $4.25 | — | $1.25 / $4.25 |
| 30 | Gemini 3 Flash | 85.59% | $0.5 / $3 | — | $0.50 / $3 | |
| 31 | GPT-5.1-Codex | OpenAI | 85.55% | $1.25 / $10 | — | $1.25 / $10 |
| 32 | IInkling | Thinky | 85.52% | $1 / $4.05 | — | $1 / $4.05 |
| 33 | GPT-5.2 | OpenAI | 85.36% | $1.75 / $14 | — | $1.75 / $14 |
| 34 | Qwen 3.5 Plus | Alibaba | 85.33% | $0.4 / $2.4 | — | $0.30 / $1.80 |
| 35 | GPT-5.5 | OpenAI | 85.30% | $5 / $30 | — | $5 / $30 |
| 36 | Claude Opus 4.7 | Anthropic | 85.07% | $5 / $25 | — | $5 / $25 |
| 37 | GPT 5 Codex | OpenAI | 84.72% | $1.25 / $10 | — | — |
| 38 | Claude Opus 4.6 | Anthropic | 84.68% | $5 / $25 | — | $5 / $25 |
| 39 | Grok 4.3 | xAI | 84.49% | $1.25 / $2.5 | — | $1.25 / $2.50 |
| 40 | Grok 4.20 | xAI | 84.27% | $2 / $6 | — | $1.25 / $2.50 |
| 41 | GPT-5.4 | OpenAI | 84.14% | $2.5 / $15 | — | $2.50 / $15 |
| 42 | GPT-5.4 nano | OpenAI | 84.01% | $0.2 / $1.25 | — | $0.20 / $1.25 |
| 43 | Qwen3.8-27B | Alibaba | 84.00% | $0.5 / $3 | — | $0.20 / $2.50 |
| 44 | LLing 3.0 Flash | inclusionAI | 83.99% | $0.075 / $0.22 | — | $0.021 / $0.063 |
| 45 | o3 | OpenAI | 83.91% | $2 / $8 | — | $2 / $8 |
| 46 | Kimi K2.5 | Moonshot AI | 83.87% | $0.6 / $3 | — | $0.50 / $2.50 |
| 48 | GPT 5.1 Codex Max | OpenAI | 83.56% | $1.25 / $10 | — | $1.25 / $10 |
| 49 | Qwen3.5-Flash | Alibaba | 83.28% | $0.1 / $0.4 | — | $0.065 / $0.26 |
| 50 | Grok 4 | xAI | 83.25% | $3 / $15 | — | — |
| 51 | gpt-oss-120b | OpenAI | 83.23% | $0.15 / $0.6 | — | $0.15 / $0.60 |
| 52 | GPT-5.6 Sol | OpenAI | 82.60% | $4 / $20 | — | $4 / $20 |
| 53 | Claude Sonnet 5 | Anthropic | 82.43% | $2 / $10 | — | $2 / $10 |
| 54 |  GLM-4.7 | Z.ai | 82.23% | $0.6 / $2.2 | — | $0.54 / $1.98 |
| 55 | o4-mini | OpenAI | 82.21% | $1.1 / $4.4 | — | $1.10 / $4.40 |
| 56 |  MiniMax-M3 | MiniMax | 82.15% | $0.6 / $2.4 | — | $0.30 / $1.20 |
| 57 | Claude Sonnet 4.6 | Anthropic | 82.09% | $3 / $15 | — | $3 / $15 |
| 58 | Kimi K2.7 Code | Moonshot AI | 82.05% | $0.95 / $4 | — | $0.67 / $3.35 |
| 59 | GLM-5 | Z.ai | 81.87% | $1 / $3.2 | — | $1 / $3.20 |
| 60 | MiniMax-M2.1 Preview | MiniMax | 81.76% | $0.3 / $1.2 | — | $0.30 / $1.20 |
| 61 |  MiMo-V2.5 | Xiaomi | 81.51% | $0.14 / $0.28 | — | $0.12 / $0.24 |
| 62 | GPT-5.4 mini | OpenAI | 81.47% | $0.75 / $4.5 | — | $0.75 / $4.50 |
| 63 | GLM-5.1 | Z.ai | 81.38% | $1 / $3.2 | — | $1.40 / $4.40 |
| 64 | MiMo-V2.5-Pro | Xiaomi | 81.35% | $0.435 / $0.87 | — | $0.30 / $0.61 |
| 65 | GLM-4.6 | Z.ai | 81.04% | $0.6 / $2.2 | — | $0.55 / $2.20 |
| 67 | Grok 4.1 Fast | xAI | 80.64% | $0.2 / $0.5 | — | — |
| 68 | GLM-5.3 | Z.ai | 80.53% | $1.4 / $4.4 | — | $0.079 / $1.40 |
| 69 | GLM-5.3-Flash | Z.ai | 80.51% | $0.075 / $0.25 | — | $0.15 / $0.50 |
| 70 | gpt-oss-20b | OpenAI | 80.39% | $0.07 / $0.3 | — | $0.018 / $0.09 |
| 71 | Gemini 3.1 Flash-Lite Preview | 80.12% | $0.25 / $1.5 | — | $0.25 / $1.50 | |
| 72 | MiniMax-M2.7 | MiniMax | 79.93% | $0.3 / $1.2 | — | $0.30 / $1.20 |
| 73 | MiniMax-M2.5 | MiniMax | 79.21% | $0.3 / $1.2 | — | $0.30 / $1.20 |
| 74 | Gemini 2.5 Pro | 79.16% | $1.25 / $10 | — | $1.25 / $10 | |
| 75 | Gemini 3.5 Flash-Lite | 79.01% | $0.3 / $2.5 | — | $0.30 / $2.50 | |
| 81 | Claude Opus 4.5 | Anthropic | 75.03% | $5 / $25 | — | $5 / $25 |
| 82 |  Magistral Medium | Mistral AI | 74.86% | $2 / $5 | — | — |
| 83 | Claude Sonnet 4.5 | Anthropic | 73.00% | $3 / $15 | — | $3 / $15 |
| 85 | o3-mini | OpenAI | 71.48% | $1.1 / $4.4 | — | $1.10 / $4.40 |
| 87 | Qwen3-235B-A22B | Alibaba | 70.62% | $0.22 / $0.88 | — | $0.09 / $0.55 |
| 88 | Kimi K2 Instruct | Moonshot AI | 70.45% | $1 / $3 | — | — |
| 89 | DeepSeek-R1 | DeepSeek | 70.22% | $1.35 / $5.4 | — | $0.50 / $2.15 |
| 90 | GPT-5 nano | OpenAI | 70.22% | $0.05 / $0.4 | — | $0.05 / $0.40 |
| 92 | DeepSeek-V3.2-Exp | DeepSeek | 69.86% | $0.56 / $1.68 | — | $0.28 / $0.42 |
| 93 | GLM-5.2 | Z.ai | 69.50% | $1.4 / $4.4 | — | $0.034 / $7 |
| 94 | LLaguna M.1 | Poolside | 68.12% | N/A | — | — |
| 95 | LLaguna XS.2 | Poolside | 67.80% | N/A | — | — |
| 96 | Gemini 2.5 Flash Preview | 67.67% | $0.1 / $0.4 | — | — | |
| 97 | GLM-4.5 | Z.ai | 67.45% | $0.6 / $2.2 | — | $0.60 / $2.20 |
| 98 | Qwen3-Max-Preview | Alibaba | 66.91% | $1.2 / $6 | — | — |
| 100 | Grok 3 Mini Reasoning | xAI | 66.27% | $0.3 / $0.5 | — | — |
| 101 | DeepSeek-V3 | DeepSeek | 65.48% | $0.9 / $0.9 | — | $0.29 / $1.14 |
| 102 | Claude Opus 4.1 | Anthropic | 64.56% | $15 / $75 | — | $15 / $75 |
| 103 | Kimi K2 Thinking | Moonshot AI | 63.15% | $0.6 / $2.5 | — | $0.60 / $2.50 |
| 104 | Claude Opus 4 | Anthropic | 62.63% | $15 / $75 | — | — |
| 106 | Grok Code Fast 1 | xAI | 61.97% | $0.2 / $1.5 | — | — |
| 108 | Claude Sonnet 4 | Anthropic | 59.67% | $3 / $15 | — | — |
| 110 | GPT-4.1 mini | OpenAI | 58.16% | $0.4 / $1.6 | — | $0.40 / $1.60 |
| 112 | Claude 3.7 Sonnet | Anthropic | 56.66% | $3 / $15 | — | — |
| 114 | GPT-4.1 | OpenAI | 54.67% | $2 / $8 | — | $2 / $8 |
| 115 | Grok 3 Preview | xAI | 52.90% | $3 / $15 | — | — |
| 116 | Devstral 2 | Mistral AI | 51.84% | $0.4 / $2 | — | $0.40 / $2 |
| 117 | o1 | OpenAI | 50.26% | $15 / $60 | — | $15 / $60 |
| 118 | Claude 3.5 Sonnet | Anthropic | 49.63% | $3 / $15 | — | — |
| 119 | Llama 4 Maverick | Fireworks AI | 47.25% | $0.22 / $0.88 | — | $0.19 / $0.65 |
| 120 | Gemini 2.5 Flash Preview 4/17 | 46.87% | $0.3 / $2.5 | — | — | |
| 121 | Grok 4 Fast | xAI | 46.09% | $0.2 / $0.5 | — | — |
| 122 | Mistral Medium | Mistral AI | 44.84% | $0.4 / $2 | — | — |
| 123 | Gemini 2.0 Flash | 43.61% | $0.1 / $0.4 | — | — | |
| 124 | GPT-4o | OpenAI | 43.44% | $2.5 / $10 | — | $2.50 / $10 |
| 125 | Devstral Small 2 | Mistral AI | 43.18% | $0.1 / $0.3 | — | — |
| 126 | GPT-4.1 nano | OpenAI | 42.72% | $0.1 / $0.4 | — | $0.10 / $0.40 |
| 127 | Grok 4.1 Fast Non-Reasoning | xAI | 42.62% | $0.2 / $0.5 | — | — |
| 128 | Claude 3.5 Haiku | Anthropic | 41.92% | $0.8 / $4 | — | — |
| 129 | Gemini 1.5 Pro | 41.72% | $1.25 / $5 | — | — | |
| 130 | Claude Haiku 4.5 | Anthropic | 41.17% | $1 / $5 | — | $1 / $5 |
| 131 | Grok 2 | xAI | 38.68% | $2 / $10 | — | — |
| 132 | Llama 4 Scout | Meta | 38.54% | $0.18 / $0.59 | — | $0.10 / $0.30 |
| 133 | Mistral Large | Mistral AI | 37.09% | $2 / $6 | — | $0.50 / $1.50 |
| 134 | Gemini 1.5 Flash | 36.91% | $0.075 / $0.3 | — | — | |
| 135 | Llama 3.3 Instruct Turbo | Meta | 36.34% | $0.88 / $0.88 | — | — |
| 136 | Llama 3.3 Nemotron Super | Meta | 36.31% | N/A | — | — |
| 137 |  Command A | Cohere | 35.07% | $2.5 / $10 | — | $0.30 / $1.50 |
| 138 | Magistral Small 1.2 | Mistral AI | 31.82% | $0.075 / $0.3 | — | — |
| 139 | GPT-4o mini | OpenAI | 26.42% | $0.15 / $0.6 | — | $0.15 / $0.60 |
| 140 |  Jamba 1.6 Large | AI21 Labs | 22.32% | $2 / $8 | — | — |
| 141 | Command R+ | Cohere | 18.24% | $2.5 / $10 | — | $0.15 / $0.60 |
| 142 | Mistral Small | Mistral AI | 15.78% | $0.2 / $0.6 | — | — |
| 143 | Jamba 1.6 Mini | AI21 Labs | 9.92% | $0.2 / $0.4 | — | — |