ERNIE 5.1
amazon-nova-experimental-chat
Dola Seed 2.0 Pro
Gemma 4 31B
Step 5 PreviewMedCode leaderboard
Assigning the right medical billing codes from clinical notes. Claude Opus 5 leads with 63.57%.
- Models
- 97
- Leader
- Claude Opus 5
- Source
- Vals AI
- As of
- Oct 24, 2026
- 1
Claude Opus 563.6% - 2
Gemini 3.1 Pro Preview59.1% - 3Gemini 4 Argon58.8%
- 4Claude Fable 556.1%
- 5Gemini 3 Flash55.9%
- 6Gemini 3.5 Flash55.8%
- 7Claude Opus 4.754.9%
- 8Claude Fable 5.153.5%
- 9Gemini 3.7 Flash53.4%
- 10Claude Opus 4.853.2%
Open weightsProprietaryBest for the price
Full leaderboard
| Rank | Model | Lab | Accuracy | Cost / test | Harness | Price in / out |
|---|---|---|---|---|---|---|
| 1 | Claude Opus 5 | Anthropic | 63.57% | $5 / $25 | — | $5 / $25 |
| 2 | Gemini 3.1 Pro Preview | 59.06% | $2 / $12 | — | $2 / $12 | |
| 3 | Gemini 4 Argon | 58.80% | $4 / $20 | — | $2 / $10 | |
| 4 | Claude Fable 5 | Anthropic | 56.07% | $10 / $50 | — | $10 / $50 |
| 5 | Gemini 3 Flash | 55.92% | $0.5 / $3 | — | $0.50 / $3 | |
| 6 | Gemini 3.5 Flash | 55.83% | $1.5 / $9 | — | $1.50 / $9 | |
| 7 | Claude Opus 4.7 | Anthropic | 54.86% | $5 / $25 | — | $5 / $25 |
| 8 | Claude Fable 5.1 | Anthropic | 53.51% | $10 / $50 | — | $10 / $50 |
| 9 | Gemini 3.7 Flash | 53.39% | $1.5 / $7.5 | — | $0.75 / $3.75 | |
| 10 | Claude Opus 4.8 | Anthropic | 53.22% | $5 / $25 | — | $5 / $25 |
| 11 | Gemini 3.6 Flash | 53.15% | $1.5 / $7.5 | — | $0.75 / $3.75 | |
| 12 | Claude Sonnet 5.5 | Anthropic | 52.92% | $2 / $10 | — | $2 / $10 |
| 13 |  GPT-5.1 | OpenAI | 52.73% | $1.25 / $10 | — | $1.25 / $10 |
| 14 | Gemini 3 Pro | 52.20% | $2 / $12 | — | — | |
| 15 | Claude Haiku 5.5 | Anthropic | 51.54% | $0.1 / $0.5 | — | $0.10 / $0.50 |
| 16 |  Muse Spark | Meta | 51.31% | N/A | — | — |
| 17 | Gemini 2.5 Pro | 50.59% | $1.25 / $10 | — | $1.25 / $10 | |
| 18 | Muse Wonder Full | Meta | 49.93% | $4 / $20 | — | — |
| 19 | Claude Opus 5.5 | Anthropic | 49.80% | $4 / $20 | — | $4 / $20 |
| 20 | GPT-5.2 | OpenAI | 49.75% | $1.75 / $14 | — | $1.75 / $14 |
| 21 | GPT-5 | OpenAI | 49.63% | $1.25 / $10 | — | $1.25 / $10 |
| 22 |  Grok 4.7 | xAI | 49.55% | $2 / $6 | — | $2 / $6 |
| 23 |  Kimi K3 | Moonshot AI | 49.36% | $3 / $15 | — | $0.24 / $11 |
| 24 | Muse Spark 1.2 | Meta | 49.35% | $1.25 / $4.25 | — | $1.25 / $4.25 |
| 27 | GPT-5.5 | OpenAI | 49.10% | $5 / $30 | — | $5 / $30 |
| 28 | GPT-6.1 Sol | OpenAI | 48.84% | $2 / $10 | — | $2 / $10 |
| 29 | GPT-6 Astra | OpenAI | 48.49% | $10 / $50 | — | $10 / $50 |
| 30 | Claude Opus 4.6 | Anthropic | 48.24% | $5 / $25 | — | $5 / $25 |
| 31 | Gemini 3.8 Flash | 48.13% | $1.5 / $7.5 | — | $0.82 / $4.13 | |
| 32 | Gemini 3.1 Flash-Lite Preview | 47.60% | $0.25 / $1.5 | — | $0.25 / $1.50 | |
| 33 | Claude Sonnet 5 | Anthropic | 47.54% | $2 / $10 | — | $2 / $10 |
| 34 | o3 | OpenAI | 47.29% | $2 / $8 | — | $2 / $8 |
| 36 | GPT-6 Sol | OpenAI | 47.07% | $2 / $10 | — | $2 / $10 |
| 37 |  MiniMax-M3 | MiniMax | 46.29% | $0.6 / $2.4 | — | $0.30 / $1.20 |
| 38 | Claude Opus 4.5 | Anthropic | 45.17% | $5 / $25 | — | $5 / $25 |
| 39 |  MiMo-V2.6-Pro | Xiaomi | 44.97% | $0.435 / $0.87 | — | $0.43 / $0.87 |
| 40 | Grok 4.6 | xAI | 44.71% | $2 / $6 | — | $2 / $6 |
| 41 | GPT-6 Luna | OpenAI | 44.69% | $0.1 / $0.5 | — | $0.10 / $0.50 |
| 43 | GPT-5.6 Sol | OpenAI | 43.97% | $4 / $20 | — | $4 / $20 |
| 44 | Gemini 3.5 Flash-Lite | 43.49% | $0.3 / $2.5 | — | $0.30 / $2.50 | |
| 45 | GPT-5.6 Terra | OpenAI | 43.41% | $2 / $12 | — | $2 / $12 |
| 46 | Grok 4.5 | xAI | 43.29% | $2 / $6 | — | $2 / $6 |
| 47 |  Hy4 preview | Tencent | 43.25% | $0.834 / $2.501 | — | $0.75 / $2.25 |
| 48 | GPT-5 mini | OpenAI | 43.05% | $0.25 / $2 | — | $0.25 / $2 |
| 49 |  GLM-5.3 | Z.ai | 42.86% | $1.4 / $4.4 | — | $0.079 / $1.40 |
| 51 | GPT-5.6 Luna | OpenAI | 42.39% | $0.2 / $1.2 | — | $0.20 / $1.20 |
| 52 | GLM-5.1 | Z.ai | 41.60% | $1 / $3.2 | — | $1.40 / $4.40 |
| 53 |  DeepSeek-V4-Flash | DeepSeek | 41.41% | $0.44 / $1.32 | — | $0.042 / $0.18 |
| 54 | Claude Opus 4.1 | Anthropic | 41.37% | $15 / $75 | — | $15 / $75 |
| 55 | GPT-5.4 | OpenAI | 41.29% | $2.5 / $15 | — | $2.50 / $15 |
| 56 | IInkling | Thinky | 41.19% | $1 / $4.05 | — | $1 / $4.05 |
| 57 | DeepSeek-V4.1-Flash-20260910 | DeepSeek | 41.17% | $0.3 / $1.2 | — | $0.15 / $0.60 |
| 58 | MiMo-V2.6-Flash | Xiaomi | 41.06% | $0.14 / $0.28 | — | $0.14 / $0.28 |
| 59 | GPT-5.4 nano | OpenAI | 41.03% | $0.2 / $1.25 | — | $0.20 / $1.25 |
| 60 | GLM-5.2 | Z.ai | 40.77% | $1.4 / $4.4 | — | $0.034 / $7 |
| 61 |  Mistral Large 4 | Mistral AI | 40.69% | $1.36 / $4.18 | — | $1.36 / $4.18 |
| 62 |  Qwen3.8-Max | Alibaba | 40.67% | $2 / $6 | — | $2 / $6 |
| 63 | Claude Sonnet 4.5 | Anthropic | 40.57% | $3 / $15 | — | $3 / $15 |
| 65 | DeepSeek-V4-Pro | DeepSeek | 40.45% | $1.32 / $3.96 | — | $0.66 / $1.98 |
| 66 | Gemini 2.5 Flash Preview 4/17 | 40.36% | $0.3 / $2.5 | — | — | |
| 68 | Kimi K2.6 | Moonshot AI | 40.14% | $0.95 / $4 | — | $0.65 / $3.41 |
| 69 | Kimi K2.5 | Moonshot AI | 39.32% | $0.6 / $3 | — | $0.50 / $2.50 |
| 70 | Qwen3.7-Max-Preview | Alibaba | 38.75% | $2.5 / $7.5 | — | $1.48 / $4.42 |
| 71 |  Nemotron 3 Ultra | NVIDIA | 38.62% | N/A | — | $0.60 / $2.40 |
| 72 | Gemini 2.5 Flash | 38.42% | $0.3 / $2.5 | — | $0.30 / $2.50 | |
| 73 | Grok 4 | xAI | 38.08% | $3 / $15 | — | — |
| 74 | Grok 4.3 | xAI | 38.07% | $1.25 / $2.5 | — | $1.25 / $2.50 |
| 75 | IInkling-Small | Thinky | 37.89% | $0.3 / $1.2 | — | $0.45 / $1.20 |
| 77 | Qwen3.6-Plus | Alibaba | 36.89% | $0.5 / $3 | — | $0.33 / $1.95 |
| 78 | Llama 4 Maverick | Fireworks AI | 36.51% | $0.22 / $0.88 | — | $0.19 / $0.65 |
| 80 | MiniMax-M2.7 | MiniMax | 34.44% | $0.3 / $1.2 | — | $0.30 / $1.20 |
| 82 | MiniMax-M2.1 Preview | MiniMax | 34.08% | $0.3 / $1.2 | — | $0.30 / $1.20 |
| 83 | Claude Sonnet 4 | Anthropic | 33.94% | $3 / $15 | — | — |
| 84 | o4-mini | OpenAI | 33.79% | $1.1 / $4.4 | — | $1.10 / $4.40 |
| 85 | Mistral Medium 3.5 | Mistral AI | 33.75% | $1.5 / $7.5 | — | $1.50 / $7.50 |
| 86 | Qwen3.5-Flash | Alibaba | 33.00% | $0.1 / $0.4 | — | $0.065 / $0.26 |
| 87 | GLM-4.7 | Z.ai | 32.77% | $0.6 / $2.2 | — | $0.54 / $1.98 |
| 88 | Claude Haiku 4.5 | Anthropic | 32.68% | $1 / $5 | — | $1 / $5 |
| 89 | MiMo-V2.5-Pro | Xiaomi | 32.48% | $0.435 / $0.87 | — | $0.30 / $0.61 |
| 90 | LLing 3.0 Flash | inclusionAI | 32.27% | $0.075 / $0.22 | — | $0.021 / $0.063 |
| 91 | Grok 4.20 | xAI | 32.16% | $2 / $6 | — | $1.25 / $2.50 |
| 92 | MiMo-V2.5 | Xiaomi | 31.89% | $0.14 / $0.28 | — | $0.12 / $0.24 |
| 93 | Qwen 3 VL Plus | Alibaba | 31.65% | $0.2 / $1.6 | — | — |
| 94 | Qwen3-Max-Preview | Alibaba | 31.37% | $1.2 / $6 | — | — |
| 95 |  Mercury 2.5 | Inception | 31.33% | $0.2 / $0.75 | — | $0.04 / $0.15 |
| 96 | GPT-5 nano | OpenAI | 30.44% | $0.05 / $0.4 | — | $0.05 / $0.40 |
| 97 | Grok 4 Fast | xAI | 30.04% | $0.2 / $0.5 | — | — |
| 98 | LLing 3.0 Flash Fin | — | 29.30% | $0.06 / $0.18 | — | — |
| 99 | Qwen3.8-27B | Alibaba | 28.70% | $0.5 / $3 | — | $0.20 / $2.50 |
| 100 | Grok 4.1 Fast Non-Reasoning | xAI | 28.35% | $0.2 / $0.5 | — | — |
| 101 | Grok 4.1 Fast | xAI | 28.08% | $0.2 / $0.5 | — | — |
| 102 | Gemini 2.5 Flash-Lite Preview | 27.11% | $0.1 / $0.4 | — | $0.10 / $0.40 | |
| 103 | Gemini 2.5 Flash Preview | 27.08% | $0.1 / $0.4 | — | — | |
| 104 | Llama 4 Scout | Meta | 23.31% | $0.18 / $0.59 | — | $0.10 / $0.30 |
| 105 | LLaguna M.1 | Poolside | 23.11% | N/A | — | — |
| 106 | LLaguna XS.2 | Poolside | 21.25% | N/A | — | — |
| 107 |  Command A | Cohere | 19.72% | N/A | — | $0.30 / $1.50 |