80.05Overall
Model benchmark rankings
Compare capability scores, evaluation time, and reference cost across models and reasoning efforts.
Evaluated on private datasetsWhy we test this way
Data snapshot · 10/27/2026
79.60Overall
73.60Overall
About the scores
Service logic, error handling, and test verification. By default, each model shows its highest-scoring tested effort for the selected dimension.
Evaluation time and reference cost correspond to the selected dimension. They reflect benchmark runs, not everyday single-request latency or billing.
Explore evaluation tasksEvaluation methodScroll horizontally to view all scores and costs →
| Rank | Model | Eval. time | Speed tok/s | Actions | |||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| 01 |  gpt-6-astra Backend engineering97Frontend interaction94Knowledge & Reasoning95Visual aesthetics73Maintainability61 | 88.50 | 97 | 94 | 95 | 73 | 61 | 45m 41s | $4.80 | … | |
| 02 | gpt-6.1-sol Backend engineering95Frontend interaction96Knowledge & Reasoning90Visual aesthetics66Maintainability70 | 86.60 | 95 | 96 | 90 | 66 | 70 | 32m 36s | $1.06 | … | |
| 03 | gpt-6.1-terra Backend engineering89Frontend interaction84Knowledge & Reasoning85Visual aesthetics64Maintainability61 | 80.05 | 89 | 84 | 85 | 64 | 61 | 7m 56s | $0.38 | … | |
| 04 |  grok-4.7 Backend engineering87Frontend interaction80Knowledge & Reasoning85Visual aesthetics66Maintainability55 | 78.55 | 87 | 80 | 85 | 66 | 55 | 77m 29s | $2.00 | … | |
| 05 |  claude-sonnet-5-5 Backend engineering86Frontend interaction89Knowledge & Reasoning85Visual aesthetics73Maintainability66 | 82.30 | 86 | 89 | 85 | 73 | 66 | 15m 3s | $1.50 | … | |
| 06 | claude-fable-5-1 Backend engineering85Frontend interaction91Knowledge & Reasoning95Visual aesthetics80Maintainability68 | 87.25 | 85 | 91 | 95 | 80 | 68 | 43m 45s | $12.77 | … | |
| 06 | dot Backend engineering85Frontend interaction87Knowledge & Reasoning85Visual aesthetics70Maintainability73 | 81.95 | 85 | 87 | 85 | 70 | 73 | 3m 6s | N/A | … | |
| 06 | gpt-5.6-sol Backend engineering85Frontend interaction73Knowledge & Reasoning75Visual aesthetics66Maintainability64 | 74.15 | 85 | 73 | 75 | 66 | 64 | 29m 19s | $1.71 | … | |
| 09 | claude-opus-5-5 Backend engineering84Frontend interaction97Knowledge & Reasoning100Visual aesthetics73Maintainability70 | 89.15 | 84 | 97 | 100 | 73 | 70 | 9m 29s | $1.05 | … | |
| 09 |  k3.1-pro Backend engineering84Frontend interaction91Knowledge & Reasoning80Visual aesthetics68Maintainability64 | 79.60 | 84 | 91 | 80 | 68 | 64 | 42m 34s | $1.87 | 84 | |
| 11 |  Gemini 4 Argon Backend engineering82Frontend interaction84Knowledge & Reasoning85Visual aesthetics70Maintainability59 | 79.35 | 82 | 84 | 85 | 70 | 59 | 14m 48s | N/A | … | |
| 11 |  muse-wonder Backend engineering82Frontend interaction84Knowledge & Reasoning90Visual aesthetics73Maintainability59 | 81.55 | 82 | 84 | 90 | 73 | 59 | 14m 35s | $2.53 | … | |
| 13 | gpt-5.6-terra Backend engineering81Frontend interaction76Knowledge & Reasoning55Visual aesthetics61Maintainability61 | 65.90 | 81 | 76 | 55 | 61 | 61 | 75m 45s | $0.70 | … | |
| 14 | gpt-6-sol Backend engineering80Frontend interaction94Knowledge & Reasoning75Visual aesthetics75Maintainability66 | 78.90 | 80 | 94 | 75 | 75 | 66 | 15m 13s | $0.46 | … | |
| 15 | grok-4.6 Backend engineering78Frontend interaction80Knowledge & Reasoning85Visual aesthetics64Maintainability59 | 76.85 | 78 | 80 | 85 | 64 | 59 | 43m 8s | $0.71 | … | |
| 16 |  MiniMax-M3.1-Flash-Preview Backend engineering75Frontend interaction57Knowledge & Reasoning75Visual aesthetics70Maintainability53 | 68.45 | 75 | 57 | 75 | 70 | 53 | 18m 35s | N/A | … | |
| 17 | claude-opus-5 Backend engineering74Frontend interaction87Knowledge & Reasoning85Visual aesthetics66Maintainability59 | 77.75 | 74 | 87 | 85 | 66 | 59 | 18m 42s | $2.01 | … | |
| 17 |  hy4-preview Backend engineering74Frontend interaction73Knowledge & Reasoning65Visual aesthetics59Maintainability57 | 66.70 | 74 | 73 | 65 | 59 | 57 | 67m 39s | $0.40 | … | |
| 19 | MiniMax-M3.1-Flash Backend engineering73Frontend interaction75Knowledge & Reasoning80Visual aesthetics66Maintainability61 | 73.60 | 73 | 75 | 80 | 66 | 61 | 30m 52s | $0.11 | … | |
| 19 | muse-spark-1.3 Backend engineering73Frontend interaction91Knowledge & Reasoning75Visual aesthetics59Maintainability47 | 72.60 | 73 | 91 | 75 | 59 | 47 | 6m 23s | $0.024 | … | |
| 21 |  deepseek-v4.1-flash-1017 Backend engineering72Frontend interaction96Knowledge & Reasoning75Visual aesthetics61Maintainability53 | 74.30 | 72 | 96 | 75 | 61 | 53 | 15m 16s | $0.12 | … | |
| 22 |  glm-5.3 Backend engineering70Frontend interaction78Knowledge & Reasoning70Visual aesthetics66Maintainability64 | 70.40 | 70 | 78 | 70 | 66 | 64 | 17m 14s | $0.44 | … | |
| 22 | k3 Backend engineering70Frontend interaction85Knowledge & Reasoning70Visual aesthetics68Maintainability59 | 71.60 | 70 | 85 | 70 | 68 | 59 | 37m 56s | $0.89 | … | |
| 22 |  mimo-v2.6-pro Backend engineering70Frontend interaction85Knowledge & Reasoning65Visual aesthetics64Maintainability59 | 69.25 | 70 | 85 | 65 | 64 | 59 | 80m 5s | $0.18 | … | |
| 25 | claude-haiku-5-5 Backend engineering69Frontend interaction78Knowledge & Reasoning60Visual aesthetics59Maintainability64 | 65.65 | 69 | 78 | 60 | 59 | 64 | 8m 11s | $0.077 | … | |
| 26 |  doubao-seed-2-1-pro Backend engineering68Frontend interaction68Knowledge & Reasoning55Visual aesthetics68Maintainability49 | 61.55 | 68 | 68 | 55 | 68 | 49 | 19m 43s | $0.45 | … | |
| 26 |  Qwen 3.8 Flash Backend engineering68Frontend interaction87Knowledge & Reasoning50Visual aesthetics73Maintainability57 | 65.15 | 68 | 87 | 50 | 73 | 57 | 55m 14s | $0.12 | … | |
| 28 | deepseek-v4-flash-vision-exp Backend engineering67Frontend interaction15Knowledge & Reasoning65Visual aesthetics—Maintainability— | — | 67 | 15 | 65 | — | — | 14m 12s | $0.11 | … | |
| 28 | deepseek-v4-pro Backend engineering67Frontend interaction63Knowledge & Reasoning65Visual aesthetics70Maintainability59 | 65.15 | 67 | 63 | 65 | 70 | 59 | 26m 53s | $0.44 | … | |
| 30 | gpt-5.6-luna Backend engineering65Frontend interaction78Knowledge & Reasoning25Visual aesthetics59Maintainability61 | 52.30 | 65 | 78 | 25 | 59 | 61 | 48m 26s | $0.17 | … | |
| 30 | grok-bot Backend engineering65Frontend interaction70Knowledge & Reasoning95Visual aesthetics68Maintainability59 | 76.35 | 65 | 70 | 95 | 68 | 59 | 13m 12s | N/A | … | |
grok-bot · Test resultsTime and reference cost correspond to Backend engineering tasks. Tested effortOverallBackend engineeringFrontend interactionKnowledge & ReasoningVisual aestheticsMaintainabilityEvaluation timeReference costSpeed tok/sCompare UndisclosedShown in ranking 13m 12sN/A…Scroll horizontally to view all scores and costs → Score breakdown
Service logic, error handling, and test verification. Contracts and boundaries9 / 20 API contracts, input validation, and boundary behavior. Retries and failures15 / 20 Error recovery, retry conditions, and failure handling. CI and adversarial review11 / 20 Verification plans, risk detection, and audit evidence. Transactions and consistency14 / 20 State transitions, concurrency control, and data consistency. Caching and regression16 / 20 Cache invalidation, data updates, and regression coverage. | |||||||||||
| 32 | claude-opus-4-8 Backend engineering64Frontend interaction88Knowledge & Reasoning85Visual aesthetics68Maintainability55 | 75.85 | 64 | 88 | 85 | 68 | 55 | 63m 16s | $8.37 | … | |
| 32 | Gemini 3.8 Flash High Backend engineering64Frontend interaction86Knowledge & Reasoning40Visual aesthetics66Maintainability59 | 59.80 | 64 | 86 | 40 | 66 | 59 | 13m 35s | $0.061 | … | |
| 32 | Qwen 3.8 27b Backend engineering64Frontend interaction87Knowledge & Reasoning20Visual aesthetics66Maintainability59 | 53.00 | 64 | 87 | 20 | 66 | 59 | 22m 59s | $0.43 | … | |
| 32 | Qwen 3.8 Max Backend engineering64Frontend interaction69Knowledge & Reasoning40Visual aesthetics64Maintainability53 | 55.50 | 64 | 69 | 40 | 64 | 53 | 47m 48s | $1.07 | … | |
| 36 | Gemini 3.7 Flash High Backend engineering63Frontend interaction71Knowledge & Reasoning25Visual aesthetics70Maintainability59 | 51.95 | 63 | 71 | 25 | 70 | 59 | 5m 56s | $0.069 | … | |
| 37 | deepseek-v4.1-flash Backend engineering62Frontend interaction88Knowledge & Reasoning65Visual aesthetics64Maintainability55 | 67.85 | 62 | 88 | 65 | 64 | 55 | 12m 33s | $0.10 | … | |
| 37 | gpt-6-luna Backend engineering62Frontend interaction80Knowledge & Reasoning50Visual aesthetics68Maintainability59 | 62.00 | 62 | 80 | 50 | 68 | 59 | 17m 54s | $0.023 | … | |
| 39 |  space-bunny Backend engineering61Frontend interaction80Knowledge & Reasoning75Visual aesthetics59Maintainability55 | 68.80 | 61 | 80 | 75 | 59 | 55 | 19m 33s | $0.000 | … | |
| 39 |  step-5 Backend engineering61Frontend interaction71Knowledge & Reasoning75Visual aesthetics47Maintainability55 | 65.20 | 61 | 71 | 75 | 47 | 55 | 7m 12s | $0.34 | … | |
| 41 | deepseek-v4-flash Backend engineering58Frontend interaction76Knowledge & Reasoning55Visual aesthetics61Maintainability53 | 60.50 | 58 | 76 | 55 | 61 | 53 | 11m 36s | $0.090 | … | |
| 41 | mimo-v2.6-flash Backend engineering58Frontend interaction71Knowledge & Reasoning45Visual aesthetics59Maintainability57 | 56.10 | 58 | 71 | 45 | 59 | 57 | 35m 36s | $0.043 | … | |
| 43 | glm-5.3-flash Backend engineering55Frontend interaction76Knowledge & Reasoning20Visual aesthetics70Maintainability59 | 49.60 | 55 | 76 | 20 | 70 | 59 | 21m 43s | $0.018 | … | |
| 44 | k2.8 Backend engineering54Frontend interaction72Knowledge & Reasoning70Visual aesthetics57Maintainability53 | 63.55 | 54 | 72 | 70 | 57 | 53 | 22m 14s | $0.21 | … | |
| 45 | MiniMax-M3 Backend engineering46Frontend interaction65Knowledge & Reasoning50Visual aesthetics59Maintainability44 | 52.95 | 46 | 65 | 50 | 59 | 44 | 22m 6s | $0.31 | … | |
| 45 |  Nemotron-3-Ultra Backend engineering46Frontend interaction40Knowledge & Reasoning40Visual aesthetics61Maintainability37 | 44.05 | 46 | 40 | 40 | 61 | 37 | 17m 3s | $0.000 | … | |
Each model uses its highest-scoring effort here. Tied scores share a rank.
Service logic, error handling, and test verification. Evaluation scope and sources