Model comparison
Selected 2 / 5See the differences. Choose what matters to you.
Available modelsSelected 2 / 5
Differences vs. step-5 · default
Score, cost & time differences
Current baseline · step-5 · default
75Knowledge & Reasoning
Compared with step-5 · default
- deepseek-v4.1-flash-1017 · max
Knowledge & Reasoning: tiedReference cost $0.27 ($0.39 less)Evaluation time 28m 33s (42m 28s less)
Differences reflect these evaluation tasks. Cost and time cover the same dimension, not a typical conversation. Scoring & cost notes
| Metric | step-5 · default | deepseek-v4.1-flash-1017 · max |
|---|---|---|
| Knowledge & Reasoning | step-5default 75 | deepseek-v4.1-flash-1017max 75Tied |
| Overall | step-5default 65.20 | deepseek-v4.1-flash-1017max 74.30+9.1 pts |
| Backend engineering | step-5default 61 | deepseek-v4.1-flash-1017max 72+11 pts |
| Frontend interaction | step-5default 71 | deepseek-v4.1-flash-1017max 96+25 pts |
| Visual aesthetics | step-5default 47 | deepseek-v4.1-flash-1017max 61+14 pts |
| Maintainability | step-5default 55 | deepseek-v4.1-flash-1017max 53−2 pts |
Knowledge & Reasoning evaluation · Evaluation consumption, not a monthly subscription fee
Cost & time
Knowledge & Reasoning evaluation| Metric | step-5 · default | deepseek-v4.1-flash-1017 · max |
|---|---|---|
| Reference cost | step-5default $0.66 | deepseek-v4.1-flash-1017max $0.27−$0.39 |
| Evaluation time | step-5default 71m 1s | deepseek-v4.1-flash-1017max 28m 33s−59.8% |
Capability profiles
Show up to five models. Select names to focus the chart.
Behind each score
Expand to inspect each subaxis.
Backend engineeringSubscores
| Scoring dimension | step-5default | deepseek-v4.1-flash-1017max |
|---|---|---|
| Contracts and boundaries | 9 / 20 | 17 / 20 |
| Retries and failures | 16 / 20 | 15 / 20 |
| CI and adversarial review | 8 / 20 | 11 / 20 |
| Transactions and consistency | 16 / 20 | 14 / 20 |
| Caching and regression | 12 / 20 | 15 / 20 |
Frontend interactionSubscores
| Scoring dimension | step-5default | deepseek-v4.1-flash-1017max |
|---|---|---|
| Layout and adaptation | 18 / 20 | 20 / 20 |
| Interaction behavior | 18 / 20 | 20 / 20 |
| State continuity | 12 / 20 | 20 / 20 |
| Accessibility and feedback | 10 / 15 | 11 / 15 |
| State validation and regression | 13 / 25 | 25 / 25 |
Knowledge & ReasoningSubscores
| Scoring dimension | step-5default | deepseek-v4.1-flash-1017max |
|---|---|---|
| Mathematical reasoning | 10 / 15 | 15 / 15 |
| Computer science & AI | 10 / 15 | 15 / 15 |
| Science and engineering | 10 / 10 | 5 / 10 |
| Life sciences and medicine | 20 / 20 | 15 / 20 |
| Humanities and general knowledge | 25 / 40 | 25 / 40 |
Visual aestheticsSubscores
| Scoring dimension | step-5default | deepseek-v4.1-flash-1017max |
|---|---|---|
| Composition | 15 / 20 | 19 / 20 |
| Spacing and alignment | 14 / 20 | 15 / 20 |
| Typography and expression | 15 / 20 | 16 / 20 |
| Color and surfaces | 18 / 20 | 19 / 20 |
| Control styling | 16 / 20 | 16 / 20 |
Subscores retain their original scale; the axis score uses a consistent conversion.
MaintainabilitySubscores
| Scoring dimension | step-5default | deepseek-v4.1-flash-1017max |
|---|---|---|
| Semantic clarity | 15 / 20 | 15 / 20 |
| Control-flow organization | 19 / 20 | 19 / 20 |
| Locality of changes | 15 / 20 | 14 / 20 |
| State and lifecycle | 16 / 20 | 17 / 20 |
| Implementation economy | 17 / 20 | 16 / 20 |
Subscores retain their original scale; the axis score uses a consistent conversion.