Model comparison
Selected 2 / 5See the differences. Choose what matters to you.
Available modelsSelected 2 / 5
Differences vs. step-5 · default
Score, cost & time differences
Current baseline · step-5 · default
71Frontend interaction
Compared with step-5 · default
- Gemini 3.7 Flash High · default
Frontend interaction: tiedReference cost $0.058 ($0.18 less)Evaluation time 4m 35s (15m 34s less)
Differences reflect these evaluation tasks. Cost and time cover the same dimension, not a typical conversation. Scoring & cost notes
| Metric | step-5 · default | Gemini 3.7 Flash High · default |
|---|---|---|
| Frontend interaction | step-5default 71 | Gemini 3.7 Flash Highdefault 71Tied |
| Overall | step-5default 65.20 | Gemini 3.7 Flash Highdefault 51.95−13.25 pts |
| Backend engineering | step-5default 61 | Gemini 3.7 Flash Highdefault 63+2 pts |
| Knowledge & Reasoning | step-5default 75 | Gemini 3.7 Flash Highdefault 25−50 pts |
| Visual aesthetics | step-5default 47 | Gemini 3.7 Flash Highdefault 70+23 pts |
| Maintainability | step-5default 55 | Gemini 3.7 Flash Highdefault 59+4 pts |
Frontend interaction evaluation · Evaluation consumption, not a monthly subscription fee
Cost & time
Frontend interaction evaluation| Metric | step-5 · default | Gemini 3.7 Flash High · default |
|---|---|---|
| Reference cost | step-5default $0.24 | Gemini 3.7 Flash Highdefault $0.058−$0.18 |
| Evaluation time | step-5default 20m 9s | Gemini 3.7 Flash Highdefault 4m 35s−77.3% |
Capability profiles
Show up to five models. Select names to focus the chart.
Behind each score
Expand to inspect each subaxis.
Backend engineeringSubscores
| Scoring dimension | step-5default | Gemini 3.7 Flash Highdefault |
|---|---|---|
| Contracts and boundaries | 9 / 20 | 12 / 20 |
| Retries and failures | 16 / 20 | 16 / 20 |
| CI and adversarial review | 8 / 20 | 9 / 20 |
| Transactions and consistency | 16 / 20 | 12 / 20 |
| Caching and regression | 12 / 20 | 14 / 20 |
Frontend interactionSubscores
| Scoring dimension | step-5default | Gemini 3.7 Flash Highdefault |
|---|---|---|
| Layout and adaptation | 18 / 20 | 13 / 20 |
| Interaction behavior | 18 / 20 | 18 / 20 |
| State continuity | 12 / 20 | 15 / 20 |
| Accessibility and feedback | 10 / 15 | 10 / 15 |
| State validation and regression | 13 / 25 | 15 / 25 |
Knowledge & ReasoningSubscores
| Scoring dimension | step-5default | Gemini 3.7 Flash Highdefault |
|---|---|---|
| Mathematical reasoning | 10 / 15 | 5 / 15 |
| Computer science & AI | 10 / 15 | 0 / 15 |
| Science and engineering | 10 / 10 | 10 / 10 |
| Life sciences and medicine | 20 / 20 | 0 / 20 |
| Humanities and general knowledge | 25 / 40 | 10 / 40 |
Visual aestheticsSubscores
| Scoring dimension | step-5default | Gemini 3.7 Flash Highdefault |
|---|---|---|
| Composition | 15 / 20 | 19 / 20 |
| Spacing and alignment | 14 / 20 | 17 / 20 |
| Typography and expression | 15 / 20 | 16 / 20 |
| Color and surfaces | 18 / 20 | 20 / 20 |
| Control styling | 16 / 20 | 17 / 20 |
Subscores retain their original scale; the axis score uses a consistent conversion.
MaintainabilitySubscores
| Scoring dimension | step-5default | Gemini 3.7 Flash Highdefault |
|---|---|---|
| Semantic clarity | 15 / 20 | 17 / 20 |
| Control-flow organization | 19 / 20 | 19 / 20 |
| Locality of changes | 15 / 20 | 14 / 20 |
| State and lifecycle | 16 / 20 | 18 / 20 |
| Implementation economy | 17 / 20 | 16 / 20 |
Subscores retain their original scale; the axis score uses a consistent conversion.