Model comparison
Selected 2 / 5See the differences. Choose what matters to you.
Available modelsSelected 2 / 5
Differences vs. gpt-6-sol · low
Score, cost & time differences
Current baseline · gpt-6-sol · low
54Backend engineering
Compared with gpt-6-sol · low
- k2.8 · high
Backend engineering: tiedReference cost $0.21 ($0.003 less)Evaluation time 22m 14s (14m 32s more)
Differences reflect these evaluation tasks. Cost and time cover the same dimension, not a typical conversation. Scoring & cost notes
| Metric | gpt-6-sol · low | k2.8 · high |
|---|---|---|
| Backend engineering | gpt-6-sollow 54 | k2.8high 54Tied |
| Overall | gpt-6-sollow 66.55 | k2.8high 63.55−3 pts |
| Frontend interaction | gpt-6-sollow 81 | k2.8high 72−9 pts |
| Knowledge & Reasoning | gpt-6-sollow 70 | k2.8high 70Tied |
| Visual aesthetics | gpt-6-sollow 61 | k2.8high 57−4 pts |
| Maintainability | gpt-6-sollow 59 | k2.8high 53−6 pts |
Backend engineering evaluation · Evaluation consumption, not a monthly subscription fee
Cost & time
Backend engineering evaluation| Metric | gpt-6-sol · low | k2.8 · high |
|---|---|---|
| Reference cost | gpt-6-sollow $0.21 | k2.8high $0.21−$0.003 |
| Evaluation time | gpt-6-sollow 7m 42s | k2.8high 22m 14s+188.8% |
Capability profiles
Show up to five models. Select names to focus the chart.
Behind each score
Expand to inspect each subaxis.
Backend engineeringSubscores
| Scoring dimension | gpt-6-sollow | k2.8high |
|---|---|---|
| Contracts and boundaries | 11 / 20 | 9 / 20 |
| Retries and failures | 18 / 20 | 15 / 20 |
| CI and adversarial review | 0 / 20 | 14 / 20 |
| Transactions and consistency | 11 / 20 | 9 / 20 |
| Caching and regression | 14 / 20 | 7 / 20 |
Frontend interactionSubscores
| Scoring dimension | gpt-6-sollow | k2.8high |
|---|---|---|
| Layout and adaptation | 18 / 20 | 16 / 20 |
| Interaction behavior | 20 / 20 | 18 / 20 |
| State continuity | 15 / 20 | 15 / 20 |
| Accessibility and feedback | 13 / 15 | 10 / 15 |
| State validation and regression | 15 / 25 | 13 / 25 |
Knowledge & ReasoningSubscores
| Scoring dimension | gpt-6-sollow | k2.8high |
|---|---|---|
| Mathematical reasoning | 5 / 15 | 5 / 15 |
| Computer science & AI | 10 / 15 | 5 / 15 |
| Science and engineering | 10 / 10 | 5 / 10 |
| Life sciences and medicine | 15 / 20 | 20 / 20 |
| Humanities and general knowledge | 30 / 40 | 35 / 40 |
Visual aestheticsSubscores
| Scoring dimension | gpt-6-sollow | k2.8high |
|---|---|---|
| Composition | 19 / 20 | 16 / 20 |
| Spacing and alignment | 16 / 20 | 17 / 20 |
| Typography and expression | 15 / 20 | 16 / 20 |
| Color and surfaces | 19 / 20 | 19 / 20 |
| Control styling | 16 / 20 | 15 / 20 |
Subscores retain their original scale; the axis score uses a consistent conversion.
MaintainabilitySubscores
| Scoring dimension | gpt-6-sollow | k2.8high |
|---|---|---|
| Semantic clarity | 15 / 20 | 14 / 20 |
| Control-flow organization | 20 / 20 | 19 / 20 |
| Locality of changes | 15 / 20 | 15 / 20 |
| State and lifecycle | 16 / 20 | 17 / 20 |
| Implementation economy | 18 / 20 | 16 / 20 |
Subscores retain their original scale; the axis score uses a consistent conversion.