Model comparison
Selected 2 / 5See the differences. Choose what matters to you.
Differences vs. Qwen 3.8 27b · default
Score, cost & time differences
Current baseline · Qwen 3.8 27b · default
64Backend engineering
Compared with Qwen 3.8 27b · default
- claude-opus-4-8 · max
Backend engineering: tiedReference cost $8.37 ($7.94 more)Evaluation time 63m 16s (40m 17s more)
Differences reflect these evaluation tasks. Cost and time cover the same dimension, not a typical conversation. Scoring & cost notes
| Metric | Qwen 3.8 27b · default | claude-opus-4-8 · max |
|---|---|---|
| Backend engineering | Qwen 3.8 27bdefault 64 | claude-opus-4-8max 64Tied |
| Overall | Qwen 3.8 27bdefault 53.00 | claude-opus-4-8max 75.85+22.85 pts |
| Frontend interaction | Qwen 3.8 27bdefault 87 | claude-opus-4-8max 88+1 pts |
| Knowledge & Reasoning | Qwen 3.8 27bdefault 20 | claude-opus-4-8max 85+65 pts |
| Visual aesthetics | Qwen 3.8 27bdefault 66 | claude-opus-4-8max 68+2 pts |
| Maintainability | Qwen 3.8 27bdefault 59 | claude-opus-4-8max 55−4 pts |
Backend engineering evaluation · Evaluation consumption, not a monthly subscription fee
Cost & time
Backend engineering evaluation| Metric | Qwen 3.8 27b · default | claude-opus-4-8 · max |
|---|---|---|
| Reference cost | Qwen 3.8 27bdefault $0.43 | claude-opus-4-8max $8.37+$7.94 |
| Evaluation time | Qwen 3.8 27bdefault 22m 59s | claude-opus-4-8max 63m 16s+175.3% |
Capability profiles
Show up to five models. Select names to focus the chart.
Behind each score
Expand to inspect each subaxis.
Backend engineeringSubscores
| Scoring dimension | Qwen 3.8 27bdefault | claude-opus-4-8max |
|---|---|---|
| Contracts and boundaries | 9 / 20 | 7 / 20 |
| Retries and failures | 18 / 20 | 15 / 20 |
| CI and adversarial review | 9 / 20 | 13 / 20 |
| Transactions and consistency | 13 / 20 | 13 / 20 |
| Caching and regression | 15 / 20 | 16 / 20 |
Frontend interactionSubscores
| Scoring dimension | Qwen 3.8 27bdefault | claude-opus-4-8max |
|---|---|---|
| Layout and adaptation | 20 / 20 | 18 / 20 |
| Interaction behavior | 20 / 20 | 19 / 20 |
| State continuity | 15 / 20 | 20 / 20 |
| Accessibility and feedback | 15 / 15 | 10 / 15 |
| State validation and regression | 17 / 25 | 21 / 25 |
Knowledge & ReasoningSubscores
| Scoring dimension | Qwen 3.8 27bdefault | claude-opus-4-8max |
|---|---|---|
| Mathematical reasoning | 5 / 15 | 15 / 15 |
| Computer science & AI | 5 / 15 | 5 / 15 |
| Science and engineering | 0 / 10 | 10 / 10 |
| Life sciences and medicine | 5 / 20 | 20 / 20 |
| Humanities and general knowledge | 5 / 40 | 35 / 40 |
Visual aestheticsSubscores
| Scoring dimension | Qwen 3.8 27bdefault | claude-opus-4-8max |
|---|---|---|
| Composition | 19 / 20 | 20 / 20 |
| Spacing and alignment | 17 / 20 | 17 / 20 |
| Typography and expression | 16 / 20 | 17 / 20 |
| Color and surfaces | 19 / 20 | 18 / 20 |
| Control styling | 16 / 20 | 16 / 20 |
Subscores retain their original scale; the axis score uses a consistent conversion.
MaintainabilitySubscores
| Scoring dimension | Qwen 3.8 27bdefault | claude-opus-4-8max |
|---|---|---|
| Semantic clarity | 15 / 20 | 15 / 20 |
| Control-flow organization | 19 / 20 | 19 / 20 |
| Locality of changes | 15 / 20 | 15 / 20 |
| State and lifecycle | 18 / 20 | 16 / 20 |
| Implementation economy | 17 / 20 | 17 / 20 |
Subscores retain their original scale; the axis score uses a consistent conversion.