gpt-5.6-sol
gpt-5.6-sol · xhigh, showing overall score. Results for all tested efforts are available below.
Overall score66.60
gpt-5.6-sol · xhigh
- Backend engineering
- 78
- Frontend interaction
- 65
- Knowledge & Reasoning
- 65
- Visual aesthetics
- 61
- Maintainability
- 61
- Evaluation time
- 71m 19s
- Reference cost
- $2.56
Complete evaluation · API reference cost
Backend tested · 9/21/2026Tasks & methodology
Results by reasoning effort
Swipe to see all results →
| Model / effort | Overall | Backend engineering | Frontend interaction | Knowledge & Reasoning | Visual aesthetics | Maintainability | Total eval. time | Total ref. cost | Compare |
|---|---|---|---|---|---|---|---|---|---|
| 66.70 | 69 | 78 | 60 | 66 | 64 | 41m 49s | $1.53 | ||
| 71.80 | 73 | 83 | 70 | 68 | 59 | 59m 12s | $1.72 | ||
| 73.70 | 78 | 90 | 65 | 73 | 64 | 58m 24s | $2.05 | ||
| 66.60 | 78 | 65 | 65 | 61 | 61 | 71m 19s | $2.56 | ||
| 74.15 | 85 | 73 | 75 | 66 | 64 | 87m 21s | $3.25 |
Score breakdown
- Overall score
- 66.60
- Evaluation time
- 71m 19s
- Reference cost
- $2.56
Service logic, error handling, and test verification.
Contracts and boundaries15 / 20
API contracts, input validation, and boundary behavior.
Retries and failures17 / 20
Error recovery, retry conditions, and failure handling.
CI and adversarial review10 / 20
Verification plans, risk detection, and audit evidence.
Transactions and consistency18 / 20
State transitions, concurrency control, and data consistency.
Caching and regression18 / 20
Cache invalidation, data updates, and regression coverage.
What changes with higher reasoning effort
Compare overall scores, cost, and time across neighboring tested efforts.
high xhigh
- Overall
- −7.1 pts 73.70 → 66.60
- Reference cost
- +$0.51 $2.05 → $2.56
- Evaluation time
- +22.1% 58m 24s → 71m 19s
Data snapshot published · 10/27/2026Scoring & cost notes