gpt-6-sol
gpt-6-sol · low, showing overall score. Results for all tested efforts are available below.
Overall score66.55
gpt-6-sol · low
- Backend engineering
- 54
- Frontend interaction
- 81
- Knowledge & Reasoning
- 70
- Visual aesthetics
- 61
- Maintainability
- 59
- Evaluation time
- 33m 0s
- Reference cost
- $0.59
Complete evaluation · API reference cost
Backend tested · 9/23/2026Tasks & methodology
Results by reasoning effort
Swipe to see all results →
| Model / effort | Overall | Backend engineering | Frontend interaction | Knowledge & Reasoning | Visual aesthetics | Maintainability | Total eval. time | Total ref. cost | Compare |
|---|---|---|---|---|---|---|---|---|---|
| 66.55 | 54 | 81 | 70 | 61 | 59 | 33m 0s | $0.59 | ||
| 69.50 | 70 | 85 | 65 | 61 | 66 | 35m 34s | $0.77 | ||
| 71.65 | 76 | 81 | 70 | 61 | 66 | 31m 45s | $0.81 | ||
| 78.90 | 80 | 94 | 75 | 75 | 66 | 39m 22s | $1.10 | ||
| 76.55 | 80 | 90 | 70 | 75 | 68 | 35m 40s | $1.14 |
Score breakdown
- Overall score
- 66.55
- Evaluation time
- 33m 0s
- Reference cost
- $0.59
Service logic, error handling, and test verification.
Contracts and boundaries11 / 20
API contracts, input validation, and boundary behavior.
Retries and failures18 / 20
Error recovery, retry conditions, and failure handling.
CI and adversarial review0 / 20
Verification plans, risk detection, and audit evidence.
Transactions and consistency11 / 20
State transitions, concurrency control, and data consistency.
Caching and regression14 / 20
Cache invalidation, data updates, and regression coverage.
What changes with higher reasoning effort
Compare overall scores, cost, and time across neighboring tested efforts.
low medium
- Overall
- +3.0 pts 66.55 → 69.50
- Reference cost
- +$0.18 $0.59 → $0.77
- Evaluation time
- +7.8% 33m 0s → 35m 34s
Model and effort comparisons
Data snapshot published · 10/27/2026Scoring & cost notes