Automated page. Written and translated automatically by AI and checked against the sources by software; no human editor. SI-IQ is an index built from public benchmark results, not an IQ test. How it works
How smart is Claude 3.7 Sonnet?
Claude 3.7 Sonnet is a model from Anthropic, released on Feb 24, 2025. Its SI-IQ is 99 (90% interval 95–103), estimated from 5 benchmark results by 2 independent evaluators. Its strongest area is Coding and its weakest is Math.
Facts
- Developer
- Anthropic
- Released
- Feb 24, 2025
- Access
- API access
- Benchmarks used
- 5 results from 2 evaluators
Ability by area (SI-IQ, 90% interval)
Every benchmark result we used
Each score is one value exactly as the source published it: for Epoch AI the best of its run settings, for OpenRouter the median hosting provider (the developer's own hosting when it ran the test). “Implied SI-IQ” is the ability that this single result points to; the overall SI-IQ is their precision-weighted average.
| Benchmark | Score | Evaluated by | Source |
|---|---|---|---|
| MATH Level 5 | 91.2% | Epoch AI | Epoch AI Benchmarking Hub · data file |
| OTIS Mock AIME 2024–2025 | 57.8% | Epoch AI | Epoch AI Benchmarking Hub · data file |
| Aider Polyglot | 64.9% | Aider | Aider LLM Leaderboards · data file |
| SWE-bench Verified (Epoch AI run) | 61.0% | Epoch AI | Epoch AI Benchmarking Hub · data file |
| GPQA Diamond | 79.7% | Epoch AI | Epoch AI Benchmarking Hub · data file |
Human preference (Arena)
On the Arena leaderboard, where people vote between two anonymous answers, Claude 3.7 Sonnet has a rating of 1,388 (1,384–1,393) from 38,159 votes (published Oct 15, 2026). Human preference is a different measure from benchmark ability and is not part of SI-IQ. Arena (Hugging Face)
Models with similar SI-IQ
| Model | SI-IQ | |
|---|---|---|
| Claude Opus 4Anthropic | 98 | Claude 3.7 Sonnet vs Claude Opus 4 |
| Claude Sonnet 4Anthropic | 97 | Claude 3.7 Sonnet vs Claude Sonnet 4 |
| Qwen3-32BAlibaba | 95 | Claude 3.7 Sonnet vs Qwen3-32B |
| Claude Haiku 4.5Anthropic | 104 | Claude 3.7 Sonnet vs Claude Haiku 4.5 |
| o3-miniOpenAI | 105 | Claude 3.7 Sonnet vs o3-mini |
Computed with SI-IQ method version 1.0.0. Read the full methodology
Data sources: Aider polyglot leaderboard data (Apache-2.0); Arena leaderboard dataset on Hugging Face (CC BY 4.0); Epoch AI, ‘Capabilities & benchmarking’ (CC BY 4.0).