Automated page. Written and translated automatically by AI and checked against the sources by software; no human editor. SI-IQ is an index built from public benchmark results, not an IQ test. How it works
How smart is o4-mini?
o4-mini is a model from OpenAI, released on Apr 16, 2025. Its SI-IQ is 112 (90% interval 109–115), estimated from 10 benchmark results by 3 independent evaluators. Its strongest area is Reasoning and its weakest is Knowledge.
Facts
- Developer
- OpenAI
- Released
- Apr 16, 2025
- Access
- API access
- Benchmarks used
- 10 results from 3 evaluators
- API price
- $1.10 input / $4.40 output per 1M tokens (developer's price list, Oct 18, 2026)
- Context window
- 200,000 tokens
Ability by area (SI-IQ, 90% interval)
Every benchmark result we used
Each score is one value exactly as the source published it: for Epoch AI the best of its run settings, for OpenRouter the median hosting provider (the developer's own hosting when it ran the test). “Implied SI-IQ” is the ability that this single result points to; the overall SI-IQ is their precision-weighted average.
| Benchmark | Score | Evaluated by | Source |
|---|---|---|---|
| Chess Puzzles | 22.0% | Epoch AI | Epoch AI Benchmarking Hub · data file |
| Mystery Game Puzzles | 5.0% | Epoch AI | Epoch AI Benchmarking Hub · data file |
| FrontierMath Tier 4 | 4.9% | Epoch AI | Epoch AI Benchmarking Hub · data file |
| FrontierMath Tiers 1–3 | 36.1% | Epoch AI | Epoch AI Benchmarking Hub · data file |
| MATH Level 5 | 97.8% | Epoch AI | Epoch AI Benchmarking Hub · data file |
| OTIS Mock AIME 2024–2025 | 81.7% | Epoch AI | Epoch AI Benchmarking Hub · data file |
| Aider Polyglot | 72.0% | Aider | Aider LLM Leaderboards · data file |
| GPQA Diamond | 79.6% | Epoch AI | Epoch AI Benchmarking Hub · data file |
| SimpleQA Verified | 19.6% | Epoch AI | Epoch AI Benchmarking Hub · data file |
| Berkeley Function Calling Leaderboard | 53.2% | UC Berkeley (Gorilla) | Berkeley Function Calling Leaderboard · data file |
Human preference (Arena)
On the Arena leaderboard, where people vote between two anonymous answers, o4-mini has a rating of 1,391 (1,387–1,395) from 44,855 votes (published Oct 15, 2026). Human preference is a different measure from benchmark ability and is not part of SI-IQ. Arena (Hugging Face)
Models with similar SI-IQ
| Model | SI-IQ | |
|---|---|---|
| Qwen3-235B-A22B-Thinking (Jul 2025)Alibaba | 111 | o4-mini vs Qwen3-235B-A22B-Thinking (Jul 2025) |
| GLM-4.7Z.ai (Zhipu AI) | 112 | o4-mini vs GLM-4.7 |
| Qwen 3.6 35B-A3BAlibaba | 111 | o4-mini vs Qwen 3.6 35B-A3B |
| Claude Sonnet 4.6Anthropic | 113 | o4-mini vs Claude Sonnet 4.6 |
| Qwen3.5 397B-A17BAlibaba | 114 | o4-mini vs Qwen3.5 397B-A17B |
Computed with SI-IQ method version 1.0.0. Read the full methodology
Data sources: Aider polyglot leaderboard data (Apache-2.0); Arena leaderboard dataset on Hugging Face (CC BY 4.0); Berkeley Function Calling Leaderboard, Gorilla project (Apache-2.0); Epoch AI, ‘Capabilities & benchmarking’ (CC BY 4.0); API list prices via LiteLLM's price table (MIT); each price links to the developer's pricing page.