Automated page. Written and translated automatically by AI and checked against the sources by software; no human editor. SI-IQ is an index built from public benchmark results, not an IQ test. How it works
How smart is GPT-3.5 Turbo (Jan 2024)?
GPT-3.5 Turbo (Jan 2024) is a model from OpenAI, released on Jan 25, 2024. Its SI-IQ is 47 (90% interval 42–53), estimated from 5 benchmark results by 1 evaluator.
Data as of Oct 18, 2026 · method 1.0.0
A model is ranked when its results come from at least 5 benchmarks (the two GPQA Diamond runs count as one) in at least 3 areas, from at least 2 different evaluators, and its versions are released no more than 60 days apart. This model does not meet that yet (results from fewer than 2 evaluators). Its provisional estimate rests on 5 benchmark results and can change a lot when more results arrive.
Facts
- Developer
- OpenAI
- Released
- Jan 25, 2024
- Access
- API access
- Benchmarks used
- 5 benchmark results from 1 evaluator
- API price
- $0.50 input / $1.50 output per 1M tokens (developer's price list, Oct 18, 2026)
- Context window
- 16,385 tokens
Ability by area (SI-IQ, 90% interval)
Every benchmark result we used
Each score is one value exactly as the source published it: for Epoch AI the best of its run settings, for OpenRouter the median hosting provider (the developer's own hosting when it ran the test). “Implied SI-IQ” is the ability that this single result points to; the overall SI-IQ is their precision-weighted average.
| Benchmark | Score | Evaluated by | Source |
|---|---|---|---|
| Mystery Game Puzzles | 3.0% | Epoch AI | Epoch AI Benchmarking Hub · data file |
| FrontierMath Tiers 1–3 | 0.0% | Epoch AI | Epoch AI Benchmarking Hub · data file |
| MATH Level 5 | 11.6% | Epoch AI | Epoch AI Benchmarking Hub · data file |
| OTIS Mock AIME 2024–2025 | 2.2% | Epoch AI | Epoch AI Benchmarking Hub · data file |
| GPQA Diamond | 27.2% | Epoch AI | Epoch AI Benchmarking Hub · data file |
Human preference (Arena)
On the Arena leaderboard, where people vote between two anonymous answers, GPT-3.5 Turbo (Jan 2024) has a rating of 1,226 (1,221–1,230) from 66,207 votes (published Oct 15, 2026). Human preference is a different measure from benchmark ability and is not part of SI-IQ. Arena (Hugging Face)
Computed with SI-IQ method version 1.0.0. Read the full methodology
Data sources: Arena leaderboard dataset on Hugging Face (CC BY 4.0); Epoch AI, ‘Capabilities & benchmarking’ (CC BY 4.0); LiteLLM, model_prices_and_context_window.json (MIT) (licences and changes).