Automated page. Written and translated automatically by AI and checked against the sources by software; no human editor. SI-IQ is an index built from public benchmark results, not an IQ test. How it works
GPQA Diamond (OpenRouter run): AI model results
GPQA Diamond (OpenRouter run) is a Knowledge benchmark run by OpenRouter. 117 models in our data have a published result.
It is part of the SI-IQ index (loading k = 0.68, chance level 25%).
- Evaluator
- OpenRouter
- Benchmark home page
- openrouter.ai/benchmarks/gpqa-diamond
Results
| 1 | Gemini 4 Argon Google DeepMind | 96.5% | 140137–143 | 8 |
| 2 | Gemini 3.1 Pro Google DeepMind | 94.8% | 127124–130 | 9 |
| 3 | Gemini 3.8 Flash Google DeepMind | 94.8% | 130127–133 | 8 |
| 4 | GPT-6 Astra OpenAI | 94.7% | 150146–153 | 8 |
| 5 | GPT-6.1 Sol OpenAI | 94.4% | 148144–152 | 8 |
| 6 | Gemini 3.7 Flash Google DeepMind | 93.9% | 131128–134 | 8 |
| 7 | GPT-5.5 OpenAI | 93.6% | 138135–141 | 9 |
| 8 | Gemini 3.6 Flash Google DeepMind | 93.0% | 125122–128 | 8 |
| 9 | Claude Sonnet 5.5 Anthropic | 92.9% | 140137–143 | 8 |
| 10 | Grok 4.6 xAI | 92.5% | 126123–129 | 8 |
| 11 | Gemini 3.5 Flash Google DeepMind | 92.4% | 126123–129 | 9 |
| 12 | GPT-5.6 Sol OpenAI | 92.3% | 140137–143 | 8 |
| 13 | GPT-6 Sol OpenAI | 92.1% | 140137–144 | 8 |
| 14 | Kimi K3open Moonshot | 91.6% | 127124–130 | 8 |
| 15 | MiniMax-M3open MiniMax | 91.5% | 108102–114 | 5 |
| 16 | GLM-5.3-Flashopen Z.ai (Zhipu AI) | 90.9% | 120117–124 | 7 |
| 17 | Qwen3.7-Max Alibaba | 90.9% | 125122–128 | 9 |
| 18 | Muse Spark Openopen Meta AI | 90.6% | 127124–130 | 6 |
| 19 | Claude Opus 5.5 Anthropic | 90.2% | 144141–148 | 8 |
| 20 | DeepSeek V4 Flash 0731open DeepSeek | 90.0% | 124121–127 | 8 |
| 21 | GPT-5.4 OpenAI | 90.0% | 131128–133 | 9 |
| 22 | DeepSeek-V4-Flashopen DeepSeek | 89.9% | 129116–143 | 2 too little data |
| 23 | MiMo-V2.6 Pro Xiaomi Corp | 89.9% | 131117–144 | 2 too little data |
| 24 | Tencent Hy4 previewopen Tencent | 89.7% | 129115–143 | 2 too little data |
| 25 | Qwen3.8 Flash Alibaba | 89.6% | 125111–138 | 2 too little data |
| 26 | Claude Opus 4.8 Anthropic | 89.6% | 132129–135 | 8 |
| 27 | Claude Opus 5 Anthropic | 89.6% | 136133–140 | 8 |
| 28 | GPT-5.6 Terra OpenAI | 89.3% | 134131–137 | 8 |
| 29 | DeepSeek V4 Pro 0813open DeepSeek | 89.3% | 128125–131 | 8 |
| 30 | Claude Opus 4.7 Anthropic | 89.2% | 127124–130 | 9 |
| 31 | Claude Fable 5.1 Anthropic | 88.9% | 140136–143 | 8 |
| 32 | Gemini 3 Flash Google DeepMind | 88.6% | 122119–125 | 9 |
| 33 | Kimi K2.7 Codeopen Moonshot | 88.5% | 118115–122 | 7 |
| 34 | DeepSeek V4.1 Flashopen DeepSeek | 88.4% | 128125–131 | 8 |
| 35 | GPT-6 Luna OpenAI | 88.2% | 130127–133 | 8 |
| 36 | Kimi K2.6open Moonshot | 88.0% | 121118–124 | 9 |
| 37 | GPT-5.2 OpenAI | 87.9% | 125122–128 | 10 |
| 38 | Qwen3.7-Plus Alibaba | 87.4% | 115110–119 | 5 |
| 39 | Qwen3.5 397B-A17Bopen Alibaba | 87.3% | 114109–118 | 5 |
| 40 | GPT-5.6 Luna OpenAI | 87.2% | 130127–133 | 8 |
| 41 | Inkling-Smallopen Thinking Machines | 87.0% | 118115–122 | 7 |
| 42 | Claude Haiku 5.5 Anthropic | 86.9% | 129126–132 | 8 |
| 43 | GPT-5.1 OpenAI | 86.9% | 120115–125 | 7 |
| 44 | MiniMax-M2.1open MiniMax | 86.9% | 120106–133 | 2 too little data |
| 45 | GLM-5.3open Z.ai (Zhipu AI) | 86.4% | 125122–128 | 8 |
| 46 | Claude Fable 5 Anthropic | 86.2% | 138134–141 | 8 |
| 47 | Claude Opus 4.5 Anthropic | 86.1% | 115111–118 | 10 |
| 48 | Kimi K2.5open Moonshot | 85.9% | 119112–125 | 5 |
| 49 | Claude Sonnet 5 Anthropic | 85.8% | 126123–129 | 8 |
| 50 | MiniMax-M2.7open MiniMax | 85.7% | 120107–134 | 2 too little data |
| 51 | Claude Opus 4.6 Anthropic | 85.7% | 123120–126 | 9 |
| 52 | MiMo-V2.5-Proopen Xiaomi Corp | 85.5% | 121108–135 | 2 too little data |
| 53 | MiniMax-M2.5open MiniMax | 85.4% | 118105–132 | 2 too little data |
| 54 | DeepSeek-V4-Proopen DeepSeek | 85.4% | 117113–120 | 9 |
| 55 | GPT-5 OpenAI | 85.0% | 121118–124 | 11 |
| 56 | GPT-5.4 Mini OpenAI | 84.0% | 117113–120 | 8 |
| 57 | Gemini 3.5 Flash-Lite Google DeepMind | 84.0% | 109106–113 | 7 |
| 58 | GLM-4.7open Z.ai (Zhipu AI) | 83.6% | 112107–118 | 5 |
| 59 | Qwen 3.8 27Bopen Alibaba | 83.4% | 120106–133 | 2 too little data |
| 60 | GLM-5.2open Z.ai (Zhipu AI) | 83.3% | 121118–124 | 9 |
| 61 | Qwen 3.6 35B-A3Bopen Alibaba | 82.7% | 111107–115 | 5 |
| 62 | DeepSeek-V3.2-Expopen DeepSeek | 82.7% | 112103–121 | 4 too little data |
| 63 | MiMo-V2.5open Xiaomi Corp | 82.4% | 117104–131 | 2 too little data |
| 64 | Inklingopen Thinking Machines | 81.8% | 114110–117 | 7 |
| 65 | Gemma 4 31B ITopen Google DeepMind | 81.6% | 10498–110 | 4 too little data |
| 66 | GLM-5.1open Z.ai (Zhipu AI) | 81.2% | 116112–120 | 7 |
| 67 | Claude Sonnet 4.5 Anthropic | 81.1% | 110107–113 | 11 |
| 68 | Qwen3.5-122B-A10Bopen Alibaba | 80.7% | 112103–121 | 3 too little data |
| 69 | Gemini 2.5 Pro (Jun 2025) Google DeepMind | 80.6% | 108104–112 | 7 |
| 70 | DeepSeek-V3.2open DeepSeek | 80.3% | 114101–127 | 2 too little data |
| 71 | Qwen3.6 27Bopen Alibaba | 80.1% | 115110–119 | 5 |
| 72 | GPT-5 mini OpenAI | 80.1% | 115112–118 | 11 |
| 73 | Kimi K2 Thinkingopen Moonshot | 79.7% | 11299–126 | 2 too little data |
| 74 | Qwen3-235B-A22B-Thinking (Jul 2025)open Alibaba | 79.5% | 111105–118 | 5 |
| 75 | DeepSeek-V3.1-Terminusopen DeepSeek | 79.4% | 10289–115 | 2 too little data |
| 76 | DeepSeek-R1 (May 2025)open DeepSeek | 78.5% | 104100–109 | 4 too little data |
| 77 | Gemma 4 26B A4Bopen Google DeepMind | 77.6% | 106100–112 | 3 too little data |
| 78 | GPT-5.4 Nano OpenAI | 77.6% | 118115–121 | 8 |
| 79 | DeepSeek-V3.1open DeepSeek | 77.1% | 10087–113 | 2 too little data |
| 80 | Claude Sonnet 4 Anthropic | 76.7% | 9793–101 | 5 |
| 81 | GLM-4.6open Z.ai (Zhipu AI), Tsinghua University | 76.5% | 117106–128 | 3 too little data |
| 82 | MiMo-V2.6 Flash Xiaomi Corp | 75.9% | 11299–125 | 2 too little data |
| 83 | gpt-oss-120bopen OpenAI | 75.8% | 10699–112 | 5 |
| 84 | qwen3-coder-next — | 75.8% | 10390–116 | 2 too little data |
| 85 | Mistral Small 4open Mistral AI | 75.3% | 9683–108 | 2 too little data |
| 86 | Qwen3.5-35B-A3Bopen Alibaba | 75.0% | 106100–112 | 3 too little data |
| 87 | Kimi K2 (Sep 2025)open Moonshot | 74.7% | 10592–118 | 2 too little data |
| 88 | Qwen3.5-9Bopen Alibaba | 74.6% | 10195–107 | 3 too little data |
| 89 | Qwen3-235B-A22B-Instruct (Jul 2025)open Alibaba | 73.9% | 9685–107 | 3 too little data |
| 90 | Gemini 2.5 Flash (Jun 2025) Google DeepMind | 73.8% | 10291–113 | 3 too little data |
| 91 | Claude Haiku 4.5 Anthropic | 73.1% | 10499–108 | 7 |
| 92 | GLM-5open Z.ai (Zhipu AI) | 72.9% | 112105–118 | 4 too little data |
| 93 | GPT-5 nano OpenAI | 68.4% | 105102–109 | 10 |
| 94 | DeepSeek-V3open DeepSeek | 66.2% | 7773–82 | 4 too little data |
| 95 | GPT-4.1 OpenAI | 66.1% | 9187–94 | 10 |
| 96 | Llama 4 Maverickopen Meta AI | 64.8% | 8177–85 | 6 |
| 97 | GPT-4.1 mini OpenAI | 64.7% | 9188–95 | 10 |
| 98 | DeepSeek-V3 (Mar 2025)open DeepSeek | 64.6% | 8581–90 | 4 too little data |
| 99 | Claude Sonnet 4.6 Anthropic | 64.6% | 113108–118 | 7 |
| 100 | Qwen3-30B-A3B-Instruct (Jul 2025)open Alibaba | 64.2% | 9186–97 | 4 too little data |
| 101 | gpt-oss-20bopen OpenAI | 63.1% | 9589–101 | 3 too little data |
| 102 | Qwen3-30B-A3Bopen Alibaba | 60.4% | 9488–100 | 3 too little data |
| 103 | Qwen3-Coder-480B-A35Bopen Alibaba | 60.4% | 8572–98 | 2 too little data |
| 104 | Qwen3-32Bopen Alibaba | 55.7% | 9589–100 | 5 |
| 105 | GPT-4o (May 2024) OpenAI | 54.2% | 7066–75 | 4 too little data |
| 106 | Qwen3-14Bopen Alibaba | 53.3% | 9387–99 | 4 too little data |
| 107 | GPT-4o (Aug 2024) OpenAI | 52.8% | 7368–77 | 8 |
| 108 | GPT-4.1 nano OpenAI | 49.7% | 7672–80 | 8 |
| 109 | glm-4.7-flash — | 49.2% | 9488–100 | 3 too little data |
| 110 | Llama 3.3 70Bopen Meta AI | 47.5% | 6661–71 | 5 |
| 111 | Qwen2.5-72Bopen Alibaba | 46.1% | 7268–77 | 4 too little data |
| 112 | GPT-4o mini OpenAI | 43.1% | 6864–73 | 9 |
| 113 | Gemma 3 12Bopen Google DeepMind | 37.9% | 7366–79 | 4 too little data |
| 114 | Qwen2.5-7Bopen Alibaba | 34.2% | 5141–60 | 3 too little data |
| 115 | Gemma 3 4Bopen Google DeepMind | 27.1% | 6353–73 | 3 too little data |
| 116 | Llama 3.1-8Bopen Meta AI | 26.9% | 5549–60 | 3 too little data |
| 117 | Llama 3.2 3Bopen Meta AI | 17.3% | 6142–80 | 2 too little data |
Data sources: Aider polyglot leaderboard data (Apache-2.0); Arena leaderboard dataset on Hugging Face (CC BY 4.0); Berkeley Function Calling Leaderboard, Gorilla project (Apache-2.0); Epoch AI, ‘Capabilities & benchmarking’ (CC BY 4.0); API list prices via LiteLLM's price table (MIT); each price links to the developer's pricing page; Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter..