Data downloads
The SI-IQ values, ranks and parameters we compute are free to reuse under the CC BY 4.0 licence; credit “IQ of SI (iqofsi.com)”. The input scores stay under their sources' own licences (CC BY 4.0, Apache-2.0 or MIT): every record in scores.json names its source and licence, and /data/LICENSES.md lists the attributions, the changes we made and the licence texts. Keep those when you redistribute the data.
| File | Contents |
|---|---|
| /data/models.json · CSV | Every model: SI-IQ, 90% interval, rank, area scores, developer, release date, openness, price. |
| /data/scores.json · CSV | Every input score with evaluator, source file, verification link and retrieval time. |
| /data/index.json | Everything needed to recompute SI-IQ: parameters, reference group, inputs and intermediate values. |
| /data/evidence.jsonl | Every input row exactly as its source published it, with the source file's address and SHA-256. |
| /data/history.json | The daily inputs behind the history curves, so every point can be recomputed with the current parameters. |
| /data/LICENSES.md | Licences, required attributions and the changes we made, per source. |
| /data/compare.json | Compact data used by the comparison tool. |
| /status.json | When the data was last checked and changed, and which sources are working. |
Recompute SI-IQ yourself
/data/index.json contains the method version, every benchmark parameter (α, β, σ², ω, family, chance level, ceiling, number of questions), the constants λ and κ, the affine map (shift, scale), the reference group, and for every model each input score with its source URL, source file SHA-256, retrieval time and evaluation date, plus the intermediate values p, p*, y, v, the family factor f and the weight w. /data/evidence.jsonl has one line per input with the source row as published. The formulas are in the file itself and on the methodology page. Recomputing any model's SI-IQ from that file reproduces the published value.
Sources
- Aider polyglot leaderboard data (Apache-2.0) — https://aider.chat/docs/leaderboards/
- Arena leaderboard dataset on Hugging Face (CC BY 4.0) — https://huggingface.co/datasets/lmarena-ai/leaderboard-dataset
- Berkeley Function Calling Leaderboard, Gorilla project (Apache-2.0) — https://gorilla.cs.berkeley.edu/leaderboard.html
- Epoch AI, ‘Capabilities & benchmarking’ (CC BY 4.0) — https://epoch.ai/benchmarks
- API list prices via LiteLLM's price table (MIT); each price links to the developer's pricing page — https://github.com/BerriAI/litellm/blob/main/model_prices_and_context_window.json
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0 — https://openrouter.ai/api/v1/datasets/exports/README.md
The data files are refreshed every hour. /status.json shows when the data was last checked and last changed, and whether any source failed.