Benchmark scores for recent small open-weight AI models.
Generated 2026-10-20T21:41:44Z
Listed by release date, newest first. Click any column header to sort (Params / Benchmarks / AA-Index sort numerically, Released by date; click again to flip direction; missing values sink to the bottom). A V badge marks models that support vision / multimodal (image) input.
| Model | Family | Params | Architecture | License | Released | Benchmarks | AA-Index-v4.3.2 |
|---|---|---|---|---|---|---|---|
| Spark-X2.6-4B | Spark X | 4.1B | dense | Apache 2.0 | 2026-10-19 | 27 | — |
| Ornith-1.5-122BV | Ornith | 125.1B | moe | MIT | 2026-10-16 | 13 | — |
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16V | Nemotron-3.5 | 124.5B | moe | other | 2026-10-12 | 37 | 26 |
| LFM2.5-24B-A2B | LFM2.5 | 24B | moe | other | 2026-10-12 | 16 | — |
| NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16V | Nemotron-3.5 | 74.9B | moe | other | 2026-10-09 | 18 | 21 |
| MiniCPM-V-4.7-35B-A3BV | MiniCPM-V-4.7-35B-A3B | 35.2B | moe | Apache 2.0 | 2026-10-07 | 33 | — |
| Agnes-3.0-FlashV | Agnes-3.0-Flash | 33.1B | dense | Apache 2.0 | 2026-09-11 | 6 | — |
| Nex-N2.5-miniV | Nex-N2.5 | 35.1B | moe | Apache 2.0 | 2026-09-08 | 16 | — |
| MiniCPM5-2B | MiniCPM5-2B | 2.5B | dense | Apache 2.0 | 2026-09-06 | 34 | 12 |
| Ling-3.0-flash-VLV | Ling-3.0-flash-VL | 124.8B | moe | MIT | 2026-09-04 | 13 | 25 |
| K2-Horizon-MoVA-36B-A4B | K2-Horizon-MoVA-36B-A4B | 37.4B | moe | Apache 2.0 | 2026-09-01 | 10 | 25 |
| K2-Horizon-7B | K2-Horizon-7B | 9B | dense | Apache 2.0 | 2026-09-01 | 9 | 21 |
| K2-Horizon-3.7B | K2-Horizon-3.7B | 5.1B | dense | Apache 2.0 | 2026-09-01 | 9 | 16 |
| Qwen3.8-Flash-NextV | Qwen3.8 | 180B | moe | other | 2026-08-24 | 23 | 40 |
| Ornith-1.5-9BV | Ornith | 9.7B | dense | MIT | 2026-08-18 | 13 | — |
| Ornith-1.5-35B-A3BV | Ornith | 36B | moe | MIT | 2026-08-18 | 15 | — |
| Ling-3.0-tiny | Ling | 7.9B | moe | MIT | 2026-08-10 | 18 | 11 |
| Muse-Glimmer-30BV | Muse-Glimmer-30B | 29.8B | dense | Apache 2.0 | 2026-08-09 | 28 | 17 |
| granite-4.2-30b | granite-4.2 | 29.3B | dense | Apache 2.0 | 2026-08-07 | 20 | 13 |
| granite-4.2-8b | granite-4.2 | 8.8B | dense | Apache 2.0 | 2026-08-07 | 20 | 11 |
| Qwen3.8-27BV | Qwen3.8 | 27.8B | dense | Apache 2.0 | 2026-08-05 | 26 | 34 |
| Ling-3.0-flash | Ling | 127.5B | moe | MIT | 2026-08-02 | 26 | 20 |
| NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 | Nemotron-3.5 | 31.6B | moe | other | 2026-08-01 | 15 | 13 |
| LongCat-Flash-Lite-Sparse | LongCat | 69.1B | dense | MIT | 2026-07-31 | 30 | 11 |
| KAT-Coder-V2.5-DevV | KAT-Coder | 34.7B | dense | Apache 2.0 | 2026-07-23 | 7 | — |
| Nanbeige4.2-3B | Nanbeige4.2 | 4.2B | dense | Apache 2.0 | 2026-07-21 | 21 | — |
| Laguna-S-2.1 | Laguna | 117.6B | moe | openmdw-1.1 | 2026-07-13 | 6 | — |
| DeepSeek-V4-Flash-DSpark | DeepSeek-V4 | 165.3B | moe | MIT | 2026-06-27 | 22 | 34 |
| Qwen-AgentWorld-35B-A3BV | Qwen-AgentWorld | 34.7B | moe | Apache 2.0 | 2026-06-22 | 1 | — |
| Laguna-XS-2.1 | Laguna | 33.4B | moe | openmdw-1.1 | 2026-06-20 | 4 | — |
| diffusiongemma-26B-A4B-itV | diffusiongemma | 25.8B | moe | Apache 2.0 | 2026-06-09 | 15 | 10 |
| North-Mini-Code-1.0 | North | 30.5B | moe | Apache 2.0 | 2026-06-05 | 10 | 10 |
| LFM2.5-8B-A1B | LFM2.5 | 8.5B | moe | other | 2026-05-28 | 13 | 7 |
| gemma-4-12B-itV | gemma-4 | 12B | dense | Apache 2.0 | 2026-05-23 | 17 | 14 |
Cell shows the score for that model×benchmark; grey = absent / no numeric score. Cell colour is scaled per benchmark (light → deep blue = lower → higher); the gold cell is the best model on that benchmark. Columns are ordered by how many models report each benchmark, and a column is hidden automatically while fewer than two models in the current filter report it (any version of its benchmark family counts). Click a benchmark column to rank models by it; click the Model column to sort by name.
| Model | Terminal-Bench 2.1 | Terminal-Bench 2.0 | Terminal-Bench 4 | Terminal-Bench Hard | GPQA Diamond | AA-Intelligence-Index -v4.3.2 | AA-Intelligence-Index -v4.3 | HLE | SWE-bench Pro | SWE-bench Verifi… | SciCode | IFBench | SWE-bench Multil… | τ³-bench | AA-LCR | AIME 2026 | AIME 2025 | BrowseComp | LiveCodeBench v6 | LiveCodeBench | LiveCodeBench 2408-2505 | BFCL v4 | BFCL v3 | HMMT Feb 2026 | HMMT Feb 2025 | MCP-Atlas | MMLU-Pro | τ²-bench | MathVision | AA-Omniscience A… | CharXiv | DeepSWE | DeepSWE 1.1 | GDPval-AA-V2 | IMO AnswerBench | MRCR | MRCR v2 | ClawEval | MMMU Pro | Multi-IF | NL2Repo-Bench | OmniDocBench 1.5 | AA-Omniscience I… | AA-Omniscience N… | IFEval | MATH500 | OSWorld-Verified | PinchBench | Toolathlon | Vision2Web | WideSearch | ClawEval-MM | Codeforces ELO | CritPt | GDPval | GDPval-AA | JobBench | LongBench-v2 | Toolathlon-Verif… | WebArena-Verifie… | Agents' Last Exa… | AndroidWorld | Apex Shortlist | Arena-Hard-V2 | ArtifactsBench | BabyVision | BigBench Extra H… | BirdBench | BrowseComp-zh | CMMLU | Claw-Gym | CoWorkBench | ERQA | GDP.pdf | GraphWalks | GraphWalks Exten… | LIFEbench | MMLU-ProX lite | MMMLU | MedXPertQA MM | OCRBench 2 | ProfBench | RULER | RealWorldQA | RecreationBench | SWE Atlas | SWE-MM | SkillsBench | SuperGPQA | WebVoyager |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen3.8-27BV | 73 | · | · | · | 89.2 | 34 | · | 30.8 | 61.7 | · | · | 79.5 | · | · | · | · | · | · | 90.3 | · | · | · | · | · | · | · | · | · | 94.6 | · | 90.2 | · | 42.2 | · | · | · | · | · | · | · | 42.3 | 91.1 | · | · | · | · | 84.3 | · | · | 62.9 | · | 57.4 | · | · | · | · | 33.4 | · | · | 64.8 | 42.9 | 81.9 | · | · | · | 85.6 | · | · | · | · | · | 70.7 | 65.5 | · | · | · | · | · | · | · | · | · | · | 85.9 | 47.1 | · | 38.6 | · | · | · |
| Qwen3.8-Flash-NextVMoE | · | · | · | · | 91.7 | 40 | · | 35.9 | 62.5 | · | · | 81.3 | 81 | · | · | · | · | · | 91.9 | · | · | · | · | · | · | · | · | · | 95.7 | · | 90.6 | · | 58.7 | · | · | · | · | · | · | · | 48.1 | · | · | · | · | · | · | · | 73.5 | 64 | · | 64.4 | · | · | · | · | 55.7 | · | · | · | 51.2 | 84.5 | · | · | · | · | · | · | · | · | · | 73.9 | 72.3 | · | · | · | · | · | · | · | · | · | · | 88.5 | 49.9 | · | · | · | · | · |
| Qwen-AgentWorld-35B-A3BVMoE | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · |
| gemma-4-12B-itV | · | · | · | · | 78.8 | 14 | · | 5.2 | · | · | · | · | · | · | · | 77.5 | · | · | 72 | · | · | · | · | · | · | · | 77.2 | 69 | 79.7 | · | · | · | · | · | · | · | 43.4 | · | 69.1 | · | · | 0.2 | · | · | · | · | · | · | · | · | · | · | 1659 | · | · | · | · | · | · | · | · | · | · | · | · | · | 53 | · | · | · | · | · | · | · | · | · | · | · | 83.4 | 48.7 | · | · | · | · | · | · | · | · | · | · |
| diffusiongemma-26B-A4B-itVMoE | · | · | · | · | 73.2 | 10 | · | 11.9 | · | · | · | · | · | · | · | 69.1 | · | · | 69.1 | · | · | · | · | · | · | · | 77.6 | 56.2 | 70.5 | · | · | · | · | · | · | · | 32 | · | 54.3 | · | · | 0.3 | · | · | · | · | · | · | · | · | · | · | 1429 | · | · | · | · | · | · | · | · | · | · | · | · | · | 47.6 | · | · | · | · | · | · | · | · | · | · | · | 81.5 | 49 | · | · | · | · | · | · | · | · | · | · |
| DeepSeek-V4-Flash-DSparkMoE | · | 56.9 | · | · | 88.1 | 34 | · | 45.1 | 52.6 | 79 | · | · | 73.3 | · | · | · | · | 73.2 | · | 91.6 | · | · | · | 94.8 | · | 69 | 86.2 | · | · | · | · | · | · | · | 88.4 | 78.7 | · | · | · | · | · | · | · | · | · | · | · | · | 47.8 | · | · | · | 3052 | · | · | 1395 | · | · | · | · | · | · | 85.7 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · |
| Laguna-S-2.1MoE | 70.2 | · | · | · | · | · | · | · | 59.4 | · | · | · | 78.5 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | 40.4 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | 49.7 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | 46.2 | · | · | · | · |
| Laguna-XS-2.1MoE | · | 37.5 | · | · | · | · | · | · | 47.6 | 70.9 | · | · | 63.1 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · |
| LFM2.5-8B-A1BMoE | · | · | · | · | · | 7 | · | · | · | · | · | 56.5 | · | · | · | 50 | 42.5 | · | · | · | · | 49.7 | 64.8 | · | · | · | · | 88.1 | · | 8.7 | · | · | · | · | · | · | · | · | · | 79.9 | · | · | -24.7 | 63.5 | 91.8 | 88.8 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · |
| Nanbeige4.2-3B | · | 44.1 | · | · | 87.4 | · | · | 17.8 | 46.9 | 63.6 | 35.6 | 54.6 | · | · | 58.7 | · | · | · | 72.5 | · | · | · | · | 82.8 | · | 57.8 | · | · | · | · | · | · | · | · | 67.3 | · | · | 52.2 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | 74.3 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | 65 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · |
| KAT-Coder-V2.5-DevV | 41.0 | · | · | · | · | · | · | · | 46.0 | 69.4 | 44.2 | · | 63 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | 93.4 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · |
| North-Mini-Code-1.0MoE | · | 36 | · | 31.1 | 75.7 | 10 | · | 11.1 | 40.2 | 67.6 | 38.2 | 57.5 | · | · | · | · | · | · | 70.3 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · |
| granite-4.2-30b | 29.2 | · | · | · | 66.4 | 13 | · | · | 33.3 | 57 | 38.8 | 77.2 | 41.9 | 62 | · | · | 89.2 | · | 75.8 | · | · | 61.4 | · | · | 89.2 | · | 77.6 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | 1225 | · | · | · | · | · | · | · | · | 67.9 | · | · | · | 41.9 | · | · | · | · | · | · | · | · | · | 66.6 | · | · | · | 42.9 | 90.0 | · | · | · | · | · | · | · |
| granite-4.2-8b | 20.6 | · | · | · | 64.1 | 11 | · | · | 19.1 | 47.7 | 36.1 | 79.3 | 30.8 | 58.1 | · | · | 86.7 | · | 73.2 | · | · | 52.4 | · | · | 78.3 | · | 74.0 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | 1189 | · | · | · | · | · | · | · | · | 65.2 | · | · | · | 41.1 | · | · | · | · | · | · | · | · | · | 61.1 | · | · | · | 41.2 | 81.0 | · | · | · | · | · | · | · |
| LongCat-Flash-Lite-Sparse | · | 33.7 | · | · | 69.5 | 11 | · | · | 40.6 | 68.2 | · | · | 59.3 | · | 48 | 65.7 | · | 48.6 | · | · | · | · | · | 41.5 | · | 45.6 | 79.2 | 96.0 | · | · | · | · | · | · | 49.4 | 44.7 | · | · | · | · | · | · | · | · | · | 96.8 | · | · | · | · | · | · | · | · | · | · | · | 53.6 | · | · | · | · | · | · | · | · | · | · | 61.9 | 84.5 | · | · | · | · | · | 66.3 | · | · | · | · | · | · | · | · | · | · | · | · | · | · |
| NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16MoE | 24.6 | · | · | · | 75.4 | 13 | · | 11.7 | · | 51.6 | 32.6 | 71.9 | 39.3 | 9.3 | 52 | · | · | 37.0 | · | · | · | · | · | · | · | · | 81.9 | · | · | · | · | · | · | 832 | · | · | · | · | · | · | · | · | · | · | · | · | · | 85.4 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · |
| Ornith-1.5-9BV | 47 | · | · | · | 86.4 | · | · | 30.5 | 47.5 | 70.6 | · | · | 54.4 | · | · | · | · | 56.4 | · | · | · | · | · | · | · | 54.2 | · | · | · | · | · | · | · | · | · | · | · | 66.5 | · | · | 32.4 | · | · | · | · | · | · | · | · | · | 59.5 | · | · | · | · | · | · | · | 41.2 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · |
| Ornith-1.5-35B-A3BVMoE | 68.5 | · | · | · | 89.2 | · | · | 33.4 | 59.6 | 79 | · | · | 71.4 | · | · | · | · | 67.6 | · | · | · | · | · | · | · | 70.2 | · | · | · | · | · | 22 | · | · | · | · | · | 72.5 | · | · | 46.2 | · | · | · | · | · | · | · | 48.7 | · | 67.8 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | 39.8 | · | · | · | · |
| Ling-3.0-tinyMoE | 27.7 | · | · | · | 73.4 | 11 | · | 9.3 | · | · | 24.2 | 63.6 | · | 20.8 | 58.7 | · | · | · | · | · | · | 62.7 | · | 70.3 | · | · | · | · | · | 8.5 | · | · | · | · | 71.0 | · | · | · | · | 83.2 | · | · | · | 69.5 | · | · | · | · | · | · | · | · | · | · | · | 772 | · | · | · | · | · | · | · | · | 47.9 | · | · | · | · | · | · | · | · | · | · | · | 62.3 | · | · | · | · | · | · | · | · | · | · | · | · | · |
| Ling-3.0-flashMoE | 57 | · | · | · | · | 20 | · | 22.7 | 56.6 | · | · | 74.5 | 72.4 | 28 | 65.1 | 93.2 | · | 82 | · | · | 82.8 | 73 | · | 87 | · | 65.5 | · | · | · | · | · | · | · | · | 83.7 | 90.8 | · | · | · | 87.7 | · | · | · | · | · | · | · | · | · | · | 73.6 | · | · | · | · | 1107 | · | · | · | · | · | · | · | · | 77 | · | · | · | · | · | · | · | · | · | · | · | 77.3 | · | · | · | · | · | · | · | · | · | · | 44.8 | · | · |
| K2-Horizon-MoVA-36B-A4BMoE | 58.6 | · | · | · | 80.8 | 25 | · | 25.2 | · | · | 38.9 | · | · | 26.8 | 66.3 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | 18.8 | · | · | · | · | · | · | · | · | · | · | · | · | · | 69.2 | · | · | · | · | · | · | · | · | · | 2.1 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · |
| K2-Horizon-7B | 39.1 | · | · | · | · | 21 | · | 18.6 | · | 70.6 | 31.6 | · | · | 25.8 | 68 | · | · | 59 | · | · | · | · | · | 73.3 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · |
| MiniCPM5-2B | 8.6 | · | · | · | 70.2 | 12 | · | 8.9 | 14.4 | 46.4 | 26.3 | 66.3 | · | 20.8 | 59 | 86.5 | 86.5 | 39.7 | 69.1 | · | · | 66.6 | · | 63.8 | · | · | 70.8 | 97.1 | · | · | · | · | · | 19.6 | · | · | · | · | · | 71.8 | · | · | · | · | 86.7 | 94.6 | · | · | · | · | · | · | · | · | · | · | · | 43.7 | · | · | · | · | · | · | · | · | · | · | 43.5 | · | 59.2 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | 40.8 | · |
| Nex-N2.5-miniVMoE | 73.4 | · | · | · | · | · | · | · | 43.8 | · | · | · | · | · | · | · | · | 83.4 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | 36.1 | 1446 | · | · | · | · | · | · | · | · | · | · | · | · | 71.2 | · | · | 52.9 | · | · | · | · | · | · | 28.5 | · | 54.6 | 63.4 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | 25.5 | · | · | · |
| Ling-3.0-flash-VLVMoE | · | · | · | · | · | 25 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | 84.9 | · | 81.3 | · | · | · | · | · | · | · | 79 | · | · | 91.3 | · | · | · | · | · | · | · | 57.7 | · | 59.9 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | 90.8 |
| Muse-Glimmer-30BV | 51.7 | · | · | · | 83.5 | 17 | · | 22 | 51.2 | 76 | 43.6 | 77 | · | 23.5 | 80 | 94.7 | · | · | · | · | · | · | · | · | · | 75.5 | · | · | · | · | 78.8 | · | · | 953 | · | · | · | · | 74 | · | · | 75.8 | · | · | · | · | 65.9 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | 44.3 | · | · |
| Agnes-3.0-FlashV | · | · | · | · | 85.0 | · | 36 | · | · | · | 38.1 | 74.2 | · | · | 68.3 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | 23 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · |
| K2-Horizon-3.7B | 25.1 | · | · | · | 65.4 | 16 | · | 12.9 | · | 68.6 | 25.9 | · | · | 17.7 | · | · | · | · | · | · | · | 50.9 | · | 70.5 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · |
| MiniCPM-V-4.7-35B-A3BVMoE | · | · | · | · | · | · | · | · | · | · | · | 47.7 | · | · | · | 76.5 | · | · | 56.6 | · | · | 60.1 | · | · | · | · | 83.5 | 84.7 | 74.2 | · | 75.6 | · | · | · | · | · | · | · | 69.7 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | 90.2 | · | · | · | · | · | · | · | · | · | · | 68.5 | · | · | · | · | · | · | · | 61.2 | · |
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16VMoE | 66.7 | · | 1 | · | 89.5 | 26 | · | 31.8 | 51.8 | 71.1 | 47.1 | 70.9 | 67.7 | 18.9 | 68.6 | · | · | 78 | 88.2 | · | · | · | · | · | · | · | · | 73.2 | 78.2 | 26.2 | 80.8 | 24.6 | · | 1211 | · | · | · | · | · | · | · | · | 4.0 | · | · | · | 51.1 | · | · | · | · | · | · | 10.9 | · | · | · | · | · | · | · | · | 88.4 | · | · | 29.6 | · | · | · | · | · | · | · | 6.6 | 89.7 | · | · | · | · | · | 68.1 | · | · | · | · | · | · | · | · | 77.7 |
| NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16VMoE | 53.9 | · | 0 | · | 88.8 | 21 | · | 28.7 | · | · | 44.5 | · | · | 17.0 | 67.4 | · | · | 70 | · | · | · | · | · | · | · | 55.6 | · | · | · | 21.8 | · | · | · | 979.0 | · | · | · | · | · | · | · | · | -19.2 | 56.1 | · | · | · | 90.3 | · | · | · | · | · | 4.3 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | 2.8 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · |
| Spark-X2.6-4B | · | · | · | · | 77.1 | · | · | 17.9 | 54.3 | 62.8 | 36.8 | 75.8 | 64.7 | 34.7 | 67.3 | 91.2 | · | 53.1 | · | · | · | 71.8 | · | 81.3 | · | 62.4 | · | 86.9 | · | · | · | · | · | · | 75.2 | · | 65.6 | 69.9 | · | · | · | · | · | · | 93.6 | · | · | · | · | · | · | · | · | · | · | · | · | 53.3 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | 92.2 | 34.2 | · | · | · | · | · | · | · | · | · | · | · | · | · | · |
| Ornith-1.5-122BVMoE | 81.2 | · | · | · | · | · | · | 48 | 76.9 | 84.5 | 53.8 | · | 76.4 | · | · | · | · | 78.5 | · | · | · | · | · | · | · | 74.6 | · | · | · | · | · | · | · | · | · | · | · | 79.4 | · | · | 51.2 | · | · | · | · | · | · | · | · | · | 75.2 | · | · | · | · | · | · | · | 70.8 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · |
| LFM2.5-24B-A2BMoE | · | · | · | · | 74.4 | · | · | 7.4 | · | 51 | 32.7 | 74.7 | · | 8.0 | · | · | · | · | · | · | · | 65.0 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | 84.4 | · | · | -24.9 | · | 96.8 | 96.0 | · | 83.2 | · | · | · | · | · | · | · | · | · | · | · | 26.8 | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · | · |
Bar charts compare the top 10 models (by score) that report the same benchmark (≥2 models within the parameter range above). Hover a bar for the exact value.
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Ornith-1.5-122B | 81.2 | % | Claude Code 2.1.126, avg of 5 runs | Hugging Face model card | link |
| Nex-N2.5-mini | 73.4 | % | Hugging Face model card | link | |
| Qwen3.8-27B | 73 | % | Terminus | Hugging Face model card | link |
| Laguna-S-2.1 | 70.2 | % | Hugging Face model card | link | |
| Ornith-1.5-35B-A3B | 68.5 | % | Claude Code | Hugging Face model card | link |
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 66.7 | Hugging Face model card | link | ||
| K2-Horizon-MoVA-36B-A4B | 58.6 | % | Hugging Face model card | link | |
| Ling-3.0-flash | 57 | % | Hugging Face model card | link | |
| NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16 | 53.9 | Hugging Face model card | link | ||
| Muse-Glimmer-30B | 51.7 | % | with terminus2 | Hugging Face model card | link |
| Ornith-1.5-9B | 47 | % | Claude Code | Hugging Face model card | link |
| KAT-Coder-V2.5-Dev | 41.0 | % | avg of two harnesses | Hugging Face model card | link |
| K2-Horizon-7B | 39.1 | % | Hugging Face model card | link | |
| granite-4.2-30b | 29.2 | % | Hugging Face model card | link | |
| Ling-3.0-tiny | 27.7 | % | Hugging Face model card | link | |
| K2-Horizon-3.7B | 25.1 | % | Hugging Face model card | link | |
| NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 | 24.6 | % | Hugging Face model card | link | |
| granite-4.2-8b | 20.6 | % | Hugging Face model card | link | |
| MiniCPM5-2B | 8.6 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| DeepSeek-V4-Flash-DSpark | 56.9 | % | Hugging Face model card | link | |
| Nanbeige4.2-3B | 44.1 | % | Hugging Face model card | link | |
| Laguna-XS-2.1 | 37.5 | % | pass@1 (avg over 5 attempts) | Hugging Face model card | link |
| North-Mini-Code-1.0 | 36 | % | Hugging Face model card | link | |
| LongCat-Flash-Lite-Sparse | 33.7 | % | w/o HI | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 1 | offline eval | Hugging Face model card | link | |
| NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16 | 0 | % | AA run, labeled Terminal-Bench 4.0 | Artificial Analysis | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| North-Mini-Code-1.0 | 31.1 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Qwen3.8-Flash-Next | 91.7 | % | Hugging Face model card | link | |
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 89.5 | Hugging Face model card | link | ||
| Qwen3.8-27B | 89.2 | % | Hugging Face model card | link | |
| Ornith-1.5-35B-A3B | 89.2 | % | Hugging Face model card | link | |
| NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16 | 88.8 | Hugging Face model card | link | ||
| DeepSeek-V4-Flash-DSpark | 88.1 | % | Pass@1 | Hugging Face model card | link |
| Nanbeige4.2-3B | 87.4 | % | Hugging Face model card | link | |
| Ornith-1.5-9B | 86.4 | % | Hugging Face model card | link | |
| Agnes-3.0-Flash | 85.0 | % | Hugging Face model card | link | |
| Muse-Glimmer-30B | 83.5 | % | high reasoning | Hugging Face model card | link |
| K2-Horizon-MoVA-36B-A4B | 80.8 | % | Hugging Face model card | link | |
| gemma-4-12B-it | 78.8 | % | Hugging Face model card | link | |
| Spark-X2.6-4B | 77.1 | % | high reasoning | Hugging Face model card | link |
| North-Mini-Code-1.0 | 75.7 | % | Overall | Artificial Analysis | link |
| NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 | 75.4 | % | no tools | Hugging Face model card | link |
| LFM2.5-24B-A2B | 74.4 | % | Hugging Face model card | link | |
| Ling-3.0-tiny | 73.4 | % | Hugging Face model card | link | |
| diffusiongemma-26B-A4B-it | 73.2 | % | Hugging Face model card | link | |
| MiniCPM5-2B | 70.2 | % | Hugging Face model card | link | |
| LongCat-Flash-Lite-Sparse | 69.5 | % | avg@16, w/o HI | Hugging Face model card | link |
| granite-4.2-30b | 66.4 | % | Hugging Face model card | link | |
| K2-Horizon-3.7B | 65.4 | % | Hugging Face model card | link | |
| granite-4.2-8b | 64.1 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Qwen3.8-Flash-Next | 40 | index | Artificial Analysis | link | |
| Qwen3.8-27B | 34 | index | reasoning level: Xhigh (highest) | Artificial Analysis | link |
| DeepSeek-V4-Flash-DSpark | 34 | index | reasoning level: Max (highest) | Artificial Analysis | link |
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 26 | index | Artificial Analysis | link | |
| K2-Horizon-MoVA-36B-A4B | 25 | index | Artificial Analysis | link | |
| Ling-3.0-flash-VL | 25 | index | Artificial Analysis | link | |
| K2-Horizon-7B | 21 | index | Artificial Analysis | link | |
| NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16 | 21 | index | Artificial Analysis | link | |
| Ling-3.0-flash | 20 | index | Artificial Analysis | link | |
| Muse-Glimmer-30B | 17 | index | reasoning level: High (highest) | Artificial Analysis | link |
| K2-Horizon-3.7B | 16 | index | Artificial Analysis | link | |
| gemma-4-12B-it | 14 | index | reasoning level: Reasoning (highest) | Artificial Analysis | link |
| granite-4.2-30b | 13 | index | Artificial Analysis | link | |
| NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 | 13 | index | Artificial Analysis | link | |
| MiniCPM5-2B | 12 | index | Artificial Analysis | link | |
| granite-4.2-8b | 11 | index | Artificial Analysis | link | |
| LongCat-Flash-Lite-Sparse | 11 | index | Artificial Analysis | link | |
| Ling-3.0-tiny | 11 | index | Artificial Analysis | link | |
| diffusiongemma-26B-A4B-it | 10 | index | Artificial Analysis | link | |
| North-Mini-Code-1.0 | 10 | index | Artificial Analysis | link | |
| LFM2.5-8B-A1B | 7 | index | Artificial Analysis | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Agnes-3.0-Flash | 36 | points | Artificial Analysis | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Ornith-1.5-122B | 48 | % | with tools | Hugging Face model card | link |
| DeepSeek-V4-Flash-DSpark | 45.1 | % | with tools, Pass@1 | Hugging Face model card | link |
| Qwen3.8-Flash-Next | 35.9 | % | Hugging Face model card | link | |
| Ornith-1.5-35B-A3B | 33.4 | % | with tools | Hugging Face model card | link |
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 31.8 | text-only | Hugging Face model card | link | |
| Qwen3.8-27B | 30.8 | % | Hugging Face model card | link | |
| Ornith-1.5-9B | 30.5 | % | with tools | Hugging Face model card | link |
| NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16 | 28.7 | no tools | Hugging Face model card | link | |
| K2-Horizon-MoVA-36B-A4B | 25.2 | % | no tools | Hugging Face model card | link |
| Ling-3.0-flash | 22.7 | % | Hugging Face model card | link | |
| Muse-Glimmer-30B | 22 | % | high reasoning, text | Hugging Face model card | link |
| K2-Horizon-7B | 18.6 | % | Hugging Face model card | link | |
| Spark-X2.6-4B | 17.9 | % | w/o tools, high reasoning | Hugging Face model card | link |
| Nanbeige4.2-3B | 17.8 | % | w/o search | Hugging Face model card | link |
| K2-Horizon-3.7B | 12.9 | % | Hugging Face model card | link | |
| diffusiongemma-26B-A4B-it | 11.9 | % | with search | Hugging Face model card | link |
| NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 | 11.7 | % | text-only, no tools | Hugging Face model card | link |
| North-Mini-Code-1.0 | 11.1 | % | Overall | Artificial Analysis | link |
| Ling-3.0-tiny | 9.3 | % | Hugging Face model card | link | |
| MiniCPM5-2B | 8.9 | % | Hugging Face model card | link | |
| LFM2.5-24B-A2B | 7.4 | % | Hugging Face model card | link | |
| gemma-4-12B-it | 5.2 | % | no tools | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Ornith-1.5-122B | 76.9 | % | no-hack, OpenHands harness | Hugging Face model card | link |
| Qwen3.8-Flash-Next | 62.5 | % | Hugging Face model card | link | |
| Qwen3.8-27B | 61.7 | % | Hugging Face model card | link | |
| Ornith-1.5-35B-A3B | 59.6 | % | Hugging Face model card | link | |
| Laguna-S-2.1 | 59.4 | % | Public Dataset | Hugging Face model card | link |
| Ling-3.0-flash | 56.6 | % | Hugging Face model card | link | |
| Spark-X2.6-4B | 54.3 | % | high reasoning | Hugging Face model card | link |
| DeepSeek-V4-Flash-DSpark | 52.6 | % | Resolved | Hugging Face model card | link |
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 51.8 | Hugging Face model card | link | ||
| Muse-Glimmer-30B | 51.2 | % | Hugging Face model card | link | |
| Laguna-XS-2.1 | 47.6 | % | Public Dataset, pass@1 (avg over 2 attempts) | Hugging Face model card | link |
| Ornith-1.5-9B | 47.5 | % | Hugging Face model card | link | |
| Nanbeige4.2-3B | 46.9 | % | Hugging Face model card | link | |
| KAT-Coder-V2.5-Dev | 46.0 | % | pass@1 | Hugging Face model card | link |
| Nex-N2.5-mini | 43.8 | % | Hugging Face model card | link | |
| LongCat-Flash-Lite-Sparse | 40.6 | % | w/o HI | Hugging Face model card | link |
| North-Mini-Code-1.0 | 40.2 | % | Overall | Hugging Face model card | link |
| granite-4.2-30b | 33.3 | % | Hugging Face model card | link | |
| granite-4.2-8b | 19.1 | % | Hugging Face model card | link | |
| MiniCPM5-2B | 14.4 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Ornith-1.5-122B | 84.5 | % | non-hack, OpenHands harness | Hugging Face model card | link |
| DeepSeek-V4-Flash-DSpark | 79 | % | Resolved | Hugging Face model card | link |
| Ornith-1.5-35B-A3B | 79 | % | Hugging Face model card | link | |
| Muse-Glimmer-30B | 76 | % | Hugging Face model card | link | |
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 71.1 | Hugging Face model card | link | ||
| Laguna-XS-2.1 | 70.9 | % | pass@1 (avg over 4 attempts) | Hugging Face model card | link |
| Ornith-1.5-9B | 70.6 | % | Hugging Face model card | link | |
| K2-Horizon-7B | 70.6 | % | Hugging Face model card | link | |
| KAT-Coder-V2.5-Dev | 69.4 | % | pass@1 | Hugging Face model card | link |
| K2-Horizon-3.7B | 68.6 | % | Hugging Face model card | link | |
| LongCat-Flash-Lite-Sparse | 68.2 | % | w/o HI | Hugging Face model card | link |
| North-Mini-Code-1.0 | 67.6 | % | Overall | Hugging Face model card | link |
| Nanbeige4.2-3B | 63.6 | % | Hugging Face model card | link | |
| Spark-X2.6-4B | 62.8 | % | high reasoning | Hugging Face model card | link |
| granite-4.2-30b | 57 | % | Hugging Face model card | link | |
| NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 | 51.6 | % | Overall | Hugging Face model card | link |
| LFM2.5-24B-A2B | 51 | % | OpenCode harness | Hugging Face model card | link |
| granite-4.2-8b | 47.7 | % | Hugging Face model card | link | |
| MiniCPM5-2B | 46.4 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Ornith-1.5-122B | 53.8 | % | Hugging Face model card | link | |
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 47.1 | subtask-level | Hugging Face model card | link | |
| NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16 | 44.5 | Hugging Face model card | link | ||
| KAT-Coder-V2.5-Dev | 44.2 | % | pass@1 | Hugging Face model card | link |
| Muse-Glimmer-30B | 43.6 | % | Hugging Face model card | link | |
| K2-Horizon-MoVA-36B-A4B | 38.9 | % | Overall | Hugging Face model card | link |
| granite-4.2-30b | 38.8 | % | Hugging Face model card | link | |
| North-Mini-Code-1.0 | 38.2 | % | Overall | Hugging Face model card | link |
| Agnes-3.0-Flash | 38.1 | % | Hugging Face model card | link | |
| Spark-X2.6-4B | 36.8 | % | high reasoning | Hugging Face model card | link |
| granite-4.2-8b | 36.1 | % | Hugging Face model card | link | |
| Nanbeige4.2-3B | 35.6 | % | Hugging Face model card | link | |
| LFM2.5-24B-A2B | 32.7 | % | Hugging Face model card | link | |
| NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 | 32.6 | % | Overall | Hugging Face model card | link |
| K2-Horizon-7B | 31.6 | % | Overall | Hugging Face model card | link |
| MiniCPM5-2B | 26.3 | % | Hugging Face model card | link | |
| K2-Horizon-3.7B | 25.9 | % | Overall | Hugging Face model card | link |
| Ling-3.0-tiny | 24.2 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Qwen3.8-Flash-Next | 81.3 | % | Hugging Face model card | link | |
| Qwen3.8-27B | 79.5 | % | Hugging Face model card | link | |
| granite-4.2-8b | 79.3 | % | prompt | Hugging Face model card | link |
| granite-4.2-30b | 77.2 | % | prompt | Hugging Face model card | link |
| Muse-Glimmer-30B | 77 | % | high reasoning | Hugging Face model card | link |
| Spark-X2.6-4B | 75.8 | % | high reasoning | Hugging Face model card | link |
| LFM2.5-24B-A2B | 74.7 | % | Hugging Face model card | link | |
| Ling-3.0-flash | 74.5 | % | Hugging Face model card | link | |
| Agnes-3.0-Flash | 74.2 | % | Hugging Face model card | link | |
| NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 | 71.9 | % | loose | Hugging Face model card | link |
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 70.9 | Hugging Face model card | link | ||
| MiniCPM5-2B | 66.3 | % | Hugging Face model card | link | |
| Ling-3.0-tiny | 63.6 | % | Hugging Face model card | link | |
| North-Mini-Code-1.0 | 57.5 | % | Overall | Artificial Analysis | link |
| LFM2.5-8B-A1B | 56.5 | % | Hugging Face model card | link | |
| Nanbeige4.2-3B | 54.6 | % | Hugging Face model card | link | |
| MiniCPM-V-4.7-35B-A3B | 47.7 | % | instruct | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Qwen3.8-Flash-Next | 81 | % | Hugging Face model card | link | |
| Laguna-S-2.1 | 78.5 | % | Hugging Face model card | link | |
| Ornith-1.5-122B | 76.4 | % | non-hack, OpenHands harness | Hugging Face model card | link |
| DeepSeek-V4-Flash-DSpark | 73.3 | % | Resolved | Hugging Face model card | link |
| Ling-3.0-flash | 72.4 | % | Hugging Face model card | link | |
| Ornith-1.5-35B-A3B | 71.4 | % | Hugging Face model card | link | |
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 67.7 | Hugging Face model card | link | ||
| Spark-X2.6-4B | 64.7 | % | high reasoning | Hugging Face model card | link |
| Laguna-XS-2.1 | 63.1 | % | pass@1 (avg over 4 attempts) | Hugging Face model card | link |
| KAT-Coder-V2.5-Dev | 63 | % | pass@1 | Hugging Face model card | link |
| LongCat-Flash-Lite-Sparse | 59.3 | % | w/o HI | Hugging Face model card | link |
| Ornith-1.5-9B | 54.4 | % | Hugging Face model card | link | |
| granite-4.2-30b | 41.9 | % | Hugging Face model card | link | |
| NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 | 39.3 | % | Overall | Hugging Face model card | link |
| granite-4.2-8b | 30.8 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| granite-4.2-30b | 62 | % | avg | Hugging Face model card | link |
| granite-4.2-8b | 58.1 | % | avg | Hugging Face model card | link |
| Spark-X2.6-4B | 34.7 | % | high reasoning | Hugging Face model card | link |
| Ling-3.0-flash | 28 | % | Banking | Hugging Face model card | link |
| K2-Horizon-MoVA-36B-A4B | 26.8 | % | Banking | Hugging Face model card | link |
| K2-Horizon-7B | 25.8 | % | Banking | Hugging Face model card | link |
| Muse-Glimmer-30B | 23.5 | % | Banking | Hugging Face model card | link |
| Ling-3.0-tiny | 20.8 | % | Banking | Hugging Face model card | link |
| MiniCPM5-2B | 20.8 | % | Banking | Hugging Face model card | link |
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 18.9 | Banking | Hugging Face model card | link | |
| K2-Horizon-3.7B | 17.7 | % | Banking | Hugging Face model card | link |
| NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16 | 17.0 | Banking | Hugging Face model card | link | |
| NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 | 9.3 | % | Banking | Hugging Face model card | link |
| LFM2.5-24B-A2B | 8.0 | % | Banking | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Muse-Glimmer-30B | 80 | % | Hugging Face model card | link | |
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 68.6 | v1.1 | Hugging Face model card | link | |
| Agnes-3.0-Flash | 68.3 | % | Hugging Face model card | link | |
| K2-Horizon-7B | 68 | % | Overall | Hugging Face model card | link |
| NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16 | 67.4 | Hugging Face model card | link | ||
| Spark-X2.6-4B | 67.3 | % | v1.1, high reasoning | Hugging Face model card | link |
| K2-Horizon-MoVA-36B-A4B | 66.3 | % | Overall | Hugging Face model card | link |
| Ling-3.0-flash | 65.1 | % | Hugging Face model card | link | |
| MiniCPM5-2B | 59 | % | Hugging Face model card | link | |
| Nanbeige4.2-3B | 58.7 | % | Hugging Face model card | link | |
| Ling-3.0-tiny | 58.7 | % | Hugging Face model card | link | |
| NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 | 52 | idx | Overall | Hugging Face model card | link |
| LongCat-Flash-Lite-Sparse | 48 | % | w/o HI | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Muse-Glimmer-30B | 94.7 | % | high reasoning | Hugging Face model card | link |
| Ling-3.0-flash | 93.2 | % | Hugging Face model card | link | |
| Spark-X2.6-4B | 91.2 | % | high reasoning | Hugging Face model card | link |
| MiniCPM5-2B | 86.5 | % | Hugging Face model card | link | |
| gemma-4-12B-it | 77.5 | % | no tools | Hugging Face model card | link |
| MiniCPM-V-4.7-35B-A3B | 76.5 | % | avg@16, instruct | Hugging Face model card | link |
| diffusiongemma-26B-A4B-it | 69.1 | % | no tools | Hugging Face model card | link |
| LongCat-Flash-Lite-Sparse | 65.7 | % | avg@32, w/o HI | Hugging Face model card | link |
| LFM2.5-8B-A1B | 50 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| granite-4.2-30b | 89.2 | % | Hugging Face model card | link | |
| granite-4.2-8b | 86.7 | % | Hugging Face model card | link | |
| MiniCPM5-2B | 86.5 | % | Hugging Face model card | link | |
| LFM2.5-8B-A1B | 42.5 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Nex-N2.5-mini | 83.4 | % | Hugging Face model card | link | |
| Ling-3.0-flash | 82 | % | multi-agent | Hugging Face model card | link |
| Ornith-1.5-122B | 78.5 | % | Hugging Face model card | link | |
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 78 | Hugging Face model card | link | ||
| DeepSeek-V4-Flash-DSpark | 73.2 | % | Pass@1 | Hugging Face model card | link |
| NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16 | 70 | Hugging Face model card | link | ||
| Ornith-1.5-35B-A3B | 67.6 | % | Hugging Face model card | link | |
| K2-Horizon-7B | 59 | % | Hugging Face model card | link | |
| Ornith-1.5-9B | 56.4 | % | Hugging Face model card | link | |
| Spark-X2.6-4B | 53.1 | % | high reasoning | Hugging Face model card | link |
| LongCat-Flash-Lite-Sparse | 48.6 | % | pass@1, w/o HI | Hugging Face model card | link |
| MiniCPM5-2B | 39.7 | % | Top100 | Hugging Face model card | link |
| NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 | 37.0 | % | Overall | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Qwen3.8-Flash-Next | 91.9 | % | Hugging Face model card | link | |
| Qwen3.8-27B | 90.3 | % | Hugging Face model card | link | |
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 88.2 | Hugging Face model card | link | ||
| granite-4.2-30b | 75.8 | % | Hugging Face model card | link | |
| granite-4.2-8b | 73.2 | % | Hugging Face model card | link | |
| Nanbeige4.2-3B | 72.5 | % | Hugging Face model card | link | |
| gemma-4-12B-it | 72 | % | Hugging Face model card | link | |
| North-Mini-Code-1.0 | 70.3 | % | Hugging Face model card | link | |
| diffusiongemma-26B-A4B-it | 69.1 | % | Hugging Face model card | link | |
| MiniCPM5-2B | 69.1 | % | Hugging Face model card | link | |
| MiniCPM-V-4.7-35B-A3B | 56.6 | % | instruct | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| DeepSeek-V4-Flash-DSpark | 91.6 | % | Pass@1 | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Ling-3.0-flash | 82.8 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Ling-3.0-flash | 73 | % | Hugging Face model card | link | |
| Spark-X2.6-4B | 71.8 | % | high reasoning | Hugging Face model card | link |
| MiniCPM5-2B | 66.6 | % | Hugging Face model card | link | |
| LFM2.5-24B-A2B | 65.0 | % | Hugging Face model card | link | |
| Ling-3.0-tiny | 62.7 | % | Hugging Face model card | link | |
| granite-4.2-30b | 61.4 | % | Hugging Face model card | link | |
| MiniCPM-V-4.7-35B-A3B | 60.1 | % | instruct | Hugging Face model card | link |
| granite-4.2-8b | 52.4 | % | Hugging Face model card | link | |
| K2-Horizon-3.7B | 50.9 | % | Hugging Face model card | link | |
| LFM2.5-8B-A1B | 49.7 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| LFM2.5-8B-A1B | 64.8 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| DeepSeek-V4-Flash-DSpark | 94.8 | % | Pass@1 | Hugging Face model card | link |
| Ling-3.0-flash | 87 | % | Hugging Face model card | link | |
| Nanbeige4.2-3B | 82.8 | % | Hugging Face model card | link | |
| Spark-X2.6-4B | 81.3 | % | high reasoning | Hugging Face model card | link |
| K2-Horizon-7B | 73.3 | % | Hugging Face model card | link | |
| K2-Horizon-3.7B | 70.5 | % | Hugging Face model card | link | |
| Ling-3.0-tiny | 70.3 | % | Hugging Face model card | link | |
| MiniCPM5-2B | 63.8 | % | Hugging Face model card | link | |
| LongCat-Flash-Lite-Sparse | 41.5 | % | avg@32, w/ HI | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| granite-4.2-30b | 89.2 | % | Hugging Face model card | link | |
| granite-4.2-8b | 78.3 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Muse-Glimmer-30B | 75.5 | % | Public | Hugging Face model card | link |
| Ornith-1.5-122B | 74.6 | % | thinking mode, 500-task public subset | Hugging Face model card | link |
| Ornith-1.5-35B-A3B | 70.2 | % | Hugging Face model card | link | |
| DeepSeek-V4-Flash-DSpark | 69 | % | Pass@1 | Hugging Face model card | link |
| Ling-3.0-flash | 65.5 | % | Hugging Face model card | link | |
| Spark-X2.6-4B | 62.4 | % | high reasoning | Hugging Face model card | link |
| Nanbeige4.2-3B | 57.8 | % | Hugging Face model card | link | |
| NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16 | 55.6 | Hugging Face model card | link | ||
| Ornith-1.5-9B | 54.2 | % | Hugging Face model card | link | |
| LongCat-Flash-Lite-Sparse | 45.6 | % | w/o HI | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| DeepSeek-V4-Flash-DSpark | 86.2 | % | EM | Hugging Face model card | link |
| MiniCPM-V-4.7-35B-A3B | 83.5 | % | instruct | Hugging Face model card | link |
| NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 | 81.9 | % | Overall | Hugging Face model card | link |
| LongCat-Flash-Lite-Sparse | 79.2 | % | w/o HI | Hugging Face model card | link |
| diffusiongemma-26B-A4B-it | 77.6 | % | Hugging Face model card | link | |
| granite-4.2-30b | 77.6 | % | Hugging Face model card | link | |
| gemma-4-12B-it | 77.2 | % | Hugging Face model card | link | |
| granite-4.2-8b | 74.0 | % | Hugging Face model card | link | |
| MiniCPM5-2B | 70.8 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| MiniCPM5-2B | 97.1 | % | Telecom | Hugging Face model card | link |
| LongCat-Flash-Lite-Sparse | 96.0 | % | Telecom, avg@4, w/ HI | Hugging Face model card | link |
| LFM2.5-8B-A1B | 88.1 | % | Telecom | Hugging Face model card | link |
| Spark-X2.6-4B | 86.9 | % | high reasoning | Hugging Face model card | link |
| MiniCPM-V-4.7-35B-A3B | 84.7 | % | instruct | Hugging Face model card | link |
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 73.2 | Telecom | Hugging Face model card | link | |
| gemma-4-12B-it | 69 | % | average over 3 | Hugging Face model card | link |
| diffusiongemma-26B-A4B-it | 56.2 | % | average over 3 | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Qwen3.8-Flash-Next | 95.7 | % | with CI | Hugging Face model card | link |
| Qwen3.8-27B | 94.6 | % | with CI | Hugging Face model card | link |
| Ling-3.0-flash-VL | 84.9 | % | Hugging Face model card | link | |
| gemma-4-12B-it | 79.7 | % | Hugging Face model card | link | |
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 78.2 | Hugging Face model card | link | ||
| MiniCPM-V-4.7-35B-A3B | 74.2 | % | 4x visual token compression, instruct | Hugging Face model card | link |
| diffusiongemma-26B-A4B-it | 70.5 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 26.2 | Hugging Face model card | link | ||
| Agnes-3.0-Flash | 23 | % | Hugging Face model card | link | |
| NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16 | 21.8 | Hugging Face model card | link | ||
| K2-Horizon-MoVA-36B-A4B | 18.8 | % | Hugging Face model card | link | |
| LFM2.5-8B-A1B | 8.7 | % | Hugging Face model card | link | |
| Ling-3.0-tiny | 8.5 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Qwen3.8-Flash-Next | 90.6 | % | RQ, with CI | Hugging Face model card | link |
| Qwen3.8-27B | 90.2 | % | RQ with CI | Hugging Face model card | link |
| Ling-3.0-flash-VL | 81.3 | % | RQ | Hugging Face model card | link |
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 80.8 | reasoning split | Hugging Face model card | link | |
| Muse-Glimmer-30B | 78.8 | % | Reasoning | Hugging Face model card | link |
| MiniCPM-V-4.7-35B-A3B | 75.6 | % | Reasoning, 4x compression, instruct | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Laguna-S-2.1 | 40.4 | % | Hugging Face model card | link | |
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 24.6 | offline eval | Hugging Face model card | link | |
| Ornith-1.5-35B-A3B | 22 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Qwen3.8-Flash-Next | 58.7 | % | Hugging Face model card | link | |
| Qwen3.8-27B | 42.2 | % | Hugging Face model card | link | |
| Nex-N2.5-mini | 36.1 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Nex-N2.5-mini | 1446 | points | Overall | Hugging Face model card | link |
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 1211 | points | overall | Hugging Face model card | link |
| NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16 | 979.0 | points | overall, AA run (AA labels this GDPval-AA v2.1) | Artificial Analysis | link |
| Muse-Glimmer-30B | 953 | points | Overall | Hugging Face model card | link |
| NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 | 832 | points | Overall | Hugging Face model card | link |
| MiniCPM5-2B | 19.6 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| DeepSeek-V4-Flash-DSpark | 88.4 | % | Pass@1 | Hugging Face model card | link |
| Ling-3.0-flash | 83.7 | % | Hugging Face model card | link | |
| Spark-X2.6-4B | 75.2 | % | high reasoning | Hugging Face model card | link |
| Ling-3.0-tiny | 71.0 | % | Hugging Face model card | link | |
| Nanbeige4.2-3B | 67.3 | % | Hugging Face model card | link | |
| LongCat-Flash-Lite-Sparse | 49.4 | % | avg@4, w/o HI | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Ling-3.0-flash | 90.8 | % | 128K | Hugging Face model card | link |
| DeepSeek-V4-Flash-DSpark | 78.7 | % | 1M | Hugging Face model card | link |
| LongCat-Flash-Lite-Sparse | 44.7 | % | 8-needle, w/o HI | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Spark-X2.6-4B | 65.6 | % | 256k-512k context, high reasoning | Hugging Face model card | link |
| gemma-4-12B-it | 43.4 | % | 8 needle 128k (average) | Hugging Face model card | link |
| diffusiongemma-26B-A4B-it | 32 | % | 8 needle 128k (average) | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Ornith-1.5-122B | 79.4 | % | 256K context | Hugging Face model card | link |
| Ornith-1.5-35B-A3B | 72.5 | % | Hugging Face model card | link | |
| Spark-X2.6-4B | 69.9 | % | EN, high reasoning | Hugging Face model card | link |
| Ornith-1.5-9B | 66.5 | % | Hugging Face model card | link | |
| Nanbeige4.2-3B | 52.2 | % | pass^3 | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Ling-3.0-flash-VL | 79 | % | Hugging Face model card | link | |
| Muse-Glimmer-30B | 74 | % | Hugging Face model card | link | |
| MiniCPM-V-4.7-35B-A3B | 69.7 | % | 4x visual token compression, instruct | Hugging Face model card | link |
| gemma-4-12B-it | 69.1 | % | Hugging Face model card | link | |
| diffusiongemma-26B-A4B-it | 54.3 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Ling-3.0-flash | 87.7 | % | Hugging Face model card | link | |
| LFM2.5-24B-A2B | 84.4 | % | Hugging Face model card | link | |
| Ling-3.0-tiny | 83.2 | % | Hugging Face model card | link | |
| LFM2.5-8B-A1B | 79.9 | % | Hugging Face model card | link | |
| MiniCPM5-2B | 71.8 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Ornith-1.5-122B | 51.2 | % | 400K context, 48K output | Hugging Face model card | link |
| Qwen3.8-Flash-Next | 48.1 | % | Hugging Face model card | link | |
| Ornith-1.5-35B-A3B | 46.2 | % | Hugging Face model card | link | |
| Qwen3.8-27B | 42.3 | % | Hugging Face model card | link | |
| Ornith-1.5-9B | 32.4 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Ling-3.0-flash-VL | 91.3 | % | Hugging Face model card | link | |
| Qwen3.8-27B | 91.1 | % | Hugging Face model card | link | |
| Muse-Glimmer-30B | 75.8 | % | Hugging Face model card | link | |
| diffusiongemma-26B-A4B-it | 0.3 | avg edit distance | Hugging Face model card | link | |
| gemma-4-12B-it | 0.2 | avg edit distance | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 4.0 | idx | Hugging Face model card | link | |
| NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16 | -19.2 | idx | Artificial Analysis | link | |
| LFM2.5-8B-A1B | -24.7 | idx | Hugging Face model card | link | |
| LFM2.5-24B-A2B | -24.9 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Ling-3.0-tiny | 69.5 | % | Hugging Face model card | link | |
| K2-Horizon-MoVA-36B-A4B | 69.2 | % | Hugging Face model card | link | |
| LFM2.5-8B-A1B | 63.5 | % | Hugging Face model card | link | |
| NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16 | 56.1 | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| LFM2.5-24B-A2B | 96.8 | % | Hugging Face model card | link | |
| Spark-X2.6-4B | 93.6 | % | high reasoning | Hugging Face model card | link |
| LFM2.5-8B-A1B | 91.8 | % | Hugging Face model card | link | |
| MiniCPM5-2B | 86.7 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| LongCat-Flash-Lite-Sparse | 96.8 | % | w/ HI | Hugging Face model card | link |
| LFM2.5-24B-A2B | 96.0 | % | Hugging Face model card | link | |
| MiniCPM5-2B | 94.6 | % | Hugging Face model card | link | |
| LFM2.5-8B-A1B | 88.8 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Qwen3.8-27B | 84.3 | % | Hugging Face model card | link | |
| Nex-N2.5-mini | 71.2 | % | NexCUA harness | Hugging Face model card | link |
| Muse-Glimmer-30B | 65.9 | % | Hugging Face model card | link | |
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 51.1 | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| KAT-Coder-V2.5-Dev | 93.4 | % | pass@1 | Hugging Face model card | link |
| NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16 | 90.3 | Hugging Face model card | link | ||
| NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 | 85.4 | % | Overall | Hugging Face model card | link |
| LFM2.5-24B-A2B | 83.2 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Qwen3.8-Flash-Next | 73.5 | % | Verified, Pass@1 | Hugging Face model card | link |
| Laguna-S-2.1 | 49.7 | % | Verified | Hugging Face model card | link |
| Ornith-1.5-35B-A3B | 48.7 | % | Verified | Hugging Face model card | link |
| DeepSeek-V4-Flash-DSpark | 47.8 | % | Pass@1 | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Qwen3.8-Flash-Next | 64 | % | Hugging Face model card | link | |
| Qwen3.8-27B | 62.9 | % | Hugging Face model card | link | |
| Ling-3.0-flash-VL | 57.7 | % | Hugging Face model card | link | |
| Nex-N2.5-mini | 52.9 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Ornith-1.5-122B | 75.2 | % | Hugging Face model card | link | |
| Ling-3.0-flash | 73.6 | % | Hugging Face model card | link | |
| Ornith-1.5-35B-A3B | 67.8 | % | Hugging Face model card | link | |
| Ornith-1.5-9B | 59.5 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Qwen3.8-Flash-Next | 64.4 | % | Pass@3 | Hugging Face model card | link |
| Ling-3.0-flash-VL | 59.9 | % | Hugging Face model card | link | |
| Qwen3.8-27B | 57.4 | % | pass@3 | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| DeepSeek-V4-Flash-DSpark | 3052 | rating | Hugging Face model card | link | |
| gemma-4-12B-it | 1659 | rating | Hugging Face model card | link | |
| diffusiongemma-26B-A4B-it | 1429 | rating | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 10.9 | Hugging Face model card | link | ||
| NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16 | 4.3 | % | Artificial Analysis | link | |
| K2-Horizon-MoVA-36B-A4B | 2.1 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| granite-4.2-30b | 1225 | score | Hugging Face model card | link | |
| granite-4.2-8b | 1189 | points | Hugging Face model card | link | |
| Nanbeige4.2-3B | 74.3 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| DeepSeek-V4-Flash-DSpark | 1395 | Elo | Hugging Face model card | link | |
| Ling-3.0-flash | 1107 | points | v2 | Hugging Face model card | link |
| Ling-3.0-tiny | 772 | points | v2 | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Qwen3.8-Flash-Next | 55.7 | % | Hugging Face model card | link | |
| Qwen3.8-27B | 33.4 | % | Hugging Face model card | link | |
| Nex-N2.5-mini | 28.5 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| LongCat-Flash-Lite-Sparse | 53.6 | % | w/ HI | Hugging Face model card | link |
| Spark-X2.6-4B | 53.3 | % | high reasoning | Hugging Face model card | link |
| MiniCPM5-2B | 43.7 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Ornith-1.5-122B | 70.8 | % | 128K max tokens | Hugging Face model card | link |
| Nex-N2.5-mini | 54.6 | % | Hugging Face model card | link | |
| Ornith-1.5-9B | 41.2 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Qwen3.8-27B | 64.8 | % | Hugging Face model card | link | |
| Nex-N2.5-mini | 63.4 | % | NexCUA harness | Hugging Face model card | link |
| LFM2.5-24B-A2B | 26.8 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Qwen3.8-Flash-Next | 51.2 | score | Score | Hugging Face model card | link |
| Qwen3.8-27B | 42.9 | % | score | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Qwen3.8-Flash-Next | 84.5 | % | Hugging Face model card | link | |
| Qwen3.8-27B | 81.9 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 88.4 | Hugging Face model card | link | ||
| DeepSeek-V4-Flash-DSpark | 85.7 | % | Pass@1 | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| granite-4.2-30b | 67.9 | % | Hugging Face model card | link | |
| granite-4.2-8b | 65.2 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Ling-3.0-flash | 77 | % | Hugging Face model card | link | |
| Ling-3.0-tiny | 47.9 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Qwen3.8-27B | 85.6 | % | with CI | Hugging Face model card | link |
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 29.6 | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| gemma-4-12B-it | 53 | % | Hugging Face model card | link | |
| diffusiongemma-26B-A4B-it | 47.6 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| granite-4.2-30b | 41.9 | % | Hugging Face model card | link | |
| granite-4.2-8b | 41.1 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| LongCat-Flash-Lite-Sparse | 61.9 | % | pass@1, w/o HI | Hugging Face model card | link |
| MiniCPM5-2B | 43.5 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| MiniCPM-V-4.7-35B-A3B | 90.2 | % | instruct | Hugging Face model card | link |
| LongCat-Flash-Lite-Sparse | 84.5 | % | w/ HI | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Nanbeige4.2-3B | 65 | % | Hugging Face model card | link | |
| MiniCPM5-2B | 59.2 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Qwen3.8-Flash-Next | 73.9 | % | Hugging Face model card | link | |
| Qwen3.8-27B | 70.7 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Qwen3.8-Flash-Next | 72.3 | % | Hugging Face model card | link | |
| Qwen3.8-27B | 65.5 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 6.6 | offline eval | Hugging Face model card | link | |
| NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16 | 2.8 | % | AA all-pass | Artificial Analysis | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Spark-X2.6-4B | 92.2 | % | BFS, 256k context, F1 | Hugging Face model card | link |
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 89.7 | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| LongCat-Flash-Lite-Sparse | 66.3 | % | w/o HI | Hugging Face model card | link |
| Spark-X2.6-4B | 34.2 | % | BFS, 1M context, F1 | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Ling-3.0-flash | 77.3 | % | Hugging Face model card | link | |
| Ling-3.0-tiny | 62.3 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| granite-4.2-30b | 66.6 | % | Hugging Face model card | link | |
| granite-4.2-8b | 61.1 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| gemma-4-12B-it | 83.4 | % | Hugging Face model card | link | |
| diffusiongemma-26B-A4B-it | 81.5 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| diffusiongemma-26B-A4B-it | 49 | % | Hugging Face model card | link | |
| gemma-4-12B-it | 48.7 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| MiniCPM-V-4.7-35B-A3B | 68.5 | % | 4x visual token compression, instruct | Hugging Face model card | link |
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 68.1 | EN | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| granite-4.2-30b | 42.9 | % | Hugging Face model card | link | |
| granite-4.2-8b | 41.2 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| granite-4.2-30b | 90.0 | % | 64K | Hugging Face model card | link |
| granite-4.2-8b | 81.0 | % | 64K | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Qwen3.8-Flash-Next | 88.5 | % | Hugging Face model card | link | |
| Qwen3.8-27B | 85.9 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Qwen3.8-Flash-Next | 49.9 | % | Hugging Face model card | link | |
| Qwen3.8-27B | 47.1 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Laguna-S-2.1 | 46.2 | % | Codebase QnA | Hugging Face model card | link |
| Ornith-1.5-35B-A3B | 39.8 | % | QnA | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Qwen3.8-27B | 38.6 | % | Hugging Face model card | link | |
| Nex-N2.5-mini | 25.5 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Ling-3.0-flash | 44.8 | % | Hugging Face model card | link | |
| Muse-Glimmer-30B | 44.3 | % | with skills | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| MiniCPM-V-4.7-35B-A3B | 61.2 | % | instruct | Hugging Face model card | link |
| MiniCPM5-2B | 40.8 | % | Hugging Face model card | link |
| Model | Score | Metric | Subtask | Source | URL |
|---|---|---|---|---|---|
| Ling-3.0-flash-VL | 90.8 | % | Hugging Face model card | link | |
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 | 77.7 | offline eval | Hugging Face model card | link |