Neura Intelligence Index
Back to Leaderboard
SWE-bench Verified
Real-world GitHub issue resolution — 500 verified problems from popular Python repos.
Model Rankings (112)
| # | Model | Score | Provider | Source |
|---|---|---|---|---|
| 1 | 95 | Anthropic | verified | |
| 2 | 93.9 | Anthropic | verified | |
| 3 | 88.6 | Anthropic | verified | |
| 4 | 87.6 | Anthropic | verified | |
| 5 | 85.2 | Anthropic | verified | |
| 6 | 80.9 | Anthropic | verified | |
| 7 | 80.8 | Anthropic | verified | |
| 8 | 80.6 | DeepSeek | verified | |
| 9 | 80.6 | verified | ||
| 10 | 80.5 | MiniMax | verified | |
| 11 | Q Qwen3.7 Max🇨🇳 | 80.4 | Alibaba Cloud / Qwen Team | verified |
| 12 | M Kimi K2.6🇨🇳 | 80.2 | Moonshot AI | verified |
| 13 | 80.2 | MiniMax | verified | |
| 14 | 80 | OpenAI | verified | |
| 15 | 79.6 | Anthropic | verified | |
| 16 | 79 | DeepSeek | verified | |
| 17 | X MiMo-V2.5-Pro🇨🇳 | 78.9 | Xiaomi | verified |
| 18 | Q Qwen3.6 Plus🇨🇳 | 78.8 | Alibaba Cloud / Qwen Team | verified |
| 19 | T Hy3🇨🇳 | 78 | Tencent | verified |
| 20 | X MiMo-V2-Pro🇨🇳 | 78 | Xiaomi | verified |
| 21 | 78 | verified | ||
| 22 | Z GLM-5🇨🇳 | 77.8 | Zhipu AI | verified |
| 23 | Q Qwen3.7-Plus🇨🇳 | 77.7 | Alibaba Cloud / Qwen Team | verified |
| 24 | 77.6 | Mistral AI | verified | |
| 25 | M Muse Spark🇺🇸 | 77.4 | Meta | verified |
| 26 | Q Qwen3.6-27B🇨🇳 | 77.2 | Alibaba Cloud / Qwen Team | verified |
| 27 | M Kimi K2.5🇨🇳 | 76.8 | Moonshot AI | verified |
| 28 | B Seed 2.0 Pro🇨🇳 | 76.5 | ByteDance | verified |
| 29 | Q Qwen3.5-397B-A17B🇨🇳 | 76.4 | Alibaba Cloud / Qwen Team | verified |
| 30 | 76.3 | OpenAI | verified | |
| 31 | 76.3 | OpenAI | verified | |
| 32 | 76.3 | OpenAI | verified | |
| 33 | 76.2 | verified | ||
| 34 | 74.9 | OpenAI | verified | |
| 35 | X MiMo-V2-Omni🇨🇳 | 74.8 | Xiaomi | verified |
| 36 | 74.5 | Anthropic | verified | |
| 37 | 74.5 | OpenAI | verified | |
| 38 | S Step-3.5-Flash🇨🇳 | 74.4 | StepFun | verified |
| 39 | Z GLM-4.7🇨🇳 | 73.8 | Zhipu AI | verified |
| 40 | 73.7 | OpenAI | verified | |
| 41 | B Seed 2.0 Lite🇨🇳 | 73.5 | ByteDance | verified |
| 42 | 73.5 | Microsoft | verified | |
| 43 | Q Qwen3.6-35B-A3B🇨🇳 | 73.4 | Alibaba Cloud / Qwen Team | verified |
| 44 | X MiMo-V2-Flash🇨🇳 | 73.4 | Xiaomi | verified |
| 45 | 73.3 | Anthropic | verified | |
| 46 | 73.1 | DeepSeek | verified | |
| 47 | 73.1 | DeepSeek | verified | |
| 48 | 73.1 | DeepSeek | verified | |
| 49 | 72.7 | Anthropic | ||
| 50 | 72.7 | Anthropic | verified | |
| 51 | 72.5 | Anthropic | verified | |
| 52 | Q Qwen3.5-27B🇨🇳 | 72.4 | Alibaba Cloud / Qwen Team | verified |
| 53 | Q Qwen3.5-122B-A10B🇨🇳 | 72 | Alibaba Cloud / Qwen Team | verified |
| 54 | 71.6 | Microsoft | verified | |
| 55 | M Kimi K2-Thinking-0905🇨🇳 | 71.3 | Moonshot AI | verified |
| 56 | X Grok Code Fast 1🇺🇸 | 70.8 | xAI | verified |
| 57 | 70.7 | NVIDIA | verified | |
| 58 | 70.3 | Anthropic | verified | |
| 59 |  Nova 2 Pro🇺🇸 | 70 | Amazon | verified |
| 60 | M LongCat-Flash-Thinking-2601🇨🇳 | 70 | Meituan | verified |
| 61 | Q Qwen3 Max🇨🇳 | 69.6 | Alibaba Cloud / Qwen Team | verified |
| 62 | Q Qwen3-Coder 480B A35B Instruct🇨🇳 | 69.6 | Alibaba Cloud / Qwen Team | verified |
| 63 | 69.4 | MiniMax | verified | |
| 64 | Q Qwen3.5-35B-A3B🇨🇳 | 69.2 | Alibaba Cloud / Qwen Team | verified |
| 65 | 69.1 | OpenAI | ||
| 66 | 69.1 | OpenAI | verified | |
| 67 | 68.1 | OpenAI | verified | |
| 68 | Z GLM-4.6🇨🇳 | 68 | Zhipu AI | verified |
| 69 | 67.8 | DeepSeek | verified | |
| 70 | 67.6 | Cohere | verified | |
| 71 | 67.2 | verified | ||
| 72 | 67 | MiniMax | verified | |
| 73 | 66 | DeepSeek | verified | |
| 74 | M Kimi K2-Instruct-0905🇨🇳 | 65.8 | Moonshot AI | verified |
| 75 | Nova 2 Lite🇺🇸 | 64.5 | Amazon | verified |
| 76 | Z GLM-4.5🇨🇳 | 64.2 | Zhipu AI | verified |
| 77 | 63.2 | verified | ||
| 78 | 61.6 | Mistral AI | verified | |
| 79 | 60.4 | verified | ||
| 80 | M LongCat-Flash-Chat🇨🇳 | 60.4 | Meituan | verified |
| 81 | M LongCat-Flash-Thinking🇨🇳 | 59.4 | Meituan | verified |
| 82 | Z GLM-4.7-Flash🇨🇳 | 59.2 | Zhipu AI | verified |
| 83 | Z GLM-4.5-Air🇨🇳 | 57.6 | Zhipu AI | verified |
| 84 | 56 | MiniMax | verified | |
| 85 | 55.8 | Anthropic | ||
| 86 | 55.6 | MiniMax | verified | |
| 87 | 54.6 | OpenAI | verified | |
| 88 | M LongCat-Flash-Lite🇨🇳 | 54.4 | Meituan | verified |
| 89 | 53.7 | NVIDIA | verified | |
| 90 | 53.6 | Mistral AI | verified | |
| 91 | 53.2 | Anthropic | ||
| 92 | 49.3 | OpenAI | verified | |
| 93 | 49 | Anthropic | verified | |
| 94 | 49 | Anthropic | ||
| 95 | 48.9 | OpenAI | ||
| 96 | S Sarvam-105B🇮🇳 | 45 | Sarvam AI | verified |
| 97 | 44.6 | DeepSeek | verified | |
| 98 | 42 | DeepSeek | verified | |
| 99 | 41.3 | OpenAI | verified | |
| 100 | 41 | OpenAI | verified | |
| 101 | 40.6 | Anthropic | verified | |
| 102 | 38.8 | NVIDIA | verified | |
| 103 | 38 | OpenAI | verified | |
| 104 | S Sarvam-30B🇮🇳 | 34 | Sarvam AI | verified |
| 105 | 33.2 | OpenAI | ||
| 106 | 33.2 | OpenAI | verified | |
| 107 | 31.6 | verified | ||
| 108 | 26.6 | Cognition | ||
| 109 | 23.6 | OpenAI | verified | |
| 110 | 22.9 | verified | ||
| 111 | 16.8 | DeepSeek | verified | |
| 112 | 8.7 | OpenAI | verified |