Models
Topics
Choose topic
258
Phi 4 Mini Reasoning486
Phi 4 Reasoning565
Refuel LLM 2 Small647
Claude Haiku 3654
GPT-4o mini679
Qwen 2.5 14B Instruct681
Hermes 4 405B Reasoning FP8689
Gemma 3 12B707
MiniMax M1708
Fauna Fox709
C4AI Aya Expanse 32B710
Switchpoint Router
714
DeepSeek-R1 Distill Qwen 14B724
Gemma 3 4B726
Llama 3.3 70BLast updated about 1 month ago
| Rank | Overall | Name | VIBE Score | Confidence Interval | Votes | Downvote % | Abort % | Speed | Latency | Context | Cost (Input) | Cost (Output) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 291 | Phi 4 Mini Reasoning | 258 | ±22 | 935 | 7.0% | 9.7% | 30 tps | 0.9s | 128K | $0.07 | $0.30 |
| 2 | 287 | Phi 4 Reasoning | 486 | ±32 | 530 | 2.8% | 21.0% | 29 tps | 1.0s | 33K | $0.06 | $0.25 |
| 3 | 339 | Refuel LLM 2 Small | 565 | ±27 | 525 | 2.8% | <0.1% | 116 tps | 0.5s | 8K | $0.20 | $0.20 |
| 4 | 241 | Claude Haiku 3 | 647 | ±42 | 525 | 2.8% | 0.4% | 62 tps | 0.5s | 200K | $0.25 | $1.25 |
| 5 | 201 | GPT-4o mini | 654 | ±30 | 515 | 4.6% | 2.1% | 71 tps | 1.7s | 128K | $0.15 | $0.60 |
| 6 | 209 | Qwen 2.5 14B Instruct | 679 | ±22 | 505 | 3.8% | 2.4% | 40 tps | 1.6s | 1M | $0.40 | $1.61 |
| 7 | 260 | Hermes 4 405B Reasoning FP8 | 681 | ±31 | 725 | 5.2% | 3.6% | 32 tps | 0.8s | 131K | $1.00 | $3.00 |
| 8 | 214 | Gemma 3 12B | 689 | ±23 | 550 | 4.3% | 4.2% | 73 tps | 0.8s | 131K | $0.05 | $0.12 |
| 9 | 284 | MiniMax M1 | 707 | ±14 | 1.5K | 1.0% | <0.1% | 31 tps | 2.8s | 1M | $0.55 | $2.20 |
| 10 | 182 | Fauna Fox | 708 | ±23 | 1.1K | 4.5% | <0.1% | 194 tps | 0.3s | 128K | $0.04 | $0.15 |
| 11 | 214 | C4AI Aya Expanse 32B | 709 | ±22 | 925 | 1.6% | 1.5% | 43 tps | 0.5s | 128K | $0.50 | $1.50 |
| 12 | 179 | Switchpoint Router | 710 | ±26 | 620 | 3.1% | 1.7% | 71 tps | 4.9s | 131K | $0.85 | $3.40 |
| 13 | 406 | DeepSeek-R1 Distill Qwen 14B | 714 | ±33 | 570 | 2.6% | <0.1% | 44 tps | 1.7s | 64K | $0.63 | $0.63 |
| 14 | 235 | Gemma 3 4B | 724 | ±24 | 660 | 3.6% | 1.3% | 138 tps | 0.7s | 131K | $0.02 | $0.04 |
| 15 | 194 | Llama 3.3 70B | 726 | ±26 | 735 | 5.2% | 0.3% | 500 tps | 0.5s | 8K | $0.48 | $0.66 |
| 16 | 241 |  Arcee AI Blitz | 728 | ±17 | 655 | 0.8% | <0.1% | 6 tps | N/A | 33K | $0.45 | $0.75 |
| 17 | 225 |  Command R | 730 | ±23 | 605 | 2.4% | 5.8% | 54 tps | 0.6s | 128K | $0.30 | $0.99 |
| 18 | 274 | DeepSeek-R1 Distill Qwen 32B | 736 | ±22 | 570 | 1.7% | 6.2% | 22 tps | 1.8s | 131K | $0.37 | $0.39 |
| 19 | 233 | Llama 3.1 70B Instruct Turbo | 739 | ±20 | 900 | 3.2% | <0.1% | 110 tps | 0.8s | 128K | $0.88 | $0.88 |
| 20 | 222 |  Jamba 1.5 Large | 744 | ±24 | 715 | 2.1% | 1.7% | 48 tps | 0.9s | 256K | $1.50 | $6.00 |
| 21 | 177 | Llama 3 70B Turbo | 755 | ±14 | 1.1K | 5.1% | <0.1% | 31 tps | 0.0s | 8K | $0.73 | $0.83 |
| 22 | 246 | DeepSeek-R1 Distill Llama 70B | 755 | ±19 | 960 | 2.5% | 3.6% | 27 tps | 1.6s | 32K | $0.73 | $0.95 |
| 23 | 186 | Jamba 1.6 Large | 761 | ±15 | 780 | 1.9% | 2.0% | 59 tps | 1.2s | 256K | $1.33 | $5.33 |
| 24 | 200 | K2 Think | 763 | ±24 | 605 | 0.8% | <0.1% | 418 tps | 2.8s | N/A | $0 | $0 |
| 25 | 270 |  Solar Pro 2 250710 (Reasoning) | 782 | ±22 | 605 | 1.6% | <0.1% | 9 tps | N/A | 66K | $0.50 | $0.50 |
| 26 | 229 |  Magistral Medium 2509 | 782 | ±28 | 550 | 7.6% | 4.0% | 58 tps | 0.9s | 131K | $2.00 | $5.00 |
| 27 | 200 |  NVIDIA Llama 3.1 Nemotron 70B | 783 | ±17 | 1.2K | 2.4% | <0.1% | 9 tps | 0.1s | 128K | $0.33 | $0.39 |
| 28 | 219 |  Grok 3 Mini Beta | 783 | ±17 | 605 | 0.8% | <0.1% | 75 tps | 0.5s | 131K | $0.45 | $2.25 |
| 29 | 225 | Command R 7B | 787 | ±26 | 660 | 2.9% | 1.1% | 76 tps | 0.4s | 128K | $0.04 | $0.15 |
| 30 | 292 | Arcee AI Spotlight | 788 | ±15 | 1.1K | 1.3% | <0.1% | 121 tps | 0.4s | 131K | $0.18 | $0.18 |
| 31 | 270 | AFM 4.5B Preview | 797 | ±38 | 610 | 3.9% | <0.1% | 32 tps | 0.0s | 66K | $0 | $0 |
| 32 | 277 | Grok 2 | 798 | ±18 | 555 | 0.9% | <0.1% | 55 tps | 1.1s | 131K | $2.00 | $10.00 |
| 33 | 179 |  Amazon Nova Pro 1.0 | 803 | ±13 | 1.2K | 2.0% | 0.9% | 96 tps | 0.7s | 300K | $0.80 | $1.70 |
| 34 | 186 | Grok 3 Mini Fast | 807 | ±14 | 2.4K | 1.8% | 1.6% | 44 tps | 0.5s | 131K | $0.60 | $4.00 |
| 35 | 186 | Gemma 3n E4B | 814 | ±17 | 1.6K | 3.6% | 2.0% | 30 tps | 0.5s | 8K | $0.01 | $0.02 |
| 36 | 235 |  GLM 4 32B | 820 | ±16 | 700 | 2.1% | 2.6% | 40 tps | 1.6s | 33K | $0.14 | $0.14 |
| 37 | 222 | Sky T1 32B Preview | 821 | ±18 | 625 | 1.6% | 7.8% | 73 tps | 0.6s | 16K | $0.12 | $0.18 |
| 38 | 277 |  Wikipedia | 821 | ±13 | 1.7K | 5.9% | <0.1% | 47 tps | 2.1s | 32K | $0 | $0 |
| 39 | 399 | Magistral Medium (Thinking) | 822 | ±24 | 600 | 1.6% | <0.1% | 67 tps | 0.8s | 41K | $2.00 | $5.00 |
| 40 | 314 | MAI-DS-R1 | 823 | ±19 | 855 | 4.5% | <0.1% | 73 tps | 3.2s | 64K | $0.10 | $0.40 |