1206
Mistral Medium 3.11125
Ministral 8B 25121080
Mistral Medium970
Mistral Small 3.2 24B962
Devstral Medium952
Magistral Medium948
Ministral 14B 3.0916
Devstral Small908
Magistral Small 2506903
Mistral Small 3.2 24B Instruct883
Magistral Medium 2509880
Magistral Small 2507875
Mistral Medium 3871
Mixtral 8x22B871
Devstral Small 2505Last updated about 1 month ago
| Rank | Overall | Name | VIBE Score | Confidence Interval | Votes | Downvote % | Abort % | Speed | Latency | Context | Cost (Input) | Cost (Output) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 53 | Mistral Medium 3.1 | 1206 | ±5 | 16.4K | 5.1% | <0.1% | 77 tps | 0.7s | 128K | $0.40 | $2.00 |
| 2 | 97 | Ministral 8B 2512 | 1125 | ±15 | 510 | 7.3% | <0.1% | 174 tps | 0.5s | 128K | $0.15 | $0.15 |
| 3 | 105 | Mistral Medium | 1080 | ±4 | 9.6K | 5.6% | 1.8% | 48 tps | 0.6s | 33K | $1.48 | $4.55 |
| 4 | 167 | Mistral Small 3.2 24B | 970 | ±13 | 4.6K | 4.9% | 2.8% | 141 tps | 0.7s | 33K | $0.02 | $0.08 |
| 5 | 167 | Devstral Medium | 962 | ±11 | 3.5K | 5.2% | 1.5% | 77 tps | 0.6s | 131K | $0.40 | $2.00 |
| 6 | 230 | Magistral Medium | 952 | ±16 | 1.3K | 10.8% | <0.1% | 95 tps | 0.5s | 41K | $2.00 | $5.00 |
| 7 | 179 | Ministral 14B 3.0 | 948 | ±16 | 805 | 8.5% | 2.0% | 119 tps | 0.5s | 128K | $0.20 | $0.20 |
| 8 | 189 | Devstral Small | 916 | ±17 | 1.4K | 5.0% | 2.4% | 180 tps | 0.6s | 131K | $0.10 | $0.30 |
| 9 | 201 | Magistral Small 2506 | 908 | ±11 | 4.3K | 3.1% | 1.6% | 156 tps | 0.5s | 40K | $0.37 | $1.10 |
| 10 | 201 | Mistral Small 3.2 24B Instruct | 903 | ±20 | 850 | 8.6% | 1.9% | 113 tps | 1.1s | 131K | $0.02 | $0.08 |
| 11 | 210 | Magistral Medium 2509 | 883 | ±16 | 2.6K | 9.5% | 4.0% | 58 tps | 0.9s | 131K | $2.00 | $5.00 |
| 12 | 280 | Magistral Small 2507 | 880 | ±19 | 730 | 13.1% | <0.1% | 148 tps | 0.4s | 41K | $0.50 | $1.50 |
| 13 | 210 | Mistral Medium 3 | 875 | ±23 | 485 | 6.7% | 2.4% | 47 tps | 0.8s | 33K | $0.40 | $2.00 |
| 14 | 210 | Mixtral 8x22B | 871 | ±22 | 1.3K | 5.0% | 1.2% | 140 tps | 0.6s | 64K | $2.00 | $6.00 |
| 15 | 293 | Devstral Small 2505 | 871 | ±15 | 1.7K | 6.2% | <0.1% | 141 tps | 1.3s | 33K | $0.03 | $0.09 |
| 16 | 210 | Ministral 3B 2512 | 854 | ±57 | 515 | 8.0% | 2.8% | 339 tps | 0.6s | 131K | $0.10 | $0.10 |
| 17 | 346 | Magistral Medium (Thinking) | 804 | ±10 | 2.2K | 5.7% | <0.1% | 67 tps | 0.8s | 41K | $2.00 | $5.00 |
| 18 | 252 | Magistral Small 2509 | 802 | ±18 | 1.8K | 7.5% | 2.7% | 116 tps | 0.6s | 131K | $0.50 | $1.50 |
| 19 | 346 | Magistral Medium 2507 | 795 | ±25 | 665 | 14.2% | <0.1% | 86 tps | 0.7s | 41K | $2.00 | $5.00 |
| 20 | 252 | Mistral Large | 785 | ±16 | 1.1K | 5.8% | 1.5% | 54 tps | 0.7s | 33K | $2.00 | $6.00 |
| 21 | 262 | Open Mistral 7B | 762 | ±18 | 1.3K | 4.7% | 0.7% | 176 tps | 0.4s | 33K | $0.25 | $0.25 |
| 22 | 374 | Mistral Nemo 12B Celeste V1.9 | 725 | ±18 | 1.1K | 3.5% | <0.1% | 6 tps | 10.2s | 8K | $0.80 | $1.20 |
| 23 | 269 |  DeepHermes 3 Mistral 24B Preview | 706 | ±30 | 715 | 5.9% | 2.5% | 50 tps | 1.0s | 33K | $0.06 | $0.25 |
| 24 | 374 |  Dolphin 3.0 R1 Mistral 24B | 701 | ±16 | 890 | 7.8% | <0.1% | 13 tps | 0.1s | 33K | $0.03 | $0.09 |
| 25 | 399 | Mistral Nemo 12B Inferor v0.0 | 454 | ±28 | 565 | 1.7% | <0.1% | 83 tps | 0.8s | 16K | $0.80 | $1.20 |