1206
Mistral Medium 3.11131
Mistral Large 31125
Ministral 8B 25121080
Mistral Medium980
Mistral Small 3.1 24B Instruct970
Mistral Small 3.2 24B969
Pixtral Large962
Devstral Medium952
Magistral Medium948
Ministral 14B 3.0931
Codestral925
Mistral Small 3.1918
Open Mistral Nemo916
Devstral Small908
Magistral Small 2506Last updated about 1 month ago
| Rank | Overall | Name | VIBE Score | Confidence Interval | Votes | Downvote % | Abort % | Speed | Latency | Context | Cost (Input) | Cost (Output) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 53 | Mistral Medium 3.1 | 1206 | ±5 | 16.4K | 5.1% | <0.1% | 77 tps | 0.7s | 128K | $0.40 | $2.00 |
| 2 | 77 | Mistral Large 3 | 1131 | ±8 | 5.4K | 5.8% | 2.1% | 51 tps | 1.0s | 256K | $0.50 | $1.50 |
| 3 | 97 | Ministral 8B 2512 | 1125 | ±15 | 510 | 7.3% | <0.1% | 174 tps | 0.5s | 128K | $0.15 | $0.15 |
| 4 | 105 | Mistral Medium | 1080 | ±4 | 9.6K | 5.6% | 1.8% | 48 tps | 0.6s | 33K | $1.48 | $4.55 |
| 5 | 159 | Mistral Small 3.1 24B Instruct | 980 | ±11 | 2.9K | 4.3% | 7.5% | 15 tps | 2.4s | 131K | $0.06 | $0.18 |
| 6 | 167 | Mistral Small 3.2 24B | 970 | ±13 | 4.6K | 4.9% | 2.8% | 141 tps | 0.7s | 33K | $0.02 | $0.08 |
| 7 | 167 | Pixtral Large | 969 | ±14 | 3.5K | 3.9% | 2.5% | 57 tps | 1.3s | 128K | $1.50 | $4.50 |
| 8 | 167 | Devstral Medium | 962 | ±11 | 3.5K | 5.2% | 1.5% | 77 tps | 0.6s | 131K | $0.40 | $2.00 |
| 9 | 230 | Magistral Medium | 952 | ±16 | 1.3K | 10.8% | <0.1% | 95 tps | 0.5s | 41K | $2.00 | $5.00 |
| 10 | 179 | Ministral 14B 3.0 | 948 | ±16 | 805 | 8.5% | 2.0% | 119 tps | 0.5s | 128K | $0.20 | $0.20 |
| 11 | 189 | Codestral | 931 | ±19 | 855 | 6.0% | 5.2% | 151 tps | 0.9s | 262K | $0.15 | $0.45 |
| 12 | 189 | Mistral Small 3.1 | 925 | ±14 | 2.4K | 4.0% | 7.4% | 13 tps | 2.6s | 32K | $0.17 | $0.28 |
| 13 | 189 | Open Mistral Nemo | 918 | ±21 | 1.7K | 4.5% | 1.5% | 171 tps | 0.5s | 131K | $0.15 | $0.15 |
| 14 | 189 | Devstral Small | 916 | ±17 | 1.4K | 5.0% | 2.4% | 180 tps | 0.6s | 131K | $0.10 | $0.30 |
| 15 | 201 | Magistral Small 2506 | 908 | ±11 | 4.3K | 3.1% | 1.6% | 156 tps | 0.5s | 40K | $0.37 | $1.10 |
| 16 | 201 | Mistral Small 3.2 24B Instruct | 903 | ±20 | 850 | 8.6% | 1.9% | 113 tps | 1.1s | 131K | $0.02 | $0.08 |
| 17 | 210 | Magistral Medium 2509 | 883 | ±16 | 2.6K | 9.5% | 4.0% | 58 tps | 0.9s | 131K | $2.00 | $5.00 |
| 18 | 280 | Magistral Small 2507 | 880 | ±19 | 730 | 13.1% | <0.1% | 148 tps | 0.4s | 41K | $0.50 | $1.50 |
| 19 | 210 | Mistral Small 3 24B Instruct | 880 | ±10 | 1.7K | 3.6% | 2.6% | 77 tps | 0.6s | 33K | $0.07 | $0.14 |
| 20 | 210 | Mistral Medium 3 | 875 | ±23 | 485 | 6.7% | 2.4% | 47 tps | 0.8s | 33K | $0.40 | $2.00 |
| 21 | 210 | Mistral Nemo | 875 | ±15 | 915 | 2.7% | <0.1% | 112 tps | 0.4s | 131K | $0.07 | $0.13 |
| 22 | 210 | Mixtral 8x22B | 871 | ±22 | 1.3K | 5.0% | 1.2% | 140 tps | 0.6s | 64K | $2.00 | $6.00 |
| 23 | 293 | Devstral Small 2505 | 871 | ±15 | 1.7K | 6.2% | <0.1% | 141 tps | 1.3s | 33K | $0.03 | $0.09 |
| 24 | 210 | Mistral Small 24B Instruct | 864 | ±16 | 1.5K | 4.1% | 1.5% | 84 tps | 0.4s | 33K | $0.80 | $0.80 |
| 25 | 210 | Mixtral 8x7B | 855 | ±18 | 1.3K | 5.1% | 2.2% | 142 tps | 0.6s | 33K | $0.23 | $0.23 |
| 26 | 210 | Ministral 3B 2512 | 854 | ±57 | 515 | 8.0% | 2.8% | 339 tps | 0.6s | 131K | $0.10 | $0.10 |
| 27 | 210 | Mixtral 8x7B Instruct | 854 | ±16 | 1.4K | 4.4% | 0.2% | 79 tps | 0.7s | 33K | $0.23 | $0.31 |
| 28 | 240 | Mixtral-8x7B Instruct v0.1 | 832 | ±23 | 1.3K | 4.6% | 1.3% | 54 tps | 0.4s | 33K | $0.60 | $0.60 |
| 29 | 240 | Ministral 8B | 825 | ±17 | 2.2K | 5.5% | 1.4% | 177 tps | 0.4s | 128K | $0.14 | $0.14 |
| 30 | 252 | Ministral 3B | 806 | ±16 | 2.3K | 5.1% | 0.8% | 248 tps | 0.4s | 131K | $0.08 | $0.08 |
| 31 | 346 | Magistral Medium (Thinking) | 804 | ±10 | 2.2K | 5.7% | <0.1% | 67 tps | 0.8s | 41K | $2.00 | $5.00 |
| 32 | 252 | Magistral Small 2509 | 802 | ±18 | 1.8K | 7.5% | 2.7% | 116 tps | 0.6s | 131K | $0.50 | $1.50 |
| 33 | 346 | Magistral Medium 2507 | 795 | ±25 | 665 | 14.2% | <0.1% | 86 tps | 0.7s | 41K | $2.00 | $5.00 |
| 34 | 252 | Mistral Large | 785 | ±16 | 1.1K | 5.8% | 1.5% | 54 tps | 0.7s | 33K | $2.00 | $6.00 |
| 35 | 262 | Mistral Small | 770 | ±12 | 1.2K | 4.5% | 1.7% | 142 tps | 0.6s | 32K | $0.43 | $1.30 |
| 36 | 262 | Open Mistral 7B | 762 | ±18 | 1.3K | 4.7% | 0.7% | 176 tps | 0.4s | 33K | $0.25 | $0.25 |
| 37 | 269 | Mixtral 8x22B Instruct | 738 | ±17 | 1.4K | 5.6% | 1.8% | 142 tps | 0.7s | 66K | $0.45 | $0.45 |
| 38 | 374 | Mistral Nemo 12B Celeste V1.9 | 725 | ±18 | 1.1K | 3.5% | <0.1% | 6 tps | 10.2s | 8K | $0.80 | $1.20 |
| 39 | 269 | Pixtral 12B | 722 | ±21 | 3K | 6.3% | 2.2% | 101 tps | 1.2s | 131K | $0.08 | $0.08 |
| 40 | 269 |  DeepHermes 3 Mistral 24B Preview | 706 | ±30 | 715 | 5.9% | 2.5% | 50 tps | 1.0s | 33K | $0.06 | $0.25 |
| 41 | 374 |  Dolphin 3.0 R1 Mistral 24B | 701 | ±16 | 890 | 7.8% | <0.1% | 13 tps | 0.1s | 33K | $0.03 | $0.09 |
| 42 | 399 | Mistral Nemo 12B Inferor v0.0 | 454 | ±28 | 565 | 1.7% | <0.1% | 83 tps | 0.8s | 16K | $0.80 | $1.20 |