1131
Mistral Large 31080
Mistral Medium980
Mistral Small 3.1 24B Instruct970
Mistral Small 3.2 24B969
Pixtral Large962
Devstral Medium948
Ministral 14B 3.0931
Codestral925
Mistral Small 3.1918
Open Mistral Nemo916
Devstral Small908
Magistral Small 2506903
Mistral Small 3.2 24B Instruct883
Magistral Medium 2509880
Mistral Small 3 24B InstructLast updated about 1 month ago
| Rank | Overall | Name | VIBE Score | Confidence Interval | Votes | Downvote % | Abort % | Speed | Latency | Context | Cost (Input) | Cost (Output) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 77 | Mistral Large 3 | 1131 | ±8 | 5.4K | 5.8% | 2.1% | 51 tps | 1.0s | 256K | $0.50 | $1.50 |
| 2 | 105 | Mistral Medium | 1080 | ±4 | 9.6K | 5.6% | 1.8% | 48 tps | 0.6s | 33K | $1.48 | $4.55 |
| 3 | 159 | Mistral Small 3.1 24B Instruct | 980 | ±11 | 2.9K | 4.3% | 7.5% | 15 tps | 2.4s | 131K | $0.06 | $0.18 |
| 4 | 167 | Mistral Small 3.2 24B | 970 | ±13 | 4.6K | 4.9% | 2.8% | 141 tps | 0.7s | 33K | $0.02 | $0.08 |
| 5 | 167 | Pixtral Large | 969 | ±14 | 3.5K | 3.9% | 2.5% | 57 tps | 1.3s | 128K | $1.50 | $4.50 |
| 6 | 167 | Devstral Medium | 962 | ±11 | 3.5K | 5.2% | 1.5% | 77 tps | 0.6s | 131K | $0.40 | $2.00 |
| 7 | 179 | Ministral 14B 3.0 | 948 | ±16 | 805 | 8.5% | 2.0% | 119 tps | 0.5s | 128K | $0.20 | $0.20 |
| 8 | 189 | Codestral | 931 | ±19 | 855 | 6.0% | 5.2% | 151 tps | 0.9s | 262K | $0.15 | $0.45 |
| 9 | 189 | Mistral Small 3.1 | 925 | ±14 | 2.4K | 4.0% | 7.4% | 13 tps | 2.6s | 32K | $0.17 | $0.28 |
| 10 | 189 | Open Mistral Nemo | 918 | ±21 | 1.7K | 4.5% | 1.5% | 171 tps | 0.5s | 131K | $0.15 | $0.15 |
| 11 | 189 | Devstral Small | 916 | ±17 | 1.4K | 5.0% | 2.4% | 180 tps | 0.6s | 131K | $0.10 | $0.30 |
| 12 | 201 | Magistral Small 2506 | 908 | ±11 | 4.3K | 3.1% | 1.6% | 156 tps | 0.5s | 40K | $0.37 | $1.10 |
| 13 | 201 | Mistral Small 3.2 24B Instruct | 903 | ±20 | 850 | 8.6% | 1.9% | 113 tps | 1.1s | 131K | $0.02 | $0.08 |
| 14 | 210 | Magistral Medium 2509 | 883 | ±16 | 2.6K | 9.5% | 4.0% | 58 tps | 0.9s | 131K | $2.00 | $5.00 |
| 15 | 210 | Mistral Small 3 24B Instruct | 880 | ±10 | 1.7K | 3.6% | 2.6% | 77 tps | 0.6s | 33K | $0.07 | $0.14 |
| 16 | 210 | Mistral Medium 3 | 875 | ±23 | 485 | 6.7% | 2.4% | 47 tps | 0.8s | 33K | $0.40 | $2.00 |
| 17 | 210 | Mistral Nemo | 875 | ±15 | 915 | 2.7% | <0.1% | 112 tps | 0.4s | 131K | $0.07 | $0.13 |
| 18 | 210 | Mixtral 8x22B | 871 | ±22 | 1.3K | 5.0% | 1.2% | 140 tps | 0.6s | 64K | $2.00 | $6.00 |
| 19 | 210 | Mistral Small 24B Instruct | 864 | ±16 | 1.5K | 4.1% | 1.5% | 84 tps | 0.4s | 33K | $0.80 | $0.80 |
| 20 | 210 | Mixtral 8x7B | 855 | ±18 | 1.3K | 5.1% | 2.2% | 142 tps | 0.6s | 33K | $0.23 | $0.23 |
| 21 | 210 | Ministral 3B 2512 | 854 | ±57 | 515 | 8.0% | 2.8% | 339 tps | 0.6s | 131K | $0.10 | $0.10 |
| 22 | 210 | Mixtral 8x7B Instruct | 854 | ±16 | 1.4K | 4.4% | 0.2% | 79 tps | 0.7s | 33K | $0.23 | $0.31 |
| 23 | 240 | Mixtral-8x7B Instruct v0.1 | 832 | ±23 | 1.3K | 4.6% | 1.3% | 54 tps | 0.4s | 33K | $0.60 | $0.60 |
| 24 | 240 | Ministral 8B | 825 | ±17 | 2.2K | 5.5% | 1.4% | 177 tps | 0.4s | 128K | $0.14 | $0.14 |
| 25 | 252 | Ministral 3B | 806 | ±16 | 2.3K | 5.1% | 0.8% | 248 tps | 0.4s | 131K | $0.08 | $0.08 |
| 26 | 252 | Magistral Small 2509 | 802 | ±18 | 1.8K | 7.5% | 2.7% | 116 tps | 0.6s | 131K | $0.50 | $1.50 |
| 27 | 252 | Mistral Large | 785 | ±16 | 1.1K | 5.8% | 1.5% | 54 tps | 0.7s | 33K | $2.00 | $6.00 |
| 28 | 262 | Mistral Small | 770 | ±12 | 1.2K | 4.5% | 1.7% | 142 tps | 0.6s | 32K | $0.43 | $1.30 |
| 29 | 262 | Open Mistral 7B | 762 | ±18 | 1.3K | 4.7% | 0.7% | 176 tps | 0.4s | 33K | $0.25 | $0.25 |
| 30 | 269 | Mixtral 8x22B Instruct | 738 | ±17 | 1.4K | 5.6% | 1.8% | 142 tps | 0.7s | 66K | $0.45 | $0.45 |
| 31 | 269 | Pixtral 12B | 722 | ±21 | 3K | 6.3% | 2.2% | 101 tps | 1.2s | 131K | $0.08 | $0.08 |
| 32 | 269 |  DeepHermes 3 Mistral 24B Preview | 706 | ±30 | 715 | 5.9% | 2.5% | 50 tps | 1.0s | 33K | $0.06 | $0.25 |