Models
More

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

Open license models

Filter the leaderboard to only show models that have an open license.

1080
Mistral Medium
970
Mistral Small 3.2 24B
962
Devstral Medium
948
Ministral 14B 3.0
916
Devstral Small
908
Magistral Small 2506
903
Mistral Small 3.2 24B Instruct
883
Magistral Medium 2509
875
Mistral Medium 3
871
Mixtral 8x22B
854
Ministral 3B 2512
802
Magistral Small 2509
785
Mistral Large
762
Open Mistral 7B
706
DeepHermes 3 Mistral 24B Preview

Last updated about 1 month ago

RankOverallNameVIBE
Score
Confidence
Interval
VotesDownvote %Abort %SpeedLatencyContextCost
(Input)
Cost
(Output)
1105Mistral Medium1080±49.6K5.6%1.8%48 tps0.6s33K$1.48$4.55
2167Mistral Small 3.2 24B970±134.6K4.9%2.8%141 tps0.7s33K$0.02$0.08
3167Devstral Medium962±113.5K5.2%1.5%77 tps0.6s131K$0.40$2.00
4179Ministral 14B 3.0948±168058.5%2.0%119 tps0.5s128K$0.20$0.20
5189Devstral Small916±171.4K5.0%2.4%180 tps0.6s131K$0.10$0.30
6201Magistral Small 2506908±114.3K3.1%1.6%156 tps0.5s40K$0.37$1.10
7201Mistral Small 3.2 24B Instruct903±208508.6%1.9%113 tps1.1s131K$0.02$0.08
8210Magistral Medium 2509883±162.6K9.5%4.0%58 tps0.9s131K$2.00$5.00
9210Mistral Medium 3875±234856.7%2.4%47 tps0.8s33K$0.40$2.00
10210Mixtral 8x22B871±221.3K5.0%1.2%140 tps0.6s64K$2.00$6.00
11210Ministral 3B 2512854±575158.0%2.8%339 tps0.6s131K$0.10$0.10
12252Magistral Small 2509802±181.8K7.5%2.7%116 tps0.6s131K$0.50$1.50
13252Mistral Large785±161.1K5.8%1.5%54 tps0.7s33K$2.00$6.00
14262Open Mistral 7B762±181.3K4.7%0.7%176 tps0.4s33K$0.25$0.25
15269DeepHermes 3 Mistral 24B Preview706±307155.9%2.5%50 tps1.0s33K$0.06$0.25