Models
Topics
Language
More

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

Open license models

Filter the leaderboard to only show models that have an open license.

889
Magistral Medium 2509
888
Rnj-1 Instruct
886
Ministral 3B
886
Mixtral 8x22B
876
Ministral 3B 2512
872
Moonshot V1 32k
871
Mixtral 8x22B Instruct
868
Llama 3.1 8B
867
Phi 4
859
Mistral Small
858
Inflection 3 Productivity
856
Solar Mini 250422
849
Open Mistral 7B
849
Mixtral-8x7B Instruct v0.1
847
Qwen 2.5 VL 32B Instruct

Last updated about 1 month ago

RankOverallNameVIBE
Score
Confidence
Interval
VotesDownvote %Abort %SpeedLatencyContextCost
(Input)
Cost
(Output)
241229Magistral Medium 2509889±54.4K3.3%4.0%58 tps0.9s131K$2.00$5.00
242222Rnj-1 Instruct888±82.4K4.5%0.6%103 tps0.3s33K$0.15$0.15
243246Ministral 3B886±57.5K1.4%0.8%248 tps0.4s131K$0.08$0.08
244246Mixtral 8x22B886±64.7K1.1%1.2%140 tps0.6s64K$2.00$6.00
245265Ministral 3B 2512876±91.3K3.4%2.8%339 tps0.6s131K$0.10$0.10
246240Moonshot V1 32k872±43.8K0.8%1.4%53 tps1.4s33K$1.00$3.00
247246Mixtral 8x22B Instruct871±45.4K1.6%1.8%142 tps0.7s66K$0.45$0.45
248229Llama 3.1 8B868±91.2K2.4%1.9%61 tps1.0s8K$0.07$0.09
249256Phi 4867±37.7K1.2%5.1%28 tps1.3s128K$0.10$0.32
250260Mistral Small859±64.4K1.6%1.7%142 tps0.6s32K$0.43$1.30
251265Inflection 3 Productivity858±46.5K0.8%0.6%50 tps3.2s8K$2.50$10.00
252256Solar Mini 250422856±83.2K2.0%1.8%90 tps1.7s33K$0.15$0.15
253260Open Mistral 7B849±64.8K1.2%0.7%176 tps0.4s33K$0.25$0.25
254265Mixtral-8x7B Instruct v0.1849±55K1.5%1.3%54 tps0.4s33K$0.60$0.60
255214Qwen 2.5 VL 32B Instruct847±168404.0%6.3%43 tps3.2s128K$0.35$0.62
256256Mixtral 8x7B Instruct844±55.7K1.3%0.2%79 tps0.7s33K$0.23$0.31
257284MiniMax M1843±52.7K1.6%<0.1%31 tps2.8s1M$0.55$2.20
258260Apriel 1.6 15B Thinker840±128552.3%2.6%92 tps0.4s131K$0$0
259214OpenAI o3-mini-high839±63.6K1.6%2.4%231 tps10.5s200K$1.10$4.40
260240Llama 3.3 70B Instruct839±186752.2%5.3%28 tps1.3s128K$0.38$0.55
261271Inflection 3 Pi837±46.8K0.9%1.1%33 tps3.4s8K$2.50$10.00
262260Hermes 4 405B Reasoning FP8826±45K3.5%3.6%32 tps0.8s131K$1.00$3.00
263274DeepHermes 3 Mistral 24B Preview824±99953.4%2.5%50 tps1.0s33K$0.06$0.25
264271Mistral Large818±64.3K1.6%1.5%54 tps0.7s33K$2.00$6.00
265265LFM2 2.6B816±81.7K5.2%6.7%184 tps0.4s33K$0.01$0.02
266271Hermes 3 405B Instruct814±45.5K1.2%2.3%20 tps1.1s131K$0.80$0.80
267265Qwen 2.5 VL 72B Instruct808±121.3K5.5%5.3%25 tps3.7s128K$1.01$2.79
268281MythoMax L2 13B796±49K1.6%1.2%22 tps1.1s4K$0.18$0.18
269265Magistral Small 2509786±111.7K3.7%2.7%116 tps0.6s131K$0.50$1.50
270281Gemma 2 9B779±71.3K3.6%<0.1%100 tps0.4s8K$0.09$0.09
271274C4AI Aya Expanse 8B778±158852.7%0.9%61 tps0.4s8K$0.50$1.50
272285Hunyuan A13B Instruct777±54.1K2.4%2.3%67 tps2.0s33K$0.01$0.01
273285Phi 4 Mini Instruct774±53.7K2.0%7.4%40 tps1.1s128K$0.07$0.30
274274MiniMax M2-her767±118801.7%<0.1%108 tps0.7s205K$0.30$1.20
275274LFM2 8B A1B757±91.9K4.8%<0.1%142 tps0.3s33K$0.01$0.02
276274Pixtral 12B748±152.3K5.1%2.2%101 tps1.2s131K$0.08$0.08
277281Goliath 120B741±92.6K2.1%2.7%21 tps2.2s6K$6.56$9.38
278287Phi 4 Reasoning707±101K2.8%21.0%29 tps1.0s33K$0.06$0.25
279274Moonshot V1 128k Vision649±315156.4%3.1%44 tps3.8s131K$2.00$5.00
280289UI-TARS 1.5 7B646±179154.2%4.0%75 tps0.9s128K$0.10$0.20
View All (283 models)