Models
Topics
Language
More

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

Open license models

Filter the leaderboard to only show models that have an open license.

843
MiniMax M1
843
Magistral Medium 2507
842
Gemini 1.5 Flash 8B
840
Apriel 1.6 15B Thinker
839
OpenAI o3-mini-high
839
Llama 3.3 70B Instruct
837
Inflection 3 Pi
835
Mythalion 13B
833
DeepSeek-R1 Distill Qwen 14B
832
Phi 4 Multimodal Instruct
830
Magistral Small 2507
826
Hermes 4 405B Reasoning FP8
825
MiMo 7B RL
825
Mistral Nemo 12B Celeste V1.9
824
DeepHermes 3 Mistral 24B Preview

Last updated about 1 month ago

RankOverallNameVIBE
Score
Confidence
Interval
VotesDownvote %Abort %SpeedLatencyContextCost
(Input)
Cost
(Output)
361284MiniMax M1843±52.7K1.6%<0.1%31 tps2.8s1M$0.55$2.20
362369Magistral Medium 2507843±91.1K4.7%<0.1%86 tps0.7s41K$2.00$5.00
363399Gemini 1.5 Flash 8B842±126852.8%<0.1%11 tps0.0s1M$0.02$0.10
364260Apriel 1.6 15B Thinker840±128552.3%2.6%92 tps0.4s131K$0$0
365214OpenAI o3-mini-high839±63.6K1.6%2.4%231 tps10.5s200K$1.10$4.40
366240Llama 3.3 70B Instruct839±186752.2%5.3%28 tps1.3s128K$0.38$0.55
367271Inflection 3 Pi837±46.8K0.9%1.1%33 tps3.4s8K$2.50$10.00
368392Mythalion 13B835±35.2K0.8%<0.1%63 tps0.5s4K$0.56$1.13
369406DeepSeek-R1 Distill Qwen 14B833±159753.0%<0.1%44 tps1.7s64K$0.63$0.63
370399Phi 4 Multimodal Instruct832±55.9K2.3%<0.1%17 tps1.4s128K$0.03$0.05
371361Magistral Small 2507830±81.4K4.1%<0.1%148 tps0.4s41K$0.50$1.50
372260Hermes 4 405B Reasoning FP8826±45K3.5%3.6%32 tps0.8s131K$1.00$3.00
373392MiMo 7B RL825±36.7K1.1%<0.1%31 tps0.4s32K$0.49$0.49
374392Mistral Nemo 12B Celeste V1.9825±45.6K1.1%<0.1%6 tps10.2s8K$0.80$1.20
375274DeepHermes 3 Mistral 24B Preview824±99953.4%2.5%50 tps1.0s33K$0.06$0.25
376392Phi 3 Mini 128k Instruct821±91K2.4%<0.1%16 tps0.5s128K$0.12$0.31
377406Command821±63.1K1.6%<0.1%25 tpsN/A4K$0.83$1.33
378406Solar Pro 250422820±71.2K1.2%<0.1%13 tps0.6s33K$0$0
379271Mistral Large818±64.3K1.6%1.5%54 tps0.7s33K$2.00$6.00
380265LFM2 2.6B816±81.7K5.2%6.7%184 tps0.4s33K$0.01$0.02
381271Hermes 3 405B Instruct814±45.5K1.2%2.3%20 tps1.1s131K$0.80$0.80
382265Qwen 2.5 VL 72B Instruct808±121.3K5.5%5.3%25 tps3.7s128K$1.01$2.79
383412ArliAI QwQ 32B Arliai RpR V1799±166555.1%<0.1%34 tps1.8s33K$0.02$0.07
384281MythoMax L2 13B796±49K1.6%1.2%22 tps1.1s4K$0.18$0.18
385412Dolphin 3.0 R1 Mistral 24B795±72.4K1.4%<0.1%13 tps0.1s33K$0.03$0.09
386412Dolphin 2.9.2 Mixtral 8x22B791±45.4K0.8%<0.1%20 tps1.5s16K$0.90$0.90
387412Shisa V2 Llama 3.3 70B790±91.1K2.2%<0.1%8 tps2.0s33K$0.03$0.09
388399Phi 3 Medium 128k Instruct789±108952.2%<0.1%40 tps1.3s128K$0.58$0.84
389265Magistral Small 2509786±111.7K3.7%2.7%116 tps0.6s131K$0.50$1.50
390281Gemma 2 9B779±71.3K3.6%<0.1%100 tps0.4s8K$0.09$0.09
391274C4AI Aya Expanse 8B778±158852.7%0.9%61 tps0.4s8K$0.50$1.50
392285Hunyuan A13B Instruct777±54.1K2.4%2.3%67 tps2.0s33K$0.01$0.01
393285Phi 4 Mini Instruct774±53.7K2.0%7.4%40 tps1.1s128K$0.07$0.30
394274MiniMax M2-her767±118801.7%<0.1%108 tps0.7s205K$0.30$1.20
395274LFM2 8B A1B757±91.9K4.8%<0.1%142 tps0.3s33K$0.01$0.02
396274Pixtral 12B748±152.3K5.1%2.2%101 tps1.2s131K$0.08$0.08
397424ERNIE 4.5 0.3B744±101.1K5.7%<0.1%85 tps2.2s120K$0$0
398421Llema 7B742±44.3K1.7%<0.1%1 tps15.0s4K$0.80$1.20
399281Goliath 120B741±92.6K2.1%2.7%21 tps2.2s6K$6.56$9.38
400287Phi 4 Reasoning707±101K2.8%21.0%29 tps1.0s33K$0.06$0.25
View All (410 models)