Models
Topics
Language
More

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

Open license models

Filter the leaderboard to only show models that have an open license.

880
Mistral Small 3 24B Instruct
875
Mistral Nemo
870
Qwen 2.5 7B Turbo
864
Hermes 2 Pro Llama 3 8B
864
Mistral Small 24B Instruct
856
Gemma 3 27B
855
Mixtral 8x7B
854
Mixtral 8x7B Instruct
853
Gemma 3 27B IT
851
Llama 3.3 70B Instruct Turbo
849
Command R 7B
835
DeepSeek-R1 Distill Llama 70B
832
Mixtral-8x7B Instruct v0.1
831
Qwen 2.5 7B
829
Sky T1 32B Preview

Last updated about 1 month ago

RankOverallNameVIBE
Score
Confidence
Interval
VotesDownvote %Abort %SpeedLatencyContextCost
(Input)
Cost
(Output)
41210Mistral Small 3 24B Instruct880±101.7K3.6%2.6%77 tps0.6s33K$0.07$0.14
42210Mistral Nemo875±159152.7%<0.1%112 tps0.4s131K$0.07$0.13
43210Qwen 2.5 7B Turbo870±256156.1%0.5%125 tps0.4s131K$0.30$0.30
44210Hermes 2 Pro Llama 3 8B864±211.8K2.5%<0.1%76 tps1.0s131K$0.08$0.09
45210Mistral Small 24B Instruct864±161.5K4.1%1.5%84 tps0.4s33K$0.80$0.80
46210Gemma 3 27B856±271.1K6.9%1.8%35 tps1.1s66K$0.06$0.10
47210Mixtral 8x7B855±181.3K5.1%2.2%142 tps0.6s33K$0.23$0.23
48210Mixtral 8x7B Instruct854±161.4K4.4%0.2%79 tps0.7s33K$0.23$0.31
49234Gemma 3 27B IT853±102.3K3.9%2.0%60 tps0.8s128K$0.17$0.29
50234Llama 3.3 70B Instruct Turbo851±191.2K6.0%2.0%78 tps1.0s131K$0.88$0.88
51234Command R 7B849±153.3K4.8%1.1%76 tps0.4s128K$0.04$0.15
52240DeepSeek-R1 Distill Llama 70B835±93.4K5.2%3.6%27 tps1.6s32K$0.73$0.95
53240Mixtral-8x7B Instruct v0.1832±231.3K4.6%1.3%54 tps0.4s33K$0.60$0.60
54240Qwen 2.5 7B831±172K5.1%3.7%40 tps1.9s131K$0.08$0.27
55240Sky T1 32B Preview829±142.4K4.5%7.8%73 tps0.6s16K$0.12$0.18
56240Ministral 8B825±172.2K5.5%1.4%177 tps0.4s128K$0.14$0.14
57240C4AI Aya Expanse 32B821±73.8K4.0%1.5%43 tps0.5s128K$0.50$1.50
58240Gemma 2 27B815±171.5K4.1%1.4%44 tps1.4s8K$0.80$0.80
59252Ministral 3B806±162.3K5.1%0.8%248 tps0.4s131K$0.08$0.08
60252Gemma 3 1B802±112K6.1%0.6%176 tps1.0s33K$0.06$0.10
61252Phi 4798±161.7K3.4%5.1%28 tps1.3s128K$0.10$0.32
62262Command R778±182.2K4.9%5.8%54 tps0.6s128K$0.30$0.99
63262Mistral Small770±121.2K4.5%1.7%142 tps0.6s32K$0.43$1.30
64262Hermes 4 405B Reasoning FP8759±112.7K12.8%3.6%32 tps0.8s131K$1.00$3.00
65262Goliath 120B754±247455.7%2.7%21 tps2.2s6K$6.56$9.38
66269Gemma 3 4B742±103.3K4.7%1.3%138 tps0.7s131K$0.02$0.04
67269Mixtral 8x22B Instruct738±171.4K5.6%1.8%142 tps0.7s66K$0.45$0.45
68269Command R+738±151.6K5.6%2.8%36 tps0.7s128K$2.08$9.45
69269Pixtral 12B722±213K6.3%2.2%101 tps1.2s131K$0.08$0.08
70276Hermes 3 405B Instruct702±201.4K4.1%2.3%20 tps1.1s131K$0.80$0.80
71279MythoMax L2 13B600±212.3K5.8%1.2%22 tps1.1s4K$0.18$0.18
72279Phi 4 Mini Instruct599±211K7.1%7.4%40 tps1.1s128K$0.07$0.30
73279Phi 4 Reasoning573±172.1K5.5%21.0%29 tps1.0s33K$0.06$0.25
74284Qwen 2.5 VL 3B Instruct523±254.1K6.1%3.0%44 tps2.5s128K$0.21$0.63
75284CodeLlama 7B Instruct Solidity463±544858.5%3.6%33 tps0.7s16K$0.80$1.20
76286Phi 4 Mini Reasoning447±153.4K12.0%9.7%30 tps0.9s128K$0.07$0.30
View All (76 models)