Models
Topics
Language
More

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

Open license models

Filter the leaderboard to only show models that have an open license.

924
Devstral Small
920
Magistral Small 2506
919
Inception Mercury
919
Qwen3 30B A3B Thinking 2507
918
Magistral Medium 2509
916
Qwen 2.5 32B Instruct
916
Amazon Nova Pro 1.0
915
Mistral Small 3.2 24B Instruct
914
Llama 3.3 70B Instruct Turbo
911
Llama 4 Scout
911
Baichuan-M2-32B
911
Kimi K2 0711
911
Mistral Small 3.2 24B
908
OpenAI o3-mini-high
907
DeepSeek-R1 Distill Llama 70B

Last updated about 1 month ago

RankOverallNameVIBE
Score
Confidence
Interval
VotesDownvote %Abort %SpeedLatencyContextCost
(Input)
Cost
(Output)
161201Devstral Small924±1657012.3%2.4%180 tps0.6s131K$0.10$0.30
162194Magistral Small 2506920±152K6.9%1.6%156 tps0.5s40K$0.37$1.10
163179Inception Mercury919±102.8K11.5%0.4%257 tps1.1s32K$0.25$1.00
164148Qwen3 30B A3B Thinking 2507919±101.3K3.6%0.5%124 tps1.2s131K$0.16$1.70
165229Magistral Medium 2509918±82.1K11.3%4.0%58 tps0.9s131K$2.00$5.00
166153Qwen 2.5 32B Instruct916±91.9K18.0%2.5%48 tps1.0s131K$0.21$0.25
167179Amazon Nova Pro 1.0916±162.1K10.3%0.9%96 tps0.7s300K$0.80$1.70
168186Mistral Small 3.2 24B Instruct915±225259.5%1.9%113 tps1.1s131K$0.02$0.08
169214Llama 3.3 70B Instruct Turbo914±2464011.7%2.0%78 tps1.0s131K$0.88$0.88
170160Llama 4 Scout911±68K9.6%0.6%88 tps5.1s131K$0.18$0.46
171179Baichuan-M2-32B911±2550513.7%<0.1%32 tps3.3s131K$0.07$0.07
172170Kimi K2 0711911±83.2K9.2%1.6%29 tps1.3s131K$0.72$2.60
173170Mistral Small 3.2 24B911±102K12.4%2.8%141 tps0.7s33K$0.02$0.08
174214OpenAI o3-mini-high908±141.1K6.5%2.4%231 tps10.5s200K$1.10$4.40
175246DeepSeek-R1 Distill Llama 70B907±235357.0%3.6%27 tps1.6s32K$0.73$0.95
176186Gemma 3n E4B905±102.6K8.4%2.0%30 tps0.5s8K$0.01$0.02
177201ERNIE 4.5 VL 424B A47B905±128057.5%4.9%36 tps3.5s123K$0.42$1.25
178209Llama 3.3 Swallow 70B Instruct904±81.6K15.2%1.4%153 tps1.3s131K$0.13$0.39
179186Grok 3 Mini903±56K12.8%1.2%43 tps0.5s131K$0.30$0.50
180157Qwen3 Next 80B A3B Thinking903±74.9K11.2%0.6%175 tps1.3s256K$0.21$2.26
181161Qwen3 8B902±122K17.8%2.4%61 tps1.4s41K$0.02$0.07
182186Gemma 3 27B902±1861513.4%1.8%35 tps1.1s66K$0.06$0.10
183186Grok 3 Mini Fast897±75.2K14.9%1.6%44 tps0.5s131K$0.60$4.00
184186Jamba 1.6 Large895±118809.7%2.0%59 tps1.2s256K$1.33$5.33
185194Llama 3.3 70B893±102.2K9.2%0.3%500 tps0.5s8K$0.48$0.66
186235GLM 4 32B893±121.2K11.1%2.6%40 tps1.6s33K$0.14$0.14
187214C4AI Aya Expanse 32B889±111.3K10.0%1.5%43 tps0.5s128K$0.50$1.50
188179GLM 4.7 Flash887±138452.9%5.8%61 tps2.8s128K$0.07$0.39
189246Mixtral 8x22B880±2346512.3%1.2%140 tps0.6s64K$2.00$6.00
190186Jamba 1.7 Large877±1762015.1%1.3%58 tps1.0s256K$1.33$5.33
191214Gemma 3 12B874±1591011.2%4.2%73 tps0.8s131K$0.05$0.12
192225Command R872±1677012.5%5.8%54 tps0.6s128K$0.30$0.99
193165Qwen3 4B871±73.3K16.3%1.9%94 tps1.5s128K$0.01$0.01
194256Solar Mini 250422869±1564016.3%1.8%90 tps1.7s33K$0.15$0.15
195229Ministral 8B868±1580013.5%1.4%177 tps0.4s128K$0.14$0.14
196246Mixtral 8x22B Instruct866±3157010.2%1.8%142 tps0.7s66K$0.45$0.45
197274Moonshot V1 128k Vision862±175857.1%3.1%44 tps3.8s131K$2.00$5.00
198194Mistral Small 3 24B Instruct858±1858512.7%2.6%77 tps0.6s33K$0.07$0.14
199179Qwen 2.5 72B854±2653511.6%1.2%96 tps1.2s131K$0.14$0.26
200222Rnj-1 Instruct853±245907.8%0.6%103 tps0.3s33K$0.15$0.15
View All (237 models)