Models
Topics
Language
More

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

Open license models

Filter the leaderboard to only show models that have an open license.

958
Qwen 2.5 VL 32B Instruct
958
Mistral Small 24B Instruct
957
Kimi K2 0711
957
Switchpoint Router
956
Gemma 3 12B
956
GLM 4.7 Flash
954
Rnj-1 Instruct
954
Devstral Small
952
Qwen3.5 9B FP8
950
GPT-3.5 Turbo
948
Grok 3 Mini
947
Krutrim 2
946
Open Mistral Nemo
945
Hermes 2 Pro Llama 3 8B
944
Jamba 1.5 Large

Last updated about 1 month ago

RankOverallNameVIBE
Score
Confidence
Interval
VotesDownvote %Abort %SpeedLatencyContextCost
(Input)
Cost
(Output)
201214Qwen 2.5 VL 32B Instruct958±121.6K5.4%6.3%43 tps3.2s128K$0.35$0.62
202201Mistral Small 24B Instruct958±46.8K2.1%1.5%84 tps0.4s33K$0.80$0.80
203170Kimi K2 0711957±223.3K2.3%1.6%29 tps1.3s131K$0.72$2.60
204179Switchpoint Router957±48.5K2.0%1.7%71 tps4.9s131K$0.85$3.40
205214Gemma 3 12B956±39.8K1.9%4.2%73 tps0.8s131K$0.05$0.12
206179GLM 4.7 Flash956±84.8K1.8%5.8%61 tps2.8s128K$0.07$0.39
207222Rnj-1 Instruct954±63K3.7%0.6%103 tps0.3s33K$0.15$0.15
208201Devstral Small954±65.4K2.4%2.4%180 tps0.6s131K$0.10$0.30
209209Qwen3.5 9B FP8952±194953.9%5.8%64 tps0.7s256K$0.10$0.15
210209GPT-3.5 Turbo950±26K1.0%1.3%74 tps0.9s16K$0.75$1.75
211186Grok 3 Mini948±228.5K3.9%1.2%43 tps0.5s131K$0.30$0.50
212214Krutrim 2947±211.8K0.6%12.5%33 tps2.1s128K$1.00$1.00
213225Open Mistral Nemo946±37.3K2.1%1.5%171 tps0.5s131K$0.15$0.15
214235Hermes 2 Pro Llama 3 8B945±28.8K1.0%<0.1%76 tps1.0s131K$0.08$0.09
215222Jamba 1.5 Large944±313.6K1.6%1.7%48 tps0.9s256K$1.50$6.00
216209Qwen 2.5 14B Instruct944±39K2.3%2.4%40 tps1.6s1M$0.40$1.61
217225Command R 7B940±314K1.9%1.1%76 tps0.4s128K$0.04$0.15
218209Llama 3.3 Swallow 70B Instruct938±310.7K3.2%1.4%153 tps1.3s131K$0.13$0.39
219201Gemma 3 27B IT938±39.7K1.7%2.0%60 tps0.8s128K$0.17$0.29
220214Qwen 2.5 7B934±47.5K2.3%3.7%40 tps1.9s131K$0.08$0.27
221186GLM 4.6V Flash933±47.9K3.7%3.7%64 tps2.1s128K$0.04$0.40
222201GPT-4o mini932±49K3.4%2.1%71 tps1.7s128K$0.15$0.60
223214C4AI Aya Expanse 32B930±217.9K1.6%1.5%43 tps0.5s128K$0.50$1.50
224229ERNIE 4.5 21B A3B Thinking930±62.7K3.6%1.8%87 tps1.5s120K$0.07$0.28
225246Ministral 3B929±38.6K2.2%0.8%248 tps0.4s131K$0.08$0.08
226229Moonshot V1 Auto928±64K1.6%1.2%54 tps1.5s8K$2.00$5.00
227240Mistral Nemo928±34.2K1.2%<0.1%112 tps0.4s131K$0.07$0.13
228240Llama 3.3 70B Instruct927±119002.7%5.3%28 tps1.3s128K$0.38$0.55
229240GPT-3.5 Turbo Instruct926±38K1.4%<0.1%46 tps1.2s4K$1.50$2.00
230214Llama 3.3 70B Instruct Turbo925±54.2K3.3%2.0%78 tps1.0s131K$0.88$0.88
231222Sky T1 32B Preview923±311.2K1.6%7.8%73 tps0.6s16K$0.12$0.18
232225GPT-3.5 Turbo 16k923±310.7K1.6%<0.1%22 tps0.6s16K$3.00$4.00
233235Mixtral 8x7B923±45.3K2.2%2.2%142 tps0.6s33K$0.23$0.23
234229Ministral 8B922±37.7K2.5%1.4%177 tps0.4s128K$0.14$0.14
235225Command R920±39.8K2.0%5.8%54 tps0.6s128K$0.30$0.99
236214Moonshot V1 128k917±54.7K1.7%1.4%54 tps1.5s131K$2.00$5.00
237229Llama 3.1 8B915±81.3K2.9%1.9%61 tps1.0s8K$0.07$0.09
238229Krutrim Spectre V2912±47.4K1.1%<0.1%33 tps3.1s4K$0.19$0.19
239240Moonshot V1 8k911±64K1.8%1.0%55 tps1.5s8K$0.20$2.00
240246WizardLM-2 8x22B911±29.8K1.1%11.6%11 tps2.5s66K$0.77$0.77
View All (288 models)