Models
More

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

Open license models

Filter the leaderboard to only show models that have an open license.

958
Llama 4 Maverick
958
Qwen3 30B A3B Thinking 2507
957
Qwen 2.5 VL 32B Instruct
955
Switchpoint Router
954
DeepSeek-R1 0528
953
DeepSeek-R1
949
Llama 3.3 Swallow 70B Instruct
948
Open Mistral Nemo
945
Jamba 1.6 Large
945
Amazon Nova 2 Lite
940
OpenAI o4-mini-high
939
OpenAI o3-mini
939
Llama 3 8B
937
Ministral 14B 3.0
937
Moonshot V1 Auto

Last updated about 1 month ago

RankOverallNameVIBE
Score
Confidence
Interval
VotesDownvote %Abort %SpeedLatencyContextCost
(Input)
Cost
(Output)
161167Llama 4 Maverick958±511K4.1%1.2%88 tps2.4s1M$0.23$0.83
162179Qwen3 30B A3B Thinking 2507958±122.3K5.2%0.5%124 tps1.2s131K$0.16$1.70
163148Qwen 2.5 VL 32B Instruct957±246903.5%6.3%43 tps3.2s128K$0.35$0.62
164179Switchpoint Router955±102.5K3.4%1.7%71 tps4.9s131K$0.85$3.40
165159DeepSeek-R1 0528954±114.2K3.7%1.3%93 tps0.5s64K$1.60$3.67
166179DeepSeek-R1953±95.4K4.2%0.8%133 tps0.6s64K$0.91$3.07
167189Llama 3.3 Swallow 70B Instruct949±123.4K5.4%1.4%153 tps1.3s131K$0.13$0.39
168189Open Mistral Nemo948±291.6K4.6%1.5%171 tps0.5s131K$0.15$0.15
169189Jamba 1.6 Large945±83K2.6%2.0%59 tps1.2s256K$1.33$5.33
170135Amazon Nova 2 Lite945±182K7.3%1.0%137 tps0.6s300K$0.35$2.95
171148OpenAI o4-mini-high940±115.9K8.3%1.9%117 tps15.9s200K$1.10$4.40
172148OpenAI o3-mini939±96.4K8.1%0.8%143 tps3.3s200K$1.10$4.40
173201Llama 3 8B939±113.1K3.4%6.0%85 tps0.7s8K$0.12$0.16
174179Ministral 14B 3.0937±197608.4%2.0%119 tps0.5s128K$0.20$0.20
175201Moonshot V1 Auto937±239003.7%1.2%54 tps1.5s8K$2.00$5.00
176201Magistral Small 2506937±123.5K2.8%1.6%156 tps0.5s40K$0.37$1.10
177189Mistral Small 3.1936±122.4K3.8%7.4%13 tps2.6s32K$0.17$0.28
178159Kimi K2 0711936±103.3K5.7%1.6%29 tps1.3s131K$0.72$2.60
179167Qwen3 14B936±104.2K9.1%1.7%109 tps0.8s41K$0.04$0.15
180189Devstral Small934±321.3K5.0%2.4%180 tps0.6s131K$0.10$0.30
181189Grok 3 Mini934±94.6K7.5%1.2%43 tps0.5s131K$0.30$0.50
182179Qwen3 8B929±123.4K9.0%2.4%61 tps1.4s41K$0.02$0.07
183179Grok 3 Mini Fast928±94.8K7.5%1.6%44 tps0.5s131K$0.60$4.00
184179DeepSeek Prover v2926±171.1K3.2%5.2%14 tps1.3s164K$0.40$1.56
185210Magistral Medium 2509923±172.1K9.6%4.0%58 tps0.9s131K$2.00$5.00
186159OpenAI o3-mini-low920±95.5K8.9%0.7%139 tps1.5s200K$1.10$4.40
187179ERNIE 4.5 VL 424B A47B918±195455.2%4.9%36 tps3.5s123K$0.42$1.25
188210Qwen 2.5 7B Turbo918±385655.8%0.5%125 tps0.4s131K$0.30$0.30
189179NVIDIA Llama 3.3 Nemotron Super 49B v1.5917±338207.9%2.0%50 tps0.6s131K$0.09$0.33
190201GPT-3.5 Turbo916±151.1K2.2%1.3%74 tps0.9s16K$0.75$1.75
191189Inception Mercury Coder Small Beta914±345702.6%1.7%270 tps1.4s32K$0.25$1.00
192189Codestral911±297255.8%5.2%151 tps0.9s262K$0.15$0.45
193210Inception Mercury911±66.6K3.2%0.4%257 tps1.1s32K$0.25$1.00
194179ERNIE 4.5 21B A3B910±245107.3%2.3%78 tps1.5s120K$0.05$0.19
195201Amazon Nova Pro 1.0908±95.2K3.6%0.9%96 tps0.7s300K$0.80$1.70
196210Mistral Small 3 24B Instruct907±121.7K3.4%2.6%77 tps0.6s33K$0.07$0.14
197210Krutrim Spectre V2904±161.1K0.9%<0.1%33 tps3.1s4K$0.19$0.19
198201Llama 3.2 11B Instruct902±142K3.8%1.5%152 tps0.5s8K$0.16$0.16
199210Moonshot V1 128k899±231.1K4.4%1.4%54 tps1.5s131K$2.00$5.00
200210Mistral Small 24B Instruct894±131.5K4.2%1.5%84 tps0.4s33K$0.80$0.80
View All (273 models)