Models
Topics
Language
More

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

Open license models

Filter the leaderboard to only show models that have an open license.

998
DeepSeek-R1 0528
992
Qwen3 8B
988
MiniMax M2.5 FP8
988
Gemini 2.0 Flash Lite
981
OpenAI o1
980
Llama 4 Maverick
978
Gemini 2.5 Flash Lite Thinking Preview 0925
972
Kimi K2 0905 Turbo
972
MiniMax M2.5 Lightning
970
Qwen3 4B
966
OpenAI o4-mini-high
966
Amazon Nova 2 Lite
963
OpenAI o3-mini-low
956
DeepSeek V3.1 Thinking
954
Llama 3.1 8B Turbo

Last updated about 1 month ago

RankOverallNameVIBE
Score
Confidence
Interval
VotesDownvote %Abort %SpeedLatencyContextCost
(Input)
Cost
(Output)
121133DeepSeek-R1 0528998±44.9K1.5%1.3%93 tps0.5s64K$1.60$3.67
122161Qwen3 8B992±83.1K1.6%2.4%61 tps1.4s41K$0.02$0.07
12371MiniMax M2.5 FP8988±195251.9%3.6%33 tps1.7s205K$0.45$1.75
124143Gemini 2.0 Flash Lite988±64.1K2.6%<0.1%42 tps0.5s1M$0.08$0.30
125153OpenAI o1981±59.1K1.7%4.2%92 tps5.5s200K$15.00$60.00
126161Llama 4 Maverick980±67.3K1.8%1.2%88 tps2.4s1M$0.23$0.83
12795Gemini 2.5 Flash Lite Thinking Preview 0925978±72.2K2.5%1.5%152 tps3.0s1M$0.10$0.40
128124Kimi K2 0905 Turbo972±73.2K3.9%0.7%373 tps0.5s262K$1.70$6.50
12979MiniMax M2.5 Lightning972±179351.1%1.5%51 tps2.0s205K$0.60$2.40
130165Qwen3 4B970±83.1K2.7%1.9%94 tps1.5s128K$0.01$0.01
131148OpenAI o4-mini-high966±49.3K1.8%1.9%117 tps15.9s200K$1.10$4.40
13286Amazon Nova 2 Lite966±91.6K3.0%1.0%137 tps0.6s300K$0.35$2.95
133175OpenAI o3-mini-low963±88.8K1.9%0.7%139 tps1.5s200K$1.10$4.40
134129DeepSeek V3.1 Thinking956±102.2K2.4%7.1%18 tps1.8s131K$0.23$0.75
135170Llama 3.1 8B Turbo954±206852.1%2.1%650 tps0.5s128K$0.13$0.14
136170Mistral Small 3.2 24B953±91.4K1.8%2.8%141 tps0.7s33K$0.02$0.08
137177Mistral Small 3.1 24B Instruct949±167452.0%7.5%15 tps2.4s131K$0.06$0.18
138165DeepSeek R1T2 Chimera947±206202.4%3.0%28 tps1.8s164K$0.13$0.45
139160Llama 4 Scout941±76.9K1.5%0.6%88 tps5.1s131K$0.18$0.46
140179GLM 4.7 Flash939±111.1K1.3%5.8%61 tps2.8s128K$0.07$0.39
141186Grok 3 Mini Fast939±113.9K2.3%1.6%44 tps0.5s131K$0.60$4.00
142157Cogito v2.1 671B937±158851.7%0.8%85 tps0.5s128K$1.25$1.25
143148OpenAI o3935±54.3K1.7%0.9%85 tps6.8s128K$7.33$29.33
144161DeepSeek Prover v2933±178252.4%5.2%14 tps1.3s164K$0.40$1.56
145214Llama 3.3 70B Instruct Turbo931±275053.8%2.0%78 tps1.0s131K$0.88$0.88
146201Gemma 3 27B IT930±156552.2%2.0%60 tps0.8s128K$0.17$0.29
147157GPT-5 Nano928±101.8K3.0%3.2%113 tps20.9s400K$0.05$0.40
148170Kimi K2 0711928±93.2K2.2%1.6%29 tps1.3s131K$0.72$2.60
149139OpenAI o4-mini925±84K2.3%1.4%97 tps7.0s128K$1.10$4.40
150209Seed 1.6 Flash 250715922±165802.5%2.5%108 tps1.6s256K$0.07$0.30
151214OpenAI o3-mini-high922±67.5K2.0%2.4%231 tps10.5s200K$1.10$4.40
152177OpenAI o3-mini921±69K1.9%0.8%143 tps3.3s200K$1.10$4.40
153214Gemma 3 12B921±186353.1%4.2%73 tps0.8s131K$0.05$0.12
154186Jamba 1.6 Large915±186601.5%2.0%59 tps1.2s256K$1.33$5.33
155113GLM 4.5 AirX913±235401.8%3.3%75 tps1.2s131K$1.10$4.50
156186Grok 3 Mini908±93.8K2.3%1.2%43 tps0.5s131K$0.30$0.50
157214Qwen 2.5 7B901±194904.9%3.7%40 tps1.9s131K$0.08$0.27
158194Llama 3.3 70B900±121.1K3.0%0.3%500 tps0.5s8K$0.48$0.66
159170Devstral Medium899±109951.5%1.5%77 tps0.6s131K$0.40$2.00
160186GLM 4.6V Flash899±151.3K2.3%3.7%64 tps2.1s128K$0.04$0.40
View All (193 models)