Models
Topics
Language
More

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

Open license models

Filter the leaderboard to only show models that have an open license.

921
Gemma 3 12B
921
OpenAI o3-mini
922
OpenAI o3-mini-high
922
Seed 1.6 Flash 250715
925
OpenAI o4-mini
928
Kimi K2 0711
928
GPT-5 Nano
930
Gemma 3 27B IT
931
Llama 3.3 70B Instruct Turbo
933
DeepSeek Prover v2
935
OpenAI o3
937
Cogito v2.1 671B
939
Grok 3 Mini Fast
939
GLM 4.7 Flash
941
Llama 4 Scout

Last updated about 1 month ago

RankOverallNameVIBE
Score
Confidence
Interval
VotesDownvote %Abort %SpeedLatencyContextCost
(Input)
Cost
(Output)
41214Gemma 3 12B921±186353.1%4.2%73 tps0.8s131K$0.05$0.12
42177OpenAI o3-mini921±69K1.9%0.8%143 tps3.3s200K$1.10$4.40
43214OpenAI o3-mini-high922±67.5K2.0%2.4%231 tps10.5s200K$1.10$4.40
44209Seed 1.6 Flash 250715922±165802.5%2.5%108 tps1.6s256K$0.07$0.30
45139OpenAI o4-mini925±84K2.3%1.4%97 tps7.0s128K$1.10$4.40
46170Kimi K2 0711928±93.2K2.2%1.6%29 tps1.3s131K$0.72$2.60
47157GPT-5 Nano928±101.8K3.0%3.2%113 tps20.9s400K$0.05$0.40
48201Gemma 3 27B IT930±156552.2%2.0%60 tps0.8s128K$0.17$0.29
49214Llama 3.3 70B Instruct Turbo931±275053.8%2.0%78 tps1.0s131K$0.88$0.88
50161DeepSeek Prover v2933±178252.4%5.2%14 tps1.3s164K$0.40$1.56
51148OpenAI o3935±54.3K1.7%0.9%85 tps6.8s128K$7.33$29.33
52157Cogito v2.1 671B937±158851.7%0.8%85 tps0.5s128K$1.25$1.25
53186Grok 3 Mini Fast939±113.9K2.3%1.6%44 tps0.5s131K$0.60$4.00
54179GLM 4.7 Flash939±111.1K1.3%5.8%61 tps2.8s128K$0.07$0.39
55160Llama 4 Scout941±76.9K1.5%0.6%88 tps5.1s131K$0.18$0.46
56165DeepSeek R1T2 Chimera947±206202.4%3.0%28 tps1.8s164K$0.13$0.45
57177Mistral Small 3.1 24B Instruct949±167452.0%7.5%15 tps2.4s131K$0.06$0.18
58170Mistral Small 3.2 24B953±91.4K1.8%2.8%141 tps0.7s33K$0.02$0.08
59170Llama 3.1 8B Turbo954±206852.1%2.1%650 tps0.5s128K$0.13$0.14
60129DeepSeek V3.1 Thinking956±102.2K2.4%7.1%18 tps1.8s131K$0.23$0.75
61175OpenAI o3-mini-low963±88.8K1.9%0.7%139 tps1.5s200K$1.10$4.40
6286Amazon Nova 2 Lite966±91.6K3.0%1.0%137 tps0.6s300K$0.35$2.95
63148OpenAI o4-mini-high966±49.3K1.8%1.9%117 tps15.9s200K$1.10$4.40
64165Qwen3 4B970±83.1K2.7%1.9%94 tps1.5s128K$0.01$0.01
6579MiniMax M2.5 Lightning972±179351.1%1.5%51 tps2.0s205K$0.60$2.40
66124Kimi K2 0905 Turbo972±73.2K3.9%0.7%373 tps0.5s262K$1.70$6.50
6795Gemini 2.5 Flash Lite Thinking Preview 0925978±72.2K2.5%1.5%152 tps3.0s1M$0.10$0.40
68161Llama 4 Maverick980±67.3K1.8%1.2%88 tps2.4s1M$0.23$0.83
69153OpenAI o1981±59.1K1.7%4.2%92 tps5.5s200K$15.00$60.00
70143Gemini 2.0 Flash Lite988±64.1K2.6%<0.1%42 tps0.5s1M$0.08$0.30
7171MiniMax M2.5 FP8988±195251.9%3.6%33 tps1.7s205K$0.45$1.75
72161Qwen3 8B992±83.1K1.6%2.4%61 tps1.4s41K$0.02$0.07
73133DeepSeek-R1 0528998±44.9K1.5%1.3%93 tps0.5s64K$1.60$3.67
74157Qwen3 Next 80B A3B Thinking1000±73.2K3.0%0.6%175 tps1.3s256K$0.21$2.26
75148DeepSeek-R11001±65K1.7%0.8%133 tps0.6s64K$0.91$3.07
76133Qwen3 14B1002±63.6K1.6%1.7%109 tps0.8s41K$0.04$0.15
77113Gemini 2.5 Flash Lite Thinking1003±83.7K2.4%1.0%118 tps4.4s1M$0.03$0.13
78113Kimi K2 Fast1003±410K1.8%0.8%365 tps0.5s131K$1.00$3.00
79133DeepSeek V3.2 Speciale1003±101.3K2.2%6.0%43 tps1.4s131K$0.84$1.52
80143Seed 1.6 2506151005±208802.2%3.1%46 tps2.2s256K$0.25$2.00
View All (193 models)