Leaderboard | Text

Models

Choose model family

Claude by Anthropic

Mistral by Mistral AI

Topics

Choose topic

All topics Facts and Information Creative Writing and Ideation Logic and Problem-Solving Task Completion Coding

Choose language

All languages English Chinese Arabic Spanish Indonesian Japanese

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

All Single turn Multiple turns

Open license models

Filter the leaderboard to only show models that have an open license.

All selected Open license Proprietary license

654

GPT-4o mini

679

Qwen 2.5 14B Instruct

689

Gemma 3 12B

707

MiniMax M1

710

Switchpoint Router

726

Llama 3.3 70B

736

DeepSeek-R1 Distill Qwen 32B

744

Jamba 1.5 Large

761

Jamba 1.6 Large

782

Magistral Medium 2509

803

Amazon Nova Pro 1.0

807

Grok 3 Mini Fast

814

Gemma 3n E4B

820

GLM 4 32B

833

OpenAI o3-mini-high

Last updated about 1 month ago

Rank	Overall	Name	VIBE Score	Confidence Interval	Votes	Downvote %	Abort %	Speed	Latency	Context	Cost (Input)	Cost (Output)
1	201	GPT-4o mini	654	±30	515	4.6%	2.1%	71 tps	1.7s	128K	$0.15	$0.60
2	209	Qwen 2.5 14B Instruct	679	±22	505	3.8%	2.4%	40 tps	1.6s	1M	$0.40	$1.61
3	214	Gemma 3 12B	689	±23	550	4.3%	4.2%	73 tps	0.8s	131K	$0.05	$0.12
4	284	MiniMax M1	707	±14	1.5K	1.0%	<0.1%	31 tps	2.8s	1M	$0.55	$2.20
5	179	Switchpoint Router	710	±26	620	3.1%	1.7%	71 tps	4.9s	131K	$0.85	$3.40
6	194	Llama 3.3 70B	726	±26	735	5.2%	0.3%	500 tps	0.5s	8K	$0.48	$0.66
7	274	DeepSeek-R1 Distill Qwen 32B	736	±22	570	1.7%	6.2%	22 tps	1.8s	131K	$0.37	$0.39
8	222	Jamba 1.5 Large	744	±24	715	2.1%	1.7%	48 tps	0.9s	256K	$1.50	$6.00
9	186	Jamba 1.6 Large	761	±15	780	1.9%	2.0%	59 tps	1.2s	256K	$1.33	$5.33
10	229	Magistral Medium 2509	782	±28	550	7.6%	4.0%	58 tps	0.9s	131K	$2.00	$5.00
11	179	Amazon Nova Pro 1.0	803	±13	1.2K	2.0%	0.9%	96 tps	0.7s	300K	$0.80	$1.70
12	186	Grok 3 Mini Fast	807	±14	2.4K	1.8%	1.6%	44 tps	0.5s	131K	$0.60	$4.00
13	186	Gemma 3n E4B	814	±17	1.6K	3.6%	2.0%	30 tps	0.5s	8K	$0.01	$0.02
14	235	GLM 4 32B	820	±16	700	2.1%	2.6%	40 tps	1.6s	33K	$0.14	$0.14
15	214	OpenAI o3-mini-high	833	±13	2.9K	1.0%	2.4%	231 tps	10.5s	200K	$1.10	$4.40
16	179	Inception Mercury	847	±13	1.4K	1.0%	0.4%	257 tps	1.1s	32K	$0.25	$1.00
17	177	OpenAI o3-mini	851	±7	4.7K	1.8%	0.8%	143 tps	3.3s	200K	$1.10	$4.40
18	186	Grok 3 Mini	852	±14	2.5K	1.4%	1.2%	43 tps	0.5s	131K	$0.30	$0.50
19	175	OpenAI o3-mini-low	852	±8	4.4K	1.8%	0.7%	139 tps	1.5s	200K	$1.10	$4.40
20	209	Llama 3.3 Swallow 70B Instruct	865	±19	820	1.8%	1.4%	153 tps	1.3s	131K	$0.13	$0.39
21	170	Devstral Medium	865	±19	805	1.8%	1.5%	77 tps	0.6s	131K	$0.40	$2.00
22	194	Magistral Small 2506	870	±16	1K	2.8%	1.6%	156 tps	0.5s	40K	$0.37	$1.10
23	160	Llama 4 Scout	872	±11	4.4K	1.4%	0.6%	88 tps	5.1s	131K	$0.18	$0.46
24	157	Cogito v2.1 671B	876	±30	490	3.9%	0.8%	85 tps	0.5s	128K	$1.25	$1.25
25	139	GLM 4.6V	880	±33	885	2.2%	6.4%	21 tps	1.8s	128K	$0.38	$0.90
26	143	Seed 1.6 250615	888	±23	530	2.8%	3.1%	46 tps	2.2s	256K	$0.25	$2.00
27	148	OpenAI o4-mini-high	915	±10	4.7K	1.5%	1.9%	117 tps	15.9s	200K	$1.10	$4.40
28	133	DeepSeek V3.2 Speciale	922	±25	780	6.6%	6.0%	43 tps	1.4s	131K	$0.84	$1.52
29	111	Grok 3 Fast	922	±12	530	0.9%	1.7%	52 tps	2.4s	131K	$5.00	$25.00
30	170	Mistral Small 3.2 24B	929	±14	985	2.5%	2.8%	141 tps	0.7s	33K	$0.02	$0.08
31	170	Kimi K2 0711	932	±12	2.4K	1.7%	1.6%	29 tps	1.3s	131K	$0.72	$2.60
32	179	GLM 4.7 Flash	932	±26	690	2.1%	5.8%	61 tps	2.8s	128K	$0.07	$0.39
33	165	Qwen3 4B	940	±14	1.7K	5.2%	1.9%	94 tps	1.5s	128K	$0.01	$0.01
34	153	OpenAI o1	946	±11	3.6K	1.0%	4.2%	92 tps	5.5s	200K	$15.00	$60.00
35	143	Gemini 2.0 Flash Lite	948	±7	3.5K	1.7%	<0.1%	42 tps	0.5s	1M	$0.08	$0.30
36	86	Amazon Nova 2 Lite	948	±21	970	7.6%	1.0%	137 tps	0.6s	300K	$0.35	$2.95
37	157	GPT-5 Nano	955	±18	1.2K	4.1%	3.2%	113 tps	20.9s	400K	$0.05	$0.40
38	133	GPT-4.1 nano	958	±8	4K	1.4%	0.6%	175 tps	0.5s	1M	$0.10	$0.40
39	71	DeepSeek V3.1	962	±20	750	3.2%	0.8%	197 tps	0.4s	164K	$0.55	$1.60
40	143	Gemini 2.0 Flash	965	±12	1.8K	1.3%	<0.1%	76 tps	0.5s	1M	$0.14	$0.56

1of4

View All (131 models)