Leaderboard | Text

Models

Choose model family

Claude by Anthropic

Mistral by Mistral AI

Topics

Choose topic

All topics Facts and Information Creative Writing and Ideation Logic and Problem-Solving Task Completion Coding

Choose language

All languages English Chinese Arabic Spanish Indonesian Japanese

More filters

Show inactive models

Hide models that are no longer actively available on Yupp.

Turns

Filter model performance by the number of turns in a conversation.

All Single turn Multiple turns

Open license models

Filter the leaderboard to only show models that have an open license.

All selected Open license Proprietary license

901

OpenAI o3-mini-high

902

Command R+

903

GPT-4 Turbo

903

Mixtral 8x22B

904

GLM 4 32B

906

Gemma 2 27B

909

Gemma 3 1B

909

Gemma 3 4B

911

WizardLM-2 8x22B

911

Moonshot V1 8k

912

Krutrim Spectre V2

915

Llama 3.1 8B

917

Moonshot V1 128k

920

Command R

922

Ministral 8B

Last updated about 1 month ago

Rank	Overall	Name	VIBE Score	Confidence Interval	Votes	Downvote %	Abort %	Speed	Latency	Context	Cost (Input)	Cost (Output)
41	214	OpenAI o3-mini-high	901	±3	15.8K	3.0%	2.4%	231 tps	10.5s	200K	$1.10	$4.40
42	235	Command R+	902	±5	6.6K	2.2%	2.8%	36 tps	0.7s	128K	$2.08	$9.45
43	253	GPT-4 Turbo	903	±13	785	4.3%	4.7%	21 tps	1.9s	128K	$10.00	$30.00
44	246	Mixtral 8x22B	903	±5	5.2K	2.1%	1.2%	140 tps	0.6s	64K	$2.00	$6.00
45	235	GLM 4 32B	904	±2	11.7K	2.1%	2.6%	40 tps	1.6s	33K	$0.14	$0.14
46	253	Gemma 2 27B	906	±3	6.9K	1.8%	1.4%	44 tps	1.4s	8K	$0.80	$0.80
47	256	Gemma 3 1B	909	±4	7.1K	3.0%	0.6%	176 tps	1.0s	33K	$0.06	$0.10
48	235	Gemma 3 4B	909	±2	12.6K	1.9%	1.3%	138 tps	0.7s	131K	$0.02	$0.04
49	246	WizardLM-2 8x22B	911	±2	9.8K	1.1%	11.6%	11 tps	2.5s	66K	$0.77	$0.77
50	240	Moonshot V1 8k	911	±6	4K	1.8%	1.0%	55 tps	1.5s	8K	$0.20	$2.00
51	229	Krutrim Spectre V2	912	±4	7.4K	1.1%	<0.1%	33 tps	3.1s	4K	$0.19	$0.19
52	229	Llama 3.1 8B	915	±8	1.3K	2.9%	1.9%	61 tps	1.0s	8K	$0.07	$0.09
53	214	Moonshot V1 128k	917	±5	4.7K	1.7%	1.4%	54 tps	1.5s	131K	$2.00	$5.00
54	225	Command R	920	±3	9.8K	2.0%	5.8%	54 tps	0.6s	128K	$0.30	$0.99
55	229	Ministral 8B	922	±3	7.7K	2.5%	1.4%	177 tps	0.4s	128K	$0.14	$0.14
56	235	Mixtral 8x7B	923	±4	5.3K	2.2%	2.2%	142 tps	0.6s	33K	$0.23	$0.23
57	225	GPT-3.5 Turbo 16k	923	±3	10.7K	1.6%	<0.1%	22 tps	0.6s	16K	$3.00	$4.00
58	222	Sky T1 32B Preview	923	±3	11.2K	1.6%	7.8%	73 tps	0.6s	16K	$0.12	$0.18
59	214	Llama 3.3 70B Instruct Turbo	925	±5	4.2K	3.3%	2.0%	78 tps	1.0s	131K	$0.88	$0.88
60	240	GPT-3.5 Turbo Instruct	926	±3	8K	1.4%	<0.1%	46 tps	1.2s	4K	$1.50	$2.00
61	240	Llama 3.3 70B Instruct	927	±11	900	2.7%	5.3%	28 tps	1.3s	128K	$0.38	$0.55
62	240	Mistral Nemo	928	±3	4.2K	1.2%	<0.1%	112 tps	0.4s	131K	$0.07	$0.13
63	229	Moonshot V1 Auto	928	±6	4K	1.6%	1.2%	54 tps	1.5s	8K	$2.00	$5.00
64	246	Ministral 3B	929	±3	8.6K	2.2%	0.8%	248 tps	0.4s	131K	$0.08	$0.08
65	229	ERNIE 4.5 21B A3B Thinking	930	±6	2.7K	3.6%	1.8%	87 tps	1.5s	120K	$0.07	$0.28
66	214	C4AI Aya Expanse 32B	930	±2	17.9K	1.6%	1.5%	43 tps	0.5s	128K	$0.50	$1.50
67	201	GPT-4o mini	932	±4	9K	3.4%	2.1%	71 tps	1.7s	128K	$0.15	$0.60
68	186	GLM 4.6V Flash	933	±4	7.9K	3.7%	3.7%	64 tps	2.1s	128K	$0.04	$0.40
69	214	Qwen 2.5 7B	934	±4	7.5K	2.3%	3.7%	40 tps	1.9s	131K	$0.08	$0.27
70	201	Gemma 3 27B IT	938	±3	9.7K	1.7%	2.0%	60 tps	0.8s	128K	$0.17	$0.29
71	209	Llama 3.3 Swallow 70B Instruct	938	±3	10.7K	3.2%	1.4%	153 tps	1.3s	131K	$0.13	$0.39
72	225	Command R 7B	940	±3	14K	1.9%	1.1%	76 tps	0.4s	128K	$0.04	$0.15
73	209	Qwen 2.5 14B Instruct	944	±3	9K	2.3%	2.4%	40 tps	1.6s	1M	$0.40	$1.61
74	222	Jamba 1.5 Large	944	±3	13.6K	1.6%	1.7%	48 tps	0.9s	256K	$1.50	$6.00
75	235	Hermes 2 Pro Llama 3 8B	945	±2	8.8K	1.0%	<0.1%	76 tps	1.0s	131K	$0.08	$0.09
76	225	Open Mistral Nemo	946	±3	7.3K	2.1%	1.5%	171 tps	0.5s	131K	$0.15	$0.15
77	214	Krutrim 2	947	±2	11.8K	0.6%	12.5%	33 tps	2.1s	128K	$1.00	$1.00
78	186	Grok 3 Mini	948	±2	28.5K	3.9%	1.2%	43 tps	0.5s	131K	$0.30	$0.50
79	209	GPT-3.5 Turbo	950	±2	6K	1.0%	1.3%	74 tps	0.9s	16K	$0.75	$1.75
80	209	Qwen3.5 9B FP8	952	±19	495	3.9%	5.8%	64 tps	0.7s	256K	$0.10	$0.15

2of8

View All (288 models)