Last updated about 1 month ago
| Rank | Overall | Name | VIBE Score | Confidence Interval | Votes | Downvote % | Abort % | Speed | Latency | Context | Cost (Input) | Cost (Output) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 401 | 419 | 694 | ±19 | 880 | 2.2% | <0.1% | 17 tps | 13.5s | 131K | $0.12 | $0.47 | |
| 402 | 274 | 649 | ±31 | 515 | 6.4% | 3.1% | 44 tps | 3.8s | 131K | $2.00 | $5.00 | |
| 403 | 289 | UI-TARS 1.5 7B | 646 | ±17 | 915 | 4.2% | 4.0% | 75 tps | 0.9s | 128K | $0.10 | $0.20 |
| 404 | 430 | OpenHands LM 32B V0.1 | 633 | ±7 | 1.8K | 0.8% | <0.1% | 11 tps | N/A | 16K | $2.60 | $3.40 |
| 405 | 291 | 626 | ±8 | 4.4K | 4.9% | 9.7% | 30 tps | 0.9s | 128K | $0.07 | $0.30 | |
| 406 | 288 | 624 | ±17 | 2.2K | 7.8% | 3.0% | 44 tps | 2.5s | 128K | $0.21 | $0.63 | |
| 407 | 434 | 596 | ±9 | 1.9K | 4.1% | <0.1% | 34 tps | 3.3s | 33K | $0.02 | $0.07 | |
| 408 | 430 | 569 | ±13 | 745 | 2.6% | <0.1% | 14 tps | 0.7s | 128K | $0.10 | $0.10 | |
| 409 | 291 | 508 | ±26 | 545 | 5.2% | 2.6% | 258 tps | 0.4s | 33K | $0 | $0 | |
| 410 | 439 | Mistral Nemo 12B Inferor v0.0 | 344 | ±7 | 2.2K | 0.9% | <0.1% | 83 tps | 0.8s | 16K | $0.80 | $1.20 |