Fixie AI
availableShows if the model has enough results for an index.Ultravox v0.6 Llama 3.3 70B
Ultravox v0.6 Llama 3.3 70B is a non-reasoning model from Fixie AI. 10 benchmarks count toward its score, in 5 categories.
IndexOverall score out of 100.29.6 ±7.6
CoverageShare of the index weight with results.75%
SpeedOutput tokens per second.—
Input / 1MUS dollars per 1M input tokens.N/A
Output / 1MUS dollars per 1M output tokens.N/A
ContextMaximum tokens in one request.N/A
EloLMArena rating and rank.N/A
The index is a score out of 100. The ± range shows how much it can change.
CapabilitiesScore per category, out of 100.
Out of 100Results
10 counted| BenchmarkThe test name. | CategoryThe capability that the test measures. | ResultThe score from the publisher. | IndexThis result as a score out of 100. | RunThe settings of the run. | DateDate of the result. | Published byThe source of the result. |
|---|---|---|---|---|---|---|
| Artificial Analysis GPQA Diamond | Knowledge | 49.8% | 19.6 | — | — | Artificial Analysis |
| Artificial Analysis IFBench | Instruction | 47.1% | 36.9 | — | — | Artificial Analysis |
| τ²-Bench Tool-Agent-User Evaluation | Agentic | 26.6% | 17.9 | — | — | Victor Barres et al. |
| Artificial Analysis Omniscience Accuracy | Knowledge | 19.0% | 37.4 | — | — | Artificial Analysis |
| Artificial Analysis Long Context Reasoning | Reasoning | 15.7% | 19.1 | — | — | Artificial Analysis |
| Artificial Analysis Coding Index | Coding | 11.9% | 27.4 | — | — | Artificial Analysis |
| Artificial Analysis Intelligence Index | Knowledge | 7.7% | 32.0 | — | — | Artificial Analysis |
| Artificial Analysis Humanity's Last Exam | Knowledge | 3.6% | 28.5 | — | — | Artificial Analysis |
| GDPval-AA normalized | Agentic | 0.0% | 35.6 | — | — | Artificial Analysis |
| Critical Physics Tasks | Reasoning | 0.0% | 38.4 | — | — | Artificial Analysis |
10 benchmarks count, from 10 of 10 results. A grey row does not count. Too few models took that benchmark.