Ornith-1.5-397B

Ornith-1.5-397B is a reasoning model from Ornith AI in the Ornith 1.5 family. 14 benchmarks count toward its score, in 3 categories.

partialShows if the model has enough results for an index.
IndexOverall score out of 100.Unranked
CoverageShare of the index weight with results.55%
SpeedOutput tokens per second.
Input / 1MUS dollars per 1M input tokens.Free
Output / 1MUS dollars per 1M output tokens.Free
ContextMaximum tokens in one request.262K
EloLMArena rating and rank.N/A

The index is a score out of 100. The ± range shows how much it can change.

CapabilitiesScore per category, out of 100.

Out of 100
AgenticMulti-step tasks with tools.
70.8
CodingCode writing and repair.
68.4
ReasoningLogic problems and puzzles.
N/A
MultimodalTasks with images and text.
N/A
KnowledgeFacts and expert knowledge.
65.2
MultilingualTasks in many languages.
N/A
InstructionTasks with strict rules in the prompt.
N/A
MathMath problems.
N/A

Results

14 counted
BenchmarkThe test name.CategoryThe capability that the test measures.ResultThe score from the publisher.IndexThis result as a score out of 100.RunThe settings of the run.DateDate of the result.Published byThe source of the result.
Graduate-Level Google-Proof Q&AKnowledge92.8%63.9David Rein et al.
GPQA DiamondKnowledge92.8%63.9David Rein et al.
BrowseCompAgentic86.6%72.5OpenAI
Terminal-Bench 2.1 (provider run)Agentic86.1%74.9DeepSeek-AI
Terminal-Bench 2.1 (provider run)Agentic86.1%74.9DeepSeek-AI
Software Engineering Benchmark VerifiedCoding86.0%66.5Carlos E. Jimenez et al.
Claw-EvalAgentic81.4%86.3Bowen Ye et al.
WideResearchAgentic80.8%66.7Qwen
MCP AtlasAgentic80.0%68.4OpenAI
Toolathlon-VerifiedAgentic71.2%69.9Moonshot AI
SWE-bench ProCoding65.1%67.0Xiang Deng et al.
NL2RepoCoding59.5%71.8MiniMax
Humanity's Last Exam with toolsAgentic56.1%68.9DeepSeek-AI
DeepSWEAgentic56.0%64.5Datacurve AI
Humanity's Last ExamKnowledge44.6%66.6Center for AI Safety et al.
Humanity's Last Exam without toolsKnowledge44.6%66.6OpenAI
Terminal-Bench 3.0Agentic13.5%65.2Ryan Marten et al.

14 benchmarks count, from 17 of 17 results. A grey row does not count. Too few models took that benchmark.

Sources

BenchLM benchmark aggregationUsed with attribution; per-benchmark results credited to their original authors

More from Ornith AI

Ornith-1.5-35B-A3BUnrankedOrnith-1.5-9BUnranked