SWE-Llama 7B

SWE-Llama 7B is a model from Unknown. 2 benchmarks count toward its score, in 1 category.

partialShows if the model has enough results for an index.
IndexOverall score out of 100.Unranked
CoverageShare of the index weight with results.20%
SpeedOutput tokens per second.
Input / 1MUS dollars per 1M input tokens.N/A
Output / 1MUS dollars per 1M output tokens.N/A
ContextMaximum tokens in one request.N/A
EloLMArena rating and rank.N/A

The index is a score out of 100. The ± range shows how much it can change.

CapabilitiesScore per category, out of 100.

Out of 100
AgenticMulti-step tasks with tools.
N/A
CodingCode writing and repair.
5.0
ReasoningLogic problems and puzzles.
N/A
MultimodalTasks with images and text.
N/A
KnowledgeFacts and expert knowledge.
N/A
MultilingualTasks in many languages.
N/A
InstructionTasks with strict rules in the prompt.
N/A
MathMath problems.
N/A

Results

2 counted
BenchmarkThe test name.CategoryThe capability that the test measures.ResultThe score from the publisher.IndexThis result as a score out of 100.RunThe settings of the run.DateDate of the result.Published byThe source of the result.
SWE-bench VerifiedCoding1.4%5.0RAG baseline26 Feb 2026SWE-bench team
SWE-bench LiteCoding1.3%5.0RAG baseline11 Sept 2025SWE-bench team

2 benchmarks count, from 2 of 2 results. A grey row does not count. Too few models took that benchmark.

Sources

BenchLM benchmark aggregationUsed with attribution; per-benchmark results credited to their original authorsSWE-bench team, collected directlyNo licence stated for the leaderboard. The harness repo is MIT

More from Unknown

4x ScaledUnranked6 No ThinkingUnrankedAI Co-MathematicianUnrankedAlephproverUnrankedAMALIA 9B DPOUnranked