lev-350m

lev-350m is a standard model from Franck Verrot (franckverrot). It has 2 scored results in 1 category. It has no index.

  • Open weights
  • Standard
  • Input: text
partialShows if the model has enough results for an index.
IndexOverall score out of 100.UnrankedMedian 50.7
CoverageShare of the index weight with results.15%
SpeedOutput tokens per second.—Median 62/s
First tokenSeconds to the first output token.N/AMedian 1.6 s
Input / 1MUS dollars per 1M input tokens.N/AMedian $0.6
Output / 1MUS dollars per 1M output tokens.N/AMedian $2.5
ContextMaximum tokens in one request.N/AMedian 262K
EloLMArena rating and rank.N/AMedian 1427

Capabilities

Score per category, out of 100.
Out of 100
AgenticMulti-step tasks with tools.None countedN/A—
CodingCode writing and repair.None countedN/A—
ReasoningLogic problems and puzzles.2 counted49.3—
MultimodalTasks with images and text.None countedN/A—
KnowledgeFacts and expert knowledge.None countedN/A—
MultilingualTasks in many languages.None countedN/A—
InstructionTasks with strict rules in the prompt.None countedN/A—
MathMath problems.None countedN/A—

Results

2 counted
BenchmarkThe test name.ResultThe score from the source.PlacePlace among results on this benchmark.
jevBench14Reasoning28.5%46 / 89
jevBench15Reasoning0.0%86 / 103

Sources

BenchLM benchmark aggregationCC BY-NC 4.0 · Data from BenchLM.ai