Needle 3 (options as tools)

Needle 3 (options as tools) is a standard model from Cactus Compute. It has no scored result.

  • Open weights
  • Standard
  • Input: text
partialShows if the model has enough results for an index.
IndexOverall score out of 100.UnrankedMedian 50.7
CoverageShare of the index weight with results.0%
SpeedOutput tokens per second.—Median 62/s
First tokenSeconds to the first output token.N/AMedian 1.6 s
Input / 1MUS dollars per 1M input tokens.N/AMedian $0.6
Output / 1MUS dollars per 1M output tokens.N/AMedian $2.5
ContextMaximum tokens in one request.N/AMedian 262K
EloLMArena rating and rank.N/AMedian 1427

Capabilities

Score per category, out of 100.
Out of 100
AgenticMulti-step tasks with tools.None countedN/A—
CodingCode writing and repair.None countedN/A—
ReasoningLogic problems and puzzles.None countedN/A—
MultimodalTasks with images and text.None countedN/A—
KnowledgeFacts and expert knowledge.None countedN/A—
MultilingualTasks in many languages.None countedN/A—
InstructionTasks with strict rules in the prompt.None countedN/A—
MathMath problems.None countedN/A—

Results

0 counted
BenchmarkThe test name.ResultThe score from the source.PlacePlace among results on this benchmark.
jevBench15Reasoning0.0%—

Sources

BenchLM benchmark aggregationCC BY-NC 4.0 · Data from BenchLM.ai

More from Cactus Compute

All models
Needle 3 (2-bit)Unranked