ToolSandbox

Apple benchmark of stateful, conversational tool use, where tool calls change state and a simulated user takes part.

ModelsModels with a result.3
Top resultBest result on this benchmark.—
Top-3 spreadPoints from first to third.—
YearYear of release.2024

Results

3 results
#ModelResultThe score from the source.
—LFM3-1.7B80.4%