jevBench14

In index
Reasoning

Models89

Top result70.8%classifier.dev (fast)

Top-3 spread5.0 pts

YearN/A

Result and price

Results

89 results

#ModelResult

01classifier.dev (fast)70.8%

02Imajev-4B67.4%

03Plumb-4B65.8%

04decider-4b v264.1%

05Jev 1.13.063.3%

06JevK5 v0.2.062.0%

07Cygnet61.8%

08Hopper59.4%

09Winnow-12B Q855.6%

10reflex 4B54.0%

11djev52.2%

12Jev-Omni51.3%

13metask-jev-4b47.8%

14SemIf Qwen3.5-4B47.7%

15Jobe Qwen3.5-4B46.9%

16local-jev Qwen3.5-4B46.8%

17system-one-open45.1%

18spark-s1-4b-v644.6%

19Malkuth-4B44.5%

20jqv Qwen3-32B44.4%

21decider-35b-a3b41.2%

22Raw Qwen3 4B Instruct 2507 direct logits41.0%

23OpenSourceJev Qwen3.5-4B Q4_K_M40.9%

24ZeroEntropy zerank-240.2%

25decision-machine-139.9%

26Malkuth-2B38.9%

27Raw Phi-4 mini direct logits38.0%

28JEV Qwen3.5-9B Base NVFP437.7%

29OpenJev DiffusionGemma 26B-A4B NVFP436.9%

30kev 4B36.1%

31Decision 2B v5935.8%

32Qwen3.5-9B Jev-like data-mix v235.2%

33GPT-6 Luna (low)35.1%

34SimpleJev Qwen3.8-27B34.6%

35NInfer Qwen3.8-Flash-Next mixed34.0%

36swanOne33.6%

37GPT-6 Luna (medium)33.3%

38open-alternative-jev Qwen3.5-4B33.2%

39jev-local Qwen3.5-9B32.5%

39Decision Fast v53a32.5%

41decider-2b30.7%

42jeff30.6%

43Laya30.3%

44Autoloops Gemma 4 31B IT30.0%

45Standard One 8B29.1%

46lev-350m28.5%

47openjev-sglang Qwen3.6-35B-A3B27.7%

48Von 395M27.5%

49NInfer Qwen3.8-27B NVFP4 (T=1.5)26.9%

50NInfer Qwen3.8-27B NVFP426.3%

51kev 8B25.6%

52JevOne25.5%

53typecastlm25.3%

54SimpleJev Qwen3.6-35B-A3B24.9%

55kev 0.6B24.8%

56Raw Qwen3 8B direct logits23.7%

57system-one Qwen3-8B23.4%

58OpenDecision ModernBERT-large21.6%

59LitJev Qwen3.8-27B19.5%

60openJev Verdict 1.419.0%

61kev 0.5B18.9%

62Bespoke Nimble 9B18.7%

63GPT-5.6 Luna (low)18.5%

64openJev Verdict18.1%

64Raw Qwen3 1.7B direct logits18.1%

66reflex-27b17.8%

67JevAct16.9%

68djev (thinking)15.2%

69GLiNER2 large15.1%

70OpenJev (thinking, BF16)14.8%

71Qwen3.5-0.8B Decision Model14.5%

72Gemini 3.1 Flash-Lite14.3%

73open-jev-deberta-v3-large12.6%

74smalljev semantic-v912.3%

75GLiNER2.5 base11.8%

76Instinct Qwen3.8-27B11.4%

77Open-Jev 9B11.2%

78Open-Jev 2B10.0%

79GLiNER2.5 multi9.8%

80CLM-8B8.6%

81SimpleJev Qwen3.5-0.8B7.5%

82GLiNER2.5 small7.2%

83Raw Qwen3 0.6B direct logits7.1%

84verdict-small5.7%

85DeepSeek V4.1 Flash4.8%

86Mirror2.1%

87Open Jev JSON Canvas0.0%

87Qwen3.8-27B (Chutes TEE)0.0%