jamba-mini-1.7 vs llama-3.3-70b-versatile

Capability for the money

Not the same tier: llama-3.3-70b-versatile leads jamba-mini-1.7 by 15.7 points on following instructions (IFBench), for 2.6× the price.

1. Following instructions

   extraction, classification, sticking to a format

   IFBench
   jamba-mini-1.731.4%

   llama-3.3-70b-versatile47.1%

   llama-3.3-70b-versatile +15.7

2. Coding

   writing and fixing code

   LiveCodeBench
   jamba-mini-1.76.1%

   llama-3.3-70b-versatile28.8%

   llama-3.3-70b-versatile +22.7

3. Tool use

   multi-step agent work against real tools

   τ²-bench
   jamba-mini-1.712.6%

   llama-3.3-70b-versatile26.6%

   llama-3.3-70b-versatile +14.0

4. Hard reasoning

   graduate-level science and multi-step analysis

   GPQA Diamond
   jamba-mini-1.732.2%

   llama-3.3-70b-versatile49.8%

   llama-3.3-70b-versatile +17.6

Averaged over the benchmarks both models sat, jamba-mini-1.7 returns 82.3 points of pass rate per dollar of blended price against 59.5 — the ratio that decides whether the dearer model earns its rate.

Each figure is a pass rate: the share of that test set the model answered correctly, measured by a third party rather than self-reported by the lab. Rows are different tests of different difficulty, so compare a model against the other model, not one row against the next. And a benchmark is not your workload — it narrows the shortlist, it does not pick for you.