jamba-large-1.7 vs ministral-8b-latest

Capability for the money

jamba-large-1.7 is 23.3× dearer for 6.1 points on following instructions (IFBench) — worth it only if that is your bottleneck.

1. Following instructions

   extraction, classification, sticking to a format

   IFBench
   jamba-large-1.735.2%

   ministral-8b-latest29.1%

   jamba-large-1.7 +6.1

2. Coding

   writing and fixing code

   LiveCodeBench
   jamba-large-1.718.1%

   ministral-8b-latest30.3%

   ministral-8b-latest +12.2

3. Tool use

   multi-step agent work against real tools

   τ²-bench
   jamba-large-1.713.5%

   ministral-8b-latest26.6%

   ministral-8b-latest +13.1

4. Hard reasoning

   graduate-level science and multi-step analysis

   GPQA Diamond
   jamba-large-1.739.0%

   ministral-8b-latest47.1%

   ministral-8b-latest +8.1

Averaged over the benchmarks both models sat, ministral-8b-latest returns 221.8 points of pass rate per dollar of blended price against 7.6 — the ratio that decides whether the dearer model earns its rate.

Each figure is a pass rate: the share of that test set the model answered correctly, measured by a third party rather than self-reported by the lab. Rows are different tests of different difficulty, so compare a model against the other model, not one row against the next. And a benchmark is not your workload — it narrows the shortlist, it does not pick for you.