claude-opus-5 vs llama-3.1-8b-instant

Capability for the money

Not the same tier: claude-opus-5 leads llama-3.1-8b-instant by 67.3 points on hard reasoning (GPQA Diamond), for 173.9× the price.

1. Hard reasoning

   graduate-level science and multi-step analysis

   GPQA Diamond
   claude-opus-593.2%

   llama-3.1-8b-instant25.9%

   claude-opus-5 +67.3

Averaged over the benchmarks both models sat, llama-3.1-8b-instant returns 450.4 points of pass rate per dollar of blended price against 9.3 — the ratio that decides whether the dearer model earns its rate.

Each figure is a pass rate: the share of that test set the model answered correctly, measured by a third party rather than self-reported by the lab. Rows are different tests of different difficulty, so compare a model against the other model, not one row against the next. No published following instructions, coding or tool use score for one of these models, so those lenses are omitted. And a benchmark is not your workload — it narrows the shortlist, it does not pick for you.