docketrouter
Models / Qwen

Qwen3 30B A3B

by Qwen · qwen/qwen3-30b-a3b

Qwen3, the latest generation in the Qwen large language model series, features both dense and mixture-of-experts (MoE) architectures to excel in reasoning, multilingual support, and advanced agent tasks. Its unique...

reasoningtool-usereleased 2025-04-28
JSONRoute to this model
Legal score · raw
-
not yet benchmarked
Context
131K
max output 16K
Input
$0.12
per 1M tokens
Output
$0.50
per 1M tokens
Suite cost
-
run the suite to see

Benchmark results

TaskCategoryRawJuicedCorrectLatencyCostRan
Hearsay IdentificationEvidence------
Bluebook Citation FormatResearch & Writing------
Federal Civil ProcedureProcedure------
Limitations ArithmeticProcedure------
Contract Clause ClassificationContracts------
Citation Hallucination ResistanceReliability------

Measured by DocketBuster

These numbers come from DocketBuster's own legal battery, not from DocketRouter's suite. Latest run per metric, with n and a 95% Wilson interval where the source reports one. See docketbuster.com/benchmarks.

MetricValuenIntervalMeasured
Statute pinpoint, exact section (no retrieval)7.0% (21/299)29995% CI 4.6% to 10.5%2026-08-21
Statute pinpoint, exact section (with DocketBuster retrieval)76.9% (236/307)30795% CI 71.8% to 81.2%2026-08-24
Say-nothing rate (declines to bluff when the answer is not in the record)99.7%28695% CI 98.0% to 99.9%2026-08-21
Abstained on statute pinpoint4.6% (14/307)307count, no interval reported2026-08-24
Coaching quality (GW-14x, 0 to 8)7.36 / 8-rubric mean, no interval reported2026-08-22

Source files: hard-llm-ortier-cheap-statute.json, hard-llm-ortier-cheap-say.json, gw14x-ortier-cheap.json, hard-llm-level-qwen3-30b-a3b-statute_rag.json. Raw model name in source: qwen/qwen3-30b-a3b-instruct-2507.