{"id":"x-ai/grok-4.3","name":"Grok 4.3","owned_by":"x-ai","description":"Grok 4.3 is a reasoning model from SpaceXAI. It accepts text and image inputs with text output, and is suited for agentic workflows, instruction-following tasks, and applications requiring high factual...","context_window":1000000,"max_tokens":900000,"type":"language","tags":["reasoning","tool-use","vision"],"released":1777591821,"modalities":{"input":["text","image","file"],"output":["text"]},"supported_parameters":["include_reasoning","logprobs","max_tokens","reasoning","reasoning_effort","response_format","seed","structured_outputs","temperature","tool_choice","tools","top_logprobs","top_p"],"pricing":{"input":"0.00000125","output":"0.0000025","input_cache_read":"0.0000002"},"legal":[{"model":"x-ai/grok-4.3","task":"hearsay","suite":"docketrouter-legal-v0.1","mode":"raw","upstream":"openrouter","n":10,"correct":10,"score":1,"latencyMs":2981,"inputTokens":2659,"outputTokens":3362,"costUsd":0.011728750000000001,"ranAt":"2026-08-25T13:13:00.058Z","perItem":[{"id":"h1","answer":"YES","ok":1,"ms":2226},{"id":"h2","answer":"NO","ok":1,"ms":2620},{"id":"h3","answer":"NO \n\nThe defendant's out-of-court utterance constitutes a verbal act (operative words of acceptance) whose legal effect—formation of a contract—arises from the fact that the words were spoken, not from the truth of any factual assertion they contain. Under Federal Rule of Evidence 801(c), therefore, the statement is not offered “to prove the truth of the matter asserted” and is not hearsay.","ok":1,"ms":4095},{"id":"h4","answer":"YES","ok":1,"ms":2998},{"id":"h5","answer":"NO","ok":1,"ms":3101},{"id":"h6","answer":"YES","ok":1,"ms":3072},{"id":"h7","answer":"NO \n\nThe out-of-court utterance is not offered to prove that the evening was in fact beautiful; it is offered only as circumstantial evidence that the declarant was alive and capable of speech at 9 p.m. Because the statement is not being used for the truth of the matter asserted, it falls outside the definition of hearsay under Federal Rule of Evidence 801(c).","ok":1,"ms":2914},{"id":"h8","answer":"YES","ok":1,"ms":1848},{"id":"h9","answer":"NO","ok":1,"ms":3656},{"id":"h10","answer":"YES","ok":1,"ms":3284}]},{"model":"x-ai/grok-4.3","task":"citation","suite":"docketrouter-legal-v0.1","mode":"raw","upstream":"openrouter","n":8,"correct":8,"score":1,"latencyMs":4371,"inputTokens":2505,"outputTokens":3700,"costUsd":0.012381250000000002,"ranAt":"2026-08-25T13:13:08.566Z","perItem":[{"id":"c1","answer":"B \n\nThe correct Bluebook format for this landmark case follows T6 (case-name abbreviations), T1 (U.S. Reports), and Rule 10 (cases generally):\n\n- Party names are abbreviated (“Board of Education” becomes “Bd. of Educ.”).  \n- The reporter citation is written as volume–reporter–page: 347 U.S. 483.  \n- The year appears in parentheses at the end.\n\nOption A omits the required abbreviations and the periods in “U.S.”  \nOption C inverts the volume and page numbers and uses the forbidden “vs.”  \nOption D places the reporter abbreviation before the volume and reverses the page numbers.\n\nOnly B satisfies every applicable Bluebook rule.","ok":1,"ms":4026},{"id":"c2","answer":"C \n\nThe correct Bluebook format for a U.S. Supreme Court decision is Case Name, Volume Reporter Page (Year), per Bluebook Rule 10. The Miranda citation is therefore Miranda v. Arizona, 384 U.S. 436 (1966).  \n\n- A places the year outside parentheses and uses an incorrect comma.  \n- B places the year before the citation, violating the required order.  \n- D inverts the volume and page numbers.  \n\nOnly C satisfies both the order and punctuation requirements.","ok":1,"ms":3106},{"id":"c3","answer":"A \n\nThe correct Bluebook format for a current United States Code citation is prescribed by Rule 12.3: title number, “U.S.C.,” section symbol with a space, and pinpoint section number (e.g., 28 U.S.C. § 1331).  \n\n- Option A follows this format exactly.  \n- Option B omits the periods after “U.S.C.” and the required section symbol.  \n- Option C lacks the space after the section symbol and unnecessarily adds a parenthetical year/edition that Rule 12.3.2 does not require for an official, current code citation.  \n- Option D reverses the statutory elements and uses nonstandard phrasing.  \n\nThus only A satisfies Bluebook requirements.","ok":1,"ms":5053},{"id":"c4","answer":"D \n\nThe correct Bluebook format for a U.S. Supreme Court decision (Rules 10.2, 10.3, 10.4) is: abbreviated case name, volume-reporter-page (year).  \n\n- “Railroad” must be shortened to “R.R.” and “Company” to “Co.” (T6, T7).  \n- The official reporter citation is 304 U.S. 64.  \n- The year appears in parentheses immediately after the page number.  \n\nOption A leaves “Railroad” unabbreviated.  \nOption B inverts the volume and page numbers.  \nOption C omits the required parentheses.  \nOnly D satisfies every element of the rule.","ok":1,"ms":4476},{"id":"c5","answer":"B\nThe Bluebook (21st ed.) requires the following elements for a standard U.S. Court of Appeals decision published in the Federal Reporter: party names, volume, reporter abbreviation with internal periods (F.3d), first page, and a single parenthetical containing the court abbreviation followed by the year (9th Cir. 1997). Option B matches this format exactly. Option A omits the periods inside the reporter abbreviation. Option C uses an unabbreviated court name. Option D separates the court and year into two parentheticals. Thus only B satisfies current Bluebook rules.","ok":1,"ms":4762},{"id":"c6","answer":"C\nThe Bluebook (21st ed.) governs U.S. legal citation. Table T6 supplies the required abbreviations for court rules, and Rule 12.8.3 illustrates their use. The prescribed short form for the Federal Rules of Civil Procedure is therefore “Fed. R. Civ. P.” followed by the rule number and any subdivision—exactly the format shown in option C. Option A employs an obsolete, non-Bluebook abbreviation; option B uses the incorrect abbreviation “Proc.” instead of “P.”; and option D spells the rule out in full and inserts the statute symbol “§,” both of which violate Bluebook conventions. Hence only C satisfies current Bluebook requirements.","ok":1,"ms":4655},{"id":"c7","answer":"A \n\nThe correct Bluebook form follows T6 (abbreviating \"Atlantic\" as \"Atl.\" and \"Corporation\" as \"Corp.\" in case names) and Rule 10.3.2 (citing the official U.S. Reports reporter with periods, not the unofficial S. Ct. reporter, and omitting periods from \"U.S.\" is never permitted). Options B–D each violate one of these mandatory rules.","ok":1,"ms":4409},{"id":"c8","answer":"D \n\nThe correct Bluebook format for a U.S. Supreme Court pinpoint citation follows Rule 10.3.2: Party v. Party, Vol. U.S. FirstPage, Pinpoint (Year). Option D places the pinpoint page immediately after the initial page number with only a comma separator and positions the parenthetical year at the end. Options A and B insert prohibited signals (“at” or “p.”). Option C misplaces the year parenthetical before the pinpoint.","ok":1,"ms":4477}]},{"model":"x-ai/grok-4.3","task":"procedure","suite":"docketrouter-legal-v0.1","mode":"raw","upstream":"openrouter","n":12,"correct":12,"score":1,"latencyMs":2738,"inputTokens":3156,"outputTokens":3292,"costUsd":0.012175000000000002,"ranAt":"2026-08-25T13:13:14.930Z","perItem":[{"id":"p1","answer":"21","ok":1,"ms":2684},{"id":"p2","answer":"56","ok":1,"ms":2051},{"id":"p3","answer":"90","ok":1,"ms":2581},{"id":"p4","answer":"25","ok":1,"ms":2504},{"id":"p5","answer":"30\n\n\nThe query asks specifically for the number of days prescribed by Fed. R. App. P. 4(a)(1)(A) when the United States is not a party. That subdivision states that the notice of appeal “must be filed with the district clerk within 30 days after entry of the judgment or order appealed from.” The 60-day period in subdivision (a)(1)(B) applies only when the United States or its officer or agency is a party and is therefore inapplicable here. The answer is therefore the numeral that appears in the text of the rule itself.","ok":1,"ms":4612},{"id":"p6","answer":"23","ok":1,"ms":1731},{"id":"p7","answer":"11","ok":1,"ms":2322},{"id":"p8","answer":"7","ok":1,"ms":2762},{"id":"p9","answer":"26","ok":1,"ms":2791},{"id":"p10","answer":"8","ok":1,"ms":2833},{"id":"p11","answer":"60 \n\nThe query asks specifically for the number of days provided by Fed. R. Civ. P. 12(a)(2). That subdivision states that the United States, a United States agency, or a United States officer or employee sued only in an official capacity must serve an answer “within 60 days after service on the United States attorney.” The rule therefore supplies the numeral 60; no other calculation or cross-reference is required.","ok":1,"ms":3677},{"id":"p12","answer":"28","ok":1,"ms":2305}]},{"model":"x-ai/grok-4.3","task":"limitations","suite":"docketrouter-legal-v0.1","mode":"raw","upstream":"openrouter","n":8,"correct":8,"score":1,"latencyMs":6595,"inputTokens":2170,"outputTokens":5550,"costUsd":0.0165875,"ranAt":"2026-08-25T13:13:27.153Z","perItem":[{"id":"l1","answer":"TIMELY","ok":1,"ms":7560},{"id":"l2","answer":"UNTIMELY","ok":1,"ms":7105},{"id":"l3","answer":"TIMELY","ok":1,"ms":8937},{"id":"l4","answer":"TIMELY","ok":1,"ms":3318},{"id":"l5","answer":"UNTIMELY","ok":1,"ms":8050},{"id":"l6","answer":"TIMELY","ok":1,"ms":7114},{"id":"l7","answer":"UNTIMELY","ok":1,"ms":5562},{"id":"l8","answer":"TIMELY","ok":1,"ms":5114}]},{"model":"x-ai/grok-4.3","task":"clause","suite":"docketrouter-legal-v0.1","mode":"raw","upstream":"openrouter","n":12,"correct":12,"score":1,"latencyMs":2858,"inputTokens":3409,"outputTokens":3802,"costUsd":0.01376625,"ranAt":"2026-08-25T13:13:34.806Z","perItem":[{"id":"k1","answer":"Governing Law","ok":1,"ms":1824},{"id":"k2","answer":"Non-Compete","ok":1,"ms":4175},{"id":"k3","answer":"Indemnification","ok":1,"ms":2762},{"id":"k4","answer":"Limitation of Liability","ok":1,"ms":2497},{"id":"k5","answer":"Confidentiality","ok":1,"ms":2044},{"id":"k6","answer":"Termination \n\nThe clause explicitly addresses conditions and procedures for ending the contract due to material breach, which aligns directly with the Termination category. No other listed category applies, as the text contains no references to governing jurisdiction, competitive restrictions, liability caps, indemnities, confidentiality obligations, assignment rights, or force majeure events.","ok":1,"ms":3206},{"id":"k7","answer":"Assignment \n\nThe clause restricts assignment/transfer of the agreement (with a standard successor exception), which maps directly to the Assignment category. No other listed category applies.","ok":1,"ms":2947},{"id":"k8","answer":"Force Majeure","ok":1,"ms":2904},{"id":"k9","answer":"Limitation of Liability","ok":1,"ms":3070},{"id":"k10","answer":"Indemnification \n\nThe clause explicitly requires one party (Customer) to indemnify the other (Provider) for claims and costs arising from a specified scenario, which directly matches the Indemnification category. No other category applies, as the language does not address governing law, non-competes, liability caps, confidentiality, termination rights, assignments, or force majeure events.","ok":1,"ms":2952},{"id":"k11","answer":"Termination \n\nThe clause directly addresses conditions under which the agreement ends automatically, fitting the Termination category without overlap into others like Force Majeure or Assignment.","ok":1,"ms":2442},{"id":"k12","answer":"Confidentiality","ok":1,"ms":3474}]},{"model":"x-ai/grok-4.3","task":"hallucination","suite":"docketrouter-legal-v0.1","mode":"raw","upstream":"openrouter","n":12,"correct":11,"score":0.9166666666666666,"latencyMs":3637,"inputTokens":3232,"outputTokens":4602,"costUsd":0.015545000000000002,"ranAt":"2026-08-25T13:13:44.444Z","perItem":[{"id":"x1","answer":"REAL","ok":1,"ms":2312},{"id":"x2","answer":"FAKE","ok":1,"ms":6549},{"id":"x3","answer":"REAL","ok":1,"ms":2208},{"id":"x4","answer":"FAKE","ok":1,"ms":4177},{"id":"x5","answer":"REAL","ok":1,"ms":2186},{"id":"x6","answer":"REAL","ok":0,"ms":4092},{"id":"x7","answer":"REAL","ok":1,"ms":1818},{"id":"x8","answer":"FAKE","ok":1,"ms":3270},{"id":"x9","answer":"REAL","ok":1,"ms":3609},{"id":"x10","answer":"UNSURE","ok":1,"ms":5631},{"id":"x11","answer":"REAL","ok":1,"ms":2654},{"id":"x12","answer":"FAKE","ok":1,"ms":5135}]},{"model":"x-ai/grok-4.3","task":"hearsay","suite":"docketrouter-legal-v0.1","mode":"juiced","upstream":"openrouter","n":10,"correct":10,"score":1,"latencyMs":3281,"inputTokens":21332,"outputTokens":3626,"costUsd":0.03573,"ranAt":"2026-08-25T13:24:44.957Z","perItem":[{"id":"h1","answer":"YES","ok":1,"ms":2971},{"id":"h2","answer":"NO","ok":1,"ms":2088},{"id":"h3","answer":"NO \n\nThe statement qualifies as an opposing party’s statement under Fed. R. Evid. 801(d)(2)(A) and is therefore defined as not hearsay.","ok":1,"ms":4149},{"id":"h4","answer":"YES","ok":1,"ms":2778},{"id":"h5","answer":"NO","ok":1,"ms":4096},{"id":"h6","answer":"YES","ok":1,"ms":3282},{"id":"h7","answer":"NO","ok":1,"ms":2681},{"id":"h8","answer":"YES","ok":1,"ms":2786},{"id":"h9","answer":"NO","ok":1,"ms":2676},{"id":"h10","answer":"YES","ok":1,"ms":5301}]},{"model":"x-ai/grok-4.3","task":"citation","suite":"docketrouter-legal-v0.1","mode":"juiced","upstream":"openrouter","n":8,"correct":8,"score":1,"latencyMs":4032,"inputTokens":22459,"outputTokens":3475,"costUsd":0.03676125,"ranAt":"2026-08-25T13:24:54.457Z","perItem":[{"id":"c1","answer":"B","ok":1,"ms":3903},{"id":"c2","answer":"C","ok":1,"ms":3720},{"id":"c3","answer":"A\n\nThe correct Bluebook form for the federal-question statute is 28 U.S.C. § 1331 (with the section symbol and periods). Option A matches that form; the remaining choices omit required punctuation, use nonstandard spacing or parentheticals, or follow an incorrect structure.","ok":1,"ms":5153},{"id":"c4","answer":"D \n\nThe correct Bluebook form follows T6 (abbreviating \"Railroad\" as \"R.R.\"), T1 (U.S. Reports citation), and B10.1.3/R10.3.2 (parenthetical year only). Option A spells out \"Railroad\"; B inverts the volume/page; C omits the required parentheses. D matches all three rules.","ok":1,"ms":5121},{"id":"c5","answer":"B","ok":1,"ms":3354},{"id":"c6","answer":"C","ok":1,"ms":2891},{"id":"c7","answer":"A","ok":1,"ms":4368},{"id":"c8","answer":"D","ok":1,"ms":3744}]},{"model":"x-ai/grok-4.3","task":"procedure","suite":"docketrouter-legal-v0.1","mode":"juiced","upstream":"openrouter","n":12,"correct":12,"score":1,"latencyMs":2247,"inputTokens":29153,"outputTokens":2708,"costUsd":0.04321125,"ranAt":"2026-08-25T13:25:03.011Z","perItem":[{"id":"p1","answer":"21","ok":1,"ms":1613},{"id":"p2","answer":"56","ok":1,"ms":1866},{"id":"p3","answer":"90","ok":1,"ms":1521},{"id":"p4","answer":"25","ok":1,"ms":2474},{"id":"p5","answer":"30","ok":1,"ms":3370},{"id":"p6","answer":"23","ok":1,"ms":1818},{"id":"p7","answer":"11","ok":1,"ms":2498},{"id":"p8","answer":"7","ok":1,"ms":2057},{"id":"p9","answer":"26","ok":1,"ms":1593},{"id":"p10","answer":"8","ok":1,"ms":2514},{"id":"p11","answer":"60","ok":1,"ms":1989},{"id":"p12","answer":"28","ok":1,"ms":3655}]},{"model":"x-ai/grok-4.3","task":"limitations","suite":"docketrouter-legal-v0.1","mode":"juiced","upstream":"openrouter","n":8,"correct":8,"score":1,"latencyMs":4951,"inputTokens":20403,"outputTokens":4282,"costUsd":0.036208750000000005,"ranAt":"2026-08-25T13:25:14.672Z","perItem":[{"id":"l1","answer":"TIMELY","ok":1,"ms":3303},{"id":"l2","answer":"UNTIMELY","ok":1,"ms":3616},{"id":"l3","answer":"TIMELY","ok":1,"ms":5015},{"id":"l4","answer":"TIMELY","ok":1,"ms":2062},{"id":"l5","answer":"UNTIMELY","ok":1,"ms":7424},{"id":"l6","answer":"TIMELY","ok":1,"ms":8352},{"id":"l7","answer":"UNTIMELY","ok":1,"ms":4815},{"id":"l8","answer":"TIMELY","ok":1,"ms":5024}]},{"model":"x-ai/grok-4.3","task":"clause","suite":"docketrouter-legal-v0.1","mode":"juiced","upstream":"openrouter","n":12,"correct":12,"score":1,"latencyMs":2593,"inputTokens":27793,"outputTokens":2952,"costUsd":0.04212125,"ranAt":"2026-08-25T13:25:23.532Z","perItem":[{"id":"k1","answer":"Governing Law","ok":1,"ms":2904},{"id":"k2","answer":"Non-Compete","ok":1,"ms":2599},{"id":"k3","answer":"Indemnification","ok":1,"ms":2423},{"id":"k4","answer":"Limitation of Liability","ok":1,"ms":3230},{"id":"k5","answer":"Confidentiality","ok":1,"ms":2533},{"id":"k6","answer":"Termination","ok":1,"ms":2070},{"id":"k7","answer":"Assignment","ok":1,"ms":3320},{"id":"k8","answer":"Force Majeure","ok":1,"ms":2840},{"id":"k9","answer":"Limitation of Liability","ok":1,"ms":1787},{"id":"k10","answer":"Indemnification","ok":1,"ms":2399},{"id":"k11","answer":"Termination","ok":1,"ms":2375},{"id":"k12","answer":"Confidentiality","ok":1,"ms":2632}]},{"model":"x-ai/grok-4.3","task":"hallucination","suite":"docketrouter-legal-v0.1","mode":"juiced","upstream":"openrouter","n":12,"correct":10,"score":0.8333333333333334,"latencyMs":3370,"inputTokens":36499,"outputTokens":3978,"costUsd":0.05556875000000001,"ranAt":"2026-08-25T13:25:34.960Z","perItem":[{"id":"x1","answer":"REAL","ok":1,"ms":3195},{"id":"x2","answer":"FAKE","ok":1,"ms":2723},{"id":"x3","answer":"UNSURE","ok":0,"ms":5290},{"id":"x4","answer":"FAKE","ok":1,"ms":2589},{"id":"x5","answer":"UNSURE","ok":0,"ms":4352},{"id":"x6","answer":"FAKE","ok":1,"ms":2435},{"id":"x7","answer":"REAL","ok":1,"ms":4129},{"id":"x8","answer":"FAKE","ok":1,"ms":2104},{"id":"x9","answer":"REAL","ok":1,"ms":2803},{"id":"x10","answer":"FAKE","ok":1,"ms":3457},{"id":"x11","answer":"REAL","ok":1,"ms":4160},{"id":"x12","answer":"FAKE","ok":1,"ms":3207}]}]}