docketrouter
Models / Mistral

Mixtral 8x22B Instruct

by Mistral · mistralai/mixtral-8x22b-instruct

Mistral's official instruct fine-tuned version of [Mixtral 8x22B](/models/mistralai/mixtral-8x22b). It uses 39B active parameters out of 141B, offering unparalleled cost efficiency for its size. Its strengths include: - strong math, coding,...

tool-usereleased 2024-04-17
Legal score · raw
-
not yet benchmarked
Context
66K
max output 52K
Input
$2.50
per 1M tokens
Output
$7.50
per 1M tokens
Suite cost
-
no run recorded

Prompt caching

Grounded answers re-send the same retrieved authority every turn, so a cached read is what a long matter actually costs. Prices are per 1M tokens, from the provider’s own catalog.

Cache read
$0.25
10x cheaper than uncached
Uncached input
$2.50
per 1M tokens

Capabilities

Modalities
in textfile
out text
Request parameters it accepts
frequency_penaltymax_tokenspresence_penaltyresponse_formatseedstopstructured_outputstemperaturetool_choicetoolstop_p

Benchmark results

This model has not been run through the suite yet. See Humanity's Last Lawsuit for the benchmark models are ranked on.