Models / Meta
Llama 3.1 8B Instruct
by Meta ·
meta-llama/llama-3.1-8b-instructMeta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to...
tool-usereleased 2024-07-23
Legal score · raw
-
not yet benchmarked
Context
131K
max output 118K
Input
$0.06
per 1M tokens
Output
$0.10
per 1M tokens
Suite cost
-
no run recorded
Prompt caching
Grounded answers re-send the same retrieved authority every turn, so a cached read is what a long matter actually costs. Prices are per 1M tokens, from the provider’s own catalog.
Cache read
$0.03
2.0x cheaper than uncached
Uncached input
$0.06
per 1M tokens
Capabilities
Modalities
in text
out text
Request parameters it accepts
frequency_penaltylogit_biaslogprobsmax_tokensmin_ppresence_penaltyrepetition_penaltyresponse_formatseedstopstructured_outputstemperaturetool_choicetoolstop_ktop_logprobstop_p
Benchmark results
This model has not been run through the suite yet. See Humanity's Last Lawsuit for the benchmark models are ranked on.