Open weights · Meta
Llama 3.1 405B
The largest open-weights model — GPT-4-class quality you can self-host later.
Context window
128K
tokens
Input price
$2.7
per 1M tokens
Output price
$2.7
per 1M tokens
Routing
Included
failover + retries
Call it with any OpenAI SDK
Swap the base URL and key — request shape, streaming and tool calls stay identical.
python
from openai import OpenAI client = OpenAI( base_url="https://api.lingyuns.com/v1", api_key="ly-sk-…", ) r = client.chat.completions.create( model="llama-3-1-405b", messages=[{"role": "user", "content": "Hello"}], ) # billed at $2.7 in / $2.7 out per 1M
Specifications
Prices are list rates in USD per million tokens. Your prepaid credits cover every model in the catalog at these rates.
Alternatives
Other Open weights models
Llama 3.1 70B
The open-weights workhorse for fine-tuning and private deployments.
Llama 3.1 8B
Ultra-cheap 8B model for classification, routing and simple extraction.
DeepSeek-V3
671B MoE open model with strong general and coding performance.