← Back to Directory
Meta AI
LLM2024-07-23

Llama 3.1 405B

Llama 3.1 405B is the first frontier-level open-weight AI model.

#open-source#flagship#massive

Overview

Llama 3.1 405B is the first open-weight model to compete at the absolute frontier. It provides a foundation for the open source community to build specialized models.

Unique Factor

Frontier-level performance with open weights.

Key Capabilities

●
Open weights
●
Frontier performance
●
128K context

Benchmarks

MMLU Score
88.6%
HumanEval (Coding)
89%
GPQA Diamond
75%
MATH Benchmark
83.5%

Top Use Cases

Model Distillation

Using 405B to train smaller, more efficient models.

Example: “Generate 1000 examples of complex logical reasoning for training.”

Technical Specs

Context128,000 tokens
Params405B
LicenseLlama 3.1 Community
ArchTransformer

API Pricing

$0 / 1M input tokens

Output: $0 / 1M tokens

✓ Free tier available
Access API

Developer

Meta's AI research division — makers of Llama, the world's most popular open-source LLM family.

Prompt Library

Browse Coding Prompts →

📋

Previous Version

Llama 3 70b →