← Back to Directory
Microsoft Research
LLM2024-12-12

Phi-4

Phi-4 is a 14B parameter model that punches way above its weight class.

#SLM#efficient#open-source

Overview

Phi-4 is Microsoft's latest 'small' language model that challenges the performance of models ten times its size. It focuses on high-quality data over raw parameter count.

Unique Factor

Frontier-level reasoning in a 14B parameter package.

Key Capabilities

Small but mighty
High reasoning
Efficient

Benchmarks

MMLU Score
80.1%
HumanEval (Coding)
82.5%
GPQA Diamond
60%
MATH Benchmark
81%

Top Use Cases

On-device reasoning

Running high-quality AI on laptops and edge devices.

Example: “Summarize this local log file and find errors.

Technical Specs

Context16,384 tokens
Params14B
LicenseMIT
ArchTransformer

API Pricing

$0 / 1M input tokens

Output: $0 / 1M tokens

✓ Free tier available
Access API

Developer

Global research division of Microsoft, developing small-language models (SLMs).

Prompt Library

Browse Coding Prompts

📋

Previous Version

Phi 3 5