Skip to content

Glossary · Efficiency

MFU

Model FLOPs utilisation (MFU) is the share of a GPU's theoretical peak throughput that a training run spends on the model's own arithmetic. It is the main efficiency number for turning FLOPs into GPU-hours.

Also called Model FLOPs utilisation, model FLOPs utilization · Reviewed 15 November 2026

The PaLM paper defined MFU as observed tokens per second times the model's FLOPs per token, divided by peak FLOPS; recomputation for gradient checkpointing doesn't count. PaLM reached 46% on TPU v4, and Meta reported 38–43% for Llama 3 405B on H100s.

Planning at about 40% is reasonable for a well-tuned large run; small or unoptimised jobs often get far less.

Formula

MFU = (tokens/s × FLOPs per token) / peak FLOPS

Learn more on Kojen

Sources

  1. [1]Chowdhery et al., 2022. PaLM: Scaling Language Modeling with Pathways (arXiv:2204.02311)
  2. [2]Meta, 2024. The Llama 3 Herd of Models (arXiv:2407.21783)

All 31 terms

Put the definitions to work.

Kojen evaluates, tunes and red-teams your agents with these methods built in: Wilson intervals, pass^k, LLM judges with visible components. Free to start.

Start training free