GPT-4o Mini
OpenAI · July 2024
⚠ deprecatedClosedmixture of expertsmultimodalAPI Available
Context Window128K tokens
Sunset DateFebruary 2026
Description
A smaller, faster, and much cheaper version of GPT-4o designed for high-volume applications. Despite being significantly more affordable, it outperformed GPT-3.5 Turbo on nearly every benchmark, effectively replacing it as OpenAI's default lightweight model.
Key Innovations
Distillation
DistillationTraining a smaller 'student' model to mimic a larger 'teacher' model, preserving capability at lower cost.
Family Tree
Built On
Lineage
Related Research (1)
GPT-4Scaling
2023 · OpenAI
Described GPT-4's multimodal capabilities and performance across professional/academic benchmarks, setting new SOTA on bar exam, MMLU, and many others…