Apple Intelligence Foundation
Apple · June 2024
● activeCloseddecoder onlymultimodal
Parameters~3B (on-device)
Why It Matters
Brought AI to billions of Apple users with a privacy-first approach — processing on-device by default, using 'Private Cloud Compute' only when necessary.
Description
Apple's on-device and server foundation models that power Apple Intelligence across iPhone, iPad, and Mac. Uses a compact 3 billion parameter model that runs directly on the device for speed and privacy, with a larger server model for more complex tasks. When the server model is needed, requests are processed through 'Private Cloud Compute' — Apple's system that processes data without storing it or making it accessible to anyone, including Apple.
Key Innovations
Distillation
DistillationTraining a smaller 'student' model to mimic a larger 'teacher' model, preserving capability at lower cost.
Multimodal
MultimodalProcessing multiple types of input (text, images, audio, video) in a single model.