Apple just updated its Developer Agreement with specific requirements for apps that use its on-device AI models, signaling how seriously the company is treating AI governance on its platforms.
The key changes:
- Guardrails are now mandatory. Apps using Apple's built-in AI models through the Foundation Models Framework must implement "reasonable guardrails." Apple has not published a detailed spec for what qualifies, but the requirement gives them a contractual basis to reject or pull apps that misuse on-device AI.
- Adapter compatibility is enforced. If you build model adapters (custom layers that modify how Apple's base models behave for your app), Apple can require you to keep them compatible with the current OS model version. Fall behind, and your app may break.
- Age verification tightened. Alongside the AI changes, Apple added new requirements around age verification, though the AI provisions are the more consequential update for most developers.
What This Means for iOS Developers
Apple's Foundation Models Framework, introduced alongside Apple Intelligence, lets developers run inference (use AI models to generate responses) directly on-device without sending data to external servers. It is a privacy-first approach, but it also means Apple controls the base models and can set terms for how they are used.
The adapter compatibility rule is particularly notable. It means developers cannot just ship a model adapter and forget about it. Each major OS update could require adapter updates, creating an ongoing maintenance burden. For small teams, this is one more thing to track alongside regular app updates.
The "reasonable guardrails" language is vague by design. Apple likely wants flexibility to interpret it case-by-case during App Review rather than publishing a rigid checklist that developers game around. Expect the definition to sharpen over time as real enforcement decisions set precedent.
For developers building with Apple Intelligence features, read the updated agreement carefully. The new terms are not optional, and Apple has a track record of enforcing developer agreement changes through App Review rejections.