Apple Foundation Models

While I'm happy with Apple introducing this abstraction. my main concern was with local models.

I'd love using Gemma4 as an example. but thinking of a user. if 10 Apps each uses same model and downloads it, the phone will be bloated.

I still didn't understand if Apple provided a way for multiple apps uses same on-device model (without tricky namespaces and permissions).

I didn't see anything suggesting that's the case.

Is this Apple encouraging developers to go through their api abstraction layer to use LLMs so that when they launch their own (which I think we’ve heard they’ve been spending lots of money on training and might be somehow involved with Siri or current Apple AI?) that they can easily help devs make a seamless transition? Or is it just a developer nicety or something else?

> Requests go directly from your app to the Claude API; Apple is not in the request path and does not see prompts or responses.

I know this is from a developer perspective. But as a consumer this is just funny.

Coding agent itself an imposed layer. Now they are adding one more layer? Many times I think of coding agent as the vendor supervisor from the body shops of the 90's who promise the customer everything under the sky and thrash the poor contractor to deliver. Coding agents consume 10x more tokens just like how body shops charged their customers vs how they paid the contractors. For a simple test, the same task that makes the model to go out of context length when used via a coding agent, runs fine when prompted directly.

Layers are luxury and remove control and transparency.

From app developer standpoint why would anyone ship claude keys like that ... or am I missing something? From consumer standpoint - I guess they can use their own keys but it is not something that is very user friendly as you can imagine.

> Usage is billed to your Anthropic account at standard API pricing.

While expected, it’s still a bummer.

Does "Apple Intelligence" need to be Turned On for this as well?

the github repo: https://github.com/anthropics/ClaudeForFoundationModels

So actually the most successful AI was OpenRouter Intelligence? Pronounced as OÏ.

So where does the api key reside? You can’t ship it on the iOS client since anyone can read and abuse it

This seems smart. Apple, despite not really leading in AI themselves, are right on the hot path of where developers are going to yolo slop into the ecosystem. Make a tonne of sense to define a nice clean API that places like Anthropic can build on top of and expose to developers.

It's also smart for them to make sure the billing is going direct from Anthropic to the developer. The initial thought is "That means Apple's not taking a cut", but from the other side of it, developers who use this API are going to have to expose that cost to customers somehow, and that translates to subscription/InAppPurchase etc. on top of which Apple will get it's 30%.

Misleading title. This is about Claude for Apple Foundation Models, not about Apple Foundation Models

Why would I want a nerfed model?

[flagged]

[dead]