feat: tool calling

[grabbou]

Tool call works in an example, so I think this is good to go! There's lots of changes, so I am happy to mark this as experimental and split into follow-ups.

I moved parser outside of AppleLLM class, hence the diff is slightly larger.

TODO:

• Dynamic tool creation
• Fix arguments passing

Here's a couple of additional things I caught:

• fix(apple-llm): calling w/o schema - should just respond with a text string #62
• chore(apple-llm): always throw when schema is corrupted, instead of continuing #63
• chore(apple-llm): remove reflection for parsing LLM output and use same method we have for tool calls #64
• refactor(apple-llm): put tools on a global object only for the duration of the call #65
• feat(apple-llm): add tool calls to returned transcript (tool request, tool call) #66
• docs(apple-llm): document tool calling #67

[changeset-bot]

⚠️ No Changeset found

Latest commit: 30b61f6

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
ai	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Jul 21, 2025 6:37am

[szymonrybczak]

Nice! So good for DevX that we omitted codegen 🙏

[grabbou]

Yeah! I run across this comment on Apple forum where they explain how to do it, which caught me by surprise!