feat(provider/openai): support native skills and hosted shell#12581
Open
felixarntz wants to merge 12 commits intomainfrom
Open
feat(provider/openai): support native skills and hosted shell#12581felixarntz wants to merge 12 commits intomainfrom
felixarntz wants to merge 12 commits intomainfrom
Conversation
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Contributor
aayush-kapoor
left a comment
There was a problem hiding this comment.
could you please add/modify the ui example that exists for shell tool under examples/next-openai to make sure it works for multiturn conversations?
also maybe a separate UI example for skills? basically one modifies the exisiting local shell execution and one that tests container execution
Contributor
Author
|
@aayush-kapoor great point. tested the original ui examples and added some more for container based shell tool, with and without skills. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Background
OpenAI's Responses API supports skills natively attached to the shell tool environment. Skills allow extending the shell tool with custom instructions and capabilities, similar to Anthropic's computer use features.
Additionally, the shell tool now supports running in a hosted container on OpenAI's infrastructure. This is recent and an enhancement over the initial implementation which only supported "local" execution (implemented in #10810 for AI SDK).
See:
Summary
Adds native OpenAI skills support to the shell tool environment for the Responses API via
providerOptions.Supports both local shell execution and hosted container shell execution.
Key changes:
openai.tools.shell()withenvironmentconfiguration supporting three modes:containerAuto: Automatic container provisioning with optional skillscontainerReference: Reference to existing containerlocal: Local execution with filesystem-based skillsskillReferenceorinlinetypes for container environments) or filesystem paths (for local environments)shell_call_outputhandling in the language model stream parser (relevant for container hosted shell)The implementation is fully backward compatible; existing shell tool usage without skills continues to work unchanged (important note:
environment.typemust remain optional and default tolocal); verified by running existing tests and examples originally introduced.Manual Verification
Ran example scripts with both container-based and local skills configurations:
Also run the other
examples/ai-functions/src/generate-text/openai-responses-shell-*andexamples/ai-functions/src/stream-text/openai-responses-shell-*examples to verify back compat.Checklist
pnpm changesetin the project root)Future Work
Related Issues
Fixes #12487
Builds on top of #10810