first cut of setup sdk skill #12
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…detection - Clarify three things to confirm with user: app, injection point, libraries - Add three-part library discovery process: known integrations, docs search, SDK search - Update reference files with comprehensive library detection lists - Add documentation links for all languages (repos, hosted docs, package docs) - Mark library lists as non-exhaustive with links to current docs Co-Authored-By: Claude Opus 4.5 <[email protected]>
Grants Read, Glob, Grep, WebFetch permissions so the skill can access its own reference files without prompting users. Co-Authored-By: Claude Opus 4.5 <[email protected]>
Co-Authored-By: Claude Opus 4.5 <[email protected]>
Each reference file now has: - Link to check latest version on package registry - Instructions to install with pinned version number Co-Authored-By: Claude Opus 4.5 <[email protected]>
Each reference file now shows how to programmatically find the latest version: - Python: PyPI JSON API - TypeScript: npm registry API - Go: GitHub releases API - Java: Maven Central search API - Ruby: RubyGems API Co-Authored-By: Claude Opus 4.5 <[email protected]>
- Add Step 2(d) to ask user for Braintrust project name - Convert URLs to proper markdown links for better UX - Add instructions to construct actual project URL with org/project name Co-Authored-By: Claude Opus 4.5 <[email protected]>
- Add REQUIRED instruction to use WebFetch for version lookup - Emphasize "Do NOT guess or use a version from memory" - Add example PyPI API call for clarity Co-Authored-By: Claude Opus 4.5 <[email protected]>
Test import before writing instrumentation code to catch wrong function names (e.g., wrapOpenAI vs wrap_openai). Co-Authored-By: Claude Opus 4.5 <[email protected]>
- Build app and fix any errors - Run app to trigger LLM call - Query Braintrust API to verify logs were received - Debug and repeat until logs appear Co-Authored-By: Claude Opus 4.5 <[email protected]>
Split into three focused skills: - setup-braintrust-sdk: Main skill with installation + orchestration - discover-sdk-integrations: Find LLM providers/frameworks - install-sdk-integration: Add wrapper code and initialization Added try-do-verify loop in Step 4 for verification. Each skill has language-specific references (Python, TypeScript, Go, Java, Ruby). Co-Authored-By: Claude Opus 4.5 <[email protected]>
- Add step to ask user for run command or detect it - Allow skill to either run itself or ask user to run - Add explicit debug loop with repeat instruction - Emphasize setup not complete until traces appear Co-Authored-By: Claude Opus 4.5 <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.