-
Notifications
You must be signed in to change notification settings - Fork 2.8k
Open
0 / 10 of 1 issue completedLabels
changelog:new-featureChange that should be called out as new feature in CHANGELOGChange that should be called out as new feature in CHANGELOGenhancement
Description
Summary
GenAI can provide powerful capabilities for automatic analysis of tracing data.
There can be multiple product functions, with increasing order of complexity:
- Free form question about a single trace. Easiest, needs chat infra in the UI.
- Ability to use user-provided skills (nice to have). Requires agentic loop. - Automated analysis of a trace. Needs agentic loop & prompt tuning on our side
- Free form search query. Needs ability act on the UI elements from agentic loop, and prompt tuning.
- Free form investigation. Ultimate, investigation agent, needs lots of prompting.
Everything beyond (1) involves prompt engineering and the only non-anecdotal way to evaluate the prompts is with benchmarks.
Directional design - "bring your own agent".
Resources:
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
changelog:new-featureChange that should be called out as new feature in CHANGELOGChange that should be called out as new feature in CHANGELOGenhancement
Type
Projects
Status
No status