Skip to content

Mlflow tracing and evals#145

Draft
mjschock wants to merge 3 commits intomainfrom
cursor/mlflow-tracing-and-evals-28bd
Draft

Mlflow tracing and evals#145
mjschock wants to merge 3 commits intomainfrom
cursor/mlflow-tracing-and-evals-28bd

Conversation

@mjschock
Copy link
Collaborator

Integrates MLflow for tracing OpenAI calls and evaluating GenAI responses in both Python and TypeScript examples.

This integration enables automatic tracing of OpenAI calls in the Python A2A server and custom tracing via a lightweight MLflow REST client in the TypeScript A2A server. For evaluations, the Python test client uses MLflow's GenAI relevance metric, while the TypeScript client logs custom metrics like prompt overlap, providing comprehensive observability for agent interactions.


Open in Cursor Open in Web

Co-authored-by: m <m@mjschock.com>
@cursor
Copy link

cursor bot commented Jan 19, 2026

Cursor Agent can help with this pull request. Just @cursor in comments and I'll start working on changes in this branch.
Learn more about Cursor Agents

cursoragent and others added 2 commits January 19, 2026 22:38
Co-authored-by: m <m@mjschock.com>
Co-authored-by: m <m@mjschock.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants