Skip to content

fix(AE-999): remove duplicate root span and change evaluation span_type to 'eval'#1289

Closed
AAgnihotry wants to merge 1 commit intomainfrom
feat/spanType
Closed

fix(AE-999): remove duplicate root span and change evaluation span_type to 'eval'#1289
AAgnihotry wants to merge 1 commit intomainfrom
feat/spanType

Conversation

@AAgnihotry
Copy link
Contributor

@AAgnihotry AAgnihotry commented Feb 10, 2026

Summary

Fixes two issues reported in AE-999:

  1. Removed duplicate root span: The extra root span with span_type="eval" wrapping agent execution has been removed
  2. Changed span_type: The Evaluation span now uses span_type="eval" instead of "evaluation" for consistency

Changes Made

1. Removed Duplicate Root Span (Commit a7592a7)

  • Removed the intermediate root span that was accidentally re-introduced
  • Removed execution_id and span_attributes parameters from UiPathExecutionRuntime
  • This span was previously removed in commit 27f913e but got re-added

File: src/uipath/_cli/_evals/_runtime.py:817-821, 838-839

2. Changed Evaluation Span Type (Commit dcb3fe1)

  • Changed span_type from "evaluation" to "eval"
  • Updated all Python tests to expect the new span type
  • This maintains consistency with the temporal backend and avoids confusion with the removed root span

Files:

  • src/uipath/_cli/_evals/_runtime.py:509
  • tests/cli/eval/test_eval_runtime_spans.py
  • tests/cli/eval/test_eval_tracing_integration.py
  • testcases/eval-spans-testcase/src/assert.py

New Span Hierarchy

Evaluation Set Run (span_type="eval_set_run")
├── Evaluation (span_type="eval") ← Changed from "evaluation"
│   ├── Agent execution spans (no extra wrapping)
│   └── Evaluator (span_type="evaluator")
│       └── evalOutput (span_type="evalOutput")

Testing

  • ✅ All 1919 tests pass
  • ✅ Linting passed
  • ✅ Formatting passed
  • ✅ Type checking passed
  • ✅ Build successful

Frontend Changes Required

⚠️ Note: The Agents repo (StudioWeb) frontend needs corresponding updates to filter by the new span type:

File: frontend-sw/src/components/coded-evaluator/EvalRunTraceDialog/EvalRunTraceDialog.tsx

  • Line 138: Change span.SpanType === "evaluation" to span.SpanType === "eval"

File: frontend-sw/src/components/coded-evaluator/EvalRunTraceDialog/EvalRunTraceDialog.test.tsx

  • Line 65: Change filter condition
  • Lines 148+: Update all test mocks from "evaluation" to "eval"

Related Issues

Fixes: https://uipath.atlassian.net/browse/AE-999

🤖 Generated with Claude Code

Development Package

  • Use uipath pack --nolock to get the latest dev build from this PR (requires version range).
  • Add this package as a dependency in your pyproject.toml:
[project]
dependencies = [
  # Exact version:
  "uipath==2.8.7.dev1012894671",

  # Any version from PR
  "uipath>=2.8.7.dev1012890000,<2.8.7.dev1012900000"
]

[[tool.uv.index]]
name = "testpypi"
url = "https://test.pypi.org/simple/"
publish-url = "https://test.pypi.org/legacy/"
explicit = true

[tool.uv.sources]
uipath = { index = "testpypi" }

[tool.uv]
override-dependencies = [
    "uipath>=2.8.7.dev1012890000,<2.8.7.dev1012900000",
]

Changed the span_type attribute from "evaluation" to "eval" for the
Evaluation span to maintain consistency and match the expected format.

This completes the AE-999 fix by:
1. Removing the duplicate root span with span_type="eval" (prev commit)
2. Changing the actual Evaluation span from "evaluation" to "eval" (this commit)

Updated all Python tests to expect span_type="eval":
- tests/cli/eval/test_eval_runtime_spans.py
- tests/cli/eval/test_eval_tracing_integration.py
- testcases/eval-spans-testcase/src/assert.py

All 1919 tests pass.

Note: Agents repo (StudioWeb) frontend needs corresponding updates:
- EvalRunTraceDialog.tsx line 138: Change filter from "evaluation" to "eval"
- EvalRunTraceDialog.test.tsx: Update test mocks and assertions

Fixes: https://uipath.atlassian.net/browse/AE-999

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
@github-actions github-actions bot added test:uipath-langchain Triggers tests in the uipath-langchain-python repository test:uipath-llamaindex Triggers tests in the uipath-llamaindex-python repository labels Feb 10, 2026
@AAgnihotry AAgnihotry added the build:dev Create a dev build from the pr label Feb 10, 2026
@AAgnihotry AAgnihotry closed this Feb 10, 2026
@cristipufu cristipufu deleted the feat/spanType branch February 23, 2026 06:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

build:dev Create a dev build from the pr test:uipath-langchain Triggers tests in the uipath-langchain-python repository test:uipath-llamaindex Triggers tests in the uipath-llamaindex-python repository

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant