Skip to content

Commit 59d7774

Browse files
authored
Merge pull request #328 from dimagi/changelog-pr-3130-86
Changelog + Docs: Import evals dataset to annotation queue (OCS #3130)
2 parents 1d96ef4 + b88ab5f commit 59d7774

2 files changed

Lines changed: 5 additions & 0 deletions

File tree

docs/changelog.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4,6 +4,9 @@ hide:
44
---
55

66
# Changelog
7+
## Apr 2, 2026
8+
* **NEW** Added the ability to import sessions from an existing evaluation dataset into an annotation queue.
9+
710
## Mar 31, 2026
811
* **NEW** Added three session selection modes when adding sessions to an annotation queue: **Selected only** (default, hand-pick via checkboxes), **All matching filters** (bulk-add every session matching the current filter), and **Sample** (add a random percentage of matching sessions using a configurable slider). A confirmation modal is shown for bulk operations.
912

docs/concepts/evaluations/dataset.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -34,6 +34,8 @@ Selecting multiple sessions from the list will clone all the messages from those
3434

3535
Messages that are cloned from a session will be "connected" to their actual message in OCS, and you will be able to follow links back to their original conversation when viewing the output of an evaluator. However, modifying or updating a cloned message will break this link.
3636

37+
Because cloned messages retain this session connection, the sessions they belong to can be imported into an annotation queue for human review. Only dataset entries with a linked session are eligible for this import — messages added manually or via CSV upload do not have a session link and cannot be imported into an annotation queue.
38+
3739
### Manually creating a dataset
3840

3941
Messages can be manually added in the UI. You must enter a Human Message, an AI response, and optionally the history for this message and any context.

0 commit comments

Comments
 (0)