Skip to content

Conversation

stkillen
Copy link
Contributor

@stkillen stkillen commented Jul 17, 2025

Summary

Backport all changes to AI Test Tool.

Work Item(s)

Fixes AB#592420

stkillen and others added 4 commits July 17, 2025 16:45
<!-- Thank you for submitting a Pull Request. If you're new to
contributing to BCApps please read our pull request guideline below
* https://github.com/microsoft/BCApps/Contributing.md
-->
Improve extensibility of AI Test Tool.

needs to be open and approved. Submitting PRs with no linked issues or
unapproved issues is highly discouraged. -->
Fixes
[AB#579313](https://dynamicssmb2.visualstudio.com/Dynamics%20SMB/_workitems/edit/579313)
<!-- Thank you for submitting a Pull Request. If you're new to
contributing to BCApps please read our pull request guideline below
* https://github.com/microsoft/BCApps/Contributing.md
-->
Add evaluators and columns mappings to the AI Test Tool. Improve
extensibility add new procedures to AIT Test Context that matches
formatting for [Azure AI
Foundry](https://learn.microsoft.com/en-us/azure/ai-foundry/how-to/develop/evaluate-sdk).

- Add evaluators and column mappings for data that can be used by
extensions
- Include evaluators and column mappings in XMLport and UI pages
- Add new integration event OnAfterRunComplete that is raised after a
run is completed

needs to be open and approved. Submitting PRs with no linked issues or
unapproved issues is highly discouraged. -->
Fixes
[AB#562564](https://dynamicssmb2.visualstudio.com/1fcb79e7-ab07-432a-a3c6-6cf5a88ba4a5/_workitems/edit/562564)

---------

Co-authored-by: Darrick <[email protected]>
<!-- Thank you for submitting a Pull Request. If you're new to
contributing to BCApps please read our pull request guideline below
* https://github.com/microsoft/BCApps/Contributing.md
-->
#### Summary <!-- Provide a general summary of your changes -->
Do not replicate evaluators and column mappings.

#### Work Item(s) <!-- Add the issue number here after the #. The issue
needs to be open and approved. Submitting PRs with no linked issues or
unapproved issues is highly discouraged. -->
Fixes
[AB#591730](https://dynamicssmb2.visualstudio.com/Dynamics%20SMB/_workitems/edit/591730/)
@stkillen stkillen requested review from a team as code owners July 17, 2025 14:55
@github-actions github-actions bot added this to the Version 26.4 milestone Jul 17, 2025
@stkillen stkillen changed the title [26.x] [AI Test Tool] Add evaluators and improve extensibility [26.x] [AI Test Tool] Backport changes Jul 17, 2025
t-prda
t-prda previously approved these changes Jul 17, 2025
@stkillen stkillen merged commit 826d26f into releases/26.x Jul 18, 2025
20 checks passed
@stkillen stkillen deleted the features/592420 branch July 18, 2025 11:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants