Skip to content

Actions: Azure/azure-sdk-for-python

Actions

Copilot coding agent

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
311 workflow runs
311 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

AdversarialSimulator is getting stuck in a loop when using ADV_CONVERSATION scenario for FDP projects. ``` import os import asyncio import logging from dotenv import load_dotenv from azure.identity import AzureCliCredential from azure.ai.evaluation.simul Copilot coding agent #236: by Copilot AI
15m 14s copilot/fix-09f37de5-74c3-4e74-b04e-c00c05fcae75
copilot/fix-09f37de5-74c3-4e74-b04e-c00c05fcae75
15m 14s
Fixing issue #42410 Copilot coding agent #235: by Copilot AI
16m 53s copilot/fix-42410
copilot/fix-42410
16m 53s
Fixing issue #42405 Copilot coding agent #234: by Copilot AI
16m 29s copilot/fix-42405
copilot/fix-42405
16m 29s
Fixing issue #42403 Copilot coding agent #233: by Copilot AI
9m 24s copilot/fix-42403
copilot/fix-42403
9m 24s
Fixing issue #42401 Copilot coding agent #232: by Copilot AI
9m 0s copilot/fix-42401
copilot/fix-42401
9m 0s
Fixing issue #42390 Copilot coding agent #231: by Copilot AI
6m 17s copilot/fix-42390
copilot/fix-42390
6m 17s
Addressing comment on PR #42363 Copilot coding agent #230: by Copilot AI
8m 46s copilot/fix-42362
copilot/fix-42362
8m 46s
Fixing issue #42362 Copilot coding agent #229: by Copilot AI
13m 35s copilot/fix-42362
copilot/fix-42362
13m 35s
Running Copilot Copilot coding agent #228: by Copilot AI
6m 15s copilot/fix-ee2e001b-580c-4828-9f06-954e7f04ab9c
copilot/fix-ee2e001b-580c-4828-9f06-954e7f04ab9c
6m 15s
Addressing comment on PR #42317 Copilot coding agent #227: by Copilot AI
11m 39s copilot/fix-b895e627-53ae-45f6-afe6-d61edd4ccf6a
copilot/fix-b895e627-53ae-45f6-afe6-d61edd4ccf6a
11m 39s
When we run _SafetyEvaluation with _SafetyEvaluator.DIRECT_ATTACK and num_rows=200, we see two of the same queries appear. See if you able to reproduce this issue, and if so, find the root cause. Then, if necessary, propose a fix. Copilot coding agent #226: by Copilot AI
12m 27s copilot/fix-b895e627-53ae-45f6-afe6-d61edd4ccf6a
copilot/fix-b895e627-53ae-45f6-afe6-d61edd4ccf6a
12m 27s
When we run _SafetyEvaluation with _SafetyEvaluator.DIRECT_ATTACK and num_rows=200, we see two of the same queries appear. See if you able to reproduce this issue, and if so, find the root cause. Then, if necessary, propose a fix. Copilot coding agent #225: by Copilot AI
16m 56s copilot/fix-80de3c1e-5204-4619-983b-13aad5e75b35
copilot/fix-80de3c1e-5204-4619-983b-13aad5e75b35
16m 56s
Addressing comment on PR #42277 Copilot coding agent #224: by Copilot AI
7m 52s copilot/fix-ca0e36a1-f446-40c3-8232-711a165ab8d4
copilot/fix-ca0e36a1-f446-40c3-8232-711a165ab8d4
7m 52s
Release SDK package. package name: azure-template, language: Python Copilot coding agent #223: by Copilot AI
18m 14s copilot/fix-ca0e36a1-f446-40c3-8232-711a165ab8d4
copilot/fix-ca0e36a1-f446-40c3-8232-711a165ab8d4
18m 14s
Addressing comment on PR #42256 Copilot coding agent #222: by Copilot AI
6m 49s copilot/fix-a8f6aa06-6c9c-49c0-beaa-a20ea66cbeb4
copilot/fix-a8f6aa06-6c9c-49c0-beaa-a20ea66cbeb4
6m 49s
Addressing comment on PR #42256 Copilot coding agent #221: by Copilot AI
9m 57s copilot/fix-a8f6aa06-6c9c-49c0-beaa-a20ea66cbeb4
copilot/fix-a8f6aa06-6c9c-49c0-beaa-a20ea66cbeb4
9m 57s
Addressing comment on PR #42195 Copilot coding agent #220: by Copilot AI
13m 10s copilot/fix-42194
copilot/fix-42194
13m 10s
Addressing comment on PR #42256 Copilot coding agent #219: by Copilot AI
5m 42s copilot/fix-a8f6aa06-6c9c-49c0-beaa-a20ea66cbeb4
copilot/fix-a8f6aa06-6c9c-49c0-beaa-a20ea66cbeb4
5m 42s
Addressing comment on PR #42195 Copilot coding agent #218: by Copilot AI
7m 1s copilot/fix-42194
copilot/fix-42194
7m 1s
Addressing comment on PR #42195 Copilot coding agent #217: by Copilot AI
16m 14s copilot/fix-42194
copilot/fix-42194
16m 14s
Addressing comment on PR #42256 Copilot coding agent #216: by Copilot AI
6m 24s copilot/fix-a8f6aa06-6c9c-49c0-beaa-a20ea66cbeb4
copilot/fix-a8f6aa06-6c9c-49c0-beaa-a20ea66cbeb4
6m 24s
Release azure-template package. Copilot coding agent #215: by Copilot AI
15m 2s copilot/fix-a8f6aa06-6c9c-49c0-beaa-a20ea66cbeb4
copilot/fix-a8f6aa06-6c9c-49c0-beaa-a20ea66cbeb4
15m 2s
We are using the same randomization_seed to get the single-turn query set by invoking safety evaluation interface with direct attack evaluator in evaluation SDK twice—once for the treatment group and once for the control group. We expect the returned query sets from control and treatment to be identical; however, only half of queries are matched, which is unexpected. Evaluator returned number of queries is 200. Matched queries for direct_attack should be 200. However, there are only 100 queries matched... Copilot coding agent #214: by Copilot AI
26m 29s copilot/fix-fae0862b-dffa-452d-af0d-a3c4b5b120b1
copilot/fix-fae0862b-dffa-452d-af0d-a3c4b5b120b1
26m 29s
Addressing comment on PR #42190 Copilot coding agent #213: by Copilot AI
13m 22s copilot/fix-42189
copilot/fix-42189
13m 22s
Addressing comment on PR #42195 Copilot coding agent #212: by Copilot AI
16m 21s copilot/fix-42194
copilot/fix-42194
16m 21s