Run tests in Copilot Studio Kit

A Test Run in Copilot Studio Kit allows you to execute multiple tests contained in a single test set against a specific Agent Configuration.

Create a test run

To create a test run:

1. Access the Copilot Studio Kit application.
2. Navigate to Test Runs.
3. Create a New Agent Test Run record.
4. Enter a Name.
5. Select the Agent Test Set you want.
6. Select the Agent Configuration you want.
7. Save the record.

Understand what happens when a test runs

When you save a Test Run record, a few things happen in order:

1. An initial cloud flow triggers and runs all the tests against the specified agent configuration.
2. The Run Status changes from Not Run to Running.
3. The system creates individual Test Results for each Test.
4. When the tests finish running, the Run Status updates to Complete.
5. If there's an Error, the system provides a link to the failed cloud flow for further troubleshooting.

When the Run Status reaches Complete, other cloud flows might start, depending on the configuration:

1. App Insights Enrichment Status is set to Pending until the data is available in App Insights. The status updates to Running and Complete when the analysis finishes.
2. Generated Answers Analysis is set to Pending if App Insights Enrichment Status is configured so that it runs after it. The status updates to Running and Complete when the analysis finishes.
3. Dataverse Enrichment Status is set to Pending until the conversation transcript is available in Dataverse. The status updates to Running and Complete when the analysis is done.

Duplicate a test run

You can quickly rerun the exact same test set by selecting the Duplicate Run command. This command creates a copy of the record that immediately runs after saving.

Duplicate a test run to rerun the same test configuration, for example, at a different time, after making configuration changes, or after adding to the test set.

Rerun a specific step

You can rerun a specific child flow:

• Enrich with App Insights
• Analyze with AI Builder
• Enrich with Dataverse
• Update Rollup Columns

The primary purpose of rerunning steps is to rerun enrichment steps when technical issues occur. The rerun processes only test cases with Success or Pending status.

Next step