Share via


Analyze conversation transcripts with Copilot Studio Kit (preview)

[This article is prerelease documentation and is subject to change.]

The Conversation Analyzer enables makers to analyze the conversation transcripts of their Copilot Studio custom agents by using custom prompts. The feature includes two built-in prompts: sentiment analysis and personal data analysis. You can create, use, save, and reuse custom prompts. Using custom prompts to analyze the conversations can provide insights that traditional analytics don't offer.

Overview

Navigate to the Conversation Analyzer to view a list of agents. Agent Inventory shows agent data.

The Action column in the agent list displays either:

  • View Results indicates that recent transcripts for the agent are already analyzed and ready to review.
  • Analyze indicates that no analysis has been performed. Select recent transcripts to start an analysis.

Screenshot of the overview page of Conversation Analyzer.

Create a new analysis

This feature lets makers apply custom prompts to analyze conversations.

  1. Select an agent, and then choose Analyze from the Actions column. The prompt selection screen opens.

  2. Choose either of the built-in prompts:

    • Sentiment Analysis
    • Personal data Analysis

    Screenshot of creating a New Analysis with Conversation Analyzer.

  3. Create a custom prompt:

    1. Select Create a custom prompt.
    2. Enter a descriptive name.
    3. Enter your prompt in the Prompt text box.

    Screenshot of creating a custom prompt with Conversation Analyzer.

  4. Select Start.

It might take a few moments for the analysis results to display. The custom prompt is automatically saved when you start a new analysis and appears in the prompt selection dropdown for future use.

View existing analyses

Select View results to view analysis results. This view also appears when a new analysis finishes.

Screenshot of viewing existing analysis results in Conversation Analzyer.

Each conversation analysis displays the following details:

  • Conversation ID
  • Summary
  • Duration
  • Prompt used
  • Date of analysis creation

Depending on the prompt you select, the summary offers valuable insights. To view the full conversation and analysis details, select View Results in the Action column.

View conversation analysis details

The layout of the conversation analysis view might vary slightly depending on the selected prompt. The full conversation appears on the right side of the screen, displayed as it occurred, while the main view presents the corresponding analysis details.

Screenshot of conversation analysis details in Conversation Analyzer.