Why use it
Every AI agent has two kinds of gap: the workflows you built poorly, and the workflows you did not build at all. Both hide in production conversations. Topic clusters make them visible without hand-labeling every session. You can see:- The most common things users are asking the agent to do.
- New use cases that appeared this week or this month.
- Topics with high frustration, high escalation, or high failure rates.
- Use cases that are growing quickly and deserve investment.
- Requests for capabilities the agent does not currently support.
How it works
The Context Company continuously scans conversation content across every run and groups sessions into topic clusters. Each cluster shows:- A short label describing the intent.
- Volume: number of runs in the cluster and share of overall traffic.
- Trend: stable, growing, declining, or newly emerged over the selected window.
- Example prompts drawn from real sessions in the cluster.
- Rollups for feedback, Pattern hits, failures, tools involved, and models used.
Discover, explore, track
The topic workflow mirrors the broader discovery loop:1
Discover
Open the topics view (or the topic section of the latest recap) to see emerging and shifting clusters.
2
Explore
Click into a cluster to see representative runs, feedback, tool usage, and failure rates. Use Insight Search for follow-up questions like “what tool errors show up in the scheduling topic?”
3
Track
Turn important topics into a custom Pattern if you want ongoing monitoring, alerts, or precise counts per release.
Example questions
- What are the top ten things users are trying to do with the agent right now?
- What new use cases appeared this month?
- Which topics have the highest thumbs-down rate?
- Which topics are growing fastest?
- Which requests most often escalate to a human, based on session-level signals?
- Which organizations are driving the growth in a specific topic?
- Which requests correspond to capabilities we have not built yet?
Segmenting clusters
Because clusters are computed on top of the normal run model, you can filter or segment by any of the standard dimensions:- User or organization to see whether a topic is concentrated in a few accounts.
- Agent, workflow, or tool to attribute cluster behavior to a specific part of the system.
- Custom metadata such as plan tier, region, or agent version to compare cluster behavior across cohorts.
Interpreting clusters
Volume alone is not a quality signal. A high-volume cluster with strong feedback and low failure rate means the agent handles that workflow well. A high-volume cluster with repeated frustration, silent failures, or tool errors usually points to one of:- A wrong or inconsistent answer the agent gives on that topic.
- A missing knowledge base entry or stale content.
- A tool that succeeds technically but produces the wrong result.
- A workflow the agent was never built to handle.
Limitations
- Clusters improve with traffic volume. Very low-volume tenants may see broad or unstable groupings.
- Topic labels are generated automatically and are meant to be readable, not authoritative. Two clusters that look similar may still be distinct.
- Clustering runs on conversation content; agents that operate entirely through tools without free-text turns produce fewer meaningful clusters.
