logo

NJP

Conversation Improvement themes

Conversation Improvement themes

by Service-now.com

Use insights from auto and human evaluators to identify areas of improvement for your virtual agent conversations, so you can increase customer satisfaction and ROI.

0 installs 0 reviews v1.0.8 Scoped Application Free-ish (consumes 5 tables) 5 tables

Install Trend

First tracked: 2025-12-12 Latest: 2026-09-09 (0 installs)
View Install Data
Date Install Count Change
2026-09-09 0 -

About

The primary aim of this application is to transform Conversation Evaluator’s evaluations (part of AI Control Tower) into long-term performance insights by analyzing conversation quality data over time. The approach focuses on identifying recurring patterns linked to low (and high) conversation quality and categorizing user requests into actionable themes using metadata-driven classification powered by large language models (LLMs).

Key Features

1. Automated theme detection

- Uses a domain-specific LLM theme classification framework to tag KB articles, catalog items, VA topics, and agents into themes.
- Every evaluated conversation is classified under one of these themes.

2. Thematic insights and drill-down

- Provides breakdown of poor/good quality conversations (based on conversation evaluator scores) into top underlying themes.
- Users can drill down into a specific theme and review those conversations and also identify gaps in corresponding thematic content/catalog/agents.

3. Benchmarking

- Users are able to compare themes based on whether they lead to good or bad conversations.

4.Operational and strategic alignment

- Supports both daily operational tuning and long-term strategic planning.
- Bridges the gap between AI system performance data and business value realization.

Version History (2)
v1.0.8 2026-05-05 14:47:34
Fixed a bug that was causing the transcript of a conversation not to build correctly for primary request tagging.
v1.0.7 2025-12-11 15:09:09
New Initial release.

Support

ID: da06fb72ff33221082c4ffffffffffd6 · Published: May 2026 · Updated: Sep 09, 2026