ANALYST REPORT
The New Conversation Scorecard: Coaching Agents for the Moments That Matter
Sponsored By:
THE NEW CONVERSATION SCORECARD: COACHING AGENTS FOR THE MOMENTS THAT MATTER
Featuring Insights by John Callery Cofounder, Chief Product & Technology Officer ReflexAI
Sam Dorison Cofounder & CEO ReflexAI
Introduction The idea of “AI automating simple issues so that human employees can focus on consequential ones” is more than a catchy buzz phrase. It is leaders’ consensus vision for the future of customer contact. CMP’s research continues to uncover optimism about an “agentic future” in which AI resolves a large volume of support issues without human intervention. Employees, then, will focus on interactions with high strategic value or ROI implications. In theory, this shift is exciting. It empowers human agents to contribute more value to the business, all while taking on work rooted in the true spirit of their role: connecting with people. They will leverage human-centric qualities like empathy, relationship-building, and creative problem-solving on a more consistent basis. In practice, four factors risk creating a “be careful what you wish for” scenario: lack of readiness for new work, hiring and retention constraints, ineffective scorecards, and unsupportive culture. Together, these four challenges make up what ReflexAI’s research calls the Conversation Performance Gap. As the stakes of human conversations grow, so too does the cost of leaving this gap unaddressed. Addressing them, and finding a way to develop talent capable of more engaging, empathetic, relationship-oriented service, is imperative. This analyst report explores the root causes of the Conversation Performance Gap, before providing a blueprint for rebuilding customer contact scorecards, rewriting coaching curricula, and ultimately cultivating teams that will succeed in the moments that matter.
The New Conversation Scorecard | www.customercontactweekdigital.com
2
THE NEW CONVERSATION SCORECARD: COACHING AGENTS FOR THE MOMENTS THAT MATTER
Why Yesterday’s Contact Center Wasn’t Built for Today’s Conversation Standard When it comes to transforming the contact center, AI is no longer the bottleneck. Today’s AI agents are increasingly capable of understanding customer questions, surfacing relevant answers, and even taking productive actions. Leaders have already invested. According to ReflexAI’s research, The Conversation Performance Gap, 85% of contact centers have deployed at least one AI tool for training or QA, but only 29% say they’re using AI effectively. The bottleneck, instead, comes from the very nature of the customer contact operation. Common to many contact centers, the following four limitations create a Conversation Performance Gap. This gap thwarts human employees’ readiness – and willingness – to tackle higher value work, ultimately preventing contact centers from achieving the workflow transformation they have long been seeking. As the role human agents play becomes increasingly pivotal to business success, the impact of this gap becomes increasingly significant.
1. The readiness challenge Talk about shifting employees to higher-value work rests on an important assumption: that they are actually ready to handle these more complex, unpredictable, emotionally demanding interactions. Present reality does not support that assumption. Customer contact leaders may philosophically associate qualities like empathy, sense of urgency, and creative problem-solving with the human workforce, but their existing operations are not fleshing out these skills. According to research from CMP, just 17% of leaders feel their employees are fully equipped to handle nextgeneration work. Disappointingly, this number is virtually unchanged from 2024. The persistence of this readiness gap directly jeopardizes the AI transformation. Employees will struggle to meet the elevated standard required by their new work, inhibiting the organization’s ability to generate ROI from these interactions. Employee engagement will also suffer, as human agents grow frustrated by their inability to address these more intellectually complex, emotionally demanding customer inquiries. Organizations, moreover, face a dilemma in their effort to close this gap. Because customers are presently rejecting selfservice (70% prefer live agents, per CMP’s 2026 Consumer Preferences Survey), frontline employees are still spending too much time on lower-value, more transactional interactions. A whopping 71% of leaders, in fact, say agents spend the majority of their days on tasks that could have been automated. With their focus, capacity, and intellectual competency stuck on traditional support, experienced agents have little opportunity to cultivate and apply new skills. But as AI adoption improves and contact centers begin to meaningfully offload this work, they create a development challenge for the new agents who no longer have a manageable atmosphere for learning about products, systems, and the customer base.
The New Conversation Scorecard | www.customercontactweekdigital.com
3
THE NEW CONVERSATION SCORECARD: COACHING AGENTS FOR THE MOMENTS THAT MATTER
“For years, the contact center had a built-in training ground. New agents handled a long run of routine calls, learned the business, and earned their way into the hard ones. AI is removing that runway.” - Sam Dorison, Cofounder & CEO, ReflexAI The training they do offer, moreover, is hindered by a lack of meaningful “return on learning” intelligence. Existing training gaps only compound the problem. Supervisors routinely lament not having the time or resources to deliver proper coaching for the types of interactions where their agents add the most value, and the coaching they can provide is ill-suited for today’s less predictable, more nuanced conversations.
2. The structural challenge If “on the job” training is the gateway to success, contact centers face another problem: employees are not necessarily “on the job” for long. Turnover is notoriously high in the contact center, and the growing mismatch between customer expectations and employee abilities could only amplify the problem. If the job becomes even more stressful and contentious, employees will have even less incentive to build a longterm career in the contact center. High turnover, of course, means contact centers are routinely losing their best, most seasoned performers – and constantly onboarding people who may not have the experience navigating high-stakes situations with distressed callers. With the value of human-led interactions continuing to grow, this means contact centers will be relying on unprepared, unproven talent to handle increasingly challenging interactions where the consequences of success or failure are greater than ever. The New Conversation Scorecard | www.customercontactweekdigital.com
4
THE NEW CONVERSATION SCORECARD: COACHING AGENTS FOR THE MOMENTS THAT MATTER
Recruiting for enhanced capabilities may seem like the solution, but it faces its own complication in the status quo. Only 31% of contact centers meaningfully increased compensation over the past 5 years, which means they are raising the standard of the role without making it more financially attractive. That mismatch could undermine both hiring and retention.
“When QA teams can only review 3 to 5% of interactions by hand, and the scorecard has a single ‘showed empathy’ checkbox, you end up with a number that’s subjective, inconsistent
3. The strategic challenge
between reviewers, and too sparse to
Craving new workflows and designing an operation to accommodate those workflows are two vastly different things. By failing to achieve the latter, many of today’s contact centers are establishing the futility of the former. Metrics still favor the traditional “question-andanswer” approach to service, often neglecting the more conversational “human” component. Given the well-documented link between relationshiporiented service and customer loyalty – in a 2023 CMP survey, 85% of consumers said they would be more likely to support a brand that personalized the experience – this approach has long been flawed. And it makes for an especially inadequate barometer of human performance in today’s era, where AI is handling more information requests, policy inquiries, and straightforward transactions. By painting an incomplete view of contact center performance, antiquated scorecards send the incorrect message about what matters. This trickles down to the frontline in the form of inadequate coaching. “Human” skill development has been falling comparatively low on the totem pole. CMP data confirms that while 49% have increased training on products and policies over the past year, just 40% have increasingly trained on empathy. Just 35% increased their coaching on brand and company values. Granted, this is not simply a matter of leaders neglecting the importance of relationship-minded service. Organizations have historically struggled to weave the human dimension into their scorecards, especially when those rubrics have to be deployed, at scale, to cover hundreds of thousands of agents working out of multiple facilities. The challenge organizations have faced defining empathy cannot be overstated. If an organization views it as a perfect synonym for “sympathy,” the robustness of their scorecard becomes a moot point. They will ultimately be scoring – and conditioning – agents on the wrong quality.
connect to anything downstream.” - Sam Dorison, Cofounder & CEO, ReflexAI
Struggling to properly define human qualities and rebuild the associated scorecards, leaders risk coaching toward a vision of success that is at best narrower than, and at worst counter to, what the role actually demands.
4. The culture challenge Since the issues are of greater significance, “complex work” is not simply more intellectually challenging. It is also more emotionally demanding. The heightened stakes add an unprecedented emotional element to the contact center agent’s job. Customers care more about receiving a particular outcome, which means they are more likely to get hostile in the face of ineffective performance and more likely to get upset when the resolution does not align with their expectation. That toll is lower when agents have the skills and confidence to succeed. Agents who can address a caller’s emotions and build trust find even difficult calls less draining. Due to the aforementioned challenges, many agents will lack the competencies and leadership support needed to deliver on these heightened expectations. This means they will very likely face the wrath of emotionally charged customers, exacerbating the frustration of an already challenging job. The consequence manifests in the form of “complexity burnout.” Addressing this type of burnout requires a firm commitment to wellness and support, qualities which have unfortunately been lacking from the typical contact center’s employee experience. In a statistic that underscores this neglect, 65% of contact centers do not even actively listen to employee feedback about the day-to-day work experience.
The New Conversation Scorecard | www.customercontactweekdigital.com
5
THE NEW CONVERSATION SCORECARD: COACHING AGENTS FOR THE MOMENTS THAT MATTER
Some industries are, however, demonstrating more employee centricity than others. By working to support their talent, crisis centers empower their teams to demonstrate empathy, build trust, and lessen the emotional difficulty of incredibly high-stakes calls.
“Crisis lines never had easy calls. A counselor’s first shift can include the hardest conversation of someone’s life. As AI takes over routine contacts, more customer-facing teams are working that way too, and the crisis field has years of lessons on how to prepare people for it.” - Sam Dorison, Cofounder & CEO, ReflexAI
The New Conversation Scorecard | www.customercontactweekdigital.com
6
THE NEW CONVERSATION SCORECARD: COACHING AGENTS FOR THE MOMENTS THAT MATTER
The New Scorecard: Elevating Conversation Performance and Maximizing the Moments That Matter Make no mistake: the AI revolution is happening. Business leaders are wholeheartedly committed to automating the bulk of their transactional support inquiries. The consequence will not only be a shift in the type of work humans handle but in the stakes of that work.
“As more of the customer experience is automated, the human conversations are the ones customers remember. They carry outsized weight for retention and trust.” - Sam Dorison, Cofounder and CEO, ReflexAI
As a result, closing the Conversation Performance Gap ranks as an urgent imperative for customer contact leaders. This imperative includes establishing a new performance framework that defines the most valuable qualities and behaviors, uncovers meaningful improvement areas, fosters better leadership support, and connects to real-world improvement. Keys to success follow.
Reframe empathy as actionable, contextual, and utterly critical to success As the role of the agent shifts from addressing basic inquiries to consulting on challenging scenarios and building human connections, contact centers can no longer treat empathy as an optional, aspirational concept. They must make it an integral performance dimension, right alongside traditional measures like following protocols, adhering to processes, sharing accurate information, and maintaining the brand’s tone.
The New Conversation Scorecard | www.customercontactweekdigital.com
7
THE NEW CONVERSATION SCORECARD: COACHING AGENTS FOR THE MOMENTS THAT MATTER
To bring this goal to fruition, it is essential to recognize empathy as an actionable quality that can be consistently observed, measured, and optimized. As ReflexAI CEO Sam Dorison notes, empathy can be broken into observable behaviors like perspective-taking, recognizing emotion, and communicating understanding, each scored and coached. It is equally important to embrace empathy as a contextual principle rather than a generic, superficial expression of remorse or acknowledgement.
“A useful distinction for QA teams is general versus tailored empathy. ‘Thank you for sharing that information’ could be said on any call, and customers hear it that way. ‘I can imagine how stressful it is to get a bill like this, especially with your surgery coming up next week’ shows the agent was listening. The second is the one that builds trust and drives long-term retention even in challenging times. It’s the one that’s worth measuring.” - Sam Dorison, Cofounder and CEO, ReflexAI
The actionable, contextual view of empathy connects to the big picture outcomes that matter, including CSAT, first contact resolution, and employee retention. It thus fully warrants its place on any worthwhile contact center scorecard.
Modernize QA to create a more credible contact center scorecard Defining empathy as an actionable, contextual principle helps organizations determine what to look for. Equally important is how they go about looking for it in the context of customer interactions – and then using that insight to help agents consistently improve customer perception and the overall service experience. Modern QA solutions provide this visibility, offering analysis of 100% of conversations. Notably, they connect particular behaviors, communications, and qualities to tangible outcomes.
The New Conversation Scorecard | www.customercontactweekdigital.com
8
THE NEW CONVERSATION SCORECARD: COACHING AGENTS FOR THE MOMENTS THAT MATTER
“This is what we mean by conversation performance. Contact centers have measured operational stats for decades: handle time, utilization, service levels. Conversation performance applies the same rigor to the conversations themselves, including what agents say, how they say it, and whether it works, with practice and coaching tied to what the evidence shows. Empathy belongs inside that system as a measurable skill.” - Sam Dorison, Cofounder and CEO, ReflexAI
Explainability is the heart of this elevated QA initiative, as it shifts the mindset from tracking scores to understanding and operationalizing what those scores mean. According to ReflexAI CEO Sam Dorison, effective agent coaching requires more than transparent scoring. It demands shared accountability, where agents take ownership of improvement and organizations provide fair feedback and opportunities to practice. Coaching, indeed, becomes less about retroactive judgment and more about proactive improvement. With this shift, the organization can create a scorecard tailored to the reality of agent-led conversations.
●
It evaluates interactions in their appropriate context, accounting for the pivot into more personalized, unpredictable customer conversations.
●
It extends the spotlight from static tasks and measures (Did the agent say this disclosure? Did they end the call in this amount of time?) to consequential behaviors.
●
It traces those specific behaviors to big picture business and customer experience outcomes, creating shared credibility and accountability.
The New Conversation Scorecard | www.customercontactweekdigital.com
9
THE NEW CONVERSATION SCORECARD: COACHING AGENTS FOR THE MOMENTS THAT MATTER
Leverage simulation training to coach complete conversation performance When the focus shifts from retroactive reviewing to proactive improvement, modern QA creates an opportunity to elevate training. Contact centers that properly seize this opportunity stand to reduce ramp time, position agents for long-term success, and improve employee retention. To achieve this reality, organizations must rethink their training to focus on complete conversation performance: guiding agents to combine knowledge, tool fluency, judgment, and empathy into each workflow and conversation.
“In a real conversation, an agent doesn’t get to handle the emotion first and the policy question second. A customer is upset about a denied claim, the answer depends on three rules that changed last quarter, and an AI assistant is suggesting next steps in another window. It all happens at once. Practice should look like that too. The strongest scenarios layer the knowledge challenge and the emotional one together, so the customer’s frustration rises when the agent gets a detail wrong and settles when they handle it well. Each attempt is evaluated on both accuracy and empathy behaviors. Agents learn that the two reinforce each other.” - John Callery, Cofounder and Chief Product and Technology Officer, ReflexAI
Simulation training is the answer, provided it meets certain criteria.
●
It goes beyond “mock calls” and accounts for the entire interaction workflow. What tools and software must the agent leverage during the interaction? What knowledge and customer data are essential, and how are they accessed? What balance must the employee strike between a warm, friendly, “sympathetic” tone – and a commanding, authoritative, resolution-oriented one?
●
It reflects current systems and knowledge, including real-time changes to policies and products. The strongest platforms connect directly to the knowledge management systems, wikis, and internal documents teams already maintain, so simulations and scoring stay current when a policy changes. As ReflexAI’s John Callery notes, when an agent gets a fact wrong, the feedback should point to the policy that says so.
●
It accounts for real-life variables. In the real world, conversations get interrupted. The phone gets handed off to another party. Distractions emerge. The best simulation solutions prepare agents for these inevitabilities.
●
It credibly reproduces the consequential, nuanced, industry-specific interactions agents will increasingly handle in the AI-driven contact center.
●
It evaluates and explains performance the right way. Organizations, their teams, and their customers will have their own versions of what good looks like. They will have their own approaches to empathy. The best solutions not only calibrate to these unique performance visions but explain scoring in a way that can help all users learn and improve.
The New Conversation Scorecard | www.customercontactweekdigital.com
10
THE NEW CONVERSATION SCORECARD: COACHING AGENTS FOR THE MOMENTS THAT MATTER
“Ask where the platform has been proven. ReflexAI’s simulations were built to train crisis counselors, including Veterans Crisis Line responders, where a missed cue can’t be taken back. Practice designed for that level of attunement prepares agents for the nuance of any hard customer conversation.” - John Callery, Cofounder and Chief Product and Technology Officer, ReflexAI
To elevate the impact of this solution, supervisors must evaluate simulations and real-world interactions through the same lens. This uniformity will simultaneously create gravitas around the training exercises and help the contact center quantify whether the learning is producing an actual return.
Recommit to the employee experience Committing to empathy, reframing QA, and leveraging simulation training directly address enduring gaps in readiness and strategy. By virtue of making performance management more productive and supportive, they also help reduce employee turnover – and ramp time if new agents do ultimately enter the equation. But employee-centric contact centers recognize the need to go beyond performance management. Knowing that employees who are engaged, tenured, and motivated are uniquely suited for high-stakes, emotionally intense interactions, they focus on elevating the overall employee experience. They recommit to the belief that happy, empowered agents create happy, loyal customers. They also monitor what these interactions could mean for employee sentiment. They pay specific attention to the emotional weight the evolving day-to-day could place on their teams, while assessing whether the contact center’s tools, software, and systems are sufficiently ameliorating that burden. They have active conversations about how the role is changing, leveraging the insights from their QA and simulation solutions to make the change management conversation more personalized. Further, they trace the impact sharper conversation performance has on business outcomes and use the correlation to uncover new compensation and rewards opportunities. The New Conversation Scorecard | www.customercontactweekdigital.com
11
THE NEW CONVERSATION SCORECARD: COACHING AGENTS FOR THE MOMENTS THAT MATTER
The New Conversation Scorecard | www.customercontactweekdigital.com
12
THE NEW CONVERSATION SCORECARD: COACHING AGENTS FOR THE MOMENTS THAT MATTER
Success in Practice: Better Coaching = Better Conversations = Better Business Outcomes This blueprint is not an exercise in speculation or wishful thinking. It is rooted in real-world success. ReflexAI, the conversation performance platform for high-stakes work, was built around these same objectives. It is tailored to the evolving perception of conversation quality, accounting for the value of empathy, expert-level knowledge, and sound judgment. It is also predicated on uncovering improvement opportunities rather than simply scoring existing talent. Customer case studies with quantifiable results follow.
The New Conversation Scorecard | www.customercontactweekdigital.com
13
THE NEW CONVERSATION SCORECARD: COACHING AGENTS FOR THE MOMENTS THAT MATTER
ReflexAI is the conversation performance platform for organizations where high-stakes human interactions drive outcomes. Through a closed-loop system connecting AI-powered simulation, real-world evaluation, and performance intelligence, ReflexAI helps frontline teams practice the right skills, improve faster, and sustain better performance over time. Customers across crisis and behavioral health, healthcare, financial services, and contact centers use ReflexAI to train team members up to 75% faster, achieve 100% conversation coverage, and turn performance data into the coaching decisions that matter most. Learn more at reflexai.com
The New Conversation Scorecard | www.customercontactweekdigital.com
14