March 8, 2025 By Yuanheng Fan

Crossing the Uncanny Valley of Voice: Implications for the Future of Contact Centers

The rapid advancements in AI-driven voice technology have brought us closer to seamless human-machine interactions, but they have also exposed a unique challenge—the "uncanny valley of voice." This phenomenon, explored in recent research by Sesame, highlights how users react negatively to AI-generated voices that are almost—but not quite—human. Understanding and addressing this challenge has profound implications for the future of contact centers and customer experience.

Mori's Uncanny Valley graph showing the relationship between human likeness and emotional response
Figure 1: Mori's Uncanny Valley graph illustrating how emotional response varies with human likeness

The Uncanny Valley Effect in Voice AI

The uncanny valley is a well-documented concept in robotics and animation, describing the discomfort people feel when interacting with near-human but imperfect artificial entities. Sesame's research extends this principle to AI-generated voices, demonstrating that subtle imperfections in tone, cadence, or emotional expression can lead to a sense of unease and distrust among users.

For contact centers, this means that while AI voice agents can provide efficiency, they must be carefully designed to avoid triggering the uncanny valley effect. Customers who detect an almost-human voice that feels "off" may become frustrated, leading to lower satisfaction scores and potential brand damage.

Implications for the Contact Center Industry

As contact centers increasingly leverage AI-powered voice agents to handle customer interactions, they must navigate the uncanny valley carefully. Here are some key considerations:

1. Striking the Right Balance Between AI and Human Interaction

Rather than striving for a perfect human-like AI voice, companies should consider an intentional balance between human and synthetic elements. Research suggests that customers are more accepting of AI when it clearly sounds artificial but remains natural and pleasant.

2. Emotionally Intelligent AI

AI voice agents need to go beyond simple speech synthesis to incorporate natural prosody, contextual understanding, and emotional intelligence. By analyzing customer sentiment and adjusting tone appropriately, AI can enhance interactions while minimizing discomfort.

3. Transparency in AI Usage

One key takeaway from Sesame's research is that customers prefer knowing when they are interacting with AI. Contact centers should be transparent about AI involvement in customer interactions, ensuring that users are not misled into believing they are speaking with a human.

4. The Role of Human Agents in a Hybrid Model

AI is not a replacement for human agents but a complement. The future of contact centers will likely involve a hybrid model where AI handles routine inquiries while human agents manage complex, emotionally sensitive interactions. This approach ensures that customers receive efficient service while still benefiting from genuine human empathy when needed.

Conclusion

The uncanny valley of voice presents both a challenge and an opportunity for the contact center industry. By carefully designing AI interactions, maintaining transparency, and leveraging a hybrid approach, businesses can enhance customer experiences while maximizing efficiency. As AI voice technology continues to evolve, the key to success will be in creating interactions that are not just technologically advanced but also psychologically comfortable for users.

For contact centers looking to stay ahead in the AI revolution, understanding and mitigating the uncanny valley effect will be essential in shaping the next generation of customer experiences.

References

This article draws insights from Sesame's research on conversational voice technology: Crossing the uncanny valley of conversational voice by Brendan Iribe, Ankit Kumar, and the Sesame team (February 27, 2025).