Customer Service Combining Human Operators and Virtual Agents: A Call for Multidisciplinary AI Research

Sarit Kraus, Yaniv Oshrat, Yonatan Aumann, Tal Hollander, Oleg Maksimov, Anita Ostroumov, Natali Shechtman

TL;DR

This paper argues that the future of customer service lies in a hybrid approach, seamlessly integrating human operators and virtual agents. They propose a multidisciplinary AI research agenda to tackle the complex challenges of building such systems, emphasizing the need for collaboration across AI subfields and beyond.

What Problem Does This Paper Address?

The current landscape of online customer service is often a frustrating experience for users. While virtual agents (bots) are increasingly deployed to handle customer inquiries, they frequently fall short, leading to customer dissatisfaction and a desire to speak with a human. This is often due to the limitations of current AI in understanding nuanced queries or handling complex, multi-step tasks. Furthermore, building and maintaining these virtual agents requires significant domain expertise and constant updates, making them costly and time-consuming. The paper posits that a hybrid system, where virtual agents handle routine queries and humans step in for more complex or escalated issues, is the optimal solution. However, achieving this effectively requires a holistic approach that integrates various AI technologies and disciplines, which is currently lacking.

Methods

The paper advocates for a multidisciplinary approach to building hybrid customer service systems (HOCUS). Their proposed methodology focuses on developing a virtual agent that incrementally learns from human operators, minimizing the need for explicit domain knowledge upfront. They suggest leveraging techniques from:

  • Natural Language Processing (NLP): For understanding customer queries and generating appropriate responses.
  • Machine Learning (ML) / Deep Learning (DL): For training models, domain adaptation, and learning from data.
  • Reinforcement Learning (RL) / Behavioral Cloning (BC): For agents to learn from human operator actions.
  • Multi-Agent Systems (MAS): For coordinating interactions between virtual agents and human operators.
  • Human-Computer Interaction (CHI): To ensure a positive and intuitive user experience.
  • Operations Research (OR): For optimizing system performance, resource allocation, and queuing.
  • Psychology, Business, Sociology, Economics, Informatics, Data Mining: For understanding user behavior, satisfaction, and organizational factors.

They also propose a practical approach of building a Q&A database from existing customer-agent interactions, using pre-trained language models (like BERT and its variants) to identify question clusters and achieve a reasonable accuracy in matching questions to answers.

Datasets

The paper does not introduce new datasets but discusses the use of existing data from customer service interactions. Specifically, they describe an experiment where they collected data from human subjects interacting with a virtual agent and human operators in a simulated PC building and fixing environment. This data was used to build a Q&A database and train models for question matching.

Key Insights and Ideas

  • The "Win-Win" Hybrid Model: The core idea is that a hybrid system can benefit both customers (faster service, better satisfaction) and the service provider (cost-effectiveness, reduced human operator load) by intelligently combining human and virtual agent capabilities.
  • Multidisciplinarity is Non-Negotiable: No single AI subfield can solve the challenges of hybrid customer service. True progress requires integrating knowledge and techniques from diverse fields, including AI, computer science, and social sciences.
  • Learning from Humans is Key: Virtual agents can be effectively built by learning from human operators' interactions and knowledge, reducing the upfront investment in explicit domain expertise.
  • The Handoff Challenge: Seamlessly transferring control between virtual agents and human operators, and vice versa, is a critical but complex aspect that requires careful consideration.
  • Defining Success: While customer satisfaction is paramount, the paper also highlights the need to consider operational efficiency and cost-effectiveness as key metrics for evaluating hybrid systems.

Key Results

The paper presents results from two main experiments:

  • Q&A Matching: Using pre-trained LM models, they achieved 70% accuracy in identifying question clusters from a Q&A database, which improved to 76% accuracy after minor manual processing. This demonstrates the feasibility of building a functional virtual agent with limited initial domain knowledge.
  • User Satisfaction Study: A simulation comparing a pure human environment (11 clients) to a hybrid environment (18 clients with virtual agent assistance) showed that the hybrid system could attend to more clients without increasing waiting times. Crucially, clients in the hybrid system reported higher satisfaction grades, received answers significantly faster (51.2 seconds vs. 90.7 seconds for answer delivery), and finished their tasks sooner.

Limitations and Future Work

The authors acknowledge that overcoming the differences in terminology, concepts, and methodologies across various research communities is a significant challenge. They also note that while their experiments demonstrate feasibility, further work is needed to fully realize the potential of hybrid customer service systems. Future work should focus on:

  • Developing robust handoff mechanisms between agents and humans.
  • Investigating how to effectively transfer information during handoffs.
  • Exploring the impact of different customer personalities and needs on hybrid system design.
  • Further refining the integration of various AI techniques and disciplines.
  • Developing standardized methodologies and evaluation metrics for hybrid customer service systems.

Summary updated

Abstract

The use of virtual agents (bots) has become essential for providing online assistance to customers. However, even though a lot of effort has been dedicated to the research, development, and deployment of such virtual agents, customers are frequently frustrated with the interaction with the virtual agent and require a human instead. We suggest that a holistic approach, combining virtual agents and human operators working together, is the path to providing satisfactory service. However, implementing such a holistic customer service system will not, and cannot, be achieved using any single AI technology or branch. Rather, such a system will inevitably require the integration of multiple and diverse AI technologies, including natural language processing, multi-agent systems, machine learning, reinforcement learning, and behavioral cloning; in addition to integration with other disciplines such as psychology, business, sociology, economics, operation research, informatics, computer-human interaction, and more. As such, we believe this customer service application offers a rich domain for experimentation and application of multidisciplinary AI. In this paper, we introduce the holistic customer service application and discuss the key AI technologies and disciplines required for a successful AI solution for this setting. For each of these AI technologies, we outline the key scientific questions and research avenues stemming from this setting. We demonstrate that integrating technologies from different fields can lead to a cost-effective successful customer service center. The challenge is that there is a need for several communities, each with its own language and modeling techniques, different problem-solving methods, and different evaluation methodologies, all of which need to work together. Real cooperation will require the formation of joint methodologies and techniques that could improve the service to customers, but, more importantly, open new directions in cooperation of diverse communities toward solving joint difficult tasks.
BibTeX
@inproceedings{kraus2023customer,
  author = {Sarit Kraus and Yaniv Oshrat and Yonatan Aumann and Tal Hollander and Oleg Maksimov and Anita Ostroumov and Natali Shechtman},
  title = {{Customer Service Combining Human Operators and Virtual Agents: A Call for Multidisciplinary AI Research}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2023},
  doi = {10.1609/aaai.v37i13.26795},
}
Figure