Coupling Analysis Between Twitter and Call Centre

Fangfang Li, Yanchang Zhao, Klaus Felsche, Guandong Xu, Longbing CaoarXiv 2015 · arXiv

Introduction

Government agencies often operate in a reactive mode, responding to public inquiries through traditional channels like call centers. However, social media platforms like Twitter offer a real-time pulse of public sentiment and concerns. This paper investigates the "coupling" between Twitter activity and internal call center logs for the Australian Department of Immigration and Border Protection (DIBP). The goal is to determine if social media trends can serve as lead indicators for operational demand, enabling better resource allocation.

Methodology

The researchers established a multi-stage analytical pipeline to bridge the gap between unstructured social media data and structured call center records.

The methodological framework for data transformation and coupling analysis.

The process began with Data Integration, where disparate call center "Disposition Codes" from Canberra, London, and Ottawa were mapped to six high-level categories: citizen, work, study, visit, permanent, and other. Following this, the data underwent Time Series Transformation using two distinct strategies: raw frequency (total volume) and percentage (topic density).

To isolate meaningful trends from the noise of weekends and holidays, the team applied Additive Decomposition. This step separated the data into observed, trend, seasonal, and random components, allowing for a clearer view of underlying patterns.

Additive decomposition used to isolate trends from seasonal call center fluctuations.

Finally, Cross-Correlation Functions (CCF) and Symbolic Aggregate Approximation (SAX) were used to identify temporal lags and pattern matches between the Twitter and call center datasets.

Data and Insights

The study analyzed 1.45 million tweets (2007–2014) and 387,037 call center records (Dec 2013 – Feb 2014). A primary insight was the dynamic nature of the lead-lag relationship. While Twitter often acts as a lead indicator—with users reacting immediately to news—the call center sometimes leads for complex personal issues where individuals seek official guidance before sharing experiences online.

The choice of metric also proved critical. Analyzing the percentage of a topic often revealed different lag patterns than simple frequency counts, suggesting that the relative importance of a topic (topic density) is a more sensitive operational metric than raw volume.

Results

Temporal coupling varied significantly across visa categories:

  • Study: Call center inquiries lagged Twitter activity by 3 days (correlation of -0.58).
  • Permanent Residency: Lags ranged from 1 to 5 days depending on whether frequency or percentage metrics were used.
  • Visit: Showed high simultaneous correlation (0.86), though Twitter lagged the call center by 1 day in percentage-based analysis.
  • Work: Demonstrated a 3-day lag for call centers in frequency counts, but no delay for percentage-based trends.

Conclusion

While limited by a short three-month call center data window, this research demonstrates that social media is a viable early-warning system for government operations. Future work aims to integrate sentiment analysis to distinguish between general confusion and urgent public outcry, further refining the predictive power of these external data streams.

Summary updated

Abstract

Social media has been contributing many research areas such as data mining, recommender systems, time series analysis, etc. However, there are not many successful applications regarding social media in government agencies. In fact, lots of governments have social media accounts such as twitter and facebook. More and more customers are likely to communicate with governments on social media, causing massive external social media data for governments. This external data would be beneficial for analysing behaviours and real needs of the customers. Besides this, most governments also have a call centre to help customers solve their problems. It is not difficult to imagine that the enquiries on external social media and internal call centre may have some coupling relationships. The couplings could be helpful for studying customers' intent and allocating government's limited resources for better service. In this paper, we mainly focus on analysing the coupling relations between internal call centre and external public media using time series analysis methods for Australia Department of Immigration and Border Protec-tion. The discovered couplings demonstrate that call centre and public media indeed have correlations, which are significant for understanding customers' behaviours.
BibTeX
@misc{li2015coupling,
  author = {Fangfang Li and Yanchang Zhao and Klaus Felsche and Guandong Xu and Longbing Cao},
  title = {{Coupling Analysis Between Twitter and Call Centre}},
  year = {2015},
  eprint = {1509.02238},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1509.02238},
}
Figure