Towards an Abstractive Opinion Summarisation of Multiple Reviews in the Tourism Domain

Cyril Labbé, François Portet

Introduction

In the era of Web 2.0, e-commerce platforms are inundated with user-generated reviews. For the tourism industry, this volume of data is a double-edged sword: while it provides a wealth of consumer feedback, the sheer quantity and unstructured nature of these reviews make it nearly impossible for potential customers to extract a clear, unbiased consensus. Most current automated systems rely on extractive summarization, which simply pulls existing sentences from the source text. However, these methods often fail to capture the nuance of subjective opinions, leading to redundant or irrelevant summaries.

This paper evaluates the flaws in current extractive techniques and proposes a novel abstractive summarization architecture. By leveraging Natural Language Generation (NLG), domain-specific ontologies, and temporal analysis, the authors aim to create coherent, human-like summaries that reflect the global opinion of a property over time.

The Limitations of Current Systems

To establish a baseline, the authors conducted a comparative study of three existing approaches:

  1. Open Text Summarizer (OTS): A general-purpose tool using TF-IDF to identify important sentences. It often fails on reviews because it prioritizes frequently used but irrelevant phrases (e.g., "booking was done at the last minute") over actual amenity feedback.
  2. Feature-based Selection Extraction: A custom statistical method that identifies words associated with specific features (like "BED" or "ROOM"). While better at targeting relevant topics, it suffers from extreme redundancy, often outputting multiple nearly identical sentences.
  3. RnR (Reviews and Ratings) System: A more advanced system that uses a domain ontology to categorize positive and negative features into a visual dashboard.
The RnR System dashboard provides a structured overview of hotel features and ratings but lacks the narrative context required to explain trends.

As seen in the RnR system (Figure 2), while dashboards provide a clean high-level overview, they strip away the context of the opinions and fail to explain why certain trends—such as a dip in ratings—are occurring.

A Proposed Abstractive Architecture

To move beyond the constraints of simple extraction, the authors propose a pipeline that "understands" the data before generating a summary. This architecture moves from raw text to semantic facts, and finally to a generated narrative.

The proposed abstractive architecture integrates ontology-based feature extraction with temporal segmentation and Natural Language Generation (NLG).

The core components of this new pipeline include:

  • Feature Extraction & Sentiment Analysis: Utilizing an Ontology and WordNet to identify key hotel features and their polarities.
  • Temporal Segmentation: Analyzing ratings as a time series to identify distinct periods in a hotel's lifecycle, allowing the system to detect if service quality is improving or declining.
  • Natural Language Generation (NLG): Instead of copying sentences, the system aggregates facts to generate fluid text. For example, it can contrast opinions in a single sentence: "While the rooms are small, most guests found the bathroom exceptionally clean."

Key Insights and Qualitative Results

The study highlights that frequency-based extraction is fundamentally ill-suited for the subjective nature of reviews. Qualitative analysis showed that OTS often required several sentences before mentioning a relevant hotel feature. Meanwhile, feature-based extraction, though relevant, produced repetitive and jarring outputs.

The authors argue that NLG is uniquely suited for this domain because it can:

  • Aggregate data: Combining multiple positive points into a single, concise sentence.
  • Handle Vagueness: Summarizing a range of opinions without losing the general sentiment.
  • Provide Temporal Context: Explaining how a hotel's performance has changed over the years, a feature missing from static dashboards.

Conclusion and Future Directions

While abstractive summarization is computationally more expensive than extractive methods due to the need for semantic reasoning, it offers a significantly more useful output for consumers. The authors acknowledge the lack of a "gold standard" for evaluating review summaries, as automated metrics like BLEU or ROUGE do not capture the utility of a summary. Future work will focus on a task-based evaluation strategy to measure how effectively these generated summaries assist users in making real-world travel decisions.

Summary updated

Abstract

Since the arrival of Web 2.0, there is an increasing amount of on-line Reviews and Ratings about diverse products or services. The reviews contain general comments as well as highly personal elements or opinions about the customers’ experience with the product. Other customers or companies are facing the problem of extracting the relevant information from this mass of reviews. In this paper, we present a comparative study of three different summarisation techniques for reviews analysis. From this study, we propose a general architecture which relies on a customisable abstractive summarisation approach making use of domain knowledge and temporal analysis. The paper ends by identifying research directions for improving the efficiency of review summarisation methods.
BibTeX
@inproceedings{labbe2012towards,
  author = {Cyril Labbé and François Portet},
  title = {{Towards an Abstractive Opinion Summarisation of Multiple Reviews in the Tourism Domain}},
  booktitle = {SDAD@ECML/PKDD},
  year = {2012},
  url = {https://openreview.net/forum?id=LeQ5E6EI6Tr},
}
Figure