Clustering Sentences with Density Peaks for Multi-document Summarization

Yang Zhang, Yunqing Xia, Yi Liu, Wenmin WangNAACL 2015

TL;DR

This paper introduces a novel multi-document summarization (MDS) method that leverages density peaks clustering (DPC) to simultaneously score sentences for representativeness, diversity, and conciseness. By adapting DPC, the method avoids the need for pre-defined cluster numbers or post-processing for redundancy, offering a more efficient and unified approach to MDS.

What Problem Does This Paper Address?

Creating concise and informative summaries from multiple documents (multi-document summarization or MDS) is a challenging task. Existing methods often struggle to balance three key aspects: representativeness (capturing the main points), diversity (avoiding redundant information), and conciseness (keeping the summary short). Many approaches tackle these issues separately, leading to complex pipelines. Specifically, clustering-based methods, while popular for identifying related sentences, often require pre-determining the number of clusters and then performing separate ranking or redundancy reduction steps. This paper aims to address these limitations by proposing a unified scoring model that integrates these crucial factors directly within a clustering framework.

Methods

The core of this paper is the adaptation of the Density Peaks Clustering (DPC) algorithm for multi-document summarization. DPC, originally designed for general clustering, identifies cluster centers based on high local density and a large distance from points with higher densities.

The authors adapt DPC in the following ways:

  • Sentence Representation: Sentences are represented using a bag-of-words model, and similarity is calculated using a boolean scheme (term presence/absence).
  • Unified Scoring: Instead of separate steps, the authors propose a single scoring function that combines three key metrics:
  • Representativeness Score ($REP(i)$): A sentence is considered more representative if it has more similar sentences around it (higher density). This is calculated based on the sum of similarities to other sentences, weighted by a threshold.
  • Diversity Score ($DIV(i)$): This score measures how dissimilar a sentence is to other sentences with higher representativeness scores. It's calculated as 1 minus the maximum similarity to a more representative sentence.
  • Length Score ($LEN(i)$): Shorter sentences are preferred. This score considers both the "real length" (total word count) and "effective length" (unique non-stop terms) of a sentence.
  • DPSC Method: The final score for a sentence ($DPSC(i)$) is the product of these three scores (or the sum of their logarithms for computational ease). Sentences are then ranked based on this unified score.
  • Summary Generation: The top-ranked sentences are selected to form the summary, naturally incorporating the desired properties.

A key advantage highlighted is that DPC inherently handles the number of clusters and can rank all data points, eliminating the need for separate post-processing steps for redundancy reduction.

Datasets

The primary dataset used for evaluation is the DUC2004 dataset, specifically for generic multi-document summarization. The authors note that this dataset is manually annotated for generic MDS. No new benchmarks are introduced.

Key Insights and Ideas

  • Unified Scoring is Powerful: The paper demonstrates that integrating representativeness, diversity, and length into a single scoring metric is effective for MDS. This contrasts with methods that treat these aspects independently.
  • DPC's Suitability for MDS: The density peaks clustering algorithm proves to be a surprisingly good fit for MDS. Its ability to identify cluster centers and rank all points simultaneously simplifies the summarization pipeline significantly.
  • Eliminating External Resources: The method's independence from external resources like WordNet or Wikipedia, and its avoidance of complex parsing, makes it highly practical for easy reproduction and deployment.
  • Global Diversity: The proposed diversity score, which compares a sentence to all other sentences (not just those already selected, as in MMR), offers a more global perspective on diversity.

Key Results

  • The proposed DPSC method outperforms the DUC04Best method and other existing clustering-based methods on the DUC2004 dataset.
  • It achieves results comparable to state-of-the-art generic MDS methods.
  • The method is noted for its low complexity and usability, making it easily reproducible.
  • Experiments on the density threshold show that a setting around 0.22 is optimal for the DUC04 dataset, with performance dropping significantly after 0.30.

Limitations and Future Work

  • Semantic Similarity: The authors acknowledge that the current sentence similarity is based on bag-of-words. They suggest that incorporating semantic text similarity could further improve the quality of the summaries.
  • Query-Based Summarization: The paper proposes extending the method to query-based multi-document summarization, which would involve adapting the scoring to prioritize sentences relevant to a specific query.

Summary updated

BibTeX
@inproceedings{zhang2015clustering,
  author = {Yang Zhang and Yunqing Xia and Yi Liu and Wenmin Wang},
  title = {{Clustering Sentences with Density Peaks for Multi-document Summarization}},
  booktitle = {Conference of the North American Chapter of the Association for Computational Linguistics},
  year = {2015},
}
Figure