Why Read if You Can Scan? Trigger Scoping Strategy for Biographical Fact Extraction

Dian Yu, Heng Ji, Sujian Li, Chin-Yew Lin

Instead of painstakingly parsing every word in a sentence, this research proposes a "scanning" strategy for biographical fact extraction that mimics human reading behavior. By identifying specific "trigger" words (like born or graduated) and determining their linguistic "scope," the authors achieve up to a 26% absolute gain in F-score over state-of-the-art methods—all without relying on complex syntactic analysis or external knowledge bases.

The Challenge of Biographical Fact Extraction

Extracting biographical facts—such as birth dates, education, and family relations—from the massive influx of digital text is a cornerstone of Knowledge Base Population (KBP). Traditional approaches usually fall into two camps:

  1. Pattern-based methods: These use rigid templates. They are precise but suffer from low recall because language is too diverse for a few patterns to cover.
  2. Dependency-based methods: These rely on deep syntactic parsing to find relationships. While powerful, they are computationally expensive and often struggle with the messy reality of natural language.

The authors noticed a crucial statistic: 94.36% of biographical facts in standard datasets appear in sentences containing clear "trigger" words. However, simply finding a trigger isn't enough; you need to know exactly where the related information starts and ends. The challenge is defining this "trigger scope" effectively to extract the right data without getting lost in the "noise" of the rest of the sentence.

The Trigger Scoping Method

The authors designed an extraction process based on human "scanning" theory, which involves looking for keywords and then reading closely only within a specific window.

1. Trigger Tagging

The system uses a list of 343 mined triggers (e.g., resident, native, spouse) to identify potential facts within a sentence.

2. Scope Identification

This is the core innovation. The authors define "trigger scope" as the shortest fragment of text related to a trigger. They tested two ways to find it:

  • Rule-based: A simple heuristic where the trigger is the left boundary and the next verb or different-type trigger is the right boundary.
  • Supervised Classification (SVM): A machine learning model that looks at features like the distance from the trigger, Part-of-Speech (POS) tags, and Named Entity types to decide if a word is "inside" or "outside" the scope.
Performance comparison of Rule-based vs. SVM-based scope identification across fact groups.

As shown in the table above, the supervised classifier was remarkably accurate at identifying scope boundaries, with accuracy scores ranging from 93.8% to 96.6% across different fact groups, significantly outperforming the rule-based approach.

3. Fact Extraction

Once the scope is identified, the system simply looks for entities within that window that match the required type (e.g., if the trigger is children, it looks for a "Person" entity).

Evaluation and Key Results

The study utilized the TAC-KBP Slot Filling (SF) 2012 and 2013 corpora. The system was evaluated on 50 person-based queries covering 11 biographical fact types. The "Trigger Scoping" strategy significantly outperformed existing state-of-the-art systems:

  • Overall Performance: The SVM-based approach (System 3 in the table below) achieved an overall F-score of 71.6%, compared to the state-of-the-art baseline of 56.9% (System 1).
  • Specific Wins: In categories like place of birth and date of birth, the system saw massive improvements, reaching F-scores of 88.2% and 100% respectively.
Detailed performance metrics (Recall, Precision, F-score) across various biographical fact types.

Discussion and Future Work

The success of this method suggests that "Trigger Scoping" is a highly generalizable strategy. Humans don't read every word when looking for a specific fact; we jump to keywords. This paper proves that NLP systems can be significantly more effective by mimicking this targeted behavior. Furthermore, the results indicate that knowing the boundaries of a trigger's influence (the scope) is often sufficient and much more robust than full dependency parsing.

Limitations

The primary limitation identified is the "Centroid Person" assumption. The current model assumes a sentence revolves around a single main subject. If a sentence mentions multiple people and a trigger (e.g., "Reina, the mother of Orlando, who died in February"), the system might mistakenly attribute the death date to both individuals.

Future Work: * Developing methods to better analyze the specific relationship between the query entity and the trigger to avoid misattribution in complex sentences. * Exploring ways to automatically generate trigger lists for new, "surprise" fact types to make the system even more adaptable.

Summary updated

Abstract

The rapid growth of information sources brings a unique challenge to biographical information extraction: how to find specific facts without having to read all the words. An effective solution is to follow the human scanning strategy which keeps a specific keyword in mind and searches within a specific scope. In this paper, we mimic a scanning process to extract biographical facts. We use event and relation triggers as
BibTeX
@inproceedings{yu2015why,
  author = {Dian Yu and Heng Ji and Sujian Li and Chin-Yew Lin},
  title = {{Why Read if You Can Scan? Trigger Scoping Strategy for Biographical Fact Extraction}},
  booktitle = {Conference of the North American Chapter of the Association for Computational Linguistics},
  year = {2015},
  doi = {10.3115/v1/n15-1126},
}
Figure