Event versus entity co-reference: Effects of context and form of referring expression

Sharid Loáiciga, Luca Bevacqua, Hannah Rohde, Christian HardmeierNAACL 2018

TL;DR

This paper investigates how the choice between referring to an "event" or an "entity" with pronouns like "It" and "This" is influenced by the pronoun itself and the surrounding linguistic context. They found that "It" tends to refer to entities, while "This" favors events, a bias that can be further modulated by verb types and prior discourse context.

What Problem Does This Paper Address?

Resolving co-reference – figuring out which noun phrase or pronoun refers to the same real-world thing or concept – is a fundamental challenge in natural language processing. While systems are getting better at identifying when a pronoun refers to a concrete "entity" (like a person or object), they often struggle with "abstract anaphora," where pronouns refer to events, situations, or ideas. This is particularly tricky because some pronouns, like "It" and "This," can plausibly refer to either entities or events, leading to ambiguity. Current co-reference systems often focus only on nominal antecedents, neglecting these event references. This paper aims to bridge this gap by understanding how humans resolve these ambiguous cases, providing a baseline for improving NLP systems.

Methods

The researchers conducted two psycholinguistic studies using a story-continuation task. Participants were presented with a context sentence and a prompt (either "It" or "This") and asked to write a continuation.

  • Study 1 (Constructed Passages): This study used carefully crafted sentences to control for specific linguistic features. They manipulated two factors:
  • Verb Type: Alternating verbs (which can be used transitively or intransitively, allowing for an agent) versus non-alternating verbs (which typically only take one argument).
  • Pronoun Prompt: "It" vs. "This." The goal was to see how these factors influenced participants' choice to refer to an entity or an event.

  • Study 2 (Corpus Passages): This study used naturally occurring sentences extracted from the ParCorFull corpus, which is annotated for co-reference. This allowed them to examine how participants resolved pronouns in more realistic discourse contexts, considering both the original co-reference type (entity or event) and the pronoun used.

Both studies used statistical modeling (mixed-effects logistic regression) to analyze the participants' choices.

Datasets

  • Study 1: Used 24 custom-designed experimental items, each consisting of a context sentence and a pronoun prompt. These were interleaved with filler items.
  • Study 2: Used 48 minimally edited passages from the ParCorFull corpus. This corpus is a German-English parallel corpus annotated with full co-reference, including both nominal and event antecedents. They focused on the TED talk transcripts portion of the corpus.

Key Insights and Ideas

  • Pronoun Bias: There's a clear, though not absolute, tendency for "It" to refer to entities and "This" to refer to events. This suggests that the form of the referring expression itself carries significant information about the intended antecedent type.
  • Verb Type Matters: In constructed contexts, verbs that allow for agent alternations (like "melt" in "The snow melted" vs. "The heat melted the snow") are more likely to trigger event co-reference. This is likely because these verbs implicitly suggest a potential agent, making the event more salient.
  • Contextual Influence: The original co-reference type in a passage (whether it was previously referring to an event or an entity) also influences subsequent pronoun choices. This highlights the importance of discourse history in resolving ambiguous references.
  • Flexibility, Not Rigidity: Neither "It" nor "This" is used categorically for entities or events. This flexibility is crucial for natural language and presents a challenge for systems that might rely on strict rules.

Key Results

  • Study 1: Showed a significant main effect of prompt type, with "This" leading to more event co-reference than "It." There was also a main effect of verb type, with alternating verbs yielding more event co-reference.
  • Study 2: Confirmed the prompt type effect, with "This" favoring event co-reference. It also found that when the original passage already contained event co-reference, event co-reference for the subsequent pronoun was even higher.

Limitations and Future Work

  • Defining "Event": The paper acknowledges that defining what constitutes an "event" can be challenging, especially for abstract concepts or situations that blur the line between events and entities. Some ambiguous examples were excluded due to this difficulty.
  • Further Investigation Needed: More research is required to fully understand the properties that make events salient, how their salience interacts with pronoun choice, and the nuances of the "gray area" between events and entities.
  • Improving NLP Systems: The findings offer a promising avenue for improving anaphoricity detection and event mention identification in co-reference resolution systems by incorporating features related to verb type and discourse context. The ability to differentiate anaphoric from pleonastic "It" is also highlighted as a related area for improvement.

Summary updated

BibTeX
@inproceedings{loaiciga2018event,
  author = {Sharid Loáiciga and Luca Bevacqua and Hannah Rohde and Christian Hardmeier},
  title = {{Event versus entity co-reference: Effects of context and form of referring expression}},
  booktitle = {Conference of the North American Chapter of the Association for Computational Linguistics},
  year = {2018},
}
Figure