Event Extraction as Natural Language Generation

I-Hung Hsu, Kuan-Hao Huang, Elizabeth Boschee, Scott Miller, Prem Natarajan, Kai-Wei Chang, Nanyun Peng

Abstract

Event extraction (EE) is a critical NLP task that involves identifying event triggers and their participants (arguments). However, high-quality human annotation for EE is expensive and time-consuming. This paper introduces DEGREE (Data-Efficient Generation-Based Event Extraction), a model that reformulates EE as a conditional generation task. By utilizing manually designed prompts and a pre-trained encoder-decoder architecture, DEGREE generates natural language summaries of events. This approach allows the model to leverage label semantics and joint dependencies, leading to significant performance gains in low-resource environments.

Introduction

Traditional event extraction models typically treat the task as a sequence labeling or classification problem. These methods often require large amounts of labeled data and fail to capture the semantic meaning of event roles (e.g., treating "Agent" as an opaque category). Furthermore, pipeline-based models that extract triggers and arguments separately cannot exploit the mutual information between them.

Methodology: DEGREE

DEGREE shifts the paradigm from classification to generation. The model takes a passage and a specific Prompt as input. The prompt provides semantic guidance through three components: an event type description, event keywords, and an end-to-end (E2E) template.

The DEGREE architecture concatenates the passage and a structured prompt to generate a natural language output, which is then parsed into event triggers and arguments.

The model uses a pre-trained BART-large transformer. During inference, it generates a sentence following the template, filling placeholders with entities from the passage. A deterministic algorithm then extracts the final predictions from this generated text. This design allows the model to use its pre-trained "common sense"—for instance, knowing that a "Place" role should be filled by a location entity.

Experimental Results

The researchers evaluated DEGREE on the ACE 2005 and ERE-EN benchmarks, focusing on its performance when training data is scarce.

DEGREE significantly outperforms baseline models like OneIE and TANL in low-resource settings (1-50% of data) across multiple datasets.

Key Findings

  • Data Efficiency: In the 1% data regime, DEGREE outperformed the state-of-the-art OneIE model by 15 F1 points in trigger classification and 5 points in argument extraction.
  • Semantic Leveraging: The use of natural language templates proved superior to abstract tags, as the model could better utilize its pre-trained linguistic knowledge.
  • Joint Learning: By generating triggers and arguments simultaneously, the model effectively captures the dependencies between them, improving overall extraction accuracy.

Conclusion and Future Work

DEGREE demonstrates that generative models are highly effective for low-resource event extraction. By framing the task as natural language generation, the model overcomes the limitations of traditional classification approaches. Future work will focus on improving inference efficiency—as the current model must iterate through event types—and automating the creation of high-quality templates.

Summary updated

Abstract

Event extraction requires high-quality expert human annotations, which are usually expensive. Therefore, learning a data-efficient event extraction model that can be trained with only a few labeled examples has become a crucial challenge. In this paper, we focus on low-resource end-to-end event extraction and propose DEGREE, a data-efficient model that formulates event extraction as a conditional generation problem. Given a passage and a manually designed prompt, DEGREE learns to summarize the events mentioned in the passage into a natural sentence that follows a predefined pattern. The final event predictions are then extracted from the generated sentence with a deterministic algorithm. DEGREE has three advantages to learn well with less training data. First, our designed prompts provide semantic guidance for DEGREE to leverage DEGREE and thus better capture the event arguments. Moreover, DEGREE is capable of using additional weakly-supervised information, such as the description of events encoded in the prompts. Finally, DEGREE learns triggers and arguments jointly in an end-to-end manner, which encourages the model to better utilize the shared knowledge and dependencies among them. Our experimental results demonstrate the strong performance of DEGREE for low-resource event extraction.
BibTeX
@inproceedings{hsu2022event,
  author = {I-Hung Hsu and Kuan-Hao Huang and Elizabeth Boschee and Scott Miller and Prem Natarajan and Kai-Wei Chang and Nanyun Peng},
  title = {{Event Extraction as Natural Language Generation}},
  booktitle = {Conference of the North American Chapter of the Association for Computational Linguistics},
  year = {2022},
  doi = {10.18653/v1/2022.naacl-main.138},
}
Figure