What Is Overlap Knowledge in Event Argument Extraction? APE: A Cross-datasets Transfer Learning Model for EAE

Kaihang Zhang, Kai Shuang, Xinyue Yang, Xuyang Yao, Jinyu GuoACL 2023 · OpenReview

Abstract

The Event Argument Extraction (EAE) task extracts structured event records from text. Most existing approaches train models on datasets independently, ignoring "overlap knowledge"—generalizable associations between entity types and events shared across datasets. This paper defines overlap knowledge and proposes APE (Assembles Prefix and Adapter), a model that learns shared and dataset-specific knowledge in two serial phases. By formulating both as conditional generation tasks and using Stressing Entity Type Prompts, APE achieves state-of-the-art performance, particularly in low-data scenarios where it outperforms baselines by an average of 27.27% F1 with only ten training records.

Introduction

Event Argument Extraction (EAE) is the process of identifying the "who, what, where, and when" of an event described in text. Despite its importance, EAE models often struggle with data scarcity due to the high cost of annotation. While transfer learning offers a potential solution, it is complicated by varying schemas across datasets; for instance, a person might be labeled a "Victim" in one dataset and a "Target" in another.

Existing models typically treat datasets in isolation, missing the opportunity to leverage universal entity-event relationships. APE addresses this by decoupling "overlap knowledge"—the general association between entity types (e.g., Person, Location) and events—from "specific knowledge"—the dataset-specific roles (e.g., Killer, Victim).

Methodology: The APE Framework

The APE model operates under the Seek Common ground while Reserving Differences (SC-RD) framework. This framework decomposes the EAE task into two distinct learning phases designed to accumulate knowledge without catastrophic forgetting.

Two-Phase Learning

  1. Overlap Knowledge Learning (Phase 1): The model learns to identify entities associated with an event using a universal set of entity types (e.g., Person, Location, Time). This is framed as a Pseudo-Entity Recognition (PER) task. General knowledge is stored using Prefix-tuning, where trainable prefix vectors are added to Transformer layers.
  2. Specific Knowledge Learning (Phase 2): The model is tuned to the specific argument roles of a target dataset. It uses Adapters—small, trainable modules—while the previously learned "Overlap" Prefix remains frozen.
The APE model architecture, illustrating the two-phase learning process: Overlap Knowledge Learning (Phase 1) and Specific Knowledge Learning (Phase 2).

Stressing Entity Type Prompts

To bridge these phases, APE uses Stressing Entity Type Prompts. These prompts utilize identical special tokens (e.g., [person/organization]) in both phases. This consistency allows the model to "ignite" the general knowledge from Phase 1 to solve the specific role-mapping task in Phase 2.

Experimental Evaluation

APE was evaluated on three major benchmarks: ACE 2005 (sentence-level), RAMS (document-level), and WikiEvents (document-level). A manual mapping function was used to align dataset-specific roles with universal entity types.

Results and Key Insights

APE achieved new state-of-the-art results across all benchmarks, with absolute F1 gains of 2.7% on ACE05, 2.1% on RAMS, and 3.4% on WikiEvents using a BART-large backbone.

The model's most significant advantage is in few-shot learning. As shown in the table below, when only 10 training samples are available, APE dramatically outperforms the PAIE baseline.

Performance comparison between the baseline PAIE and the proposed APE model in low-data (few-shot) scenarios across three benchmarks.

Ablation studies confirmed that both the Prefix (for shared knowledge) and the Adapter (for specific knowledge) are critical. Removing either component resulted in significant performance degradation, validating the two-phase modular approach.

Conclusion and Future Work

APE demonstrates that explicitly modeling overlap knowledge across datasets significantly enhances EAE performance, especially when data is scarce. By isolating shared and specific knowledge, the model effectively transfers "event-sense" across different schemas. Future research directions include automating the mapping between roles and entity types and exploring cross-lingual transfer learning for EAE.

Summary updated

Abstract

The EAE task extracts a structured event record from an event text. Most existing approaches train the EAE model on each dataset independently and ignore the overlap knowledge across datasets. However, insufficient event records in a single dataset often prevent the existing model from achieving better performance. In this paper, we clearly define the overlap knowledge across datasets and split the knowledge of the EAE task into overlap knowledge across datasets and specific knowledge of the target dataset. We propose APE model to learn the two parts of knowledge in two serial learning phases without causing catastrophic forgetting. In addition, we formulate both learning phases as conditional generation tasks and design Stressing Entity Type Prompt to close the gap between the two phases. The experiments show APE achieves new state-of-the-art with a large margin in the EAE task. When only ten records are available in the target dataset, our model dramatically outperforms the baseline model with average 27.27% F1 gain.
BibTeX
@inproceedings{zhang2023what,
  author = {Kaihang Zhang and Kai Shuang and Xinyue Yang and Xuyang Yao and Jinyu Guo},
  title = {{What Is Overlap Knowledge in Event Argument Extraction? APE: A Cross-datasets Transfer Learning Model for EAE}},
  booktitle = {Annual Meeting of the Association for Computational Linguistics},
  year = {2023},
  url = {https://openreview.net/forum?id=OyUFNHTnwO},
}
Figure