Semantic Role Labeling for Question Generation

35 concepts26 papers1 proposal

When we transform a declarative sentence into a question, our brains naturally focus on the underlying event and its participants. If we read "The chef chopped onions in the kitchen," we can instantly generate questions like "Who chopped the onions?" or "Where did the chef chop the onions?"

For decades, automated question generation (QG) systems attempted to mimic this capability using surface-level syntactic transformations—manipulating dependency trees or shifting word positions. However, syntax is notoriously fickle. If the sentence shifts to the passive voice ("Onions were chopped by the chef"), the syntactic structure changes entirely, requiring an entirely new set of transformation rules.

To solve this, researchers shifted their focus from syntax to deep semantics using Semantic Role Labeling (SRL). SRL normalizes sentences by identifying their core predicate-argument structures—answering who did what to whom, where, and when, regardless of how the sentence is phrased. This semantic invariance provides a clean, structured foundation for generating precise and diverse questions.


The Core Mechanism: Mapping Roles to Interrogatives

The reason SRL works so effectively for question generation is that it abstracts a sentence into a structured database of roles. Consider a standard SRL framework that labels a predicate (the action) along with its core arguments:

  • ARG0 (Agent): The entity performing the action.
  • ARG1 (Patient/Theme): The entity affected by the action.
  • ARGM-LOC (Location): Where the action occurred.
  • ARGM-TMP (Time): When the action occurred.

Once these slots are filled, generating a question becomes a systematic mapping exercise rather than a complex syntactic puzzle.

[The chef]    [chopped]   [the onions]   [in the kitchen].
  │             │             │              │
  ▼             ▼             ▼              ▼
 ARG0       Predicate        ARG1         ARGM-LOC

Targeting ARG0     ──►  Who [Predicate] [ARG1]?       ──►  Who chopped the onions?
Targeting ARGM-LOC ──►  Where did [ARG0] [Predicate]? ──►  Where did the chef chop the onions?

By selecting a specific argument to serve as the "answer," a system can deterministically choose the correct question word (e.g., who for ARG0, where for ARGM-LOC) and restructure the remaining arguments into a coherent query.

Michael Flor et al. demonstrated this in A Semantic Role-based Approach to Open-Domain Automatic Question Generation, showing that selecting specific arguments from an SRL analysis allows rule-based systems to generate high-quality "wh-" and "yes/no" questions that outperform shallow neural network approaches. Similarly, Karen Mazidi et al. found in Linguistic Considerations in Automatic Question Generation that prioritizing semantic roles over surface syntax yields a 44% reduction in error rates, significantly improving the clarity and grammaticality of generated questions.

Moving beyond basic arguments, Christopher D Manning showed in Syn-QG: Syntactic and Shallow Semantic Rules for Question Generation that role-based heuristics allow systems to target more nuanced modifiers, such as manner, purpose, and extent. This dramatically increases the volume and diversity of valid question-answer pairs that can be extracted from a single sentence.


Targeted Substitution: Distractors, Clues, and Security

Because SRL isolates the functional components of a sentence, it enables applications to perform surgical modifications to text. Instead of just generating a question, systems can manipulate specific arguments to test comprehension or verify identity.

Multiple-Choice Distractor Generation

In educational testing, creating plausible wrong answers (distractors) is often harder than generating the question itself. If a system swaps out random words, the distractor might be grammatically incorrect or obviously irrelevant.

Cheng Zhang 0016 et al. solved this in Generating Adequate Distractors for Multiple-Choice Questions by applying SRL to complex sentences. By identifying the core subjects, objects, or predicates, their system selectively replaces these specific semantic arguments. This ensures that the resulting distractors remain grammatically sound and contextually plausible, forcing readers to comprehend the exact factual relationships rather than relying on simple vocabulary recognition.

Source: "The company acquired the startup in 2021."
SRL Target (ARG1): [the startup] ──► Substitute with semantic neighbor ──► [a competitor]
Distractor: "The company acquired a competitor in 2021." (Tests precise fact comprehension)

Educational Clues and Authentication

This same structural precision powers other targeted generation tasks:

  • Crossword Clues: Santiago Berruti et al. leveraged SRL in Automatic Crossword Clues Extraction for Language Learning to extract context-specific definitions. By understanding the deep semantic roles within a sentence, the system generates accurate and natural clues for language learners.
  • Security Questions: Traditional authentication questions (e.g., "What is your mother's maiden name?") are easily compromised. Zuyao Li et al. developed a system in Good Automatic Authentication Question Generation that takes a user's short personal story, extracts the semantic agents and themes via SRL, and maps them to templates. This creates highly memorable, personalized security questions that are difficult for attackers to guess.

Scaling Up: Data Synthesis and Unsupervised Learning

Manually labeling question-answering datasets is expensive and time-consuming. By automating the pipeline from text to predicate-argument structure to question, SRL serves as a powerful engine for data synthesis.

In Improving Unsupervised Question Answering via Summarization-Informed Question Generation, Chenyang Lyu et al. used news summaries as a bridge, applying SRL to identify underlying arguments and automatically construct diverse heuristic questions. This synthetic data allowed a QA model trained on just 20,000 examples to outperform prior unsupervised systems trained on millions of instances.

This programmatic restructuring is not limited to standard prose. Chenxiao Liu et al. introduced CodeQA: A Question Answering Dataset for Source Code Comprehension, applying dependency parsing and SRL to code comments. By isolating the actors, actions, and objects described in developer documentation, the authors programmatically converted declarative comments into over 190,000 professional-grade QA pairs for Java and Python.


Information Retrieval and Structural Alignment

When a system needs to match a user's query to a document, or find deep structural patterns across texts, keyword matching falls short. SRL provides a common semantic framework that allows systems to align information based on meaning rather than surface tokens.

User Query: "When did the earthquake strike Tokyo?"
Query SRL:  [the earthquake] (ARG0) | [strike] (Pred) | [Tokyo] (ARG1) | [When] (ARGM-TMP)
               │                       │               │               │
               ▼                       ▼               ▼               ▼
Doc Match:   "In 1923, a massive tremor devastated the Japanese capital."
Doc SRL:    [In 1923] (ARGM-TMP) | [a massive tremor] (ARG0) | [devastated] (Pred) | [the Japanese capital] (ARG1)

Even though the vocabulary differs completely, the semantic roles align perfectly. This structural alignment underpins several advanced retrieval and modeling paradigms:


Foundations and Multimodal Horizons

The utility of predicate-argument structures for question-driven systems has a long lineage and continues to expand into multimodal domains. Early interactive QA architectures, such as the FERRET system introduced by Sanda M. Harabagiu et al. in Experiments with Interactive Question-Answering, relied on predicting what a user might ask next by pre-computing topic-relevant question-answer pairs from text structures. To scale these systems to open domains, Umar Maqsud et al. built Nerdle: Topic-Specific Question Answering Using Wikia Seeds, utilizing SRL to extract deep semantic facts from collaborative wikis to handle diverse user phrasings.

Recognizing that syntactic parsing alone is insufficient for advanced natural language understanding, researchers have invested heavily in cross-lingual semantic resources. For instance, Attila Novák et al. detailed the painstaking process of building a richly annotated semantic role corpus in Creation of a corpus with semantic role labels for Hungarian, explicitly noting that such resources are foundational for moving question generation systems beyond shallow syntax.

Today, this semantic framing is breaking out of pure text. In Leveraging Task-Specific Pre-Training to Reason across Images and Videos, Arka Sadhu et al. applied SRL to multimodal reasoning. By decomposing visual scenes into structured components of actors and actions, they generated complex relational queries that were subsequently smoothed into natural language by large language models.

Whether analyzing a line of source code, a news summary, or a video frame, the core intuition remains identical: by mapping the chaotic surface structure of language down to the invariant roles of an event, we unlock a reliable, highly controllable blueprint for asking questions.

Key Foundational Work

Experiments with Interactive Question-Answering (2005) — contributed 1 concept elements to this direction.
Generation as Structure Driven Derivation (1988) — contributed 1 concept elements to this direction.
History & citationVersion 1 · 2026-10-04

Current · Permanent link

View frozen version 1

Cite this direction

Latest version (a living page):

@misc{lacuna_semantic_role_labeling_for_question_gene_e64e5320,
  title = {semantic role labeling for question generation},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/semantic-role-labeling-for-question-generation/rdr_e64e5320bd2647e5857c4d6ce604cce0},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-19},
}

This exact version (version 1, frozen text):

@misc{lacuna_semantic_role_labeling_for_question_gene_e64e5320_v1,
  title = {semantic role labeling for question generation},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/semantic-role-labeling-for-question-generation/rdr_e64e5320bd2647e5857c4d6ce604cce0/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-19},
}
About

These directions overlap with this one through shared papers.

See something wrong? Report a mistake