Introduction
Automatic Question Generation (QG) is a critical task for developing intelligent tutoring systems and enhancing search engine capabilities. While neural models have achieved high proficiency in English, they typically require vast amounts of labeled data—often hundreds of thousands of sentence-question pairs. For most other languages, such datasets are scarce, creating a significant barrier to entry.
This research addresses this "cold-start" problem by introducing a cross-lingual framework that allows models to leverage knowledge from high-resource languages (like English) to improve performance in low-resource settings (like Hindi and Chinese). Alongside this framework, the authors introduce HiQuAD, a new benchmark dataset for Hindi question answering.
Methodology
The proposed Cross-Lingual Question Generation (CLQG) model is built upon the Transformer architecture and utilizes a two-phase training regime designed to maximize cross-lingual transfer.
Training Phases
- Unsupervised Pre-training: The model first learns the linguistic structure of both the primary (e.g., Hindi) and secondary (English) languages using large-scale unpaired text. This phase employs Denoising Autoencoding (reconstructing shuffled sentences) and Back-translation (translating from English to Hindi and back to English). These techniques force the model to develop a shared latent space where semantic meaning is preserved across languages.
- Joint Supervised Training: The model is fine-tuned simultaneously on actual sentence-question pairs from both languages.
Architectural Innovation
Unlike standard models that share all parameters, CLQG uses "partial weight sharing." Language-specific encoder and decoder layers are maintained to capture unique grammatical nuances, while the middle layers are shared to facilitate the transfer of abstract semantic concepts.
Datasets
The study utilizes several key datasets to validate the model's effectiveness:
- HiQuAD: A novel Hindi dataset containing 6,555 sentence-question pairs curated from Indian history texts.
- SQuAD: The standard English dataset (approx. 70,000 pairs) serving as the high-resource secondary language.
- DuReader: A Chinese dataset used to evaluate generalizability across different language families.
- Monolingual Corpora: Large-scale unpaired text for Hindi (93,000 sentences) and Chinese (100,000 descriptions) used during unsupervised pre-training.
Results and Discussion
The CLQG model demonstrated substantial improvements over baseline architectures in both quantitative and qualitative evaluations.
Quantitative Performance
For Hindi, the CLQG+parallel model achieved a BLEU-4 score of 20.24, more than doubling the performance of a standard Transformer baseline (8.64). Similar, though less dramatic, gains were observed in the Chinese experiments.
Key Insights
- The Impact of Pre-training: Ablation studies identified unsupervised pre-training as the most significant contributor to performance, providing a jump of approximately 7 BLEU-4 points. This phase effectively teaches the model grammar before it begins learning the specific task of question formulation.
- Cross-Lingual Logic: Joint training on English data improved Hindi performance, suggesting the model successfully learns the abstract logic of question generation and applies it across languages.
- Data Efficiency: The model showed high efficiency, achieving significant performance gains even when the Hindi training set was restricted to only 2,000 examples.
Conclusion and Future Work
The CLQG framework proves that cross-lingual transfer and unsupervised pre-training can effectively mitigate data scarcity in QG tasks. While domain mismatches between datasets (e.g., Wikipedia vs. history books) remain a challenge, the results establish a strong baseline for low-resource QG. Future research will explore the integration of cross-lingual embeddings, such as XLM, to further refine language alignment during pre-training.
Summary updated