Introduction
Post-disaster reconnaissance reports are a critical resource for engineers and emergency managers, documenting everything from soil liquefaction to specific structural failure modes. However, these reports are often hundreds of pages of unstructured, technical text. While Large Language Models (LLMs) are theoretically suited for this data, they often "hallucinate" or lose context when dealing with complex, cascading hazards.
To address this, researchers from Texas A&M and the University of Illinois introduced MoRA-RAG (Mixture-of-Retrieval Agentic RAG). This framework is designed to transform unstructured disaster narratives into a reliable foundation for multi-hazard reasoning, achieving high accuracy in complex engineering domains.
The MoRA-RAG Framework
MoRA-RAG moves beyond "Vanilla RAG" through three core innovations:
- Agentic Chunking: An LLM agent identifies standalone factual "propositions" and groups them into semantically coherent chunks, preserving the logical flow of engineering observations.
- Mixture-of-Retrieval (MoR): A router agent determines which hazard-specific databases are relevant to a query and dynamically allocates a retrieval budget to capture cascading effects (e.g., an earthquake triggering a landslide).
- The Agentic Loop: A five-agent pipeline—comprising a Router, Evaluator, Online Search, Rewriter, and Answer Writer—iteratively verifies evidence sufficiency before synthesizing a grounded response.
The HazardRecQA Dataset
The framework was evaluated using HazardRecQA, a new benchmark derived from Geotechnical Extreme Events Reconnaissance (GEER) reports. This dataset encompasses 5,776 question-answer pairs across 90 global disaster events, providing a robust testbed for multi-hazard understanding.
Key Results and Insights
MoRA-RAG achieved 94.5% accuracy, significantly outperforming zero-shot LLMs and existing RAG systems. Key insights from the study include:
- Hallucination Reduction: The "Evidence Evaluator" agent allows the system to recognize when information is missing, preventing forced, incorrect answers.
- Model Democratization: MoRA-RAG enables mid-sized, open-weight models (12B+ parameters) to perform on par with proprietary models, facilitating reproducible and locally-hosted research.
- Query Stability: The system maintained consistent performance across various question categories, including hazard characteristics, impact analysis, and response recovery.
Conclusion
While the multi-agent approach increases latency (averaging ~20 seconds per query), the gains in accuracy and reliability are vital for high-stakes disaster science. Future work will explore multi-modal integration, allowing the framework to correlate textual reports with satellite imagery and sensor data to provide a more holistic understanding of disaster impacts.
Summary updated