A Survey on Large Language Models for Critical Societal Domains: Finance, Healthcare, and Law

Zhiyu Zoey Chen, Jing Ma, Xinlu Zhang, Nan Hao, An Yan, Armineh Nourbakhsh, Xianjun Yang, Julian J. McAuley, Linda R. Petzold, William Yang Wang

Introduction

As Large Language Models (LLMs) transition from general-purpose assistants to specialized tools, they encounter the unique "high-stakes" requirements of Finance, Healthcare, and Law (FHL). In these domains, the cost of a "hallucination" is not merely a conversational quirk but can lead to significant financial loss, medical malpractice, or legal injustice. This survey maps the current landscape of "LLM+X" in these sectors, examining how domain-specific adaptations address professional expertise, data privacy, and regulatory compliance.

The FHL domains share a unique set of constraints that distinguish them from general NLP applications:

  • Professional Expertise: Tasks often require specialized training, such as interpreting complex tax codes or diagnostic imaging.
  • Confidentiality: Data is frequently protected by regulations like HIPAA or KYC, limiting the use of open-source training data.
  • Multimodality: Information is often embedded in non-textual formats, including tables, charts, and medical scans.
  • Strict Regulation: Outputs must be explainable, fair, and legally compliant.

Methodological Framework

The evolution of AI in FHL domains can be categorized into three primary methodological waves:

  1. Domain-Specific Pre-training: Models like BERT or RoBERTa are trained from scratch or continued on massive domain-specific corpora (e.g., BloombergGPT for finance).
  2. Instruction Fine-Tuning (IFT): General LLMs are adapted using specialized instruction sets to follow domain-specific logic (e.g., FinMA or ChatLaw).
  3. Advanced Prompting & RAG: Techniques such as Chain-of-Thought (CoT), Program-of-Thought (PoT)—where models generate code for numerical tasks—and Retrieval-Augmented Generation (RAG) provide factual context without retraining.
Summary of financial LLMs categorized by training paradigm, including architecture and evaluation tasks.

Domain-Specific Benchmarks and Tasks

The survey identifies a wide array of benchmarks across the three sectors. In Finance, tasks range from sentiment analysis (FPB) to numerical reasoning over tables (FinQA). Healthcare benchmarks include MedQA (USMLE-style) and MIMIC-CXR for radiology. Legal benchmarks like LegalBench and CAIL2018 focus on reasoning and judgment prediction.

A hierarchical taxonomy of Financial NLP tasks and associated benchmark datasets.

Key Insights and Sector Performance

A central argument of this survey is the "FHL Synergy": these domains should be studied together due to their shared "high-stakes" profile, necessitating a shift from accuracy-only metrics to comprehensive "trustworthiness" evaluations.

  • Finance: Numerical reasoning remains a critical frontier. Models increasingly utilize "Program-of-Thought" prompting to ensure calculation accuracy. While GPT-4 leads in complex reasoning, instruction-tuned models like FinMA-30B are narrowing the gap.
  • Healthcare: Specialized models like Med-PaLM 2 have achieved expert-level performance on medical exams. Multimodal Vision-Language Models (VLMs) are also emerging to assist in clinical report generation.
  • Law: Despite passing the Bar Exam, LLMs still struggle with "Legal Reading Comprehension" in long-form documents compared to specialized supervised baselines.

Challenges and Future Directions

Several bottlenecks remain for the next generation of FHL AI:

  • Evaluation Gap: Current multiple-choice benchmarks do not reflect real-world professional workflows; more free-form evaluation frameworks are needed.
  • Hallucination Mitigation: In legal and medical contexts, hallucinations remain a critical safety risk that RAG only partially addresses.
  • Human-AI Collaboration: Research is shifting toward "Human-in-the-loop" models where AI assists rather than replaces experts.
  • Data Scarcity: Privacy constraints necessitate the exploration of synthetic data generation and privacy-preserving techniques like Federated Learning.

Summary updated

Abstract

In the fast-evolving domain of artificial intelligence, large language models (LLMs) such as GPT-3 and GPT-4 are revolutionizing the landscapes of finance, healthcare, and law: domains characterized by their reliance on professional expertise, challenging data acquisition, high-stakes, and stringent regulatory compliance. This survey offers a detailed exploration of the methodologies, applications, challenges, and forward-looking opportunities of LLMs within these high-stakes sectors. We highlight the instrumental role of LLMs in enhancing diagnostic and treatment methodologies in healthcare, innovating financial analytics, and refining legal interpretation and compliance strategies. Moreover, we critically examine the ethics for LLM applications in these fields, pointing out the existing ethical concerns and the need for transparent, fair, and robust AI systems that respect regulatory norms. By presenting a thorough review of current literature and practical applications, we showcase the transformative impact of LLMs, and outline the imperative for interdisciplinary cooperation, methodological advancements, and ethical vigilance. Through this lens, we aim to spark dialogue and inspire future research dedicated to maximizing the benefits of LLMs while mitigating their risks in these precision-dependent sectors. To facilitate future research on LLMs in these critical societal domains, we also initiate a reading list that tracks the latest advancements under this topic, which will be continually updated: \url{https://github.com/czyssrs/LLM_X_papers}.
BibTeX
@article{chen2024survey,
  author = {Zhiyu Zoey Chen and Jing Ma and Xinlu Zhang and Nan Hao and An Yan and Armineh Nourbakhsh and Xianjun Yang and Julian J. McAuley and Linda R. Petzold and William Yang Wang},
  title = {{A Survey on Large Language Models for Critical Societal Domains: Finance, Healthcare, and Law}},
  journal = {Accepted by TMLR},
  year = {2024},
  url = {https://openreview.net/forum?id=upAWnMgpnH},
}
Figure