Using Soft Constraints in Joint Inference for Clinical Concept Recognition

Prateek Jindal, Dan Roth

Introduction

Recognizing medical concepts such as "pneumonia" (Problem) or "aspirin" (Treatment) in clinical narratives is a fundamental task in medical informatics. While local sequence models like Conditional Random Fields (CRFs) are standard, they often fail to capture the global structure of a medical report. For instance, symptoms listed together are likely of the same type, and specific linguistic patterns often link tests to the problems they diagnose.

This paper proposes a method to move beyond local sequence models to global joint inference. By formulating concept recognition as an Integer Quadratic Program (IQP), the authors incorporate "soft constraints"—rules that are generally true but allow for exceptions—resulting in a significant performance boost over traditional hard-constraint models.

Methodology

The authors implement a two-stage pipeline followed by a global optimization step. First, a CRF identifies the boundaries of medical concepts. Second, a multi-class SVM assigns a probability distribution over four types (TEST, TREatment, PROBlem, or NULL) for each identified concept. Finally, an IQP finds the optimal global assignment by balancing local classifier confidence against three types of constraints:

  • Type-1 (Hard): Each concept must have exactly one type.
  • Type-2 (Soft): Concepts in a list or conjunction likely share the same type (e.g., a list of symptoms).
  • Type-3 (Soft): Specific linguistic patterns suggest relationships between neighboring concepts (e.g., "[TEST] gave positive evidence for [PROB]").
Examples of clinical concept relationships and lists used for soft constraints.

Unlike Integer Linear Programming (ILP) models that enforce "hard" rules, this IQP approach uses a penalty ($\rho$) for constraint violations. This allows the model to "overrule" a rule if the local evidence is sufficiently strong, making it more robust to the variability of clinical writing.

Experimental Setup

The study utilized a subset of the 2010 i2b2/VA shared task dataset, consisting of de-identified clinical reports from Partners Healthcare, Beth-Israel Deaconess Medical Center, and the University of Pittsburgh Medical Center. Due to data privacy restrictions, the experimental subset included 170 reports for training and 256 for testing.

Results and Discussion

The researchers compared four system configurations: B (Baseline), BK (Baseline + Knowledge features), BC (Baseline + Constraints), and BKC (the full model incorporating both knowledge and constraints).

Performance comparison (Precision, Recall, F1) across different model configurations.

The full BKC system achieved an overall F1-score of 86.1, a statistically significant improvement over the baseline's 83.6. A key finding was the superiority of "soft" over "hard" constraints; when penalties were set high enough to force hard constraints, the F1-score dropped to 85.1. This 1.0 point difference highlights that flexibility is crucial in natural language processing for medicine. Furthermore, the IQP formulation proved computationally efficient, with modern solvers processing approximately 76 reports per second.

Conclusion

Exploiting discourse knowledge—the structural "style" of clinical text—is as vital as leveraging medical ontologies. While the current pipeline architecture means errors in boundary detection cannot be corrected during classification, the success of soft constraints in joint inference provides a robust framework for clinical concept recognition. Future work may explore joint training to further integrate these components.

Summary updated

Abstract

This paper introduces IQPs (Integer Quadratic Programs) as a way to model joint inference for the task of concept recognition in clinical domain. IQPs make it possible to easily incorporate soft constraints in the optimization framework and still support exact global inference. We show that soft constraints give statistically significant performance improvements when compared to hard constraints.
BibTeX
@inproceedings{jindal2013using,
  author = {Prateek Jindal and Dan Roth},
  title = {{Using Soft Constraints in Joint Inference for Clinical Concept Recognition}},
  booktitle = {Conference on Empirical Methods in Natural Language Processing},
  year = {2013},
  doi = {10.18653/v1/d13-1186},
}
Figure