Improved Allergy Wheal Detection for the Skin Prick Automated Test Device

Rembert Daems, Sven Seys, Valérie Hox, Adam Chaker, Glynnis De Greve, Winde Lemmens, Anne-Lise Poirrier, Eline Beckers, Zuzana Diamant, Carmen Dierickx, Peter W. Hellings, Caroline Huart, Claudia Jerin, Mark Jorissen, Hanne Oscé, Karolien Roux, Mark Thompson, Sophie Tombu, Saartje Uyttebroek, Andrzej Zarowski, Senne Gorris, Laura Van Gerven, Dirk Loeckx, Thomas Demeester

TL;DR

Researchers have developed a high-precision automated system for detecting and measuring allergy "wheals" (skin swelling) using the Skin Prick Automated Test (SPAT) device. By leveraging a unique dataset of 32 images taken under varying lighting angles, their deep learning approach significantly outperforms traditional single-image methods, paving the way for more consistent and objective allergy diagnostics.

What Problem Does This Paper Address?

The skin prick test (SPT) remains the "gold standard" for diagnosing allergies. A clinician applies allergens to the skin and measures the resulting wheal—a small, raised bump. However, manual interpretation is fraught with issues: it is highly dependent on the operator's expertise, the tools used, and the consistency of the prick itself.

The Skin Prick Automated Test (SPAT) device was created to standardize the "pricking" part of the process. But capturing the results is still tricky. Wheals are often pale and subtle; in uniform lighting, they can be nearly invisible against the skin. This paper addresses the challenge of automatically and accurately delineating these wheals to provide a reliable, objective diagnosis.

Methods

The authors propose a two-step pipeline that moves from raw pixels to clinical measurements:

  1. Step 1: Pixel-level Classification (The "Where"): The researchers used a modified U-Net architecture. The SPAT device captures 35 images, 32 of which use distinct lighting angles to create "shadow lines" that highlight the wheal's topography. Instead of using a complex multi-stream network, the authors simply concatenated these 32 images along the channel dimension (creating a 96-channel input). This allows a standard 2D convolutional network to learn which lighting angles best reveal the edges of a wheal.
  2. Step 2: Algorithmic Detection (The "What"): To ensure the model is interpretable and "white-box," the output of the U-Net is processed using traditional computer vision. They apply thresholding and a connected components algorithm to identify distinct regions. Because the arm might move slightly between the prick and the image capture, they use a rigid transformation (translation and rotation) to match the detected wheals back to the known theoretical prick locations.

Datasets

The study utilized a substantial clinical dataset:

  • Participants: 868 adult patients with suspected inhalant allergies across five Belgian hospitals and one German hospital.
  • Annotations: 10,416 wheals were manually annotated by experts using detailed polygons.
  • Split: The data was split into a training set (75% / 651 patients) and a hold-out validation set (25% / 217 patients), stratified by hospital to ensure a balanced representation.

Key Insights and Ideas

  • Shadows as Data: The "aha moment" here is that uniform, "perfect" lighting is actually a disadvantage for detecting raised skin surfaces. By using 32 different angles, the system captures the physical height of the wheal through shadows, which provides much more information than color or texture alone.
  • Simplicity in Multi-modality: Rather than designing a complex architecture to fuse 32 images, the authors found that simple channel concatenation was "simple yet effective." This makes the model compatible with standard deep learning layers while still capturing the necessary spatial-temporal lighting cues.
  • Interpretability Matters: By splitting the process into a neural network (for pattern recognition) and an algorithmic step (for pairing and measurement), the authors ensure that clinicians can verify why a specific prick was marked as positive.

Key Results

The multi-image approach showed a clear advantage over the baseline (a single image with uniform lighting):

  • Segmentation Performance: The 32-image model achieved a Dice coefficient of 0.787, compared to 0.717 for the single-image baseline.
  • Detection Accuracy: At an Intersection over Union (IoU) threshold of 0.5, the automated pipeline reached 91.8% accuracy using all images, vs. 85.2% for the baseline.
  • Sensitivity Analysis: The researchers analyzed which images contributed most to the model's success. They found that lights illuminating the arm from the top center and the bottom corners provided the most critical information for classification.

Limitations and Future Work

  • Rigid Body Assumption: The current matching algorithm assumes the arm behaves as a rigid object. In reality, skin can stretch or deform, which might require more complex non-rigid registration in future iterations.
  • Clinical Integration: While the technical results are strong, the data was collected as part of a broader clinical study that is still under analysis. The ultimate goal is to see how this automated "read-out" compares to the final clinical diagnoses made by allergists in a real-world setting.
  • Hardware Dependency: The method is currently tailored specifically to the SPAT device's unique lighting array, meaning it cannot be directly applied to standard smartphone photos without significant adaptation.

Summary updated

Abstract

Background: The skin prick test (SPT) is the gold standard for diagnosing sensitization to inhalant allergies. The Skin Prick Automated Test (SPAT) device was designed for increased consistency in test results, and captures 32 images to be jointly used for allergy wheal detection and delineation, which leads to a diagnosis.
BibTeX
@inproceedings{daems2025improved,
  author = {Rembert Daems and Sven Seys and Valérie Hox and Adam Chaker and Glynnis De Greve and Winde Lemmens and Anne-Lise Poirrier and Eline Beckers and Zuzana Diamant and Carmen Dierickx and Peter W. Hellings and Caroline Huart and Claudia Jerin and Mark Jorissen and Hanne Oscé and Karolien Roux and Mark Thompson and Sophie Tombu and Saartje Uyttebroek and Andrzej Zarowski and Senne Gorris and Laura Van Gerven and Dirk Loeckx and Thomas Demeester},
  title = {{Improved Allergy Wheal Detection for the Skin Prick Automated Test Device}},
  booktitle = {AIME},
  year = {2025},
  url = {https://openreview.net/forum?id=FWmbV7mftl},
}

Loading related content...

Figure