Deep Compressed Pneumonia Detection for Low-Power Embedded Devices

Hongjia Li, Sheng Lin, Ning Liu, Caiwen Ding, Yanzhi Wang

TL;DR

This paper presents a highly compressed YOLOv3-based deep neural network for real-time pneumonia detection from chest X-rays, specifically optimized for low-power embedded medical devices. By applying a novel ADMM-based structured weight pruning technique, the authors compress a 106-layer model by 36x (reducing parameters from 61.5M to 1.7M) without any loss in detection accuracy, proving the viability of deploying advanced AI diagnostics on portable hardware.

What Problem Does This Paper Address?

Pneumonia is a leading cause of death globally, and diagnosing it from chest X-rays requires highly trained specialists. While deep neural networks (DNNs) have shown great promise in automating and assisting this diagnostic process, they are typically massive, requiring significant memory and computational resources.

This creates a major bottleneck for portable medical devices and embedded systems, which have strict power and memory constraints. While traditional "irregular" weight pruning can reduce model size, it leaves behind a fragmented network structure that requires complex indexing, undermining actual hardware efficiency. The authors tackle this by developing a hardware-friendly structured pruning method to shrink a state-of-the-art object detector so it can run efficiently on a low-power edge device.

Methods

The authors build their pneumonia detector using YOLOv3 (with a Darknet-53 backbone), treating the disease diagnosis as an object detection problem (drawing bounding boxes around afflicted lung areas). They use K-means clustering to generate custom anchor boxes tailored to chest X-rays and apply modern training optimizations like learning rate warmup, cosine learning rate decay, and mixup data augmentation.

The core novelty lies in their ADMM-based unified weight pruning algorithm, which operates in three phases: pre-pruning, masked mapping, and retraining. To ensure the resulting model is hardware-friendly, they focus on structured pruning—specifically targeting the General Matrix Multiplication (GEMM) operations in convolutional layers:

  • Filter Pruning: Removes entire filters (reducing the number of rows in the weight matrix).
  • Column Pruning: Removes entire columns in the converted 2D weight matrix.
  • Combined Pruning: A sequential approach that first masks zeroed-out filters and then applies column pruning, allowing for maximum sparsity while maintaining a dense matrix structure that hardware accelerators love.

Datasets

  • RSNA Pneumonia Detection Challenge Dataset: Derived from the publicly available NIH Clinical Center Chest X-Ray dataset.
  • The authors used a subset of 6,002 labeled images containing bounding boxes for pneumonia. This was split into 5,400 images for training and 602 for testing. Images were resized from their original 1024x1024 resolution to 320x320 for model processing.

Key Insights and Ideas

  • Structured > Irregular Pruning for Edge AI: Irregular pruning might reduce parameter counts on paper, but the metadata required to track sparse weights eats up memory and compute. Structured pruning physically shrinks the matrix dimensions, yielding true, measurable hardware acceleration.
  • Combined Sparsity is Highly Effective: By sequentially applying filter-wise and column-wise pruning, the network achieves a multiplicative compression effect, stripping out massive amounts of redundancy in deep convolutional layers.
  • Massive Redundancy in Medical Vision Models: It is possible to remove over 97% of a 106-layer object detection network's parameters and still maintain the exact same mean Average Precision (mAP) for medical image detection, highlighting how over-parameterized standard vision models are for specific clinical tasks.

Key Results

  • Accuracy Maintained: The original YOLOv3 model achieved 71.23 mAP (at an IoU threshold of 0.5). The 36x combined pruned model achieved 71.0 mAP, effectively maintaining baseline performance.
  • Extreme Compression: The model's parameter count dropped from 61.5 Million to just 1.7 Million.
  • Storage Reduction: The memory footprint shrank from 246.4 MB to 6.84 MB, small enough to fit on almost any modern microcontroller or edge device.
  • Compute Reduction: Floating Point Operations (FLOPs) were reduced from 38.63 Billion to 1.32 Billion.
  • Hardware Deployment: When deployed on an NVIDIA Jetson TX2 embedded device, the pruned model consumed only 7.3 W of power, achieving an energy efficiency of 0.69 Inferences Per Second per Watt (IPS/W).

Limitations and Future Work

The authors do not explicitly outline a dedicated limitations or future work section. However, a few limitations are apparent: the paper does not detail extensive clinical validation or test the model against out-of-distribution datasets (e.g., X-rays from different hospitals or machines). It also focuses solely on YOLOv3, without comparing the pruning efficacy against newer or specialized medical architectures.

Promising future directions implied by this work include deploying this framework onto actual portable medical devices for real-world clinical trials, and extending the combined structured pruning framework to other computationally heavy medical imaging tasks like 3D MRI or CT scan segmentation.

Summary updated

Abstract

Deep neural networks (DNNs) have been expanded into medical fields and triggered the revolution of some medical applications by extracting complex features and achieving high accuracy and performance, etc. On the contrast, the large-scale network brings high requirements of both memory storage and computation resource, especially for portable medical devices and other embedded systems. In this work, we first train a DNN for pneumonia detection using the dataset provided by RSNA Pneumonia Detection Challenge. To overcome hardware limitation for implementing large-scale networks, we develop a systematic structured weight pruning method with filter sparsity, column sparsity and combined sparsity. Experiments show that we can achieve up to 36x compression ratio compared to the original model with 106 layers, while maintaining no accuracy degradation. We evaluate the proposed methods on an embedded low-power device, Jetson TX2, and achieve low power usage and high energy efficiency.
BibTeX
@inproceedings{li2019deep,
  author = {Hongjia Li and Sheng Lin and Ning Liu and Caiwen Ding and Yanzhi Wang},
  title = {{Deep Compressed Pneumonia Detection for Low-Power Embedded Devices}},
  booktitle = {LABELS/HAL-MICCAI/CuRIOUS @ MICCAI},
  year = {2019},
  doi = {10.1007/978-3-030-33642-4\_10},
}

Loading related content...

Figure