Scoring Enzootic Pneumonia-like Lesions in Slaughtered Pigs: Traditional vs. Artificial-Intelligence-Based Methods

Jasmine Hattab, Angelo Porrello, Anastasia Romano, Alfonso Rosamilia, Sergio Ghidini, Nicola Bernabò, Andrea Capobianco Dondona, A. Corradi, Giuseppe MarruchellaPathogens 2023 · DOI

TL;DR

This paper explores the use of a convolutional neural network (CNN) to automatically score enzootic pneumonia-like lesions in slaughtered pig lungs, comparing its performance against traditional, human-expert scoring methods. The study demonstrates that the AI approach achieves high specificity and sensitivity, correlating well with expert assessments, suggesting its potential for efficient and objective lesion scoring in abattoirs.

What Problem Does This Paper Address?

Swine enzootic pneumonia (EP), caused by Mycoplasma hyopneumoniae, is a significant contributor to the porcine respiratory disease complex (PRDC), leading to substantial economic losses in pig farming. While post-mortem inspection at slaughter is a crucial opportunity to quantify EP and its impact, traditional scoring methods, relying on visual inspection and palpation by skilled operators, are time-consuming, expensive, and prone to inter-operator variability. This limits the consistent collection of data needed for effective herd management and disease control. The paper addresses the need for a more objective, efficient, and scalable method for scoring these lesions, proposing an AI-based solution.

Methods

The study employed a previously trained convolutional neural network (CNN) based on a U-Net architecture, specifically modified to predict and segment lung silhouettes and EP-like lesions from input images. This CNN was designed to classify images as either diseased or healthy and, when diseased, to estimate the percentage of the lung surface affected by lesions.

The core of the methodology involved a comparative analysis:

  1. Traditional Scoring (Gold Standard): A skilled veterinarian examined 441 pig lungs, assigning scores based on established methods: Madec's grid and Christensen's grids. These methods involve visual inspection and palpation of each lung lobe.
  2. AI-Based Scoring: The same lungs were photographed, and these images were fed into the trained CNN. The CNN then provided its own scores for the presence and extent of EP-like lesions.

The performance of the CNN was evaluated by comparing its predictions against the veterinarian's scores, using metrics such as sensitivity, specificity, and correlation coefficients.

Datasets

The study utilized a dataset of 441 pig lungs collected from routinely slaughtered heavy pigs. These lungs were categorized as:

  • 180 healthy lungs (score 0)
  • 261 diseased lungs with EP-like lesions

The lungs were photographed using a smartphone camera under field lighting conditions. The images were then pre-processed (resized to 400 × 300 pixels) before being fed into the CNN. This dataset represents a real-world scenario from a slaughterhouse.

Key Insights and Ideas

  • AI as a Viable Alternative: The study strongly suggests that AI, specifically CNNs, can serve as a powerful and reliable tool for lesion scoring in abattoirs, potentially replacing or augmenting human inspection.
  • Objectivity and Standardization: A key advantage of the CNN is its inherent objectivity and standardization. Unlike human operators, the AI's scoring is consistent, eliminating inter-operator variability and ensuring repeatable results.
  • Accessory Lobe's Marginal Role: The findings indicate that the accessory lobe of the right lung plays a marginal role in the overall scoring of EP-like lesions and could potentially be ignored without significantly impacting the accuracy of the AI's assessment.
  • Potential for Early Detection: While the CNN missed some very small lesions, its ability to accurately identify larger lesions and its high specificity suggest it could be effective in flagging significant cases, allowing for targeted interventions.

Key Results

  • Specificity: The CNN demonstrated a high specificity of 95.55%, correctly identifying healthy lungs.
  • Sensitivity: The CNN achieved a sensitivity of 85.05%, correctly identifying diseased lungs.
  • Correlation: A strong and significant correlation was found between the CNN's scores and the veterinarian's scores (Spearman's coefficient = 0.831, p < 0.01).
  • False Positives/Negatives: The CNN correctly predicted 172 out of 180 healthy lungs. It correctly recognized 222 out of 261 diseased lungs, meaning EP-like lesions went unnoticed in 39 lungs. In a few cases, the CNN mistakenly identified artifacts as lesions or missed very small lesions.

Limitations and Future Work

  • Missed Small Lesions: The CNN occasionally failed to detect very small EP-like lesions, which were scored as 1 by the veterinarian. This is attributed to factors like lesion size, slight lobe rotation obscuring the lesion, or the presence of small blood clots.
  • Artifact Misinterpretation: In one notable case, the CNN mistakenly interpreted a large, partially collapsed area of the diaphragmatic lobe as a lesion. The paper suggests that palpation, a component of traditional methods, can be useful in confirming or ruling out pneumonia in such ambiguous cases.
  • Image Acquisition Challenges: The authors highlight that taking suitable photographs (i.e., of both lungs, properly positioned and centered) might be the most challenging aspect of implementing this technology in high-throughput abattoirs with fast slaughter chain speeds.
  • Future Work: The paper stimulates further investigation in this field, suggesting that the CNN's performance can improve over time through continued training and education. Future research could focus on optimizing image acquisition protocols and further refining the CNN to better handle subtle lesions and artifacts.

Summary updated

Abstract

Artificial-intelligence-based methods are regularly used in the biomedical sciences, mainly in the field of diagnostic imaging. Recently, convolutional neural networks have been trained to score pleurisy and pneumonia in slaughtered pigs. The aim of this study is to further evaluate the performance of a convolutional neural network when compared with the gold standard (i.e., scores provided by a skilled operator along the slaughter chain through visual inspection and palpation). In total, 441 lungs (180 healthy and 261 diseased) are included in this study. Each lung was scored according to traditional methods, which represent the gold standard (Madec's and Christensen's grids). Moreover, the same lungs were photographed and thereafter scored by a trained convolutional neural network. Overall, the results reveal that the convolutional neural network is very specific (95.55%) and quite sensitive (85.05%), showing a rather high correlation when compared with the scores provided by a skilled veterinarian (Spearman's coefficient = 0.831, <i>p</i> < 0.01). In summary, this study suggests that convolutional neural networks could be effectively used at slaughterhouses and stimulates further investigation in this field of research.
BibTeX
@inproceedings{hattab2023scoring,
  author = {Jasmine Hattab and Angelo Porrello and Anastasia Romano and Alfonso Rosamilia and Sergio Ghidini and Nicola Bernabò and Andrea Capobianco Dondona and A. Corradi and Giuseppe Marruchella},
  title = {{Scoring Enzootic Pneumonia-like Lesions in Slaughtered Pigs: Traditional vs. Artificial-Intelligence-Based Methods}},
  booktitle = {Pathogens},
  year = {2023},
  doi = {10.3390/pathogens12121460},
}
Figure