Towards Transfer Learning for Large-Scale Image Classification Using Annealing-Based Quantum Boltzmann Machines

Daniëlle Schuman, Leo Sünkel, Philipp Altmann, Jonas Korbinian Stein, Christoph Roch, Thomas Gabor, Claudia Linnhoff-Popien

Introduction

Quantum Machine Learning (QML) has traditionally focused on gate-based architectures, often utilizing Variational Quantum Circuits (VQCs) for hybrid classical-quantum tasks. While promising, these methods are currently constrained by the limitations of the Noisy Intermediate-Scale Quantum (NISQ) era, including low qubit counts and high decoherence rates. This research explores an alternative path: leveraging annealing-based Quantum Boltzmann Machines (QBMs) within a transfer learning framework to tackle complex, real-world image classification tasks.

By integrating the feature-extraction power of classical Convolutional Neural Networks (CNNs) with the probabilistic modeling capabilities of QBMs, the authors demonstrate a robust pipeline for medical diagnostic imaging, specifically the identification of COVID-19 from Computed Tomography (CT) scans.

The Hybrid Pipeline

The proposed architecture follows a multi-stage process designed to bridge the gap between high-dimensional image data and the binary nature of Boltzmann Machines:

  1. Classical Feature Extraction: A pre-trained ResNet-18 model, originally trained on ImageNet, serves as the backbone. It processes raw CT slices to extract high-level visual features.
  2. Dimensionality Reduction: The resulting 512-dimensional feature vector is passed through a classical linear layer, compressing it to 64 dimensions to accommodate the constraints of the quantum classifier.
  3. Binarization: Because Boltzmann Machines operate on discrete states, the compressed features are converted into bit-vectors.
  4. Quantum Classification: The final classification is performed by a QBM. Unlike feed-forward networks, QBMs are undirected energy-based models. To train this hybrid system, the authors utilize the SEQUENT (SEQuential Unsupervised-to-supervised Training) approach. This involves pre-training the classical layers with a surrogate classifier before introducing the QBM, which is then optimized using gradient descent based on Kullback-Leibler divergence.

Due to the limited availability of physical Quantum Processing Unit (QPU) time, the researchers employed Simulated Annealing (SA) as a classical proxy. SA mimics the thermal fluctuations of the annealing process, providing a reliable baseline for how a physical quantum annealer might perform.

Experimental Setup and Data

The study utilized the COVID-CT-MD dataset, a collection of lung CT scan slices categorized into three classes: COVID-19, Community-Acquired Pneumonia (Cap), and Healthy (Normal). The dataset was balanced to include 905 training images and 275 testing images per class. All images were preprocessed to 224x224 pixels and converted to grayscale to maintain compatibility with the ResNet-18 input requirements.

Key Findings

The performance of the SA-based QBM was compared against a classical Feed-forward Neural Network (FNN) of equivalent size using sigmoidal units. Several key advantages emerged:

  • Superior Accuracy and AUC-ROC: The annealing-based models consistently outperformed the classical baselines, achieving test accuracies near 70% and AUC-ROC scores of approximately 80%.
  • Accelerated Convergence: The QBM-based approach demonstrated significantly higher training efficiency. The best SA models reached peak performance within 6 to 11 epochs, whereas the classical FNN required 13 to 18 epochs to stabilize.
  • Robustness: One of the most notable results was the stability of the QBM. The variance in performance across different random training seeds was significantly lower for the quantum-inspired model than for the classical baseline, suggesting that the energy-based landscape of the QBM may be less susceptible to getting stuck in poor local optima during training.

Discussion and Future Directions

While the results are promising, the authors identify several areas for further development. The current reliance on Simulated Annealing means that true quantum effects, such as quantum tunneling, were not present in this study. Transitioning the pipeline to physical hardware, such as D-Wave quantum annealers, is a necessary next step to determine if physical quantum properties offer additional performance gains or introduce new noise-related challenges.

Furthermore, the binarization step remains a potential bottleneck, as converting continuous feature vectors into bits likely discards nuanced information. Future research will focus on optimizing this interface and comparing the annealing-based approach directly against gate-model VQCs to establish which quantum paradigm is best suited for large-scale medical image analysis. Despite these hurdles, this work provides a critical proof-of-concept for moving Quantum Transfer Learning beyond the gate-model status quo.

Summary updated

Abstract

Quantum Transfer Learning (QTL) recently gained popularity as a hybrid quantum-classical approach for image classification tasks by efficiently combining the feature extraction capabilities of large Convolutional Neural Networks with the potential benefits of Quantum Machine Learning (QML). Existing approaches, however, only utilize gate-based Variational Quantum Circuits for the quantum part of these procedures. In this work we present an approach to employ Quantum Annealing (QA) in QTL-based image classification. Specifically, we propose using annealing-based Quantum Boltzmann Machines as part of a hybrid quantum-classical pipeline to learn the classification of real-world, large-scale data such as medical images through supervised training. We demonstrate our approach by applying it to the three-class COVID-CT-MD dataset, a collection of lung Computed Tomography (CT) scan slices. Using Simulated Annealing as a stand-in for actual QA, we compare our method to classical transfer learning, using a neural network of the same order of magnitude, to display its improved classification performance. We find that our approach consistently outperforms its classical baseline in terms of test accuracy and AUC-ROC-Score and needs less training epochs to do this.
BibTeX
@inproceedings{schuman2023towards,
  author = {Daniëlle Schuman and Leo Sünkel and Philipp Altmann and Jonas Korbinian Stein and Christoph Roch and Thomas Gabor and Claudia Linnhoff-Popien},
  title = {{Towards Transfer Learning for Large-Scale Image Classification Using Annealing-Based Quantum Boltzmann Machines}},
  booktitle = {QCE},
  year = {2023},
  url = {https://openreview.net/forum?id=SisiNo_A_u},
}
Figure