Compact Quantum Channel Attention for Static ASL Recognition: A Controlled Study with Parameter-Matched Baselines

Ronak Bhalgami, Deep Kothadiya, Nikita BhattarXiv 2026 · arXiv

TL;DR

This paper introduces QCA-DenseNet, a hybrid model for American Sign Language (ASL) recognition that uses a compact 8-qubit variational circuit for channel attention. While the quantum gate is 7.5 times more parameter-efficient than standard classical attention, rigorous testing against parameter-matched classical baselines reveals that the "quantumness" provides no measurable performance advantage—the heavy lifting is done by the classical backbone.

What Problem Does This Paper Address?

The field of Hybrid Quantum-Classical Machine Learning (HQCM) is booming, with many papers reporting high accuracies on vision tasks. However, a persistent "attribution problem" plagues the field: is the quantum circuit actually providing a unique advantage, or is the performance simply a result of powerful pretrained classical features and a high parameter count?

The authors tackle this by applying quantum circuits to channel attention—a mechanism that reweights feature maps to focus on important information. They specifically look at static ASL recognition, where generalizing to a new person (unseen signer) is a notoriously difficult "out-of-distribution" challenge.

Methods

The authors propose the QCA-DenseNet pipeline. It starts with a standard DenseNet121 backbone (pretrained on ImageNet) to extract features. These features are then passed through a Quantum Channel Attention (QCA) gate.

As shown in the architecture below, the QCA gate works by:

  1. Compressing 1,024 feature channels down to 8 classical values.
  2. Encoding these values as rotation angles in an 8-qubit variational quantum circuit with two entangling layers.
  3. Measuring the qubits and expanding the results back to 1,024 weights (using a sigmoid function) to rescale the original feature channels.
Figure 1: Proposed QCA-DenseNet pipeline (a) and the internal structure of the QCA gate (b).

Crucially, the authors compare this to three reference modules:

  • Squeeze-and-Excitation (SE): The standard classical channel attention block.
  • Matched MLP: A classical version of the QCA gate where the quantum circuit is replaced by a simple 8x8 linear layer, keeping the parameter count nearly identical.
  • No Attention: A baseline DenseNet121 with no gating at all.

Datasets

  • MU HandImages ASL: A challenging dataset used for the main evaluation. It contains 1,815 images of letters A–Z from five different signers. The authors use a "leave-one-signer-out" (LOSO) protocol to test how well the model generalizes to a person it has never seen before.
  • Kaggle ASL Alphabet: A much larger dataset (87,000 images) used for "frozen-backbone" ablation studies. Because random splits in this dataset often put nearly identical frames in both training and test sets, it is used here primarily to see how the attention heads perform when they are the only trainable part of the network.

Key Insights and Ideas

  • The Attribution Trap: The study highlights that without "parameter-matched" baselines, it's easy to mistake classical feature-extraction power for quantum advantage. In this study, the "Matched MLP" performed identically to the quantum circuit, suggesting the circuit acts merely as a classical bottleneck.
  • Parameter Efficiency vs. Expressivity: The QCA gate is incredibly lean, using only 17,464 parameters compared to the 131,072 in a standard SE block. While it matches SE's performance in full fine-tuning, it falls behind when the backbone is frozen, suggesting that the sheer capacity (number of parameters) of the SE block matters more than the "quantumness" of the QCA gate.
  • Backbone Dominance: In modern hybrid transfer learning, the pretrained classical backbone is so dominant that small "plug-in" quantum modules have little room to move the needle on final accuracy.

Key Results

  • Generalization: On unseen signers, QCA-DenseNet achieved 94.50% mean accuracy, slightly better than the much larger SE block (93.72%) but virtually identical to the Matched MLP (94.55%) and the model with no attention (94.78%).
  • Efficiency: The QCA gate achieved this parity using 7.51 times fewer parameters than the SE block.
  • Confusion Patterns: As seen in the confusion matrix, most errors occurred between visually similar signs, such as 'M' and 'N' (which differ only by thumb position) or 'V' and 'W'.
Figure 4: QCA-DenseNet predictions pooled over the five held-out MU signers.
  • The "No Advantage" Verdict: Figure 3(a) clearly shows that while QCA is more efficient than SE, it doesn't outperform its direct classical equivalent (the Matched MLP).
Accuracy vs. Attention Budget. The QCA gate (purple star) sits right next to its classical equivalent (blue dot), showing no performance gain from the quantum circuit.

Limitations and Future Work

The authors are refreshingly honest about the limitations:

  • Scale: The 8-qubit circuit is small. While scaling up might increase expressivity, larger circuits are significantly harder to train due to issues like "barren plateaus" (vanishing gradients).
  • Simulation: The study used exact classical simulation of quantum circuits. Real-world quantum hardware is noisy, which might further degrade performance.
  • Static vs. Dynamic: The model only handles static images. Future work could extend this to continuous fingerspelling in video.
  • Comparison Scope: While compared to SE, the authors suggest future comparisons with other ultra-efficient classical gates like ECA-Net.

Summary updated

Abstract

Hybrid quantum-classical models often report good accuracy on image tasks, but it is rarely clear whether the quantum part is responsible. This paper proposes QCA-DenseNet, a static American Sign Language (ASL) recognition pipeline in which an eight-qubit variational circuit acts as a channel-attention gate on DenseNet121 features. The quantum channel attention (QCA) gate has 17,464 parameters, 7.51 times fewer than a squeeze-and-excitation (SE) block. The pipeline is tested on 1,815 MU HandImages images by holding out one of five signers at a time, and a frozen-backbone ablation uses small parts of the Kaggle ASL Alphabet data. On unseen signers, QCA-DenseNet reaches 94.50% mean accuracy, above SE (93.72%) and within 0.28 points of the best model. A matched classical MLP and a model without attention perform about the same, and no difference is significant. QCA gives a much smaller attention gate without a detectable loss in accuracy, but no quantum advantage.
BibTeX
@misc{bhalgami2026compact,
  author = {Ronak Bhalgami and Deep Kothadiya and Nikita Bhatt},
  title = {{Compact Quantum Channel Attention for Static ASL Recognition: A Controlled Study with Parameter-Matched Baselines}},
  year = {2026},
  eprint = {2611.10544},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.10544},
}
Figure