Beyond Cross-Modal Reconstruction: Participant-Level Evaluation of sEMG-Kinematic Coupling in Post-Stroke Gait

Rafsan Jany, Md Rafid Islam, Mohammad Fahim Islam, Hafiz Abdur RahmanarXiv 2026 · arXiv

In the world of biomechanics and AI, "cross-modal reconstruction"—predicting one type of signal (like joint movement) from another (like muscle activity)—is often hailed as a breakthrough. If a model can accurately predict how you move based on your muscle signals (sEMG), it must have "learned" your unique physiology, right?

Not so fast. A new paper presented at ICCIT 2026 suggests we might be falling for a sophisticated "shortcut." The researchers argue that high reconstruction accuracy often stems from the model learning the average timing of a human gait cycle rather than the specific nuances of an individual's body.

TL;DR

High accuracy in predicting gait kinematics from muscle signals doesn't necessarily mean a model understands individual physiology; it often just exploits the predictable structure of a standard gait cycle. By applying rigorous "falsification" tests, the authors show that their cross-modal model relied on population-level patterns and failed to provide clinical value beyond simple factors like walking speed and age.

What Problem Does This Paper Address?

The core challenge in gait analysis is "shortcut learning." Because human walking is cyclic and repetitive, a deep learning model can appear successful by simply memorizing the "average" way people walk.

In clinical settings, especially for stroke recovery, we want models that capture individualized neuromuscular coupling—the specific way a patient's muscles drive their movement. If a model is just using a "template" of a healthy gait, it might miss the very abnormalities doctors need to see. The authors set out to determine if a high-performing cross-modal model actually requires a specific participant's data to work, or if it's just playing back a sophisticated average.

Methods

The authors developed BioCoupleNet, a bidirectional model designed to translate between 7-channel sEMG and 4 sagittal joint angles.

  • Architecture: It uses Temporal Convolutional Networks (TCNs) with circular padding to respect the cyclic nature of gait. It also incorporates an "anatomical graph" to restrict predictions to known muscle-joint relationships (e.g., the gastrocnemius affecting the ankle).
  • The Falsification Framework: This is the paper's most critical contribution. To test if the model truly learned individualized coupling, they used three controls:
  • Complete Source Removal: How does the model perform with no input at all?
  • Cross-Participant Substitution: What happens if you give the model Participant A's muscle signals but ask it to predict Participant B's movement?
  • Template Baseline: Can a simple average gait cycle (adjusted for age and sex) beat the neural network?
Fig. 2. Participant-level evaluation of cross-model gait coupling.

Datasets

The study utilized a large public dataset from Van Criekinge et al., featuring:

  • 82 able-bodied participants (used for training and "untouched" testing).
  • 43 stroke survivors (used as a transfer cohort to test clinical utility).
  • The data included synchronized full-body kinematics and bilateral sEMG.

Key Insights and Ideas

  • The "Identity Swap" Test: If a model performs nearly as well when you swap one person's data for another's, it hasn't learned individualized physiology. It has learned a population-level shortcut.
  • The Template Trap: In this study, a simple population-average template actually outperformed the complex neural network in reconstruction accuracy. This is a major "aha moment"—it suggests that the "intelligence" we attribute to deep models in this field might sometimes be an illusion created by the data's inherent structure.
  • Clinical Redundancy: The model's "learned asymmetry" features (intended to measure stroke impact) were less effective at predicting clinical mobility scores (POMA) than basic covariates like walking speed.

Key Results

The quantitative results were a "reality check" for cross-modal modeling:

  • Source Necessity: Removing the input modality entirely did hurt the model (increasing error by ~7-11%), proving the model wasn't just guessing.
  • Individualization Failure: However, substituting one participant's signal for another's only increased error by a tiny 1.68%.
  • Template Superiority: The simple age/sex/cycle-position template actually reduced reconstruction error by up to 2.89% compared to the full BioCoupleNet model.
  • Clinical Prediction: For predicting POMA scores, a baseline of walking speed, age, and sex achieved a Mean Absolute Error (MAE) of 3.693. Adding the model's complex learned features actually worsened the error to 4.229.
Fig. 3. How reconstruction error changed when each falsification control was applied. The bars report the mean RMSE difference from the intact model, and the whiskers give the bootstrap 95% confidence intervals. We chose a 5% change in advance as the cutoff for a meaningful effect. Only removing the source signal passed this cutoff in the held-out healthy group. Using another participant’s signal or the cycle-position–age–sex template did not. Negative values favor the control.

Limitations and Future Work

The authors are transparent about several limitations:

  • Cohort Size: The stroke group was relatively small (43 participants).
  • Speed Confounding: There was very little overlap in walking speeds between the healthy and stroke groups, making it hard to separate "stroke-specific" patterns from "slow-walking" patterns.
  • Data Normalization: The sEMG signals were normalized to timing and pattern, losing information about the absolute magnitude of muscle activation.

Future Work: The authors call for this "falsification framework" to become a standard in the field. They suggest that future models must be tested on larger, speed-matched cohorts to prove they are capturing something more than just the "average" human walk. Only then can these models be trusted as valid clinical biomarkers.

Summary updated

Abstract

Accurate cross-modal reconstruction is often treated as evidence of physiological coupling, although it may simply reflect temporal patterns shared across participants. We tested whether frozen bidirectional models captured subject-specific neuromuscular coupling between electromyographic activity and gait kinematics in 82 held-out able-bodied and 43 post-stroke participants. Complete source-modality removal and cross-participant source substitution, along with a cycle-position-age-sex template baseline, were applied. Learned bilateral asymmetry was also compared with transparent waveform and derivative asymmetry for predicting Performance-Oriented Mobility Assessment (POMA) scores in the case of repeated nested cross-validation. Complete source removal increased reconstruction RMSE by 6.90% for electromyography-to-kinematics and 11.38% in the reverse direction. In contrast, cross-participant substitution increased RMSE by only 1.68% and 1.67%, respectively, while the template reduced RMSE by 2.89% and 0.55%. For POMA prediction, walking speed, age, and sex achieved an MAE of 3.693, compared with 4.229 and 4.427 after adding absolute and signed learned asymmetry, respectively. In all of the 20 repeated evaluations, all asymmetry representations performed worse than the covariate baseline. No localized learned feature remained significant after covariate adjustment and false-discovery-rate correction. The model mainly relied on shared gait-phase patterns, with no clear subject-specific coupling or added clinical value. Participant-level controls are therefore needed before reconstruction accuracy is treated as evidence of individualized physiology.
BibTeX
@misc{jany2026beyond,
  author = {Rafsan Jany and Md Rafid Islam and Mohammad Fahim Islam and Hafiz Abdur Rahman},
  title = {{Beyond Cross-Modal Reconstruction: Participant-Level Evaluation of sEMG-Kinematic Coupling in Post-Stroke Gait}},
  year = {2026},
  eprint = {2611.23856},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.23856},
}

Loading related content...

Figure