Physics-Aware Data Augmentation for Robust Sensor Imaging

This direction is no longer present in the current build. Its last version stays readable and citable here.

Version 1 of 170 papers100 conceptsfrozen 2026-10-04

In standard computer vision, data augmentation is often intuitive: if you rotate a picture of a cat, it remains a cat. However, in medical and sensor imaging—such as MRI, CT, and Radar—the relationship between the object and the image is mediated by complex physical acquisition processes. A patient moving in an MRI scanner doesn't just "blur" the image; they introduce structured phase errors in the raw frequency data.

Recent research has shifted away from generic image-domain transformations (like flipping or Gaussian noise) toward physics-aware data augmentation. By simulating artifacts within the raw signal domain, researchers are building models that generalize to the messy, inconsistent reality of clinical environments.

The Gap Between Pixels and Physics

Standard augmentations fail in medical imaging because they do not respect the underlying signal formation. As Mohammed Wattad and Alexander M. Bronstein argue in On The Role of K-Space Acquisition in MRI Reconstruction Domain-Generalization, image-level noise can actually be counterproductive. It teaches a model to ignore pixel-wise jitter, but it doesn't prepare the model for the structured "aliasing" or "banding" caused by hardware imperfections.

To solve this, researchers like Ilkay Öksüz and James R. Clough propose augmenting data in k-space—the raw frequency domain where MRI data is actually collected. In Automatic CNN-based detection of cardiac MR motion artefacts using k-space data augmentation and curriculum learning, they demonstrate that swapping lines or shifting phases in k-space creates "ghosting" artifacts that perfectly mimic real-world patient movement. Because the model sees the cause of the artifact (the frequency shift), it becomes far more robust at detecting and correcting it.

Augmenting the Acquisition Process

This principle extends across modalities. The intuition is always the same: augment the signal before it becomes an image.

Synthetic Reality and Domain Randomization

One of the most powerful applications of this idea is training models on "intentionally unrealistic" synthetic data that is physically grounded. Malte Hoffmann describes this as domain randomization in Domain-randomized deep learning for neuroimage analysis.

By taking an abstract anatomical label map and "corrupting" it with simulated bias fields, Gaussian blurs (for partial volume effects), and downsampling, researchers can create an infinite stream of training data. Because the model is trained on such a wide, randomized variety of physical corruptions, it becomes "acquisition-agnostic." It no longer cares which scanner or protocol was used; it has learned to see through the physics of the machine to the underlying anatomy.

This approach is particularly vital in areas where ground-truth labels are impossible to get. For example, Luca Peretti uses physics-informed simulations to generate training pairs for motion correction in Residual learning for 3D motion corrected quantitative MRI, effectively bypassing the need for perfectly still "gold standard" scans that are rarely achievable in clinical practice.

Why It Works: The Manifold Intuition

The reason physics-aware augmentation outperforms standard methods can be understood through the concept of the data manifold.

Real medical images live on a very narrow manifold of "physically possible acquisitions." Standard augmentations like random pixel noise push the data off this manifold, teaching the model to handle patterns it will never see in a hospital. Physics-aware augmentations—like the k-space perturbations used by Arjun Desai in VORTEX—explore the manifold of possible artifacts.

When a model is trained on these structured, physically plausible variations, it learns to decouple the "true" signal from the "acquisition" noise. As Hampus Olsson demonstrates in Simulating rigid head motion artifacts on brain magnitude MRI data, modeling structured motion paradigms (like a patient nodding) produces artifacts that replicate real-world ringing and ghosting far better than stochastic noise ever could.

By respecting the physics of the sensor, these models don't just learn to recognize images; they learn to understand the process that created them.

Papers in this version

Showing 60 of 70 papers.

History & citationVersion 1 · 2026-10-04

No longer present in the current build · Permanent link

View frozen version 1

Cite this direction

Latest version (a living page):

@misc{lacuna_physics_aware_data_augmentation_for_robu_11d7b105,
  title = {Physics-Aware Data Augmentation for Robust Sensor Imaging},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/physics-aware-data-augmentation-for-robust-sensor-imaging/rdr_11d7b10555384189ace3284722c9f8e8},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-19},
}

This exact version (version 1, frozen text):

@misc{lacuna_physics_aware_data_augmentation_for_robu_11d7b105_v1,
  title = {Physics-Aware Data Augmentation for Robust Sensor Imaging},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/physics-aware-data-augmentation-for-robust-sensor-imaging/rdr_11d7b10555384189ace3284722c9f8e8/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-19},
}