Abstract
Magnetic Resonance Imaging (MRI) often involves a trade-off between image quality and acquisition time. While multi-contrast super-resolution (SR) techniques leverage high-resolution reference scans to sharpen lower-quality target scans, existing methods suffer from rigid scaling limitations and inefficient square-window processing. This paper introduces McASSR, a framework utilizing a novel Rectangle-Window Cross-Attention Transformer (RCT) and Reference-Aware Implicit Attention (RIA). McASSR enables high-quality SR at any magnification level, capturing long-range anatomical dependencies more effectively than traditional methods.
The Challenge of MRI Super-Resolution
In clinical settings, high-resolution (HR) images are essential for diagnosis but time-consuming to acquire, often leading to patient discomfort and motion artifacts. Super-resolution—using AI to upscale low-resolution (LR) scans—offers a solution. Multi-contrast SR specifically uses a fast-acquired reference scan (e.g., T1-weighted) to help reconstruct a slower target scan (e.g., T2-weighted).
However, current state-of-the-art models face two primary hurdles:
- Rigid Scaling: Most models are restricted to fixed integer scales (e.g., 2x, 4x). Non-integer or arbitrary scales require retraining, which is clinically impractical.
- Square-Window Limitations: Standard transformers use square windows (e.g., 8x8) that fail to capture the elongated anatomical structures and global symmetries inherent in human organs like the brain or knee.
The McASSR Framework
To address these issues, the authors developed McASSR (Multi-Contrast Arbitrary-Scale Super-Resolution). The architecture integrates two primary innovations to handle complex medical textures and flexible zoom requirements.
Innovation 1: Rectangle-Window Cross-Attention Transformer (RCT)
Human anatomy is rarely square. Structures like the cortex or long bones are better represented by elongated windows. The RCT utilizes horizontal and vertical rectangle windows, allowing the model to "see" further across the image without increasing computational costs. This approach establishes superior long-range dependencies, which are crucial for maintaining structural integrity in medical imaging.
Innovation 2: Reference-Aware Implicit Attention (RIA)
For arbitrary scaling, McASSR moves away from traditional discrete upsampling (like bicubic interpolation) toward Implicit Neural Representation (INR). By treating the image as a continuous function, any coordinate $(x, y)$ can be mapped to a pixel value. The RIA module specifically queries the high-resolution reference image for high-frequency textures, injecting this detail into the target image during the upscaling process. This ensures that fine details are preserved even at non-integer magnification levels.
Experimental Results
The model was evaluated on the FastMRI (knee) and BraTs (brain) datasets, alongside two in-house clinical datasets. McASSR consistently outperformed state-of-the-art methods across all metrics.
- Quantitative Performance: On the FastMRI dataset at 4x scale, McASSR achieved a PSNR of 32.52 dB, significantly outperforming other arbitrary-scale methods like LTE (31.19 dB).
- Out-of-Scale Generalization: When trained on 4x scales but tested at 6x or 8x, McASSR maintained sharper edges and fewer artifacts than its competitors.
Clinical Implications and Future Work
By shifting SR from a discrete image-processing task to a continuous coordinate-mapping task, McASSR provides radiologists with a "future-proof" tool for any required zoom level. The efficiency of the model—with inference times around 35ms—makes it a strong candidate for real-time clinical integration.
A current limitation remains image registration; the reference and target scans must be perfectly aligned for optimal fusion. Future research will focus on multi-task frameworks that perform registration and super-resolution simultaneously, as well as extending the architecture to handle 3D volumetric MRI data.
Summary updated