Introduction: The Manifold Assumption Myth
In unsupervised outlier detection, the prevailing strategy relies on the Manifold Assumption. The theory suggests that an auto-encoder (AE) trained exclusively on "normal" data (e.g., healthy chest X-rays) will learn a compact representation of that specific distribution. Consequently, when presented with an anomaly—such as a lung tumor or a completely different image class—the AE should fail to reconstruct the outlier, yielding a high reconstruction error that serves as a detection signal.
However, this paper argues that this assumption is often a myth. In practice, standard AEs frequently suffer from a "Curse of Resolution." If the latent space is too large, the model simply learns an identity mapping, reconstructing anomalies perfectly. Conversely, if too constrained, it produces blurry reconstructions even for in-distribution data.
MorphAEus: Deformable Auto-Encoders
To address these reliability issues, the authors introduce MorphAEus, a novel deformable auto-encoder architecture. Instead of direct pixel reconstruction from a bottleneck, MorphAEus decouples the synthesis process into two distinct components:
- Global Image Prior: The network learns a perceptually consistent "average" representation of the training distribution. By utilizing a Perceptual Loss (PL), the model ensures that the generated prior maintains the visual characteristics of a real image rather than a blurry approximation.
- Local Deformation Field ($\Phi$): A secondary branch estimates a dense deformation field that "warps" the global prior to match the specific anatomical structure (morphometry) of the input image.
By separating content (the prior) from shape (the deformation), MorphAEus can adapt to a patient's unique anatomy without "hallucinating" or copying abnormal textures, such as COVID-19 opacities, which were absent from the training set.
Experimental Evaluation
The model was evaluated on several benchmarks to test both domain-level and pathology-level detection:
- MedNIST: Used for Out-of-Distribution (OoD) tasks across six medical imaging classes (e.g., training on CXR to detect Hand images).
- MNIST: A baseline for non-medical outliers.
- Lung Pathology Datasets: Specifically curated sets for COVID-19 and Lung Opacity to test the localization of specific diseases within the same domain.
Key Insights and Results
The authors identify a "Copy Trap" where standard Spatial AEs reconstruct unseen objects (like trucks or faces) with surprising accuracy when trained on medical images, as they learn low-level features common to all natural images.
MorphAEus demonstrates significant improvements:
- OoD Detection: It achieved near-perfect AUROC scores (0.993 to 0.999) on MedNIST, outperforming standard VAEs and DAEs.
- Pathology Localization: On the COVID-19 detection task, MorphAEus reached an AUROC of 0.868, a stark contrast to the 0.559 achieved by standard Spatial AEs.
- Qualitative Success: Visually, MorphAEus generates "pseudo-healthy" reconstructions. It effectively "cleans" the input image by removing anomalies like tumors or medical devices, making the residual (the difference between input and reconstruction) a highly effective heatmap for pathology.
Limitations and Future Work
While successful, the model currently operates at 128x128 resolution, which may miss subtle pathologies. Additionally, the model is highly sensitive and may flag non-clinical anomalies such as text annotations or pacemakers. Future work involves integrating classification heads to distinguish between clinically relevant diseases and irrelevant artifacts.
Summary updated