Introduction
Self-supervised learning (SSL) has transformed computer vision, yet medical imaging—particularly chest X-rays (CXR)—presents unique challenges. Detecting fine-grained findings like tiny nodules or subtle textural changes requires high spatial resolution. While standard models are often pretrained at 224×224 pixels, Meta’s DINOv3 introduces architectural features specifically designed for high-resolution adaptation. This study benchmarks DINOv3 against its predecessors to determine if these improvements translate to clinical utility.
Experimental Design and Datasets
The researchers conducted a large-scale evaluation using over 814,000 images from seven diverse datasets, including Pedi-CXR, VinDr-CXR, and MIMIC-CXR. The study systematically compared:
- Initializations: Supervised ImageNet-21K, DINOv2, and DINOv3.
- Backbones: ViT-B/16 (Transformer) vs. ConvNeXt-B (Convolutional).
- Resolution: Scaling from 224×224 up to 1024×1024 pixels.
- Training Strategy: Full finetuning vs. frozen features from a 7B-parameter teacher model.
Key Insights
Resolution as the Primary Performance Driver
A critical finding is that DINOv3’s advantages are resolution-dependent. At the standard 224×224 resolution, DINOv3 performs similarly to DINOv2. Its superior performance only emerges at 512×512 pixels, validating its high-resolution adaptation design. While scaling to 1024×1024 provided some gains, 512px was identified as the "sweet spot" for balancing accuracy and computational efficiency.
Backbone and Adaptation Strategy
Despite the popularity of Vision Transformers, the ConvNeXt-B backbone consistently outperformed ViT-B/16. The inductive biases of convolutional neural networks (CNNs) appear better suited for the structured spatial data in radiographs. Furthermore, domain adaptation proved more vital than model scale: a fully finetuned 89M-parameter model outperformed a frozen 7B-parameter model, emphasizing the need for task-specific tuning in radiology.
Results and Clinical Implications
The strongest configuration was a DINOv3-initialized ConvNeXt-B at 512×512 resolution. This setup achieved AUROC gains of 0.8–1.5 percentage points over ImageNet and DINOv2 baselines. These improvements were most significant for "boundary-dependent" findings, such as pneumothorax and pulmonary nodules, where fine spatial detail is paramount.
Interestingly, the pediatric cohort (Pedi-CXR) did not show the same performance gaps between initializations, likely due to smaller sample sizes and distinct anatomical differences compared to adult populations.
Conclusion
Resolution scaling is a fundamental factor in the transfer performance of modern SSL models like DINOv3. By leveraging 512×512 resolution and convolutional backbones, DINOv3 provides a meaningful step forward in the automated classification of complex chest radiograph findings. Future research should investigate whether these resolution-driven gains extend to localization and segmentation tasks across other high-resolution medical modalities.
Summary updated