Abstract
Deep convolutional neural networks have demonstrated exceptional performance in single-image super-resolution (SISR), but the trend toward increasingly complex architectures poses significant challenges for deployment on resource-constrained edge devices. This paper introduces AFSNet, an extremely lightweight and efficient super-resolution network. By employing a recursive feature selection unit and a parameter-sharing mechanism, AFSNet significantly reduces the number of parameters and floating-point operations (FLOPs) while maintaining high reconstruction quality. The network utilizes a recursive Feature Selection Module (FSM) with Efficient Channel Attention (ECA) to extract deep features and a shared upsampling module for final reconstruction. Experimental results on standard benchmarks (Set5, Set14, B100, Urban100, and Manga109) demonstrate that AFSNet achieves superior performance in terms of PSNR and SSIM compared to existing lightweight models, making it highly suitable for real-time applications on mobile hardware.
Introduction
The field of single-image super-resolution (SISR) has been revolutionized by deep learning, with models becoming progressively deeper and wider to capture intricate image details. However, this architectural complexity comes at a high computational cost, limiting the practical application of these models on mobile devices like smartphones. There is a critical need for "lightweight" solutions that balance reconstruction fidelity with efficiency. AFSNet addresses this gap by leveraging recursion and intelligent feature selection to maximize performance per parameter.
Methodology
The AFSNet architecture is structured into three primary stages: shallow feature extraction, deep feature extraction via recursion, and upsampling reconstruction.
1. Recursive Feature Selection Module (FSM)
To minimize the model's footprint, AFSNet adopts a recursive strategy. Instead of a linear stack of unique layers, the network passes features through a single Feature Selection Module (FSM) multiple times (typically six iterations). This approach allows the network to simulate the depth of a much larger model without increasing the total parameter count.
2. Channel Splitting and Feature Enhancement
Within the FSM, a "split-and-merge" strategy is employed to preserve hierarchical information. As features pass through successive convolutional layers, a portion of the channels is set aside (split) and later fused at the end of the module. This mechanism ensures that low-level structural details are not lost during the deep recursive processing, acting as a form of dense residual learning.
3. Efficient Channel Attention (ECA)
To further refine feature maps, an Efficient Channel Attention (ECA) block is integrated. Unlike traditional channel attention mechanisms that use dimensionality reduction—which can inadvertently discard useful information—ECA utilizes a fast 1D convolution to model local cross-channel interactions. This provides a significant boost in representational power with negligible computational overhead.
4. Shared Upsampling Reconstruction
The final reconstruction stage uses a shared upsampling block. By processing both shallow and deep features simultaneously through the same upsampling parameters, the network further optimizes its efficiency while ensuring that both global structure and fine details contribute to the high-resolution output.
Experiments and Results
Datasets
AFSNet was trained on the DF2K dataset (a combination of DIV2K and Flickr2K). Evaluation was conducted on five standard benchmarks: Set5, Set14, B100, Urban100, and Manga109, covering a wide variety of textures and structures.
Performance Comparison
Quantitative analysis shows that AFSNet consistently outperforms other lightweight architectures. For a 4x upscaling task, AFSNet requires only 255K parameters and 24.5G FLOPs. In contrast, models like SRFBN-S require nearly double the parameters (483K) and significantly more FLOPs (852.9G).
On the Set14 (4x) benchmark, AFSNet achieved a PSNR of 28.85 dB, outperforming CARN-M (28.42 dB) and IDN (28.25 dB). Qualitatively, AFSNet excels in reconstructing sharp edges and repetitive patterns, such as those found in urban architecture and fine-lined manga illustrations, where other lightweight models often struggle with blurring.
Conclusion
AFSNet demonstrates that high-quality super-resolution does not necessitate massive, resource-heavy architectures. Through the strategic use of recursion, channel splitting, and efficient attention mechanisms, the model achieves state-of-the-art performance for its size class. This makes AFSNet an ideal candidate for deployment in real-world scenarios requiring efficient, high-fidelity image reconstruction on edge devices.
Summary updated