End-to-End Joint Training of Super-Resolution and Compression Artifact Removal for Industrial Machine Vision

Dang BuiDinh, Sang NguyenQuang, Anh NguyenPhuong, Wen-Hsiao Peng, Xiem HoangVanarXiv 2026 · arXiv

TL;DR

This paper introduces an end-to-end framework that jointly trains Super-Resolution (SR) and Compression Artifact Removal (CAR) specifically for industrial machine vision. By optimizing for both human visual fidelity and machine-perception tasks (like defect detection), the authors achieved a massive jump in detection accuracy—improving mAP@50 from 0.461 to 0.887 under heavy compression—proving that "looking good" to humans isn't the same as "working well" for AI.

What Problem Does This Paper Address?

In modern smart factories, edge devices capture high-resolution images for automated inspection. However, transmitting these raw files to a central server for processing requires massive bandwidth. To cope, images are typically downsampled and heavily compressed (e.g., via JPEG), which introduces two major problems: loss of fine detail (resolution loss) and "blocking" artifacts (compression noise).

While researchers have developed tools for Super-Resolution (SR) and Compression Artifact Removal (CAR), they are usually applied as separate, sequential steps. Furthermore, these tools are almost always optimized for human perception—aiming for high PSNR (Peak Signal-to-Noise Ratio) or "crispness." The authors argue that these objectives are sub-optimal for machine perception. A "clean" looking image might actually have its critical features smoothed over, leading a defect detection model to miss a hairline crack or a tiny "mouse bite" on a circuit board.

Methods

The authors propose a unified quality enhancement (QE) framework that integrates SR and CAR into a single trainable pipeline.

Fig. 2. Overall architecture of the proposed QE framework. (a) End-to-end joint training pipeline, where the QE module is optimized under both human- perception and machine-perception losses. (b) Different QE configurations, including separately trained models (Sep-CS and Sep-SC) and jointly trained models (Jnt-CS and Jnt-SC).

Key technical components include:

  • Joint Architectures: They explored two processing orders: CAR followed by SR (Jnt-CS) and SR followed by CAR (Jnt-SC). For the modules themselves, they used ESRPCB for SR and a transformer-based UNet for CAR.
  • Dual-Objective Loss Function: Instead of just minimizing pixel-level error, they used a combined loss: $$\mathcal{L}_{Joint} = f(\mathcal{L}_{Human}, \mathcal{L}_{Machine})$$
    • $\mathcal{L}_{Human}$: Uses Charbonnier loss to maintain image fidelity.
  • $\mathcal{L}_{Machine}$: Uses the detection loss from a frozen YOLOv8 model (including localization, classification, and distribution focal loss).
  • Weighting Strategies: They compared Fixed-Weighting (manually setting the balance between human and machine loss) against Uncertainty Weighting (UW). The UW approach dynamically adjusts the weights during training to prevent one loss term from dominating the other.

Datasets

The framework was evaluated on three specialized industrial datasets:

  1. PCB Defect: Images of printed circuit boards with defects like short circuits, open circuits, and "mouse bites."
  2. DeepPCB: Another circuit board dataset used to verify generalization.
  3. NEU-DET: A dataset focused on surface defects in steel strips (e.g., rolled-in scale, patches, crazing).

Key Insights and Ideas

  • The Sequential Penalty: Simply stacking a pre-trained SR model and a pre-trained CAR model often performs worse than using just one of them. This is because the second model isn't trained to handle the specific residual artifacts left behind by the first. Joint training eliminates this "blind spot."
  • Fidelity vs. Detection Trade-off: There is a clear tension between PSNR (human quality) and mAP (machine accuracy). Models optimized solely for human perception often "hallucinate" or smooth out the very textures a detector needs.
  • Machine Loss as a Regularizer: Including the machine-perception loss acts as a powerful guide, forcing the restoration network to preserve high-frequency features that are critical for identifying defects, even if they don't significantly impact the overall PSNR score.

Key Results

The quantitative improvements are striking, particularly when images are highly degraded. On the PCB Defect dataset with a JPEG Quality Factor (QF) of 20:

  • Without Quality Enhancement: 0.052 mAP@50 (essentially useless).
  • Sequential SR+CAR (Separate training): 0.204 mAP@50.
  • Proposed Joint Training (Jnt-SC): 0.887 mAP@50.
Fig. 3. Average mAP@50 of different QE configurations on the PCB Defect dataset across all evaluated QFs.

Qualitatively, Figure 4 in the paper demonstrates that while the human-optimized model produces a "cleaner" image, it fails to detect several "spur" defects. The jointly trained model, despite having a lower PSNR, successfully identifies all defects.

Limitations and Future Work

  • Computational Overhead: As shown in Table VI, the joint SR-CAR models are significantly heavier than standalone models. For example, the transformer-based Jnt-SC takes about 0.09 seconds per image, which might be too slow for high-speed production lines.
  • Detector Specificity: While the authors showed that features learned via YOLOv8 can transfer to other detectors like Faster R-CNN, the restoration model is still somewhat biased toward the architecture used during training.
  • Future Directions: The authors suggest that reducing the computational overhead while maintaining these accuracy gains is the next major hurdle for deploying this technology on resource-constrained edge devices.

Summary updated

Abstract

In industrial machine vision, images captured by edge devices are often downsampled and compressed to reduce bandwidth, introducing resolution loss and compression artifacts that severely degrade the performance of downstream tasks, such as defect detection. Existing quality enhancement methods typically apply super-resolution (SR) or compression artifact removal (CAR) independently or in a sequential manner and are largely optimized for human visual fidelity rather than machine perception. This paper proposes an end-to-end quality enhancement framework that integrates SR and CAR with a unified training strategy that optimizes both human-perception and machine-perception objectives. We investigate fixed-weight and uncertainty-based dynamic-weight loss functions to balance reconstruction quality and machine vision task performance. Extensive experiments on PCB Defect, DeepPCB, and NEU-DET datasets show that the proposed jointly trained model generally outperforms standalone and separately trained SR-CAR pipelines. In particular, under severe JPEG compression, our method improves defect detection performance from 0.461 to 0.887 mAP@50 on PCB Defect over sequential SR-CAR baselines, with only a slight reduction in PSNR. These results demonstrate that joint optimization is critical for compression-aware industrial machine vision systems.
BibTeX
@misc{buidinh2026end,
  author = {Dang BuiDinh and Sang NguyenQuang and Anh NguyenPhuong and Wen-Hsiao Peng and Xiem HoangVan},
  title = {{End-to-End Joint Training of Super-Resolution and Compression Artifact Removal for Industrial Machine Vision}},
  year = {2026},
  eprint = {2611.11831},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.11831},
}
Figure