Abstract
This paper presents a novel pre-processing framework designed to pre-compensate for display-induced artifacts, such as LCD motion blur, during the image and video compression process. By integrating display degradation models directly into the rate-distortion optimization via the Alternating Direction Method of Multipliers (ADMM), the proposed method enables standard codecs like HEVC to produce bitstreams that yield significantly higher end-to-end visual quality. Experimental results demonstrate substantial gains, with PSNR improvements of up to 15.42 dB for still images and 13.90 dB for video sequences at high bit-rates, while maintaining full compatibility with standard decoders.
Introduction
In traditional imaging pipelines, compression (e.g., JPEG or HEVC) is treated as a standalone task focused on minimizing the difference between the original source and the decompressed output. However, this approach ignores the final stage of the journey: the display device. Modern LCD screens often introduce "motion blur" due to their hold-type mechanism, where frames remain static until the next update.
Standard compression does not account for these display-side artifacts. Simply sharpening an image before compression is often ineffective, as the compression process tends to remove the added high-frequency details. This research proposes a way to integrate knowledge of display degradation directly into the compression process, creating a "pre-compensated" bitstream.
Methodology
The authors model display degradation as a known linear operator $H$. The objective is to find a compressed representation $v$ such that the degraded version $Hv$ is as close as possible to the original input $x$, subject to bit-rate constraints.
To solve this optimization problem, the framework utilizes the Alternating Direction Method of Multipliers (ADMM). This iterative approach splits the problem into two distinct steps:
- Compression Step: A standard codec (e.g., HEVC) is applied to an auxiliary variable. This ensures the method is "plug-and-play" with existing standards.
- Deconvolution Step: A quadratic optimization that sharpens the image to counteract display blur while maintaining proximity to the compression output.
This process shifts the computational complexity to the encoder. The resulting bitstream remains standard-compliant, allowing decoders (such as those in smartphones or TVs) to remain simple and power-efficient.
Experimental Results
The approach was evaluated using standard benchmarks, including 18 images from TESTIMAGES, UCID, and BSDS500, as well as high-frame-rate video sequences ('Shields' and 'Stockholm') featuring horizontal motion.
Key findings include:
- Performance Gains: For still images with Gaussian blur, the method outperformed standard HEVC by up to 15.42 dB PSNR at high bit-rates.
- Video Quality: On the 'Shields' sequence, a BD-PSNR gain of 13.90 dB was achieved over regular HEVC.
- Synergy with High Bit-rates: The method is particularly effective when bandwidth is sufficient to preserve the delicate pre-compensation signals. At lower bit-rates, coarse quantization limits the effectiveness of the sharpening.
- Implicit Regularization: Interestingly, the compression step acts as a natural regularizer, preventing common deconvolution artifacts like ringing or excessive noise.
Conclusion and Future Work
The proposed ADMM-based framework successfully integrates display characteristics into the compression pipeline, offering massive quality improvements for high-end viewing experiences. While the current model assumes a linear degradation operator and requires knowledge of the target display, it paves the way for display-aware encoding. Future research may explore non-linear display models and techniques to optimize for a broader range of display devices simultaneously.
Summary updated