Tone Mapping of HDR Images via Meta-Guided Bayesian Optimization and Virtual Diffraction Modeling

Deju Huang, Xifeng Zheng, Jingxu Li, Ruoting Zhan, J. Dong, Yuanbo Wen, Xinyue Mao, Yufeng ChenSensors 2025 · DOI

TL;DR

This paper introduces a novel tone mapping technique that combines virtual diffraction, a psychophysical model of human vision, and a meta-learning-guided Bayesian optimization framework. This approach effectively balances image detail preservation with perceptual naturalness, achieving state-of-the-art results and significantly faster convergence compared to existing methods.

What Problem Does This Paper Address?

High Dynamic Range (HDR) images capture a much wider range of light intensities than standard displays can reproduce. Tone mapping (TM) is the process of converting these HDR images into Low Dynamic Range (LDR) images that can be displayed on conventional devices, while preserving visual detail and naturalness. Existing TM methods often struggle to strike a balance between preserving structural fidelity (details, edges) and perceptual naturalness (how the image "feels" to a human observer). Many methods prioritize structural fidelity, leading to unnatural-looking results, or rely on complex, hand-tuned parameters. Furthermore, optimizing TM parameters is challenging because key quality metrics like the Tone Mapping Quality Index (TMQI) are non-differentiable, making gradient-based optimization difficult. This paper aims to address these limitations by developing a more robust, efficient, and perceptually accurate tone mapping system.

Methods

The proposed framework integrates several key components:

  • Virtual Diffraction Modeling: This novel approach models the image as a light field and uses phase modulation in the frequency domain to reconstruct HDR images. This allows for precise control over image details and contrast.
  • Psychophysical Model (Stevens's Power Law): To mimic human visual perception of brightness, the Stevens's power law is applied to adjust the overall luminance distribution, enhancing visual experience and naturalness.
  • Meta-Learning Guided Bayesian Optimization (BO):
    • Bayesian Optimization: This technique is used for adaptive parameter tuning. It models uncertainty using probabilistic models to find the optimal parameters for TMQI with fewer evaluations, overcoming the non-differentiability issue.
  • Meta-Learning: A task-distribution-oriented meta-learning framework is employed. It constructs a "meta-feature space" from image statistics and uses clustering and a gated meta-learner to predict initial parameters. This significantly improves generalization to diverse HDR content and mitigates the "cold-start" problem in BO, accelerating convergence.
  • Two-Stage Noise Control: A bias term is introduced to enhance numerical stability, and an arctangent function is used for dynamic range compression and noise suppression.

Datasets

The authors evaluated their method on three publicly available HDR datasets:

  • LVZ-HDR: Contains a diverse range of complex scenes.
  • HIG: A dataset with a relatively small number of images.
  • HSD: Another dataset for evaluation.

These datasets collectively comprise 553 HDR images, covering indoor environments, landscapes, nighttime scenes, and direct sunlight conditions.

Key Insights and Ideas

  • Virtual Diffraction as a TM Tool: Using phase modulation in the frequency domain, inspired by optical diffraction, offers a novel way to manipulate image details and contrast for tone mapping.
  • Bridging Structural Fidelity and Perceptual Naturalness: The combination of virtual diffraction (for detail) and Stevens's power law (for perception) creates a more balanced approach than methods that heavily favor one aspect.
  • Meta-Learning for Efficient Optimization: By learning from past optimization tasks, the meta-learning component provides excellent initial parameter guesses for Bayesian optimization. This drastically reduces the number of evaluations needed, speeding up convergence and overcoming the typical slow start of BO.
  • Addressing TMQI's Non-Differentiability: Bayesian Optimization's gradient-free nature is crucial for directly optimizing TMQI, which is essential for achieving a good balance between structural fidelity and naturalness, unlike gradient-based methods that often struggle with the naturalness component.

Key Results

  • Superior Performance: The proposed method consistently outperformed state-of-the-art tone-mapping algorithms across all three benchmark datasets.
  • Naturalness Improvement: An average improvement of up to 27% in naturalness (NSS metric) was observed.
  • Faster Convergence: Meta-learning-guided Bayesian optimization achieved two- to five-fold faster convergence compared to traditional BO.
  • Pareto Frontier Dominance: The method consistently achieved high TMQI scores with low computational cost, occupying the optimal region of the Pareto frontier for quality vs. runtime.
  • Robustness: The method demonstrated remarkable robustness against both Gaussian and impulse noise, with only a gradual decline in TMQI scores.

Limitations and Future Work

  • Dataset Size for Meta-Learning: The paper notes that the meta-learning superiority is best demonstrated with larger datasets, and the HIG dataset's smaller size required combining it with HSD for ablation studies.
  • Computational Cost: While significantly faster than traditional BO, the method still involves optimization. The paper suggests that future improvements in GPU performance for Bayesian optimization tools could further enhance runtime.
  • Future Work: The authors highlight the potential for real-time processing in future applications due to the method's efficiency and robustness. The framework's success in various domains like film post-production and astrophotography suggests broad applicability.

Summary updated

Abstract

This paper proposes a novel image tone-mapping framework that incorporates meta-learning, a psychophysical model, Bayesian optimization, and light-field virtual diffraction. First, we formalize the virtual diffraction process as a mathematical operator defined in the frequency domain to reconstruct high-dynamic-range (HDR) images through phase modulation, enabling the precise control of image details and contrast. In parallel, we apply the Stevens power law to simulate the nonlinear luminance perception of the human visual system, thereby adjusting the overall brightness distribution of the HDR image and improving the visual experience. Unlike existing methods that primarily emphasize structural fidelity, the proposed method strikes a balance between perceptual fidelity and visual naturalness. Secondly, an adaptive parameter tuning system based on Bayesian optimization is developed to conduct optimization of the Tone Mapping Quality Index (TMQI), quantifying uncertainty using probabilistic models to approximate the global optimum with fewer evaluations. Furthermore, we propose a task-distribution-oriented meta-learning framework: a meta-feature space based on image statistics is constructed, and task clustering is combined with a gated meta-learner to rapidly predict initial parameters. This approach significantly enhances the robustness of the algorithm in generalizing to diverse HDR content and effectively mitigates the cold-start problem in the early stage of Bayesian optimization, thereby accelerating the convergence of the overall optimization process. Experimental results demonstrate that the proposed method substantially outperforms state-of-the-art tone-mapping algorithms across multiple benchmark datasets, with an average improvement of up to 27% in naturalness. Furthermore, the meta-learning-guided Bayesian optimization achieves two- to five-fold faster convergence. In the trade-off between computational time and performance, the proposed method consistently dominates the Pareto frontier, achieving high-quality results and efficient convergence with a low computational cost.
BibTeX
@inproceedings{huang2025tone,
  author = {Deju Huang and Xifeng Zheng and Jingxu Li and Ruoting Zhan and J. Dong and Yuanbo Wen and Xinyue Mao and Yufeng Chen and Yu Chen},
  title = {{Tone Mapping of HDR Images via Meta-Guided Bayesian Optimization and Virtual Diffraction Modeling}},
  booktitle = {Sensors},
  year = {2025},
  doi = {10.3390/s25216577},
}
Figure