Eyepiece-free pupil-optimized holographic near-eye displays

Jie Zhou, Shuyang Xie, Yang Wu, Qi Deng, Jun Wang

TL;DR

This paper introduces a novel eyepiece-free holographic near-eye display (NED) that overcomes limitations of current designs by optimizing wavefront modulation directly for the user's pupil. This approach eliminates bulky optics and significantly improves image quality and depth perception, paving the way for more compact and realistic VR/AR experiences.

What Problem Does This Paper Address?

Current holographic near-eye displays (NEDs) aim to provide immersive virtual and augmented reality (VR/AR) experiences by precisely reconstructing optical wavefronts. While advancements in computational holography have improved image quality and real-time generation, practical implementations face significant challenges. A primary issue is the finite and dynamically varying aperture of the human eye's pupil, which acts as a partial sampler of the holographic wavefront. This sampling can lead to degraded image quality and reduced perceptual realism, especially when the pupil's position or size changes. Traditional solutions often rely on complex optical assemblies like eyepieces or relay lenses, which add bulk and complexity to wearable NED systems. This paper addresses the need for a more compact, lightweight, and robust holographic NED that can maintain high image quality across varying pupil conditions without external optics.

Methods

The core innovation of this work is an "eyepiece-free pupil-optimized holographic NED." Instead of using conventional eyepieces, the system directly modulates the wavefront to generate multiple viewpoints within the user's pupil. This is achieved through a "customized spherical phase modulation strategy." The method jointly optimizes both the amplitude and phase distributions of these generated viewpoints. This joint optimization is crucial for mitigating image degradation caused by finite pupil sampling and for resolving subtle depth cues that are often lost in traditional spherical phase holograms.

Furthermore, the paper introduces an "optimization-based phase-only hologram (POH) encoding technique." This technique efficiently converts complex amplitude holograms (CAHs) into a high-quality, artifact-suppressed phase-only representation, which is more suitable for practical optical implementation in eyepiece-free holographic NEDs. This POH encoding is designed to be robust against artifacts that can arise from large phase variations, a limitation of previous POH generation methods like error diffusion (EDM) and double phase method (DPM).

Datasets

Not discussed in the paper. The paper focuses on numerical simulations and experimental evaluations using a USAF-1951 resolution target and a DIV2K dataset for statistical evaluation.

Key Insights and Ideas

  • Direct Pupil Modulation is Key: The most significant insight is that by directly tailoring the holographic wavefront to the user's pupil, one can bypass the need for bulky optical components and achieve superior image quality and depth perception.
  • Joint Amplitude and Phase Optimization: Optimizing both amplitude and phase distributions across multiple viewpoints is critical for overcoming the limitations of finite pupil sampling and enhancing depth cues.
  • Eyepiece-Free Design is Achievable: The paper demonstrates that a practical, high-quality holographic NED can be realized without traditional eyepieces, significantly reducing system size and complexity.
  • Robustness to Pupil Variations: The proposed method, particularly with the integration of random aperture pupils, shows robustness to physiological variations in pupil size, a crucial factor for wearable displays.
  • Advanced POH Encoding: The development of an optimization-based POH encoding technique is vital for practical implementation, effectively suppressing artifacts and improving reconstruction quality.

Key Results

  • Improved Image Quality: Numerical simulations and experimental results show substantial enhancements in reconstructed image quality, particularly in preserving high-frequency spatial details compared to conventional spherical phase holography.
  • Enhanced Depth Perception: The method generates more pronounced blur characteristics under defocus conditions, effectively enhancing depth contrast and realism.
  • Quantitative Metrics: Statistical evaluations on the DIV2K dataset show significant enhancements in Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index Measure (SSIM) across realistic pupil aperture ranges and varying depths. For example, PSNR and SSIM are consistently higher for the proposed method compared to conventional methods.
  • Artifact Reduction: The proposed POH encoding technique effectively mitigates spherical artifacts, leading to superior optical reconstructions compared to DPM and EDM.
  • Biplane Reconstruction: The method successfully demonstrates biplane image reconstruction, delivering clear and pronounced depth cues where refocusing on one plane induces perceptual blurring of the other, reinforcing depth realism.

Limitations and Future Work

  • Speckle Noise: While the optimization-based phase encoding technique mitigates spherical artifacts, incidental speckle noise remains an inherent challenge.
  • Future Work: The authors suggest further exploration and development of advanced phase encoding techniques to achieve an eyepiece-free holographic NED that is free from speckle noise and artifacts. This remains a compelling and significant research avenue.

Summary updated

Abstract

Computer-generated holography (CGH) represents a transformative visualization approach for next-generation immersive virtual and augmented reality (VR/AR) displays, enabling precise wavefront modulation and naturally providing comprehensive physiological depth cues without the need for bulky optical assemblies. Despite significant advancements in computational algorithms enhancing image quality and achieving real-time generation, practical implementations of holographic near-eye displays (NEDs) continue to face substantial challenges arising from finite and dynamically varying pupil apertures, which degrade image quality and compromise user experience. In this study, we introduce an eyepiece-free pupil-optimized holographic NED. Our proposed method employs a customized spherical phase modulation strategy to generate multiple viewpoints within the pupil, entirely eliminating the dependence on conventional optical eyepieces. Through the joint optimization of amplitude and phase distributions across these viewpoints, the method markedly mitigates image degradation due to finite pupil sampling and resolves inapparent depth cues induced by the spherical phase. The demonstrated method signifies a substantial advancement toward the realization of compact, lightweight, and flexible holographic NED systems, fulfilling stringent requirements for future VR/AR display technologies.
BibTeX
@misc{zhou2025eyepiece,
  author = {Jie Zhou and Shuyang Xie and Yang Wu and Qi Deng and Jun Wang},
  title = {{Eyepiece-free pupil-optimized holographic near-eye displays}},
  year = {2025},
  eprint = {2507.22420},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2507.22420},
}
Figure