Three-Dimensional Image Information Media: Optical and Synthetic Focusing Using Liquid Lens Array

Dongha Lee, Takafumi Koike, Keita Takahashi, Takeshi NaemuraThe Journal of The Institute of Image Information and Television Engineers 2010 · DOI

Introduction

Synthetic Aperture Photography (SAP) allows for post-capture refocusing by computationally shifting and summing multi-view images to simulate a large-aperture lens. However, SAP often suffers from "ghosting"—distracting artifacts in out-of-focus regions caused by discrete sampling of the light field. This paper introduces a hybrid system that combines an electronically controlled liquid lens array with SAP to achieve natural-looking blur and eliminate these artifacts.

System Architecture

The researchers developed a custom hardware pipeline centered on an 8×8 array of liquid lenses. Unlike traditional glass optics, these lenses change focal length via electrical signals, allowing for independent control of each viewpoint.

System schematic and experimental setup including the 8x8 liquid lens array.

To maximize the shared field of view, a large-aperture "pick-up lens" (convex) is placed between the array and the high-resolution video camera. This arrangement ensures the optical axes of all 64 lenses remain parallel, facilitating the capture of overlapping sub-images necessary for synthetic focusing.

The Focus Matching Principle

The core innovation lies in synchronizing the physical Optical Focus ($O$) of the liquid lenses with the digital Synthetic Focus ($S$) of the reconstruction algorithm.

Illustration of synthetic focusing: (a) shows alignment at the synthetic focal plane, while (b) demonstrates how misalignment leads to discrete projected points (ghosting).

In traditional SAP, sub-images are treated as pinhole captures with infinite depth of field. When the synthetic focus is set away from an object, the resulting image displays discrete "ghosts" of that object. By matching $O$ and $S$, the physical blur of the liquid lenses fills the gaps between viewpoints, creating a smooth, continuous bokeh effect.

Experimental Results

The system was tested using a scene with foreground flowers and a distant background logo. Key findings include:

  • Ghosting Reduction: Matching optical and synthetic focus significantly reduced artifacts compared to standard SAP.
  • Extended Depth of Field: By setting lenses to different focal planes (e.g., a checkerboard pattern), the system could resolve sharp details at multiple depths simultaneously.
  • High-Speed Adaptability: The liquid lenses allow the system to shift focus across a range from 10 cm to infinity in approximately 100 ms.

Conclusion and Future Work

This hybrid approach demonstrates that physical optical blur can be a powerful tool for computational imaging rather than a limitation. While current constraints include light loss due to lens boundaries and resolution trade-offs from tiling sub-images on a single sensor, the integration of adaptive optics into light-field cameras paves the way for more natural and flexible 3D imaging systems.

Summary updated

Abstract

Synthetic focusing methods, which superimpose pre-acquired multi-view images onto post-defined surfaces, are intended to simulate a camera with a large aperture and variable focus. We developed a synthetic focusing system with increased flexibility. The flexibility comes from independent control of the optical focuses of the input multi-view image. We arranged liquid lenses in a compact 8×8 array, in which focal lengths can be changed independently using electric signals, and placed a video camera behind the lens array to capture multi-view images. We found that if the optical and synthetic focuses coincide with each other, we can obtain images with more natural blurring effects. Furthermore, we can also set the optical focuses to multiple levels to increase the target depths of the synthetic focusing.
BibTeX
@article{lee2010three,
  author = {Dongha Lee and Takafumi Koike and Keita Takahashi and Takeshi Naemura},
  title = {{Three-Dimensional Image Information Media: Optical and Synthetic Focusing Using Liquid Lens Array}},
  journal = {The Journal of The Institute of Image Information and Television Engineers},
  year = {2010},
  doi = {10.3169/itej.64.585},
}
Figure