An Improved Electronic Image Motion Compensation (IMC) Method of Aerial Full-Frame-Type Area Array CCD Camera Based on the CCD Multiphase Structure and Hardware Implementation

Hang Ren, Taotao Hu, YuLong Song, Hui Sun, Bochao Liu, Minghe Gao2018 · DOI

TL;DR

This paper introduces an improved electronic image motion compensation (IMC) method for aerial CCD cameras that significantly reduces image blurring caused by camera movement during exposure. By leveraging the multiphase structure of CCDs and a novel driving timing sequence, the method achieves better image sharpness and detail compared to conventional approaches, with a practical hardware implementation detailed.

What Problem Does This Paper Address?

Aerial photography from high-speed aircraft inherently suffers from image motion during exposure. This relative movement between the camera and the target causes blurring, smearing, and loss of resolution, degrading image quality. While various IMC methods exist (mechanical, optical, electronic, image-mode), electronic IMC, particularly using CCDs, is favored for its simplicity and integration potential. However, conventional electronic IMC methods, often based on Time Delay Integration (TDI) principles, struggle with the discrete nature of charge packet transfer in CCDs. This discreteness leads to a "non-synchronous effect" where the charge packet movement doesn't perfectly match the continuous image motion, limiting compensation effectiveness. The paper aims to overcome this limitation by proposing an improved electronic IMC method that minimizes this non-synchronous effect.

Methods

The core of the proposed solution lies in an "improved electronic IMC method" that utilizes the multiphase structure of CCDs. Instead of the conventional line-by-line charge packet transfer, this new method applies a series of precisely timed driving clocks to move charge packets electrode-by-electrode during the exposure time. This finer-grained control allows the charge packets to track the moving image more closely, reducing the mismatch between charge packet transfer and image motion.

The paper also details a hardware implementation strategy. It builds upon an existing FTF4052M drive circuit system by adding a dedicated "IMC pulse pattern generator." This generator works in tandem with the main pulse pattern generator (SAA8103) to create the specific driving timings required for the improved IMC. This dual-pulse pattern generator system is designed to be flexible and efficient.

The theoretical analysis involves using the optical injection formula of CCDs to quantify the modulation degree of the image under both conventional and improved IMC methods. This theoretical framework is then validated through computer simulations and indoor real-shot experiments.

Datasets

Not discussed in the paper. The experiments utilize custom-designed experimental platforms and test images, rather than pre-existing datasets.

Key Insights and Ideas

  • Discrete vs. Continuous Motion: The fundamental challenge is bridging the gap between the continuous motion of the image and the discrete, step-wise movement of charge packets within a CCD.
  • Multiphase Structure is Key: The paper highlights that the multiphase structure of CCDs (e.g., four-phase electrodes) is crucial for enabling finer control over charge packet movement, which is essential for the improved IMC.
  • Electrode-by-Electrode Tracking: The improved method's success stems from driving charge packets electrode-by-electrode during exposure, rather than waiting for a full line transfer. This allows for much tighter synchronization with image motion.
  • Hardware Integration is Feasible: The paper demonstrates that implementing this improved IMC doesn't require a complete redesign of existing drive circuits but can be achieved by adding a specialized pulse pattern generator.
  • Quantifiable Improvement: Theoretical analysis and experimental results consistently show a significant improvement in image modulation degree and sharpness with the proposed method.

Key Results

  • Improved Modulation Degree: The average modulation degree of the improved electronic IMC method was found to be 47/96, which is significantly greater than the 1/3 achieved by the conventional electronic IMC method.
  • Enhanced Image Sharpness: Experimental results showed substantial improvements in image sharpness. For instance, at a motion velocity of 0.0015 m/s, the image sharpness increased from 0.3120 (no IMC) to 0.9389 (conventional IMC) and further to 0.9867 (improved IMC). The average improvement in sharpness for the improved method over the conventional one was noted as 0.5002.
  • Reduced Non-Synchronous Effect: The proposed method effectively reduces the non-synchronous effect between charge packet transfer and image motion.
  • Hardware Feasibility: A functional hardware implementation using a dual-pulse pattern generator system was successfully designed and verified.

Limitations and Future Work

  • Focus on Vertical Motion: The analysis and implementation primarily focus on compensating for one-dimensional (vertical) image motion. While the paper mentions that image motion can be two-dimensional, the proposed method's direct application to complex 2D motion might require further extension.
  • Specific CCD Structure: The proposed hardware implementation is tailored for the FTF4052M CCD. While the principles are general, adapting it to other CCD architectures might require modifications.
  • Future Work (Implied): The paper's success in demonstrating improved IMC for aerial cameras suggests potential for extending this approach to other imaging applications where motion blur is a significant issue, such as industrial inspection or scientific imaging. Further exploration of optimizing the driving timing for different motion profiles and CCD types could also be a future direction.

Summary updated

BibTeX
@misc{ren2018improved,
  author = {Hang Ren and Taotao Hu and YuLong Song and Hui Sun and Bochao Liu and Minghe Gao},
  title = {{An Improved Electronic Image Motion Compensation (IMC) Method of Aerial Full-Frame-Type Area Array CCD Camera Based on the CCD Multiphase Structure and Hardware Implementation}},
  year = {2018},
  doi = {10.3390/s18082632},
}
Figure