PiLLVD: A Real-World Low-Light Video Dataset for Dynamic Scenes Captured with Off-the-Shelf Cameras

Yaser Abu Awwad, Paul L. Rosin, Oktay KarakuşarXiv 2026 · arXiv

TL;DR

PiLLVD is a new, publicly available dataset of paired low-light and normal-light videos featuring complex, real-world motion captured with a low-cost Raspberry Pi setup. By providing temporally aligned sequences of dynamic scenes, it offers a rigorous benchmark for evaluating how enhancement algorithms handle temporal stability and motion artifacts—areas where current state-of-the-art models still struggle to generalize.

What Problem Does This Paper Address?

While low-light image enhancement has seen massive progress, video enhancement remains a significant challenge. The primary hurdle isn't just brightening a frame; it’s maintaining temporal consistency. If you enhance each frame independently, the video often suffers from "flickering," color shifts, and inconsistent brightness.

To train and evaluate models that solve these issues, researchers need "paired" data: a low-light video and a perfectly aligned normal-light version of the same scene. However, capturing this is technically difficult. You need two cameras perfectly synchronized in time and space. Consequently, most existing datasets are either static (no motion), synthetic (adding fake noise to bright videos), or private, which limits the development of models capable of handling the messy, unpredictable motion of the real world.

Methods

The authors developed a reproducible, low-cost acquisition system to bridge this data gap.

  • Hardware Setup: The system uses three Raspberry Pi 4Bs and two identical Arducam Sony-IMX519 cameras. A beam splitter divides incoming light, sending 30% to the "low-light" camera and 70% to the "normal-light" reference camera.
  • Synchronization: One Pi acts as a master server, using the Network Time Protocol (NTP) to sync the clocks of the other two "slave" Pis. This ensures a temporal offset of less than one millisecond between paired frames.
  • Post-Capture Alignment: Even with a rigid mount, tiny spatial misalignments occur. The authors developed a pipeline that uses histogram matching to temporarily brighten the low-light frames (preserving their structure) to estimate optical flow. They then warp the normal-light reference frame to match the low-light input, ensuring the ground truth is spatially aligned without distorting the original low-light data.
Overview of the acquisition and post-processing pipeline

Datasets

The paper introduces PiLLVD (Pi-based Low-Light Video Dataset).

  • Composition: 24 paired sequences (17 indoor, 7 outdoor) totaling 4,531 frames.
  • Diversity: Unlike previous datasets that use controlled camera rails or static scenes, PiLLVD features uncontrolled human and object motion, such as walking, gesturing, and moving handheld objects.
  • Comparison: Compared to existing benchmarks like DRV or SDSD, PiLLVD is categorized as having "High" motion diversity and "Uncontrolled" motion patterns, making it a more realistic test for real-world applications like surveillance or autonomous systems.
Fig. 1. (a), (b) Sample frames from existing paired low-light video datasets; (c) sample frames from our dataset, shown from left to right as (frame0080, frame0090, and frame0100), illustrating noticeable object motion across time.

Key Insights and Ideas

  • The "Zero-Shot" Reality Check: The authors benchmarked several top-tier models (like SDSDNet and StableLLVE) without any fine-tuning on their new data. They found that models trained on static or synthetic data often fail when faced with real-world dynamic scenes.
  • PSNR Isn't Everything: Some models achieved high PSNR (Peak Signal-to-Noise Ratio) but performed poorly on temporal stability metrics. This highlights that a "bright" frame isn't necessarily a "good" video frame if it jitters or loses texture.
  • Motion Artifacts: The dataset reveals specific failure modes in current models, such as "ghosting" (where a moving person leaves a trail) or over-smoothing of textures in motion.

Key Results

The quantitative evaluation used standard metrics (PSNR, SSIM, LPIPS) alongside mTWE (masked temporal warping error) to measure stability.

  • Indoor Performance: LLVE-STCD generally led in structural similarity (SSIM) and perceptual quality (LPIPS) for indoor scenes.
  • Temporal Stability: DP3DF demonstrated the strongest temporal consistency (lowest mTWE) across most sequences, proving more robust against flickering.
  • Qualitative Failures: In outdoor tests, SDSDNet significantly increased brightness but introduced noticeable ghosting and color smearing around moving subjects.
Qualitative comparison showing how different models handle a moving person in an outdoor scene

Limitations and Future Work

The authors acknowledge several areas for improvement:

  • Scale: While diverse, the dataset is relatively small (4,531 frames).
  • Scene Balance: There is a higher proportion of indoor scenes compared to outdoor ones.
  • Alignment Challenges: In extremely dark conditions, the high sensor noise makes it difficult for even advanced optical flow algorithms to achieve perfect pixel-level alignment.
  • Future Directions: The team plans to expand the dataset with faster motion, more extreme low-light conditions, and more outdoor environments. They also aim to develop new, efficient models specifically trained on PiLLVD for real-time edge deployment.

Summary updated

Abstract

Low-light image and video enhancement has received increasing attention in recent years. However, most existing enhancement methods are developed and evaluated on still images, while progress in low-light video enhancement remains limited by the lack of real-world paired video datasets. Acquiring paired low-light and normal-light video sequences is challenging because it requires spatially and temporally aligned captures while avoiding motion blur, exposure mismatch, and correspondence errors in dynamic scenes. To address this gap, we introduce PiLLVD, the Pi-based Low-Light Video Dataset, a paired low-light video dataset captured using an accessible Raspberry Pi-based multi-camera system with off-the-shelf cameras. PiLLVD provides paired low-light and aligned normal-light reference sequences for dynamic indoor and outdoor scenes, including diverse human and object motion under varying illumination conditions. Unlike existing datasets that are often image-based, static, synthetic, or limited to simple motion patterns, PiLLVD focuses on motion-rich scenes where frame-to-frame stability and motion-related artefacts are important for evaluation. In addition to presenting the dataset and acquisition pipeline, we benchmark representative pre-trained low-light video enhancement methods on PiLLVD under a zero-shot setting. The results show that existing methods do not generalise uniformly across the proposed sequences, highlighting the challenges posed by the proposed dataset and its value for both benchmarking existing methods and supporting the development of future low-light video enhancement algorithms.
BibTeX
@misc{awwad2026pillvd,
  author = {Yaser Abu Awwad and Paul L. Rosin and Oktay Karakuş},
  title = {{PiLLVD: A Real-World Low-Light Video Dataset for Dynamic Scenes Captured with Off-the-Shelf Cameras}},
  year = {2026},
  eprint = {2611.16515},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.16515},
}
Figure