Abstract
Recently, a camera or an image sensor receiver based optical wireless communications (OWC) techniques have attracted particular interest in areas such as the internet of things, indoor localization, motion capture, and intelligent transportation systems. As a supplementary technique of high-speed OWC based on photo-detectors, communications hinging on image sensors as receivers do not need much modification to the current infrastructure, such that the implementation complexity and cost are quite low. Therefore, in this paper, we present a comprehensive survey of optical camera communication (OCC) techniques, and their use in localization, navigation, and motion capture. This survey is distinguishable from the existing reviews on this topic by covering multiple aspects of OCC and its various applications. The first part of the paper focuses on the standardization, channel characterization, modulation, coding, and synchronization of OCC systems while the second part of the article presents the literature on OCC based localization, navigation, and motion capture. Finally, in the last part of the paper, we present the challenges and future research directions of OCC.
Introduction: Bridging the Hardware Gap
As the demand for mobile data explodes, the radio frequency (RF) spectrum is becoming increasingly congested. Optical Wireless Communication (OWC) offers a massive, unregulated spectrum as a solution. However, high-speed OWC technologies like Li-Fi typically require specialized photo-detectors that aren't present in consumer devices.
Optical Camera Communication (OCC) solves this "hardware gap" by transforming ubiquitous image sensors—like those in your smartphone or car—into data receivers. While cameras have lower sampling rates than dedicated photo-detectors, they offer unique advantages: they can separate multiple light sources spatially (MIMO), work over much longer distances (up to kilometers), and require zero hardware modifications to the receiver side. This makes OCC a low-cost, long-range alternative to traditional Visible Light Communication (VLC).
OCC System Architectures
The paper categorizes OCC into three primary system architectures based on the transmitter type and configuration:
- LED2C: A single LED transmitting to a camera.
- LEDA2C (Visual MIMO): An array of LEDs transmitting to a camera, allowing for parallel data streams through spatial multiplexing.
- S2C: A screen (like a monitor or tablet) acting as the transmitter.
Technical Foundations
Technically, the survey explores the core components of OCC systems:
- Modulation: It explores standardized techniques like Under-sampled Frequency Shift On-Off Keying (UFSOOK) and Spatial 2-Phase Shift Keying (S2-PSK), alongside non-standardized methods like Color Shift Keying (CSK), which maps data to the CIE color space.
- The "Rolling Shutter" Effect: A key technique where the CMOS sensor's row-by-row exposure is used to capture multiple states of a flickering LED in a single frame, effectively boosting the data rate beyond the camera's frame rate.
- Channel Modeling: The authors define the signal-to-noise ratio (SNR) for OCC, accounting for shot noise, read noise, and non-uniform photo-response.
Key Insights and Performance
Unlike a single photo-detector that "blurs" all incoming light together, a camera’s millions of pixels allow it to isolate a specific data-carrying light source from intense ambient noise. This spatial separation is why OCC can achieve much higher SNR and longer ranges than VLC.
Key Results from Literature:
- Localization Accuracy: The survey highlights systems achieving accuracy as fine as 2.4 cm to 7 cm, significantly outperforming Wi-Fi or Bluetooth-based indoor positioning. By using LEDs as "optical beacons," cameras can calculate their own 3D coordinates and orientation with centimeter-level precision.
- Data Rates: While generally lower than Li-Fi, experimental OCC setups have reached speeds ranging from a few kbps for simple smartphone apps to 20 Mbps in specialized Intelligent Transportation System (ITS) scenarios.
- Transmission Range: While VLC is often limited to tens of meters, OCC has been demonstrated to work over distances of several kilometers in outdoor line-of-sight conditions.
Challenges and Future Directions
Despite its promise, several "bottlenecks" remain for the research community:
- The Frame Rate Barrier: Most commercial cameras are capped at 30–60 fps. While rolling shutter tricks help, achieving high-speed, flicker-free communication on standard hardware remains difficult.
- Ambient Light Interference: Sunlight and high-intensity lamps can saturate sensors, leading to information loss.
- Mobility and Blockage: OCC requires a strict Line-of-Sight (LoS). Developing robust handover and tracking algorithms (like Kalman filters) is a priority to handle link drops.
- Unexplored MAC Layer: Most research to date focuses on the Physical (PHY) layer. The paper calls for more work on Medium Access Control (MAC) protocols to handle multi-user access and bi-directional communication.
Summary updated