CRVR: Continuous Representation-Driven Video Frame Modulation Against rPPG Heart Rate Measurement

Menglin Zhang, Xiaoxin Guo, Bohao Qu, Xiaofeng Cao, Di Lin, Shuifa Sun, Ivor Tsang, Qing GuoOpenReview 2025 · Submission to ICLR 2025 · Withdrawn · OpenReview

Its authors withdrew this paper, so there is no full text to read or summarize.

Abstract

Facial video-based remote physiological measurement (rPPG) has gained prominence for its ability to non-invasively estimate vital signs such as heart rate (HR).The foundation of rPPG lies in using a camera to record facial videos at a certain frame rate, allowing the capture of rapid skin color changes necessary for HR measurement. Inspired by this property, we identified a new task, that is, to embed malicious information into facial videos by subtly modulating frames and generating frames corresponding to the modified rate. With this task, we can mislead state-of-the-art rPPG HR methods through natural and imperceptible frame modulation changes, aiming for two objectives: testing the resilience of rPPG methods against frame modulation variations and safeguarding heart rate data, which is crucial for individual privacy. However, such a task is non-trivial and should be capable of automatically adapting to different input videos and generating natural, imperceptible frame modulation perturbations along with frames corresponding to the modified rate. To address these challenges, we propose Continuous Representation-driven Video Resampling (CRVR), which targets precise manipulation of frame timing to subtly skew perceived HR measurements. Specifically, the CRVR method consists of two modules: Variable Frame Rate Video Resampling (VFRVR), which automatically determines the optimal resampling strategy for each frame, and Continuous Video Frame Generation (CVFG), which generates frames corresponding to the modified rate and seamlessly injects them back into the video. Extensive testing on UBFC-rPPG and PURE datasets reveals that our CRVR method successfully produces realistic, imperceptible adversarial videos that effectively mislead three different rPPG-based heart rate detection technologies.
BibTeX
@misc{zhang2025crvr,
  author = {Menglin Zhang and Xiaoxin Guo and Bohao Qu and Xiaofeng Cao and Di Lin and Shuifa Sun and Ivor Tsang and Qing Guo},
  title = {{CRVR: Continuous Representation-Driven Video Frame Modulation Against rPPG Heart Rate Measurement}},
  year = {2025},
  url = {https://openreview.net/forum?id=uUsfvsrkOw},
  howpublished = {OpenReview},
  note = {Submitted to ICLR 2025},
}

Loading related content...

Figure