Timezone: »

 
Poster
SCAMPS: Synthetics for Camera Measurement of Physiological Signals
Daniel McDuff · Miah Wander · Xin Liu · Brian Hill · Javier Hernandez · Jonathan Lester · Tadas Baltrusaitis

Thu Dec 01 02:00 PM -- 04:00 PM (PST) @ Hall J #1024
in Poster Session 6 »

The use of cameras and computational algorithms for noninvasive, low-cost and scalable measurement of physiological (e.g., cardiac and pulmonary) vital signs is very attractive. However, diverse data representing a range of environments, body motions, illumination conditions and physiological states is laborious, time consuming and expensive to obtain. Synthetic data have proven a valuable tool in several areas of machine learning, yet are not widely available for camera measurement of physiological states. Synthetic data offer "perfect" labels (e.g., without noise and with precise synchronization), labels that may not be possible to obtain otherwise (e.g., precise pixel level segmentation maps) and provide a high degree of control over variation and diversity in the dataset. We present SCAMPS, a dataset of synthetics containing 2,800 videos (1.68M frames) with aligned cardiac and respiratory signals and facial action intensities. The RGB frames are provided alongside segmentation maps and precise descriptive statistics about the underlying waveforms, including inter-beat interval, heart rate variability, and pulse arrival time. Finally, we present baseline results training on these synthetic data and testing on real-world datasets to illustrate generalizability.

Keywords: Computer Vision · Health · dataset · Physiology · Synthetics

Author Information

Daniel McDuff (Google)
Miah Wander
Xin Liu (University of Washington)
Brian Hill (Optum Labs)
Javier Hernandez (Massachusetts Institute of Technology)
Jonathan Lester
Tadas Baltrusaitis (Carnegie Mellon University)

More from the Same Authors