System and method for camera-based heart rate tracking
First Claim
1. A method for camera-based heart rate tracking of a human subject, the method comprising:
- receiving a captured image sequence of light re-emitted from the skin of the human subject;
determining, using a machine learning model trained with a hemoglobin concentration (HC) changes training set, bit values from a set of bitplanes in the captured image sequence that represent the HC changes of the subject, the set of bitplanes being those that are determined to approximately maximize a signal-to-noise ratio (SNR), the HC changes training set comprising bit values from each bitplane of images captured from a set of subjects for which heart rate is known;
determining a facial blood flow data signal for each of a plurality of predetermined regions of interest (ROIs) of the subject captured by the images based on the HC changes;
applying a band-pass filter of a passband approximating the heart rate to each of the blood flow data signals;
applying a Hilbert transform to each of the blood flow data signals;
adjusting the blood flow data signals from revolving phase-angles into linear phase segments;
determining an instantaneous heart rate for each the blood flow data signals;
applying a weighting to each of the instantaneous heart rates;
averaging the weighted instantaneous heart rates; and
outputting the average heart rate.
1 Assignment
0 Petitions
Accused Products
Abstract
A system and method for camera-based heart rate tracking. The method includes: determining bit values from a set of bitplanes in a captured image sequence that represent the HC changes; determining a facial blood flow data signal for each of a plurality of predetermined regions of interest (ROIs) of the subject captured by the images based on the HC changes; applying a band-pass filter of a passband approximating the heart rate to each of the blood flow data signals; applying a Hilbert transform to each of the blood flow data signals; adjusting the blood flow data signals from revolving phase-angles into linear phase segments; determining an instantaneous heart rate for each the blood flow data signals; applying a weighting to each of the instantaneous heart rates; and averaging the weighted instantaneous heart rates.
4 Citations
20 Claims
-
1. A method for camera-based heart rate tracking of a human subject, the method comprising:
-
receiving a captured image sequence of light re-emitted from the skin of the human subject; determining, using a machine learning model trained with a hemoglobin concentration (HC) changes training set, bit values from a set of bitplanes in the captured image sequence that represent the HC changes of the subject, the set of bitplanes being those that are determined to approximately maximize a signal-to-noise ratio (SNR), the HC changes training set comprising bit values from each bitplane of images captured from a set of subjects for which heart rate is known; determining a facial blood flow data signal for each of a plurality of predetermined regions of interest (ROIs) of the subject captured by the images based on the HC changes; applying a band-pass filter of a passband approximating the heart rate to each of the blood flow data signals; applying a Hilbert transform to each of the blood flow data signals; adjusting the blood flow data signals from revolving phase-angles into linear phase segments; determining an instantaneous heart rate for each the blood flow data signals; applying a weighting to each of the instantaneous heart rates; averaging the weighted instantaneous heart rates; and outputting the average heart rate. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A system for camera-based heart rate tracking of a human subject, the system comprising one or more processors and a data storage device, the one or more processors configured to execute:
-
a TOI module to receive a captured image sequence of light re-emitted from the skin of a human subject, the TOI module determines, using a machine learning model trained with a hemoglobin concentration (HC) changes training set, bit values from a set of bitplanes in the captured image sequence that represent the HC changes of the subject, the set of bitplanes being those that are determined to approximately maximize a signal-to-noise ratio (SNR), the HC changes training set comprising bit values from each bitplane of images captured from a set of subjects for which heart rate is known, the TOI module determines a facial blood flow data signal for each of a plurality of predetermined regions of interest (ROIs) of the subject captured by the images based on the HC changes; a filtering module to apply a band-pass filter of a passband approximating the heart rate to each of the blood flow data signals; a Hilbert transform module to apply a Hilbert transform to each of the blood flow data signals; an adjustment module to adjust the blood flow data signals from revolving phase-angles into linear phase segments; a derivative module to determine an instantaneous heart rate for each the blood flow data signals; a weighting module to apply a weighting to each of the instantaneous heart rates; a summation module to average the weighted instantaneous heart rates; and an output module to output the average heart rate. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20)
-
Specification