Detecting physiological responses based on multispectral data from head-mounted cameras
First Claim
1. A system configured to detect a physiological response, comprising:
- an inward-facing head-mounted thermal camera (CAM) configured to take thermal measurements of a first region of interest (THROI1) on a user'"'"'s face;
an inward-facing head-mounted visible-light camera (VCAM) configured to take images of a second region of interest (IMROI2) on the face;
wherein the first region of interest (ROI1) and the second region of interest (ROI2) overlap; and
a computer configured to detect the physiological response based on THROI1 and IMROI2.
1 Assignment
0 Petitions
Accused Products
Abstract
Described herein are systems and methods for detecting a physiological response based on multispectral data. In one embodiment, a system includes an inward-facing head-mounted thermal camera (CAM) that takes thermal measurements of a first region of interest (THROI1) on a user'"'"'s face, and an inward-facing head-mounted visible-light camera (VCAM) that takes images of a second region of interest (IMROI2) on the face. The first and second regions of interest overlap, and the system includes a computer that detects the physiological response based on THROI1, IMROI2, and a model. Optionally, the model was trained based on previous THROI1 and IMROI2 of the user taken during different days. Optionally, the physiological response is indicative of an occurrence of an emotional state of the user, such as joy, fear, sadness or anger.
-
Citations
23 Claims
-
1. A system configured to detect a physiological response, comprising:
-
an inward-facing head-mounted thermal camera (CAM) configured to take thermal measurements of a first region of interest (THROI1) on a user'"'"'s face; an inward-facing head-mounted visible-light camera (VCAM) configured to take images of a second region of interest (IMROI2) on the face; wherein the first region of interest (ROI1) and the second region of interest (ROI2) overlap; and a computer configured to detect the physiological response based on THROI1 and IMROI2. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20)
-
-
21. A method for detecting a physiological response, comprising:
-
taking, using an inward-facing head-mounted thermal camera located at most 15 cm from a user'"'"'s face, thermal measurements of a first region of interest (THROI1) on the face; taking, using an inward-facing head-mounted visible-light camera located at most 15 cm from the face, images of a second region of interest (IMROI2) on the face;
wherein ROI1 and ROI2 overlap;generating feature values based on THROI1 and IMROI2; and utilizing a machine learning-based model to detect the physiological response based on the feature values;
wherein the machine learning-based model was trained based on previous THROI1 and IMROI2 taken during different days. - View Dependent Claims (22, 23)
-
Specification