Mental state mood analysis using heart rate collection based on video imagery
First Claim
1. A computer-implemented method for mental state analysis comprising:
- obtaining video of an individual;
analyzing the video to determine heart rate information, wherein the analyzing includes;
identifying a face of the individual in a portion of the video;
separating pixels from the video of the individual, into at least a green pixel temporal intensity trace;
training a statistical classifier, wherein the training is learned from a data set consisting of human blood volume pulse synchronized face videos; and
recognizing a pulse, from the video of the individual, using the statistical classifier, by learning patterns of variability in the mean of the pixel temporal intensity trace;
correlating the heart rate information to a stimulus that the individual is encountering; and
inferring, using one or more processors, mental states of the individual based on the heart rate information.
1 Assignment
0 Petitions
Accused Products
Abstract
Video of one or more people is obtained and analyzed. Heart rate information is determined from the video. The heart rate information is used in mental state analysis. The heart rate information and resulting mental state analysis are correlated to stimuli, such as digital media, which is consumed or with which a person interacts. The heart rate information is used to infer mental states. The inferred mental states are used to output a mood measurement. The mental state analysis, based on the heart rate information, is used to optimize digital media or modify a digital game. Training is employed in the analysis. Machine learning is engaged to facilitate the training.
-
Citations
29 Claims
-
1. A computer-implemented method for mental state analysis comprising:
-
obtaining video of an individual; analyzing the video to determine heart rate information, wherein the analyzing includes; identifying a face of the individual in a portion of the video; separating pixels from the video of the individual, into at least a green pixel temporal intensity trace; training a statistical classifier, wherein the training is learned from a data set consisting of human blood volume pulse synchronized face videos; and recognizing a pulse, from the video of the individual, using the statistical classifier, by learning patterns of variability in the mean of the pixel temporal intensity trace; correlating the heart rate information to a stimulus that the individual is encountering; and inferring, using one or more processors, mental states of the individual based on the heart rate information. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27)
-
-
28. A computer program product embodied in a non-transitory computer readable medium for mental state analysis, the computer program product comprising code which causes one or more processors to perform operations of:
-
obtaining video of an individual; analyzing the video to determine heart rate information, wherein the analyzing includes; identifying a face of the individual in a portion of the video; separating pixels from the video of the individual, into at least a green pixel temporal intensity trace; training a statistical classifier, wherein the training is learned from a data set consisting of human blood volume pulse synchronized face videos; and recognizing a pulse, from the video of the individual, using the statistical classifier, by learning patterns of variability in the mean of the pixel temporal intensity trace; correlating the heart rate information to a stimulus that the individual is encountering; and inferring mental states of the individual based on the heart rate information.
-
-
29. A computer system for mental state analysis comprising:
-
a memory which stores instructions; one or more processors attached to the memory wherein the one or more processors, when executing the instructions which are stored, are configured to; obtain video of an individual; analyze the video to determine heart rate information, wherein analyzing includes; identifying a face of the individual in a portion of the video; separating pixels from the video of the individual into at least a green pixel temporal intensity trace; training a statistical classifier, wherein the training is learned from a data set consisting of human blood volume pulse synchronized face videos; and recognizing a pulse, from the video of the individual, using the statistical classifier, by learning patterns of variability in the mean of the pixel temporal intensity trace; correlate the heart rate information to a stimulus that the individual is encountering; and infer mental states of the individual based on the heart rate information.
-
Specification