Collection of affect data from multiple mobile devices
First Claim
1. A computer-implemented method for mental state analysis comprising:
- obtaining mental state data which is collected on an individual from multiple sources wherein the multiple sources include at least two sources of facial image data, wherein at least one of the facial image data sources collects facial image data intermittently while the individual is looking toward a camera, and wherein the multiple sources include at least one mobile device, including a cell phone, a tablet computer, or a wearable device;
aggregating, using one or more processors, the mental state data from the multiple sources;
obtaining analysis of the mental state data which is aggregated from the multiple sources, wherein the analysis results in mental state analysis;
interpolating the mental state analysis where the mental state data collected is intermittent, wherein the interpolating generates interpolated data for time periods during which mental state data was not collected from one or more of the multiple sources; and
rendering an output based on the analysis of the mental state data.
1 Assignment
0 Petitions
Accused Products
Abstract
A user interacts with various pieces of technology to perform numerous tasks and activities. Reactions can be observed and mental states inferred from these performances. Multiple devices, including mobile devices, can observe and record or transmit a user'"'"'s mental state data. The mental state data collected from the multiple devices can be used to analyze the mental states of the user. The mental state data can be in the form of facial expressions, electrodermal activity, movements, or other detectable manifestations. Multiple cameras on the multiple devices can be usefully employed to collect facial data. An output can be rendered based on an analysis of the mental state data.
-
Citations
35 Claims
-
1. A computer-implemented method for mental state analysis comprising:
-
obtaining mental state data which is collected on an individual from multiple sources wherein the multiple sources include at least two sources of facial image data, wherein at least one of the facial image data sources collects facial image data intermittently while the individual is looking toward a camera, and wherein the multiple sources include at least one mobile device, including a cell phone, a tablet computer, or a wearable device; aggregating, using one or more processors, the mental state data from the multiple sources; obtaining analysis of the mental state data which is aggregated from the multiple sources, wherein the analysis results in mental state analysis; interpolating the mental state analysis where the mental state data collected is intermittent, wherein the interpolating generates interpolated data for time periods during which mental state data was not collected from one or more of the multiple sources; and rendering an output based on the analysis of the mental state data. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35)
-
-
21. A computer program product embodied in a non-transitory computer readable medium for mental state analysis, the computer program product comprising code which causes one or more processors to perform operations of:
-
obtaining mental state data which is collected on an individual from multiple sources wherein the multiple sources include at least two sources of facial image data, wherein at least one of the facial image data sources collects facial image data intermittently while the individual is looking toward a camera, and wherein the multiple sources include at least one mobile device, including a cell phone, a tablet computer, or a wearable device; aggregating the mental state data from the multiple sources; obtaining analysis of the mental state data which is aggregated from multiple sources, wherein the analysis results in mental state analysis; interpolating the mental state analysis where the mental state data collected is intermittent, wherein the interpolating generates interpolated data for time periods during which mental state data was not collected from one or more of the multiple sources; and rendering an output based on the analysis of the mental state data.
-
-
22. A computer system for mental state analysis comprising:
-
a memory which stores instructions; one or more processors coupled to the memory wherein the one or more processors, when executing the instructions which are stored, are configured to; obtain mental state data which is collected on an individual from multiple sources wherein the multiple sources include at least two sources of facial image data, wherein at least one of the facial image data sources collects facial image data intermittently while the individual is looking toward a camera, and wherein the multiple sources include at least one mobile device, including a cell phone, a tablet computer, or a wearable device; aggregate the mental state data from the multiple sources; obtain analysis of the mental state data which is aggregated from multiple sources, wherein the analysis results in mental state analysis; interpolate the mental state analysis where the mental state data collected is intermittent, wherein the interpolation generates interpolated data for time periods during which mental state data was not collected from one or more of the multiple sources; and render an output based on the analysis of the mental state data.
-
Specification