MENTAL STATE ANALYSIS USING WEB SERVICES

• US 20110301433A1
• Filed: 06/06/2011
• Published: 12/08/2011
• Est. Priority Date: 06/07/2010
• Status: Abandoned Application

• Current Assignee: Affectiva, Inc. (Smart Eye AB)
• Original Assignee: Affectiva, Inc. (Smart Eye AB)
• Inventors: Picard, Rosalind Wright, Wilder-Smith, Oliver Orion, Sadowsky, Richard Scott, el Kaliouby, Rana, Turcot, Panu James, Zheng, Zhihong
• Application Number:
  US13/153,745
• Publication Number:
  US 20110301433A1
• Time in Patent Office: Days
• US Class Current: 600/300
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: A61B 5/02055 Simultaneously evaluating both cardiovascular condition and temperature
• CPC Class Codes: A61B 5/02405 Determining heart rate variability
• CPC Class Codes: A61B 5/0533 Measuring galvanic skin response
• CPC Class Codes: A61B 5/08 Detecting, measuring or recording devices for evaluating the respiratory organs A61B5/0205 takes precedence
• CPC Class Codes: A61B 5/11 Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb for measuring pulse A61B5/02 ;A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: G06Q 30/0271 Personalized advertisement
• CPC Class Codes: G16H 20/70 relating to mental therapies, e.g. psychological therapy or autogenous training
• CPC Class Codes: G16H 40/67 for remote operation

Abstract

Analysis of mental states is provided using web services to enable data analysis. Data is captured for an individual where the data includes facial information and physiological information. Analysis is performed on a web service and the analysis is received. The mental states of other people may be correlated to the mental state for the individual. Other sources of information may be aggregated where the information may be used to analyze the mental state of the individual. Analysis of the mental state of the individual or group of individuals is rendered for display.

Claims

1. A computer implemented method for analyzing mental states comprising:

capturing data on an individual into a computer system wherein the data provides information for evaluating a mental state of the individual;

receiving analysis from a web service wherein the analysis is based on the data on the individual which was captured; and

rendering an output which describes the mental state of the individual based on the analysis which was received.

2. The method of claim 1 wherein the data on the individual includes one of a group comprising facial expressions, physiological information, and accelerometer readings.

3. The method of claim 2 wherein the facial expressions further comprise head gestures.

4. The method of claim 2 wherein the physiological information includes one of a group comprising electrodermal activity, heart rate, heart rate variability, and respiration.

5. The method of claim 2 wherein the physiological information is collected without contacting the individual.

6. The method of claim 1 wherein the mental state is one of a cognitive state and an emotional state.

7. The method of claim 1 wherein the web service comprises an interface which includes a server that is remote to the individual and cloud-based storage.

8. The method of claim 1 further comprising indexing the data on the individual through the web service.

9. The method of claim 8 wherein the indexing includes categorization based on valence and arousal information.

10. The method of claim 1 further comprising receiving analysis information on a plurality of other people wherein the analysis information allows evaluation of a collective mental state of the plurality of other people.

11. The method of claim 10 wherein the analysis information includes correlation for the mental state of the plurality of other people to the data which was captured on the mental state of the individual.

12. The method of claim 11 wherein the correlation is based on metadata from the individual and metadata from the plurality of other people.

13. The method of claim 1 wherein the analysis which is received from the web service is based on specific access rights.

14. The method of claim 1 further comprising sending a request to the web service for the analysis.

15. The method of claim 14 wherein the analysis is generated just in time based on a request for the analysis.

16. The method of claim 1 further comprising sending a subset of the data which was captured on the individual to the web service.

17. The method of claim 1 wherein the rendering is based on data which is received from the web service.

18. The method of claim 17 wherein the data which is received includes a serialized object in a form of JavaScript Object Notation (JSON).

19. The method of claim 18 further comprising deserializing the serialized object into a form for a JavaScript object.

20. The method of claim 1 wherein the rendering further comprises recommending a course of action based on the mental state of the individual.

21. The method of claim 20 wherein the recommending includes one of a group comprising modifying a question queried to a focus group, changing an advertisement on a web page, editing a movie which was viewed to remove an objectionable section, changing direction of an electronic game, changing a medical consultation presentation, and editing a confusing section of an internet-based tutorial.

22. A computer program product embodied in a non-transitory computer readable medium for analyzing mental states, the computer program product comprising:

code for capturing data on an individual into a computer system wherein the data provides information for evaluating a mental state of the individual;

code for receiving analysis from a web service wherein the analysis is based on the data on the individual which was captured; and

code for rendering an output which describes the mental state of the individual based on the analysis which was received.

23. A system for analyzing mental states comprising:

a memory which stores instructions;

one or more processors attached to the memory wherein the one or more processors, when executing the instructions which are stored, are configured to;

capture data on an individual wherein the data provides information for evaluating a mental state of the individual;

receive analysis from a web service wherein the analysis is based on the data on the individual which was captured; and

render an output which describes the mental state of the individual based on the analysis which was received.