VISUAL ATTENTION AND EMOTIONAL RESPONSE DETECTION AND DISPLAY SYSTEM

• US 20070265507A1
• Filed: 03/13/2007
• Published: 11/15/2007
• Est. Priority Date: 03/13/2006
• Status: Abandoned Application

• Current Assignee: iMotions - Emotion Technology A/S
• Original Assignee: iMotions - Emotion Technology A/S
• Inventors: de Lemos, Jakob
• Application Number:
  US11/685,552
• Publication Number:
  US 20070265507A1
• Time in Patent Office: Days
• US Class Current: 600/300
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: A61B 5/16 Devices for psychotechnics using teaching or educational appliances G09B1/00 - G09B7/00; Testing reaction times ; Devices for evaluating the psychological state
• CPC Class Codes: A61B 5/163 by tracking eye movement, gaze, or pupil change
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: G06V 40/19 Sensors therefor

Abstract

The invention is a system and method for determining visual attention, and supports the eye tracking measurements with other physiological signal measurements like emotions. The system and method of the invention is capable of registering stimulus related emotions from eye-tracking data. An eye tracking device of the system and other sensors collect eye properties and/or other physiological properties which allows a subject'"'"'s emotional and visual attention to be observed and analyzed in relation to stimuli.

Claims

1. A computer-implemented method for detecting a subject'"'"'s emotional response to one or more stimuli, comprising:

presenting at least one stimulus to a subject;

collecting physiological data from the subject while the at least one stimulus is presented to the subject to enable determination of an emotional response;

processing the physiological data, via a processor, to determine visual attention information;

generating emotional response information in response to the at least one stimulus; and

generating, for the at least one stimulus, a representation of the determined visual attention information, and a representation of the generated emotional response information.

2. The method of claim 1, wherein the at least one stimulus is a visual stimulus.

3. The method of claim 2, wherein the visual stimulus comprises at least one of text, a picture, artwork, a movie, a multimedia presentation, or interactive content.

4. The method of claim 2, wherein the visual stimulus comprises at least one of an advertisement, or a commercial.

5. The method of claim 2, wherein the visual stimulus comprises a depiction of a product.

6. The method of claim 2, wherein the visual stimulus comprises product packaging.

7. The method of claim 1, wherein the at least one stimulus comprises a visual stimulus and at least one non-visual stimulus.

8. The method of claim 1, wherein the physiological data includes one or more of pupil data, blink data, or gaze data.

9. The method of claim 1, wherein the physiological data is collected via an eye-tracking device.

10. The method of claim 1, wherein the representation of the determined visual attention information and the representation of the determined emotional response information are output to a display or printer.

11. The method of claim 1, wherein determining the visual attention information comprises:

determining one or more fixation points associated with the at least one stimulus, wherein a fixation point comprises an area on which the subject visually focused for at least a predetermined amount of time.

12. The method of claim 11, wherein the representation of the determined visual attention information comprises a gaze plot superimposed on the at least one stimulus presented to the subject, and wherein the one or more fixation points are highlighted so as to distinguish the one or more fixation points from the remainder of the at least one stimulus.

13. The method of claim 12, wherein the representation of the generated emotional response information includes emotional information corresponding to each of the one or more highlighted fixation points.

14. The method of claim 11, further comprising:

aggregating the one or more fixation points so as to identify one or more attention points.

15. The method of claim 14, further comprising:

aggregating the one or more fixation points with temporal ordering so as to identify one or more attention points.

16. The method of claim 15, further comprising:

numbering the one or more identified attention points to indicate the temporal ordering.

17. The method of claim 11, furthering comprising:

determining if the emotional response information corresponds to any of the one or more fixation points so as to identify one or more interest points.

18. The method of claim 17, wherein the representation of the generated emotional response information includes an indication of emotional valence and emotional arousal for each identified interest point.

19. The method of claim 1, wherein emotional response information includes at least one of an emotional valence component or an emotional arousal component.

20. The method of claim 1, wherein the representation of the generated emotional response information includes emotional information indicative of an overall emotional response to the at least one stimulus.

21. The method of claim 1, further comprising:

prompting the subject to answer one or more survey questions corresponding to the at least one stimulus presented to the subject.

22. The method of claim 1, wherein presenting the at least one stimulus to the subject and collecting the physiological data from the subject occurs at a kiosk;

and wherein processing the physiological data to determine visual attention information, and generating emotional response information occurs at a processing center located remotely from the kiosk.

23. The method of claim 1, wherein the at least one stimulus comprises an advertisement provided by an entity, and wherein the representation of the determined visual attention information and the representation of the generated emotional response information are provided to the entity for evaluation.

24. The method of claim 1, wherein the at least one stimulus is presented to a plurality of subjects, and wherein the representation of the determined visual attention information and the representation of the generated emotional response information each depict an aggregate of the visual attention information and emotional response information determined for the plurality of subjects.

25. A computer-implemented system for detecting a subject'"'"'s emotional response to one or more stimuli, comprising:

means for presenting at least one stimulus to a subject;

means for collecting physiological data from the subject while the at least one stimulus is presented to the subject to enable determination of an emotional response;

means for processing the physiological data to determine visual attention information;

means for generating emotional response information in response to the at least one stimulus; and

means for generating, for the at least one stimulus, a representation of the determined visual attention information, and a representation of the generated emotional response information.

26. The system of claim 25, wherein the at least one stimulus is a visual stimulus.

27. The system of claim 26, wherein the visual stimulus comprises at least one of text, a picture, artwork, a movie, a multimedia presentation, or interactive content.

28. The system of claim 26, wherein the visual stimulus comprises at least one of an advertisement, or a commercial.

29. The system of claim 26, wherein the visual stimulus comprises a depiction of a product.

30. The system of claim 26, wherein the visual stimulus comprises product packaging.

31. The system of claim 25, wherein the at least one stimulus comprises a visual stimulus and at least one non-visual stimulus.

32. The system of claim 25, wherein the physiological data includes one or more of pupil data, blink data, or gaze data.

33. The system of claim 25, wherein the physiological data is collected via an eye-tracking device.

34. The system of claim 25, wherein the representation of the determined visual attention information and the representation of the determined emotional response information are output to a display or printer.

35. The system of claim 25, wherein the means for processing the physiological data to determine visual attention information further comprises means for determining one or more fixation points associated with the at least one stimulus, wherein a fixation point comprises an area on which the subject visually focused for at least a predetermined amount of time.

36. The system of claim 35, wherein the representation of the determined visual attention information comprises a gaze plot superimposed on the at least one stimulus presented to the subject, and wherein the one or more fixation points are highlighted so as to distinguish the one or more fixation points from the remainder of the at least one stimulus.

37. The system of claim 36, wherein the representation of the generated emotional response information includes emotional information corresponding to each of the one or more highlighted fixation points.

38. The system of claim 35, further comprising:

means for aggregating the one or more fixation points so as to identify one or more attention points.

39. The system of claim 38, further comprising:

means for aggregating the one or more fixation points with temporal ordering so as to identify one or more attention points.

40. The system of claim 39, further comprising:

means for numbering the one or more identified attention points to indicate the temporal ordering.

41. The system of claim 35, furthering comprising:

means for determining if the emotional response information corresponds to any of the one or more fixation points so as to identify one or more interest points.

42. The system of claim 41, wherein the representation of the generated emotional response information includes an indication of emotional valence and emotional arousal for each identified interest point.

43. The system of claim 25, wherein emotional response information includes at least one of an emotional valence component or an emotional arousal component.

44. The system of claim 25, wherein the representation of the generated emotional response information includes emotional information indicative of an overall emotional response to the at least one stimulus.

45. The system of claim 25, further comprising:

means for prompting the subject to answer one or more survey questions corresponding to the at least one stimulus presented to the subject.

46. The system of claim 25, wherein the means for presenting the at least one stimulus to the subject and the means for collecting the physiological data from the subject are located at a kiosk;

and wherein means for processing the physiological data to determine visual attention information, and the means for generating emotional response information are located at a processing center remote from the kiosk.

47. The system of claim 25, wherein the at least one stimulus comprises an advertisement provided by an entity, and wherein the representation of the determined visual attention information and the representation of the generated emotional response information are provided to the entity for evaluation.

48. The system of claim 25, wherein the at least one stimulus is presented to a plurality of subjects, and wherein the representation of the determined visual attention information and the representation of the generated emotional response information each depict an aggregate of the visual attention information and emotional response information determined for the plurality of subjects.