System and method for dynamic content delivery based on gaze analytics

• US 9,958,939 B2
• Filed: 10/31/2014
• Issued: 05/01/2018
• Est. Priority Date: 10/31/2013
• Status: Active Grant

• Current Assignee: NeuroSync, Inc.
• Original Assignee: Sync Think, Inc.
• Inventors: Ghajar, Jamshid
• Primary Examiner(s): DAVIS, TONY O
• Application Number:
  US14/530,598
• Publication Number:
  US 20150130703A1
• Time in Patent Office: 1,278 Days
• Field of Search: 345 7- 9, 345156-158, 600558
• CPC Class Codes: G06F 2203/011 Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus

Abstract

A method of presenting content to a subject based on eye position measurements is provided. The method includes presenting the subject with content. While presenting the content to the subject, one or more of the subject'"'"'s eye positions is measured. The method further includes continuously performing the operations of generating a variability metric using the one or more measured eye positions and comparing the variability metric with a predetermined baseline to determine an attention state of the subject. Upon detection of a change in the attention state, the presentation of the content is modified.

Claims

1. A method of presenting content to a subject based on eye position measurements, comprising:

statically presenting the subject with content;

while statically presenting the content to the subject;

measuring one or more of the subject'"'"'s eye positions;

continuously performing the operations of;

generating a variability metric using the one or more measured eye positions;

determining an attention state of the subject by comparing the variability metric with a predetermined baseline;

detecting a change in the attention state of the subject; and

in accordance with detecting the change in the attention state of the subject from a not attending state to an attending state, modifying the presentation of the content so as to present different content, including different text and/or images, than if the attention state of the subject had remained the not attending state.

2. The method of claim 1, wherein the attention state is one of an about-to-attend state, an attending state, or a not attending state.

3. The method of claim 1, wherein the content includes visual content displayed on a display;

and

the method further includes;

while statically presenting the content, continuously determining a current locus of attention on the display using the one or more measured eye positions; and

in accordance with detecting the change in the attention state from the not attending state to the attending state, determining the different content to be presented in accordance with the determined current locus of attention.

4. The method of claim 3, further including:

using the continuously determined locus of attention, determining a trajectory of the locus of attention;

wherein the presentation of the content is modified in accordance with the determined trajectory of the locus of attention.

5. The method of claim 3, wherein the content includes an advertisement;

and

the method further includes, in accordance with a determination that the attention state is the attending state and that the locus of attention corresponds to the content, generating a cost-per-action metric.

6. The method of claim 5, wherein the generated cost-per-action metric is generated in accordance with a length of time that attention state is the attending state and the locus of attention corresponds to the content.

7. The method of claim 1, wherein:

the content includes a plurality of sub-content tokens; and

the method further includes;

in accordance with a determination that the attention state is the not-attending state, statically presenting a first sub-content token; and

in accordance with a determination that the attention state is the attending state, transitioning through the plurality of sub-content tokens at a predefined rate.

8. The method of claim 5, wherein:

the first sub-content token includes visual content displayed on a first region of a display; and

the plurality of sub-content tokens includes visual content displayed on a second region of the display that is larger than the first region.

9. The method of claim 7, wherein:

the predefined rate is proportional to a numerical value of the variability metric.

10. The method of claim 7, wherein:

the predefined rate is a constant rate of sub-content tokens per unit time.

11. The method of claim 1, wherein:

measuring the one or more of the subject'"'"'s eye positions includes;

measuring the subject'"'"'s right eye positions;

measuring the subject'"'"'s left eye positions; and

generating the variability metric using the one or more measured eye positions includes comparing the measured right eye positions with the measured left eye positions, wherein the variability metric is a disconjugacy metric.

12. The method of claim 11, wherein the disconjugacy metric corresponds to a standard deviation of differences between the subject'"'"'s right eye position and the subject'"'"'s left eye position over a predefined period of time.

13. The method of claim 1, wherein the variability metric is generated based on at least one of:

a variability of eye position error metric;

a variability of eye velocity gain metric;

an eye position error metric; and

a rate or number of saccades metric.

14. The method of claim 1, wherein the predetermined baseline is based on at least one of:

a variability range associated with a preselected group of control subjects;

a demographic of the subject; and

a variability metric for the subject generated from a previous test.

15. The method of claim 1, wherein measuring the subject'"'"'s eye positions is accomplished using one or more video cameras.

16. The method of claim 1, wherein the variability metric is continuously generated using one or more eye measurements measured within a continuously shifting window of time.

17. The method of claim 1, wherein:

the method includes;

in accordance with a determination that the attention state is a not-attending state, statically presenting to the subject a first sub-content item of the content; and

in accordance with a determination that the attention state is an attending state, dynamically presenting to the subject, in sequence, a plurality of sub-content items of the content.

18. The method of claim 1, wherein:

the method includes;

in accordance with a determination that the attention state is a not-attending state, statically presenting to the subject a first sub-content item of the content; and

in accordance with detecting a change in the attention state from the not-attending state to an attending state, transitioning from presenting to the subject the first sub-content item of the content to presenting to the subject a second sub-content item of the content.

19. The method of claim 1, wherein the content includes visual content displayed on a display, and the method includes:

while statically presenting the content, determining a current locus of attention of the subject, the locus of attention comprising a position on the display, determined using the one or more measured eye positions; and

modifying the presentation of the content in accordance with the determined current locus of attention of the subject and the detected change in the attention state of the subject.

20. The method of claim 19, further including:

using the determined locus of attention, determining a trajectory of the locus of attention;

wherein the presentation of the content is modified in accordance with the determined trajectory of the locus of attention.

21. A system for presenting content to a subject based on eye position measurements, comprising:

one or more sensors for measuring one or more of the subject'"'"'s eye positions;

one or more processors;

memory; and

one or more programs stored in the memory, the one or more programs comprising instructions that when executed by the one or more processors cause the system to;

statically present the subject with content;

while statically presenting the content to the subject;

measure one or more of the subject'"'"'s eye positions;

continuously perform the operations of;

generating a variability metric using the one or more measured eye positions;

determining an attention state of the subject by comparing the variability metric with a predetermined baseline;

detect a change in the attention state; and

in accordance with detecting the change in the attention state of the subject from a not attending state to an attending state, modifying the presentation of the content so as to present different content, including different text and/or images, than if the attention state of the subject had remained the not attending state.

22. The system of claim 21, wherein the content includes visual content displayed on a display, the one or more programs include instructions that when executed by the one or more processors cause the system to:

while statically presenting the content, continuously determine a current locus of attention on the display using the one or more measured eye positions; and

in accordance with detecting the change in the attention state from the not attending state to the attending state, selecting the different content to be presented in accordance with the determined current locus of attention.

23. The system of claim 21, wherein the content includes visual content displayed on a display, the one or more programs include instructions that when executed by the one or more processors cause the system to:

while statically presenting the content, determine a current locus of attention of the subject, the locus of attention comprising a position on the display, determined using the one or more measured eye positions; and

modify the presentation of the content in accordance with the determined current locus of attention of the subject and the detected change in the attention state of the subject.

24. The system of claim 23, wherein the one or more programs include instructions that when executed by the one or more processors cause the system to:

determine a trajectory of the locus of attention using the determined locus of attention; and

modify the presentation of the content accordance with the determined trajectory of the locus of attention.

25. The system of claim 21, wherein:

measuring the one or more of the subject'"'"'s eye positions includes;

measuring the subject'"'"'s right eye positions;

measuring the subject'"'"'s left eye positions; and

generating the variability metric using the one or more measured eye positions includes comparing the measured right eye positions with the measured left eye positions, wherein the variability metric is a disconjugacy metric.

26. The system of claim 25, wherein the disconjugacy metric corresponds to a standard deviation of differences between the subject'"'"'s right eye position and the subject'"'"'s left eye position over a predefined period of time.

27. The system of claim 21, wherein the variability metric is generated based on at least one of:

a variability of eye position error metric;

a variability of eye velocity gain metric;

an eye position error metric; and

a rate or number of saccades metric.

28. The system of claim 21, wherein the predetermined baseline is based on at least one of:

a variability range associated with a preselected group of control subjects;

a demographic of the subject; and

a variability metric for the subject generated from a previous test.

29. The system of claim 21, wherein the one or more sensors comprise one or more video cameras, and measuring the subject'"'"'s eye positions is accomplished using the one or more video cameras.

30. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic system with one or more sensors for measuring eye position, cause the electronic system to:

statically present the subject with content;

while statically presenting the content to the subject;

measure one or more of the subject'"'"'s eye positions;

continuously perform the operations of;

generating a variability metric using the one or more measured eye positions;

determining an attention state of the subject by comparing the variability metric with a predetermined baseline;

detect a change in the attention state; and

in accordance with detecting the change in the attention state of the subject from a not attending state to an attending state, modify the presentation of the content so as to present different content, including different text and/or images, than if the attention state of the subject had remained the not attending state.

31. The non-transitory computer readable storage medium of claim 30, wherein the content includes visual content displayed on a display, and the one or more programs include instructions that when executed by the electronic system, cause the electronic system to:

while statically presenting the content, continuously determine a current locus of attention on the display using the one or more measured eye positions; and

in accordance with detecting the change in the attention state from the not attending state to the attending state, selecting the different content to be presented in accordance with the determined current locus of attention.

32. The non-transitory computer readable storage medium of claim 30, wherein the content includes visual content displayed on a display, the one or more programs include instructions that when executed by the one or more processors cause the system to:

while statically presenting the content, determine a current locus of attention of the subject, the locus of attention comprising a position on the display, determined using the one or more measured eye positions; and

modify the presentation of the content in accordance with the determined current locus of attention of the subject and the detected change in the attention state of the subject.

33. The non-transitory computer readable storage medium of claim 32, wherein the one or more programs include instructions that when executed by the one or more processors cause the system to:

determine a trajectory of the locus of attention using the determined locus of attention; and

modify the presentation of the content accordance with the determined trajectory of the locus of attention.

34. The non-transitory computer readable storage medium of claim 30, wherein:

measuring the one or more of the subject'"'"'s eye positions includes;

measuring the subject'"'"'s right eye positions;

measuring the subject'"'"'s left eye positions; and

generating the variability metric using the one or more measured eye positions includes comparing the measured right eye positions with the measured left eye positions, wherein the variability metric is a disconjugacy metric.

35. The non-transitory computer readable storage medium of claim 34, wherein the disconjugacy metric corresponds to a standard deviation of differences between the subject'"'"'s right eye position and the subject'"'"'s left eye position over a predefined period of time.

36. The non-transitory computer readable storage medium of claim 30, wherein the variability metric is generated based on at least one of:

a variability of eye position error metric;

a variability of eye velocity gain metric;

an eye position error metric; and

a rate or number of saccades metric.

37. The non-transitory computer readable storage medium of claim 30, wherein the predetermined baseline is based on at least one of:

a variability range associated with a preselected group of control subjects;

a demographic of the subject; and

a variability metric for the subject generated from a previous test.

38. The non-transitory computer readable storage medium of claim 30, wherein the one or more sensors comprise one or more video cameras, and measuring the subject'"'"'s eye positions is accomplished using the one or more video cameras.