Systems and methods for evaluating human eye tracking

• US 8,864,310 B2
• Filed: 03/14/2013
• Issued: 10/21/2014
• Est. Priority Date: 05/01/2012
• Status: Active Grant

• Current Assignee: RightEye, LLC
• Original Assignee: RightEye, LLC
• Inventors: Gross, Adam Todd, Hunfalvay, Melissa
• Primary Examiner(s): PINKNEY, DAWAYNE
• Application Number:
  US13/830,136
• Publication Number:
  US 20130293844A1
• Time in Patent Office: 586 Days
• Field of Search: 351/209, 351200-201, 351/203, 351/205, 351210-211, 351/221, 351/246, 351/222, 351/237, 351/223, 351/239
• US Class Current: 351/209
• CPC Class Codes: A61B 2503/10 Athletes
• CPC Class Codes: A61B 3/0025 characterised by electronic signal processing, e.g. eye models
• CPC Class Codes: A61B 3/0033 characterised by user input arrangements
• CPC Class Codes: A61B 3/0041 characterised by display arrangements
• CPC Class Codes: A61B 3/0058 for multiple images
• CPC Class Codes: A61B 3/0091 Fixation targets for viewing direction
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: A61B 3/14 Arrangements specially adapted for eye photography apparatus or arrangements for taking photographs per se G03B
• CPC Class Codes: A61B 5/0013 Medical image data A61B1/00011, A61B6/56, A61B8/56 take precedence
• CPC Class Codes: A61B 5/1114 Tracking parts of the body
• CPC Class Codes: A61B 5/1124 Determining motor skills
• CPC Class Codes: A61B 5/163 by tracking eye movement, gaze, or pupil change
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/6803 Head-worn items, e.g. helmets, masks, headphones or goggles

Abstract

Systems and methods are disclosed for evaluating human eye tracking. One method includes receiving data representing the location of and/or information tracked by an individual'"'"'s eye or eyes before, during, or after the individual performs a task; identifying a temporal phase or a biomechanical phase of the task performed by the individual; identifying a visual cue in the identified temporal phase or biomechanical phase; and scoring the tracking of the individual'"'"'s eye or eyes by comparing the data to the visual cue.

Claims

1. A method comprising:

receiving data representing a location where an individual'"'"'s eye or eyes are looking before, during, or after the individual performs a task involving movement of the individual relative to a physical environment;

identifying a visual cue of where the individual should be looking during the task, at a point that is located relative to an object in the physical environment and that is associated with a segment of movement of the individual and a biomechanical phase of another individual or an object in the physical environment, the visual cue being identified based on historical or statistical analysis of other individuals'"'"' performance of the task and being unknown to the individual during the individual'"'"'s performance of the task;

generating a score of a location where the individual'"'"'s eye or eyes are looking relative to the location of the visual cue during the segment of movement, based on analysis of the received data relative to the visual cue;

informing the individual of the location of the visual cue to inform the individual where he or she should be looking during the task;

receiving data representing a location where the individual'"'"'s eye or eyes are looking before, during, or after the individual performs second or subsequent iterations of the task with knowledge of the location of the visual cue; and

updating the score or generating a new score based on locations where the individual'"'"'s eye or eyes are looking relative to the location of the visual cue during segments of movement involved in the second or subsequent iterations of the task.

2. The method of claim 1, wherein the data is one or more of:

image data of the individual'"'"'s eye or eyes, coordinate data of the location of the individual'"'"'s eye or eyes, and coordinate data of a location on which the individual'"'"'s eye or eyes were focused.

3. The method of claim 1, wherein the data is received, either locally or over a network, from a wearable eye tracker configured to obtain the data by imaging the individual'"'"'s eye or eyes.

4. The method of claim 1, further comprising:

determining a target range associated with the visual cue, the target range defining an ideal viewing area around the visual cue; and

generating a score of the location where the individual'"'"'s eye or eyes are looking by scoring where the individual'"'"'s eye or eyes are looking relative to the determined target range.

5. The method of claim 1, further comprising:

identifying movement of the identified visual cue, the identified movement including a set of coordinates of the visual cue at each of a plurality of points in time; and

determining a target range associated with each of the sets of coordinates of the visual cue.

6. The method of claim 1, further comprising:

recommending one or more training drills to the individual based on the score.

7. The method of claim 1, wherein generating the score of the location where the individual'"'"'s eye or eyes are looking includes one or more of:

generating a target score, generating a cognitive load score, and calculating a stress indicator score.

8. The method of claim 7, wherein the target score is generated based on a bull'"'"'s-eye arrangement centered around the visual cue.

9. The method of claim 7, wherein the cognitive load score is generated based on a number of eye shift movements detected within an interval of time.

10. The method of claim 7, wherein the stress indicator score is calculated as the sum of the target score and the cognitive load score.

11. The method of claim 1, further comprising calculating a predicting potential score that is predictive of the individual'"'"'s potential performance in the task, as a function of one or more performance parameters identified as predictive of future performance in the task.

12. The method of claim 11, further comprising:

calculating a score for each of the one or more performance parameters predictive of potential performance in the task;

determining a weight for each of the one or more performance parameters; and

calculating a total predicting potential score based on the determined weights and the calculated scores.

13. The method of claim 1, wherein the object in the physical environment is another person different from the individual.

14. The method of claim 1, wherein the segment of movement of the individual is a segment of time.

15. The method of claim 1, wherein the object is the individual or another person, and the segment of movement of the individual is a biomechanical phase of the individual or person.

16. The method of claim 1, wherein the object is an inanimate object used to perform the task, and the segment of movement is a subset of the object'"'"'s movement.

17. A system comprising:

a data storage device storing instructions for evaluating human eye movement;

a processor configured to execute the instructions to perform a method including;

receiving data representing a location where an individual'"'"'s eye or eyes are looking before, during, or after the individual performs a task involving movement of the individual relative to a physical environment;

identifying a visual cue of where the individual should be looking during the task, at a point that is located relative to an object in the physical environment and that is associated with a segment of movement of the individual and a biomechanical phase of another individual or an object in the physical environment, the visual cue being identified based on historical or statistical analysis of other individuals'"'"' performance of the task and being unknown to the individual during the individual'"'"'s performance of the task;

generating a score of a location where the individual'"'"'s eye or eyes are looking relative to the location of the visual cue during the segment of movement, based on analysis of the received data relative to the visual cue;

informing the individual of the location of the visual cue to inform the individual where he or she should be looking during the tas;

receiving data representing a location where the individual'"'"'s eye or eyes are looking before, during, or after the individual performs second or subsequent iterations of the task with knowledge of the location of the visual cue; and

updating the score or generating a new score based on locations where the individual'"'"'s eye or eyes are looking relative to the location of the visual cue during segments of movement involved in the second or subsequent iterations of the task.

18. The system of claim 17, wherein the data is one or more of:

image data of the individual'"'"'s eye or eyes, coordinate data of the location of the individual'"'"'s eye or eyes, and coordinate data of a location on which the individual'"'"'s eye or eyes were focused.

19. The system of claim 17, wherein the data is received, either locally or over a network, from a wearable eye tracker configured to obtain the data by imaging the individual'"'"'s eye or eyes.

20. The system of claim 17, wherein the processor is further configured for:

determining a target range associated with the visual cue, the target range defining an ideal viewing area around the visual cue; and

generating a score of the location where the individual'"'"'s eye or eyes are looking by scoring where the individual'"'"'s eye or eyes are looking relative to the determined target range.

21. The system of claim 17, wherein the processor is further configured for:

identifying movement of the identified visual cue, the identified movement including a set of coordinates of the visual cue at each of a plurality of points in time; and

determining a target range associated with each of the sets of coordinates of the visual cue.

22. The system of claim 17, wherein the processor is further configured for:

recommending one or more training drills to the individual based on the score.

23. The system of claim 17, wherein generating the score of the location where the individual'"'"'s eye or eyes are looking includes one or more of:

generating a target score, generating a cognitive load score, and calculating a stress indicator score.

24. The system of claim 23, wherein the target score is generated based on a bull'"'"'s-eye arrangement centered around the visual cue.

25. The system of claim 23, wherein the cognitive load score is generated based on a number of eye shift movements detected within an interval of time.

26. The system of claim 17, wherein the processor is further configured for:

calculating a predicting potential score that is predictive of the individual'"'"'s potential performance in the task, as a function of one or more performance parameters identified as predictive of future performance in the task.

27. The system of claim 26, wherein the processor is further configured for:

calculating a score for each of the one or more performance parameters predictive of potential performance in the task;

determining a weight for each of the one or more performance parameters; and

calculating a total predicting potential score based on the determined weights and the calculated scores.

28. A non-transitory computer readable medium storing instructions that, when executed by a computer, cause the computer to perform a method comprising:

receiving data representing a location where an individual'"'"'s eye or eyes are looking before, during, or after the individual performs a task involving movement of the individual relative to a physical environment;

identifying a visual cue of where the individual should be looking during the task, at a point that is located relative to an object in the physical environment and that is associated with a segment of movement of the individual and a biomechanical phase of another individual or an object in the physical environment, the visual cue being identified based on historical or statistical analysis of other individuals'"'"' performance of the task and being unknown to the individual during the individual'"'"'s performance of the task;

generating a score of a location where the individual'"'"'s eye or eyes are looking relative to the location of the visual cue during the segment of movement, based on analysis of the received data relative to the visual cue;

informing the individual of the location of the visual cue to inform the individual where he or she should be looking during the task;

receiving data representing a location where the individual'"'"'s eye or eyes are looking before, during, or after the individual performs second or subsequent iterations of the task with knowledge of the location of the visual cue; and

updating the score or generating a new score based on locations where the individual'"'"'s eye or eyes are looking relative to the location of the visual cue during segments of movement involved in the second or subsequent iterations of the task.