System and method for presentation of enterprise, clinical, and decision support information utilizing eye tracking navigation

• US 20060109237A1
• Filed: 01/19/2005
• Published: 05/25/2006
• Est. Priority Date: 11/24/2004
• Status: Active Grant

• Current Assignee: General Electric Company
• Original Assignee: General Electric Company
• Inventors: Gentles, Thomas A., Mahesh, Prakash, Morita, Mark M.
• Granted Patent: US 7,501,995 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: A61B 2017/00207 with hand gesture control or hand gesture recognition
• CPC Class Codes: A61B 2017/00216 with eye tracking or head position tracking control
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing
• CPC Class Codes: G16H 40/63 for local operation

Abstract

Certain embodiments of the present invention provide a method and system for using gaze detection to improve information display in a healthcare environment. Certain embodiments of a gaze detection and control system include an information system including information related to at least one image, a display device capable of displaying images and data, and a gaze tracking system for detection a location of a user'"'"'s gaze with respect to the display device. The gaze tracking system triggers a retrieval of information from the information system based at least in part on the location of the user'"'"'s gaze, and the retrieved information is displayed at the display device. In an embodiment, the retrieved information is overlaid over an image at the display device. In an embodiment, the gaze tracking system includes at least one camera and/or eyewear, for example.

Claims

1. A gaze detection and control system for displaying relevant information, said system comprising:

an information system including information related to at least one image;

a display device capable of displaying images and data; and

a gaze tracking system for detection a location of a user'"'"'s gaze with respect to said display device, wherein said gaze tracking system triggers a retrieval of information from said information system based at least in part on said location of said user'"'"'s gaze, wherein said retrieved information is displayed at said display device.

2. The system of claim 1, wherein said retrieved information is overlaid over an image at said display device.

3. The system of claim 1, wherein said gaze tracking system comprises at least one of a camera and eyewear.

4. The system of claim 1, further including a conflict resolution module for determining priority and control of the display device among a plurality of users.

5. The system of claim 1, further comprising:

a plurality of perspectives, each perspective saving a relation with at least one of a plurality of information sources; and

a medical perspectives manager for associating at least one information source with a perspective, wherein the medical perspectives manager allows a user to access the at least one associated information source using the perspective.

6. The system of claim 1, further comprising:

a rules engine including at least one rule governing at least one of availability and presentation of information; and

a context manager for obtaining information from the plurality of information sources based on a query and filtering the information based on the at least one rule.

7. The system of claim 1, wherein a function at the display is triggered using at least one of a voice command, a gesture, and a gaze.

8. A method for displaying medical information based on gaze detection, said method comprising:

determining a location of a user'"'"'s gaze in relation to a reference position; and

updating information on a display device based on said user'"'"'s gaze.

9. The method of claim 8, where the updating step further comprises updating information on said display device based on at least one of preferences and input from said user.

10. The method of claim 8, further comprising arbitrating between a plurality of users to determine control of said display device.

11. The method of claim 8, further comprising allowing multiple users to control information at said display device.

12. The method of claim 8, further comprising triggering a function at said display device using at least one of a voice command, a gesture, and a gaze.

13. The method of claim 8, further comprising overlaying information on information previously displayed at said display device.

14. The method of claim 8, further comprising defining at least one perspective personalizing information relevant to said user.

15. The method of claim 8, further comprising filtering information available at said display device based on at least one rule.

16. A computer-readable storage medium including a set of instructions for a computer, the set of instructions comprising:

a gaze detection routine for determining a location at which a user is looking at a display; and

a display routine for displaying, on the display, information associated with the location.

17. The set of instructions of claim 16, further comprising a rules-based context management routine for selecting and filtering the information for display.

18. The set of instructions of claim 16, wherein the information includes at least one of data and an image.

19. The set of instructions of claim 16, further comprising a perspectives management routine for customizing layout of the information for display.

20. The set of instructions of claim 16, wherein said gaze detection routine maps the location at the display to a location in content displayed by the display routine.