System and method for presentation of enterprise, clinical, and decision support information utilizing eye tracking navigation

• US 7,501,995 B2
• Filed: 01/19/2005
• Issued: 03/10/2009
• Est. Priority Date: 11/24/2004
• Status: Active Grant

• Current Assignee: General Electric Company
• Original Assignee: General Electric Company
• Inventors: Gentles, Thomas A., Mahesh, Prakash, Morita, Mark M.
• Primary Examiner(s): Nguyen; Kevin M
• Application Number:
  US11/039,152
• Publication Number:
  US 20060109237A1
• Time in Patent Office: 1,511 Days
• Field of Search: 345/156, 345 7- 9, 705/1, 705/2, 705/3, 705/7, 600/300
• US Class Current: 345/7
• CPC Class Codes: A61B 2017/00207 with hand gesture control or hand gesture recognition
• CPC Class Codes: A61B 2017/00216 with eye tracking or head position tracking control
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing
• CPC Class Codes: G16H 40/63 for local operation

Abstract

Certain embodiments of the present invention provide a method and system for using gaze detection to improve information display in a healthcare environment. Certain embodiments of a gaze detection and control system include an information system including information related to at least one image, a display device capable of displaying images and data, and a gaze tracking system for detection a location of a user'"'"'s gaze with respect to the display device. The gaze tracking system triggers a retrieval of information from the information system based at least in part on the location of the user'"'"'s gaze, and the retrieved information is displayed at the display device. In an embodiment, the retrieved information is overlaid over an image at the display device. In an embodiment, the gaze tracking system includes at least one camera and/or eyewear, for example.

Claims

1. A gaze detection and control system for displaying relevant enterprise, clinical or decision support information, said system comprising:

an information system including information related to at least one image;

a display device capable of displaying images and data;

a gaze tracking system for detecting a location of a user'"'"'s gaze with respect to said display device, wherein said gaze tracking system triggers a retrieval of information from said information system based at least in part on said location of said user'"'"'s gaze, wherein said retrieved information is displayed at said display device;

a plurality of perspectives, each perspective saving a relation with at least one of a plurality of information sources;

a medical perspectives manager for associating at least one information source with a perspective, wherein the medical perspectives manager allows a user to access the at least one associated information source using the perspective;

a rules engine including at least one rule governing at least one of availability and presentation of information based at least in part on the user'"'"'s gaze; and

a context manager for obtaining information from the plurality of information sources based on a query and filtering the information based on the at least one rule.

2. The system of claim 1, wherein said retrieved information is overlaid over an image at said display device.

3. The system of claim 1, wherein said gaze tracking system comprises at least one of a camera and eyewear.

4. The system of claim 1, farther including a conflict resolution module for determining priority and control of the display device among a plurality of users.

5. The system of claim 1, wherein a function at the display is triggered using at least one of a voice command, a gesture, and a gaze.

6. A method for displaying medical information based on gaze detection, said method comprising:

determining a location of a user'"'"'s gaze in relation to a reference position;

defining at least one perspective personalizing information relevant to said user;

updating information on a display device based on said user'"'"'s gaze; and

filtering information available at said display device based on at least one rule, said rule based at least in part on said user'"'"'s gaze;

wherein information is updated on said display device based on at least one of preferences and input from said user.

7. The method of claim 6, further comprising arbitrating between a plurality of users to determine control of said display device.

8. The method of claim 6, further comprising allowing multiple users to control information at said display device.

9. The method of claim 6, further comprising triggering a function at said display device using at least one of a voice command, a gesture, and a gaze.

10. The method of claim 6, further comprising overlaying information on information previously displayed at said display device.

11. A computer-readable storage medium including a set of instructions for execution on a computer, the set of instructions comprising:

a gaze detection routine for determining a gaze location at which a user is looking at a display; and

a display routine for displaying, on the display, information associated with the gaze location;

a rules-based context management routine for selecting and filtering said information for display based at least in part on the gaze location; and

a perspectives management routine for customizing layout of the information for display;

wherein said instructions, when executed on a computer, facilitate the display of information on a display device based on the user gaze location.

12. The set of instructions of claim 11, wherein said information includes at least one of data and an image.

13. The set of instructions of claim 11, wherein said gaze detection routine maps the gaze location at the display to a location in content displayed by the display routine.