System and method for selectively expanding or contracting a portion of a display using eye-gaze tracking

• US 20050047629A1
• Filed: 08/25/2003
• Published: 03/03/2005
• Est. Priority Date: 08/25/2003
• Status: Abandoned Application

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Zhai, Shumin, Farrell, Stephen P.
• Application Number:
  US10/648,120
• Publication Number:
  US 20050047629A1
• Time in Patent Office: Days
• US Class Current: 382/117
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance

Abstract

A computer-driven system amplifies a target region based on integrating eye gaze and manual operator input, thus reducing pointing time and operator fatigue. A gaze tracking apparatus monitors operator eye orientation while the operator views a video screen. Concurrently, the computer monitors an input indicator for mechanical activation or activity by the operator. According to the operator'"'"'s eye orientation, the computer calculates the operator'"'"'s gaze position. Also computed is a gaze area, comprising a sub-region of the video screen that includes the gaze position. The system determines a region of the screen to expand within the current gaze area when mechanical activation of the operator input device is detected. The graphical components contained are expanded, while components immediately outside of this radius may be contracted and/or translated, in order to preserve visibility of all the graphical components at all times.

Claims

1. A method of interacting with a monitor, comprising:

modifying a portion of an output displayed on a monitor by tracking an eye gaze and by monitoring an input indicator on the monitor that reflects a user'"'"'s activity, wherein the output comprises at least part of a target object;

wherein tracking the eye gaze comprises monitoring a user'"'"'s eye movement in a direction of the target object, and further monitoring a trajectory of the input indicator on the monitor; and

wherein the portion of the output is modified upon detecting the coincidence of the user'"'"'s eye movement and the input indicator trajectory in the direction of the target object.

2. The method according to claim 1, wherein modifying the portion of the output comprises selectively expanding the portion of the output.

3. The method according to claim 1, wherein modifying the portion of the output comprises selectively contracting the portion of the output.

4. The method according to claim 1, further comprising identifying the target object through eye-gaze tracking.

5. The method according to claim 4, wherein modifying the portion of the output comprises transforming the portion of the output that contains the target object to accommodate any of an expansion or a contraction of the target object.

6. The method according to claim 5, further comprising determining a modification time based on data derived concurrently from the user'"'"'s eye gaze.

7. The method according to claim 5, further comprising determining a motion direction of the input indicator.

8. The method according to claim 5, wherein identifying the target object is based on data derived concurrently from the eye gaze and the direction of movement of the input indicator.

9. The method according to claim 1, further comprising identifying the portion of the output based on boundaries of interactive graphical user interface components.

10. The method according to claim 9, wherein the interactive graphical user interface components comprise any one or more of a button, a menu, a scrollbar, and a hypertext link.

11. The method according to claim 10, further comprising expanding the interactive graphical user interface components to permit interactivity.

12. The method according to claim 5, wherein the input indicator is inputted by an input device that comprises any one or more of:

a mouse, a touch, a touch screen, a tablet computer, a personal digital assistant, a stylus, and a motion sensor.

13. The method according to claim 5, wherein transforming the portion of the output comprises hiding an area of the monitor that is covered by an increase in size of the target object to accommodate a change in appearance of the target object.

14. The method according to claim 5, wherein transforming the portion of the output comprises moving one or more objects on the monitor toward one or more edges of the monitor to accommodate a change in appearance of the target object.

15. The method of claim 5, wherein transforming the portion of the output comprises reducing a size of one or more objects located adjacent the target object to accommodate a change in appearance of the target object while maintaining an original appearance of a remaining portion of the output.

16. The method according to claim 12, further comprising restoring the target object and the monitor to an original appearance when any one of the eye-gaze or the input device indicates that the target object has been deselected.

17. A system for interacting with a monitor, comprising:

means for modifying a portion of an output displayed on a monitor by tracking an eye gaze and by monitoring an input indicator on the monitor that reflects a user'"'"'s activity, wherein the output comprises at least part of a target object;

wherein tracking the eye gaze is implemented by a means for monitoring an eye movement in a direction of the target object, and by a means for monitoring a trajectory of an input indicator on the monitor; and

wherein the portion of the output is modified upon detecting the coincidence of the user'"'"'s eye movement and the input indicator trajectory in the direction of the target object.

18. The method according to claim 17, wherein the means for modifying the portion of the output selectively expands the portion of the output.

19. The method according to claim 17, wherein the means for modifying the portion of the output selectively contracts the portion of the output.

20. A software program product having instruction codes for interacting with a monitor, comprising:

a first set of instruction codes for modifying a portion of an output displayed on a monitor by tracking an eye gaze and by monitoring an input indicator on the monitor that reflects a user'"'"'s activity, wherein the output comprises at least part of a target object;

wherein tracking the eye gaze is implemented by a second set of instruction codes for monitoring an eye movement in a direction of the target object, and by a third set of instruction codes for monitoring a trajectory of an input indicator on the monitor; and

wherein the portion of the output is modified upon detecting the coincidence of the user'"'"'s eye movement and the input indicator trajectory in the direction of the target object.