GAZE-CONTROLLED USER INTERFACE WITH MULTIMODAL INPUT
First Claim
1. A personal computer system providing a gaze-controlled graphical user interface, the personal computer system comprising:
- an operating system for executing an application;
a graphics module for generating a display signal to be supplied to a visual display, the graphics module being operable in;
a bidirectional interaction mode, in which the visual display shows one or more graphical controls in motion, anda unidirectional interaction mode without said graphical controls in motion;
a gaze tracking system operable to provide gaze point data of a viewer of the visual display;
a matching module operable to determine a match between a relative movement of any of said graphical controls and a relative gaze movement derived from said gaze point data in the bidirectional mode,wherein the personal computer system further comprises a selector, and the personal computer system is configured to;
i) initiate a transition from the unidirectional interaction mode to the bidirectional interaction mode in response to an input received at the selector;
ii) determine a current gaze point based on gaze point data; and
iii) enter the bidirectional interaction mode, wherein graphical controls in motion are present at least in a neighbourhood of the current gaze point.
2 Assignments
0 Petitions
Accused Products
Abstract
A personal computer system provides a gaze-controlled graphical user interface having a bidirectional and a unidirectional interaction mode. In the bidirectional interaction mode, a display shows one or more graphical controls in motion, each being associated with an input operation to an operating system. A gaze tracking system provides gaze point data of a viewer, and a matching module attempts to match a relative gaze movement against a relative movement of one of the graphical controls. The system includes a selector which is preferably controllable by a modality other than gaze. The system initiates a transition from the unidirectional interaction mode to the bidirectional interaction mode in response to an input received at the selector. The display then shows graphical controls in motion in a neighbourhood of the current gaze point, as determined based on current gaze data.
-
Citations
20 Claims
-
1. A personal computer system providing a gaze-controlled graphical user interface, the personal computer system comprising:
-
an operating system for executing an application; a graphics module for generating a display signal to be supplied to a visual display, the graphics module being operable in; a bidirectional interaction mode, in which the visual display shows one or more graphical controls in motion, and a unidirectional interaction mode without said graphical controls in motion; a gaze tracking system operable to provide gaze point data of a viewer of the visual display; a matching module operable to determine a match between a relative movement of any of said graphical controls and a relative gaze movement derived from said gaze point data in the bidirectional mode, wherein the personal computer system further comprises a selector, and the personal computer system is configured to; i) initiate a transition from the unidirectional interaction mode to the bidirectional interaction mode in response to an input received at the selector; ii) determine a current gaze point based on gaze point data; and iii) enter the bidirectional interaction mode, wherein graphical controls in motion are present at least in a neighbourhood of the current gaze point. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 17, 18, 19, 20)
-
-
15. A method of controlling an operating system in a personal computer system associated with a visual display, comprising:
-
displaying an image without graphical controls in motion; receiving a mode transition command from a viewer of the visual display; determining a current gaze point of the viewer based on gaze point data provided by a gaze tracking system; displaying an image including one or more graphical controls in motion; and in response to a positive determination of a match, indicating a predefined input operation associated with the graphical control to the operating system or to the application executing thereon, wherein said graphical controls in motion are present at least in a neighbourhood of the current gaze point. - View Dependent Claims (16)
-
Specification