EYE TYPING SYSTEM USING A THREE-LAYER USER INTERFACE

• US 20120086645A1
• Filed: 08/19/2011
• Published: 04/12/2012
• Est. Priority Date: 10/11/2010
• Status: Abandoned Application

• Current Assignee: Siemens Corp. (Siemens AG)
• Original Assignee: Siemens Corp. (Siemens AG)
• Inventors: Goose, Stuart, Zheng, Xianjun S., Kiekebosch, Joeri, Lin, Jeng-Weei James
• Application Number:
  US13/213,210
• Publication Number:
  US 20120086645A1
• Time in Patent Office: Days
• US Class Current: 345/168
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0236 using selection techniques to select from displayed items
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence

Abstract

A specially-configured interactive user interface for use in eye typing takes the form of a three-layer arrangement that allows for controlling computer input with eye gazes. The three-layer arrangement includes an outer, rectangular ring of letters, displayed clockwise in alphabetical order (forming the first layer). A group of “frequently-used words” associated with the letters being typed forms an inner ring (and is defined as the second layer). This second layer of words is constantly updated as the user continues to enter text. The third layer is a central “open” portion of the interface and forms the typing space—the “text box” that will be filled as the user continues to type. A separate row of control/function keys (including mode-switching for upper case vs. lower case, numbers and punctuation) is positioned adjacent to the three-layer on-screen keyboard display.

Claims

1. An eye typing system comprising

an eye tracking device for monitoring the movements of an eye, including gaze, fixation and saccade;

a display apparatus including an on-screen keyboard user interface configured as a three-layer arrangement comprising an outer ring of alphabet characters, an inner ring of frequently-used words and a central region for displaying typed text; and

a computer processor responsive to the eye tracking device for analyzing eye gaze and fixation data and determining which key of the on-screen keyboard user interface an individual has selected by eye movement, the letter or word associated with the selected key being displayed in the central region.

2. The eye typing system as defined in claim 1 wherein the on-screen keyboard user interface includes a row of function/control keys.

3. The eye typing system as defined in claim 2 where the row of function/control keys is displayed below the three-layer arrangement of the on-screen keyboard user interface.

4. The eye typing system as defined in claim 2 where the row of function/control keys is displayed above the three-layer arrangement of the on-screen keyboard user interface.

5. The eye typing system as defined in claim 2 where the row of function/control keys is displayed along one side of the three-layer arrangement of the on-screen keyboard user interface.

6. The eye typing system as defined in claim 1 where the outer ring of the three-layer arrangement of the on-screen keyboard user interface is disposed in a rectangular form, the first letter in the alphabet located in the upper left-hand corner of the rectangular form and proceeding clockwise.

7. The eye typing system as defined in claim 1 wherein the system further comprises visual confirmation of a user-selected letter in the outer ring.

8. The eye typing system as defined in claim 7 where the visual confirmation comprises a running circle overlying a letter upon which a user is gazing, where the circle runs for the duration of a predetermined dwell time and confirms letter selection at the completion of the dwell time interval.

9. The eye typing system as defined in claim 7 wherein the visual confirmation comprises a change in color or luminance of a letter upon which a user is gazing.

10. The eye typing system as defined in claim 1 wherein the system further comprises audio confirmation of user-selected letter in the outer ring.

11. The eye typing system as defined in claim 10 where the audio confirmation comprises a “

click”

upon completion of a predetermined dwell time interval.

12. The eye typing system as defined in claim 1 wherein the system further comprises letter prediction upon completion of letter selection.

13. The eye typing system as defined in claim 12 where letter prediction comprises a visual modification to a subset of letters predicted to follow a typed letter.

14. The eye typing system as defined in claim 13 where the visual modification comprises a change in color.

15. The eye typing system as defined in claim 13 where the visual modification comprises a change in luminance.

16. The eye typing system as defined in claim 1 where the inner ring of the three-layer arrangement of the on-screen keyboard user interface is disposed in a rectangular form, the first word in the constantly-updated frequently-used listing of words located in the upper left-hand corner of the rectangular form and proceeding clockwise in alphabetical order.

17. The eye typing system as defined in claim 16 wherein the listing of frequently-used words is updated as a letter or word is selected by the user.

18. The eye typing system as defined in claim 1 where the central area includes a set of common control function keys that may be selected using eye gaze by the user.

19. The eye typing system as defined in claim 1 wherein the system further comprises a control key to switch into a page view format such that the central region displays a page of text and overlaps the outer and inner rings of the three-layer on-screen keyboard user interface.

20. A method of eye typing using gaze, fixation and saccade attributes of eye movement, the method comprising the steps of:

providing a display apparatus with an on-screen keyboard user interface configured as a three-layer arrangement comprising an outer ring of alphabet keys, an inner ring of frequently-used words and a central region for displaying typed text;

monitoring a user'"'"'s eye movements with an eye tracking device;

analyzing eye gaze and fixation as a user is viewing the on-screen keyboard user interface; and

determining a selected key from the keyboard upon fixation for a predetermined period of time; and

displaying the selected key in the central region of the on-screen keyboard user interface.