Line-of-sight-information input apparatus and method

• US 6,033,072 A
• Filed: 10/01/1998
• Issued: 03/07/2000
• Est. Priority Date: 10/07/1997
• Status: Expired due to Term

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Ono, Tachio, Yamazaki, Masahito
• Primary Examiner(s): MANUEL, GEORGE C
• Application Number:
  US09/164,273
• Time in Patent Office: 523 Days
• Field of Search: 351/200, 351/205, 351/206, 351/208, 396/51, 396/104, 396/121, 396/123
• US Class Current: 351/208
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence

Abstract

By providing a line-of-sight-information detection device for detecting an angle of rotation of an eyeball, an individual-difference correction unit for correcting the detected angle of rotation of the eyeball for each individual, an individual-difference preserving unit for preserving line-of-sight information in which individual difference is corrected, a line-of-sight-information processing unit for calculating a line-of-sight position based on the corrected angle of rotation of the eyeball and generating an event at the line-of-sight position, and an event transmission unit for transmitting the event to a host system, it is possible to use line-of-sight information as a new basis for controlling a graphical user interface. Thus, the user'"'"'s hands are used only on a keyboard, and the functions of a mouse, which has conventionally been operated by the user'"'"'s hand, can be provided by the user'"'"'s line of sight. As a result, it is possible, for example, to improve the operational efficiency.

Claims

1. A line-of-sight-information input apparatus for performing an input operation by utilizing a line of sight, said apparatus comprising:

detection means for detecting an angle of rotation of an eyeball of a user;

correction means for correcting the detected angle of rotation of the eyeball, according to the user;

control means for calculating a line-of-sight position based on the corrected angle of rotation of the eyeball and for generating an event at the line-of-sight position; and

transmission means for transmitting the event to a host system.

2. An apparatus according to claim 1, wherein said control means displays a pointer at the calculated line-of-sight position on said display means, and calculates a line-of-sight position for interpolation for displaying a virtual line-of-sight position between the line-of-sight position and a line-of-sight position calculated at a next calculation.

3. An apparatus according to claim 2, wherein said control means keeps the pointer in a stationary state when a movement of the line of sight is small.

9. An apparatus according to any one of claims 1, 4 and 7, wherein the generation of the event can be performed by a key input from a keyboard.

10. An apparatus according to any one of claims 1, 4 and 7, wherein said transmission means transmits the event to an operating system of a computer for supporting the event.

4. A line-of-sight-information input apparatus for performing an input operation by utilizing a line of sight, said apparatus comprising:

detection means for detecting an angle of rotation of an eyeball of a user;

control means for identifying a state of opening/closing of the eyeball based on the detected angle of rotation of the eyeball, and for generating an event based on how long the eyeball is kept closed; and

transmission means for transmitting the event to a host system.

5. An apparatus according to claim 4, further comprising display means for visually displaying how long the eyeball has been kept closed.

6. An apparatus according to claim 4, wherein a length of time the eyeball is kept closed, is represented by emission of at least one sound.

7. A line-of-sight-information input apparatus for performing an input operation by utilizing a line of sight, said apparatus comprising:

detection means for detecting an angle of rotation of an eyeball of a user;

control means for calculating a gaze point in consideration of fluctuation of the eyeball based on the detected angle of rotation of the eyeball, and for generating an event at the gaze point; and

transmission means for transmitting the event to a host system.

8. An apparatus according to claim 7, further comprising display means for visually displaying an indication of a gaze state.

11. A line-of-sight-information input method for performing an input operation by utilizing a line of sight, said method comprising:

a detection step of detecting an angle of rotation of an eyeball of a user;

a correction step of correcting the detected angle of rotation of the eyeball, according to the user;

a control step of calculating a line-of-sight position based on the corrected angle of rotation of the eyeball and generating an event at the line-of-sight position; and

a transmission step of transmitting the event to a host system.

12. A method according to claim 11, wherein in said control step, a pointer is displayed at the calculated line-of-sight position on display means, and a line-of-sight position for interpolation for displaying a virtual line-of-sight position between the line-of-sight position and a line-of-sight position calculated at a next calculation is calculated.

13. A method according to claim 12, wherein, in said control step, the pointer is kept in a stationary state when a movement of the line of sight is small.

19. A method according to any one of claims 11, 14 and 17, wherein the generation of the event can be performed by a key input from a keyboard.

20. A method according to any one of claims 11, 14 and 17, wherein, in said transmission step, the event is transmitted to an operating system of a computer for supporting the event.

14. A line-of-sight-information input method for performing an input operation by utilizing a line of sight, said method comprising:

a detection step of detecting an angle of rotation of an eyeball of a user;

a control step of identifying a state of opening/closing of the eyeball based on the detected angle of rotation of the eyeball and generating an event based on how long the eyeball is kept closed; and

a transmission step of transmitting the event to a host system.

15. A method according to claim 14, further comprising a display step of visually displaying how long the eyeball has been kept closed.

16. A method according to claim 14, wherein a length of time the eyeball is kept closed, is represented by emission of at least one sound.

17. A line-of-sight-information input method for performing an input operation by utilizing a line of sight, said method comprising:

a detection step of detecting an angle of rotation of an eyeball of a user;

a control step of calculating a gaze point in consideration of fluctuation of the eyeball based on the detected angle of rotation of the eyeball, and for generating an event at the gaze point; and

a transmission step of transmitting the event to a host system.

18. A method according to claim 17, further comprising a display step of visually displaying an indication of a gaze state.

21. A storage medium storing a program for performing an input operation by utilizing a line of sight, said program comprising:

a detection module for detecting an angle of rotation of an eyeball of a user;

a correction module for correcting the detected angle of rotation of the eyeball, according to the user;

an event generation module for calculating a line-of-sight position based on the corrected angle of rotation of the eyeball and for generating an event at the line-of-sight position; and

a transmission module for transmitting the generated event to a host system.