Visual communications apparatus employing eye-position monitoring

• US 5,844,544 A
• Filed: 06/13/1995
• Issued: 12/01/1998
• Est. Priority Date: 06/17/1994
• Status: Expired due to Term

• Current Assignee: HK Eyecan Limited
• Original Assignee: H K Eyecan Limited
• Inventors: Heynen, Jan, Kahn, David Alexander
• Primary Examiner(s): NGUYEN, CHANH DUY
• Application Number:
  US08/489,749
• Time in Patent Office: 1,267 Days
• Field of Search: 345/156, 345/158, 345/2, 345/7, 345/8, 345/25, 345/26, 345/32, 351/209, 351/21, 359/10, 359/8, 359/22, 359/15, 359/32, 389/103
• US Class Current: 345/156
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0236 using selection techniques to select from displayed items

Abstract

In an eye-directed communications device which displays characters, for example symbols or letters, and determines a user'"'"'s selection by monitoring eye position to determine which of the characters is being observed, difficulties in providing for selection of the usual characters and functions of a conventional 101 key computer keyboard are overcome by dividing the required characters/functions into three sets, designated as lower case, upper case and "command" case. In order to select a particular character, the user first selects the case and then selects the character. Only one set need be displayed to the user, the characters in the other sets having spatial correspondence with those in displayed set. The system may also, or alternatively, display the characters in groups and define position selection fields corresponding to the positions of the characters in each group. The user then determines the position of the desired character in its group and makes a character selection by first selecting the corresponding position field. The apparatus then limits subsequent character selection by the user to the subset of characters in the corresponding positions in their groups. Limitation to the subset allows subsequent detection of the selected character to use a larger area than that occupied by the character in the display.

Claims

1. Visual communications apparatus comprising:

display means for displaying characters in a field of view of a user'"'"'s eye, the characters being arranged in a plurality of groups, each character occupying in its group one of a plurality of positions which positions are similar for all groups;

user-controlled means for controlling light to select one of said plurality of characters and comprising detection means for detecting changes in said light and providing corresponding position signals, and processor means defining boundaries of a plurality of selection fields and determining, in response to the position signals, which of the selection fields has been selected by the user;

the selection fields comprising character selection fields and position selection fields, the processor means being responsive to an initial selection of a position selection field to limit subsequent selection to a subset of said characters which each occupy a corresponding position in each group, and subsequently determining from the position signals the specific one of said subset of characters chosen by the user.

2. Apparatus as claimed in claim 1, wherein the characters are arranged in a rectangular array and groups of characters in blocks of four, each block comprising four quadrants, the position selection fields being disposed adjacent respective corners of the array.

3. Apparatus as claimed in claim 1, wherein the characters are spaced from one another by a set pitch, the width and height of the selection fields are greater than said pitch, and the processor means centers the selection fields upon the characters of the subset following said selection of a position selection field.

4. Apparatus as claimed in claim 1, wherein the user-controlled means comprises means for directing light onto an eye of the user, said light being reflected from the eye, the detecting means detecting eye position from light reflected from the eye and producing said position signals corresponding to a direction in which the eye is gazing.

5. Apparatus as claimed in claim 1, wherein, following selection of a character, the processing means deactivates all but a relatively small one of said selection fields and reactivates the remaining selection fields in response to subsequent selection by the user of said one of said selection fields.

6. Apparatus as claimed in claim 5, wherein the said one of said selection fields is located within a peripheral zone of the display.

7. Apparatus as claimed in claim 1, wherein the processor means stores several sets of said characters, one of the sets being displayed by the display means, the processor correlating the characters of a set which is not displayed with the characters of the set which is displayed, and defining case selection fields for selecting one or other of the sets of characters, the processor detecting an initial user-selection of a case selection field and a subsequent user-selection of a displayed character, and determining to be the selected character either the displayed character or a correlated character from the other set in dependence upon the case selection.

8. Apparatus as claimed in claim 7, wherein, following selection of a character, the processing means deactivates all but one of said selection fields and reactivates the remaining selection fields in response to subsequent selection by the user of said one of said selection fields.

9. Apparatus as claimed in claim 8, wherein the said one of said selection fields is located within a peripheral zone of the display.

10. Apparatus as claimed in claim 7, wherein the selection fields comprise peripheral case selection fields and a central confirmation selection field, the processor means determining user-selection of a case selection field and the central confirmation field to determine that the set of characters has been selected and to correlate the position signals with the character selection field for the subsequent character selection.

11. Apparatus as claimed in claim 10, wherein the case selection fields and the confirmation field are segregated by a passive guard field, the processor means not responding with action when the user is determined to gaze at the guard field.

12. Apparatus as claimed in claim 11, wherein the display subtends an angle of about 35 degrees to the eye of the user, the confirmation field subtends an angle of about 15 degrees, and the guard field has a width subtending an angle of about 5 degrees.

13. Apparatus as claimed in claim 10, wherein the processor limits, alternatively, selection to a first set of character upon selection of a corresponding first case selection field and the confirmation field, selection to a second set of characters upon selection of both a first case selection field and a corresponding second case selection field and the confirmation field, and selection to a third set of characters upon selection of both a first case selection field, a corresponding third case selection field and the confirmation field.

14. Apparatus as claimed in claim 13, wherein the first case selection fields correspond to corner groups of character fields.

15. Apparatus as claimed in claim 13, wherein the processor means highlights a selected first case until the confirmation field has been selected, or a different case selection field has been selected or a predetermined period has elapsed with neither occurring.

16. Apparatus as claimed in claim 10, wherein the display is dimensioned and positioned so as to subtend an angle of substantially 35 degrees to the eye of the user, and the confirmation field is dimensioned to subtend an angle of about 15 degrees to the eye of the user.

17. Apparatus as claimed in claim 7, wherein each position selection field is coincident with a case selection field.

18. Apparatus as claimed in claim 1, wherein the display is dimensioned and positioned so as to subtend an angle of between 25 and 40 degrees to the eye of the user.

19. Visual communications apparatus comprising:

display means for displaying characters in a field of view of a user'"'"'s eye,

user-controlled means for controlling light to select one of said plurality of characters and comprising detection means for detecting changes in said light and providing corresponding position signals, and processor means defining boundaries of a plurality of selection fields comprising character selection fields and case selection fields, and determining in response to the position signals which of the selection fields has been selected by the user;

the processor means storing a plurality of sets of characters and being responsive to an initial user-selection of a case selection field to limit subsequent selection to a corresponding one of said sets of characters, and subsequently to user-selection of a character selection field to determine the character selected by the user.

20. Apparatus as claimed in claim 19, wherein the user-controlled means comprises means for directing light onto an eye of the user, said light being reflected from the eye, the detecting means detecting eye position from light reflected from the eye and producing said position signals corresponding to a direction in which the eye is gazing.

21. Apparatus as claimed in claim 20, wherein, following selection of a character, the processing means deactivates all but a relatively small one of said selection fields and reactivates the remaining selection fields in response to subsequent selection by the user of said one of said selection fields.

22. Apparatus as claimed in claim 21, wherein the said one of said selection fields is located within a peripheral zone of the display.

23. Apparatus as claimed in claim 20, wherein the selection fields comprise peripheral case selection fields and a central confirmation selection field, the processor means determining user-selection of a case selection field and the central confirmation field to determine that the set of characters has been selected and to correlate the position signals with the character selection field for the subsequent character selection.

24. Apparatus as claimed in claim 23, wherein the case selection fields and the confirmation field are segregated by a passive guard field, the processor means not responding with action when the user is determined to gaze at the guard field.

25. Apparatus as claimed in claim 24, wherein the processor means highlights a selected first case until the confirmation field has been selected, or a different case selection field has been selected or a predetermined period has elapsed with neither occurring.

26. Apparatus as claimed in claim 24, wherein the display subtends an angle of about 35 degrees to the eye of the user, the confirmation field subtends an angle of about 15 degrees, and the guard field has a width subtending an angle of about 5 degrees.

27. Apparatus as claimed in claim 23, wherein the processor limits, alternatively, selection to a first set of character upon selection of a corresponding first case selection field and the confirmation field, selection to a second set of characters upon selection of both a first case selection field and a corresponding second case selection field and the confirmation field, and selection to a third set of characters upon selection of both a first case selection field, a corresponding third case selection field and the confirmation field.

28. Apparatus as claimed in claim 27, wherein the first case selection fields correspond to corner groups of character fields.

29. Apparatus as claimed in claim 23, wherein the display is dimensioned and positioned so as to subtend an angle of substantially 35 degrees to the eye of the user, and the confirmation field is dimensioned to subtend an angle of about 15 degrees to the eye of the user.

30. Apparatus as claimed in claim 19, wherein the display is dimensioned and positioned so as to subtend an angle of between 25 and 40 degrees to the eye of the user.

31. Visual communications apparatus comprising:

a viewing port;

display means for displaying characters for viewing by a user'"'"'s eye by way of the viewing port; and

eye-position monitoring means for monitoring eye-position to determine a character selected by the user, the eye-position monitoring means comprising infrared light source means, infrared receiver and a dichroic beam splitter, the dichroic beam splitter transmitting visible light incident thereupon along a first optical path and reflecting infrared light incident thereupon along a second optical path, the first optical path extending between the beam splitter and the display means and the second optical path extending between the beam splitter and both of the infrared light source means and the receiver means, the arrangement being such that infrared light from the infrared light source means is reflected by the beam splitter towards the viewing port, infrared light front the viewing port is reflected by the beam spliter towards the infrared light receiver means, and visible light from the display means is transmitted by the beam splitter towards the viewing port.

32. Apparatus as claimed in claim 31, wherein the display is dimensioned and positioned so as to subtend an angle of between 25 and 40 degrees to the eye of the user.

33. Eye-directed communications apparatus comprising:

display means for displaying characters within a field of view of a user and means for monitoring a user'"'"'s eye position to determine characters selected by the user, the display means being arranged to display each character in a corresponding character field, the monitoring means including a processor means programmed to calibrate the monitoring means by a training procedure in which the user directs the eye in a predetermined sequence upon a predetermined number of character fields, the processor means highlighting each selected character field, after that selected first, only after the eye has dwelled within a limited region surrounding that field and extinguishing the highlighting when measurement at that point is completed.

34. Apparatus as claimed in claim 33, wherein the predetermined number of character fields is five, comprising a central character field and four peripheral fields.

35. Apparatus as claimed in claim 34, wherein the predetermined number of character fields comprise a central field and four peripheral fields, the peripheral fields being, respectively, directly above, below and to each side of the central field.

36. Apparatus as claimed in claim 35, wherein the processor means limits user-selection of the training fields to a sequence, beginning with the central field and continuing in either a clockwise or an anticlockwise direction around the perimetric fields.

37. Visual communications apparatus comprising:

display means for displaying characters in a field of view of a user'"'"'s eye, the characters being arranged in a plurality of groups, each character occupying in its group one of a plurality of positions which positions are similar for all groups;

user-controlled means for controlling light to select one of said plurality of characters and comprising detection means for detecting changes in said light and providing corresponding position signals, and processor means defining boundaries of a plurality of selection fields and determining, in response to the position signals, which of the selection fields has been selected by the user;

the selection fields comprising character selection fields and character subset selection fields, the character selection fields corresponding to character positions, the character subset selection fields being equal in number to the number of characters in each group, the positions of the character subset selection fields relative to each other corresponding to the positions of the character in each group relative to each other,

the processor means being responsive to an initial selection of a character subset selection field to limit subsequent selection of a character to that subset of said characters which each occupy that position in the group corresponding to the selected character subset selection field, and subsequently determining from the position signals subsequent selection by the user of a character selection field for a specific one of said subset of characters.

38. Apparatus as claimed in claim 37, wherein the characters in each group are in rectangular blocks of four, each block comprising four quadrants, there being four character subset selection fields each disposed adjacent to a respective corner of a rectangle.

39. Apparatus as claimed in claim 38, wherein the characters are spaced from one another by a set pitch, the width and height of the character selection fields are greater than said pitch, and the processor means centers the character selection fields upon the characters of the subset following said selection of a character subset selection field.

40. Apparatus as claimed in claim 37, wherein the characters are spaced from one another by a set pitch, the width and height of the character selection fields are greater than said pitch, and the processor means centers the character selection fields upon the characters of the subset following said selection of a character subset selection field.