Visual axis detecting apparatus and method including scanning light source, and image device using same

• US 6,104,431 A
• Filed: 06/24/1997
• Issued: 08/15/2000
• Est. Priority Date: 10/29/1993
• Status: Expired due to Fees

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Inoue, Shunsuke, Miyawaki, Mamoru
• Primary Examiner(s): HO, TUAN V
• Application Number:
  US08/881,079
• Time in Patent Office: 1,148 Days
• Field of Search: 348/207, 348/219, 348/333, 348/334, 396/51, 396/373, 396/378, 351/210
• US Class Current: 348/333.01
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: G02B 7/287 including a sight line detecting device
• CPC Class Codes: G03B 13/02 Viewfinders
• CPC Class Codes: G03B 2213/025 Sightline detection

Abstract

A visual axis detecting method and apparatus comprising a device that illuminates an eye of an observer with a scanning light source, a photoelectric conversion device that receives reflection light from the eye of the observer, and an arithmetic device that detects Purkinje images and an iris image or a pupil image of the observer'"'"'s eye on the basis of an output from the photoelectric conversion device, and that detects a direction of a visual axis of the observer from positions of the detected images.

Claims

1. A visual axis detecting device comprising:

a liquid crystal display having a light source for projecting a light image onto an eye of an observer;

illuminating means, separate from and operable independent of said light source of said liquid crystal display, for illuminating the eye of the observer with light;

means for scanning the eye of the observer with light from said illuminating means;

photoelectric conversion means for receiving light which has been reflected from the eye of the observer; and

means for calculating a visual axis orientation of the eye of the observer on the basis of a scan timing of said illuminating means and the output of said photoelectric conversion means.

2. A visual axis detecting device according to claim 1, wherein said illuminating means has light-emitting elements two-dimensionally arranged.

3. A visual axis detecting device according to claim 2, wherein each light-emitting element is an LED element.

4. A visual axis detecting device according to claim 1, wherein said illuminating means has a light-emitting element or light-emitting elements arranged in an array, and said means for scanning has means for deflecting light from the light-emitting element or light-emitting elements.

5. A visual axis detecting device according to claim 4, wherein said means for deflecting is a movable mirror.

6. A visual axis detecting device according to claim 4, wherein each light-emitting element is an LED element.

7. A visual axis detecting device according to claim 1, wherein said scanning means comprises mechanical means or electrical means for scanning.

8. A visual axis detecting device according to claim 1, wherein said illuminating means comprises a display unit.

9. A visual axis detecting device according to claim 1, wherein said photoelectric conversion means is a photo transistor or CCD.

10. A visual axis detecting device according to claim 1, wherein light from said illuminating means illuminates the eye of the observer with light that has a wavelength in a predetermined wavelength region, and said visual axis detecting device further comprises a filter disposed in an optical path from the eye of the observer to said photoelectric conversion means for filtering out light components having a wavelength different from the predetermined wavelength region.

11. A visual axis detecting device according to claim 10, wherein said illuminating means illuminates the eye of the observer with light having a wavelength of 700 nm or greater, or light having a peak or principal light quantity in a range of wavelength of 700 nm or greater.

12. A visual axis detecting device according to claim 11, wherein said illuminating means illuminates the eye of the observer with light having a wavelength of 750 nm or greater, or a light having a peak or principal light quantity in a range of wavelength of 750 nm or greater.

13. An image apparatus comprising:

a liquid crystal display having a light source for projecting a light image onto the eye of an observer;

illuminating means, separate from and operable independent of said light source of said liquid crystal display, for illuminating the eye of the observer with light;

means for scanning the eye of the observer with light from said illuminating means;

photoelectric conversion means for receiving light which has been reflected from the eye of the observer;

means for calculating a visual axis orientation of the eye of the observer on the basis of a scan timing of said illuminating means and the output of said photoelectric conversion means; and

control means for controlling a signal output in the image apparatus or to an external device, on the basis of the visual axis orientation calculated by said calculating means.

14. An image apparatus according to claim 13, wherein said illuminating means has light-emitting elements two-dimensionally arranged.

15. An image apparatus according to claim 14, wherein each light-emitting element is an LED element.

16. An image apparatus according to claim 15, wherein said liquid crystal display is one selected from a liquid crystal panel, a CRT, an EL display, and a plasma display.

17. An image apparatus according to claim 16, wherein said image apparatus is one selected from a still camera, a video camera, a goggle-type display.

18. An image apparatus according to claim 15, wherein said image apparatus is one selected from a still camera, a video camera, a goggle-type display.

19. An image apparatus according to claim 14, wherein said liquid crystal display is one selected from a liquid crystal panel, a CRT, an EL display, and a plasma display.

20. An image apparatus according to claim 19, wherein said image apparatus is one selected from a still camera, a video camera, a goggle-type display.

21. An image apparatus according to claim 14, wherein said image apparatus is one selected from a still camera, a video camera, a goggle-type display.

22. An image apparatus according to claim 13, wherein said illuminating means has a light-emitting element or light-emitting elements arranged in an array, and said scanning means has means for deflecting light from said light-emitting element or light-emitting elements.

23. An image apparatus according to claim 22, wherein said means for deflecting is a movable mirror.

24. An image apparatus according to claim 23, wherein said liquid crystal display is one selected from a liquid crystal panel, a CRT, an EL display, and a plasma display.

25. An image apparatus according to claim 24, wherein said image apparatus is one selected from a still camera, a video camera, a goggle-type display.

26. An image apparatus according to claim 23, wherein said image apparatus is one selected from a still camera, a video camera, a goggle-type display.

27. An image apparatus according to claim 22, wherein said light-emitting element is an LED element.

28. An image apparatus according to claim 27, wherein said liquid crystal display is one selected from a liquid crystal panel, a CRT, an EL display, and a plasma display.

29. An image apparatus according to claim 28, wherein said image apparatus is one selected from a still camera, a video camera, a goggle-type display.

30. An image apparatus according to claim 27, wherein said image apparatus is one selected from a still camera, a video camera, a goggle-type display.

31. An image apparatus according to claim 22, wherein said liquid crystal display is one selected from a liquid crystal panel, a CRT, an EL display, and a plasma display.

32. An image apparatus according to claim 31, wherein said image apparatus is one selected from a still camera, a video camera, a goggle-type display.

33. An image apparatus according to claim 22, wherein said image apparatus is one selected from a still camera, a video camera, a goggle-type display.

34. An image apparatus according to claim 13, wherein said scanning means comprises mechanical means or electrical means for scanning.

35. An image apparatus according to claim 34, wherein said liquid crystal display is one selected from a liquid crystal panel, a CRT, an EL display, and a plasma display.

36. An image apparatus according to claim 35, wherein said image apparatus is one selected from a still camera, a video camera, a goggle-type display.

37. An image apparatus according to claim 34, wherein said image apparatus is one selected from a still camera, a video camera, a goggle-type display.

38. An image apparatus according to claim 13, wherein said illuminating means comprises a display unit.

39. An image apparatus according to claim 38, wherein said liquid crystal display is one selected from a liquid crystal panel, a CRT, an EL display, and a plasma display.

40. An image apparatus according to claim 39, wherein said image apparatus is one selected from a still camera, a video camera, a goggle-type display.

41. An image apparatus according to claim 38, wherein said image apparatus is one selected from a still camera, a video camera, a goggle-type display.

42. An image apparatus according to claim 13, wherein said photoelectric conversion means is a photo transistor or CCD.

43. An image apparatus according to claim 42, wherein said liquid crystal display is one selected from a liquid crystal panel, a CRT, an EL display, and a plasma display.

44. An image apparatus according to claim 43, wherein said image apparatus is one selected from a still camera, a video camera, a goggle-type display.

45. An image apparatus according to claim 42, wherein said image apparatus is one selected from a still camera, a video camera, a goggle-type display.

46. An image apparatus according to claim 13, wherein said liquid crystal display is one selected from a liquid crystal panel, a CRT, an EL display, and a plasma display.

47. An image apparatus according to claim 46, wherein said image apparatus is one selected from a still camera, a video camera, a goggle-type display.

48. An image apparatus according to claim 13, wherein said image apparatus is one selected from a still camera, a video camera, a goggle-type display.

49. An image apparatus according to claim 13, wherein light from said illuminating means illuminates the eye of the observer with light that has a wavelength in a predetermined wavelength region, and said image apparatus further comprises a filter disposed in an optical path from the eye of the observer to said photoelectric conversion means for filtering out light components having a wavelength different from the predetermined wavelength region.

50. An image device according to claim 49, wherein said illuminating means illuminates the eye of the observer with light having a wavelength of 700 nm or greater, or a light having a peak or principal light quantity in a range of wavelength of 700 nm or greater.

51. An image device according to claim 50, wherein said illuminating means illuminates the eye of the observer with light having a wavelength of 750 nm or greater, or light having a peak or principal light quantity in a range of wavelength of 750 nm or greater.

52. A visual axis detecting method comprising the steps of:

projecting a light image of a liquid crystal display onto an eye of an observer using a light source of the liquid crystal display;

scanning the eye of the observer with light from illuminating means separate from and operable independent of the light source of the liquid crystal display;

receiving by photoelectric conversion means light from the illumination means reflected from the eye of the observer; and

detecting a visual axis of the eye of the observer based on an output of the photoelectric conversion means and a timing of said scanning step.

53. A visual axis detecting method according to claim 52, wherein said scanning step includes mechanically or electrically scanning a light source.