Apparatus for measuring sighting direction

• US 5,604,818 A
• Filed: 03/10/1994
• Issued: 02/18/1997
• Est. Priority Date: 03/11/1993
• Status: Expired due to Term

• Current Assignee: Nissan Motor Co., Ltd.
• Original Assignee: Nissan Motor Co., Ltd.
• Inventors: Okabayashi, Shigeru, Sakata, Masao, Saitou, Hiroshi
• Primary Examiner(s): Boudreau, Leo
• Assistant Examiner(s): CHANG, JON CARLTON
• Application Number:
  US08/208,324
• Time in Patent Office: 1,076 Days
• Field of Search: 382/1, 382/6, 382/48, 382/117, 382/128, 351/209, 351/210, 340/825.19, 345/156, 345/158, 348/78, 354/410
• US Class Current: 382/128
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06T 7/97 Determining parameters from multiple pictures depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85

Abstract

An apparatus for measuring a sighting direction of human eyes includes: a camera oriented toward an eye and picking up images thereof with invisible light, a first light source coaxially installed with the camera and emitting the invisible light toward the human eye, a second light source installed apart from said first light source and emitting invisible light toward the human eye, a calculator for calculating an expression of a line via the center of the pupil, an expression of a line via the position of the reflection of the first light source, and an expression of a line via the position of the reflection of the second light source, according to the images of the eye, calculating the position of the center of the corneal sphere according to the expressions of the lines via the positions of the reflections of the first and second light sources, and calculating the sighting direction of the eye according to an expression of a line via the center of the pupil obtained and the center of the corneal sphere of the eye.

Claims

1. An apparatus for measuring a sighting direction of an eye ball of an operator, comprising:

a camera oriented toward the eye ball of the operator for receiving an image transmitted from the eye ball and providing image data therefrom;

a first light source coaxially located with said camera on a coaxial line on which said camera is located, for emitting an invisible light toward the eye ball;

a second light source located apart from said first light source at a position (F2) and also emitting invisible light toward the eye ball;

first arithmetic operation means for solving, according to images of the eye ball received by said camera,

a) a first expression representing a first straight line (F1A) passing between a center (Q) of a pupil of the eye ball and a focus point (F1) of said camera;

b) a second expression representing a second straight line (F1B) passing between a position (P'"'"') of reflection of light from said first light source and the focus point (F1) of said camera; and

c) a third expression representing a third straight line (F1C) passing between a position (P) of reflection of light from said second light source and the focus point (F1) of said camera;

second arithmetic operation means for calculating a position of the center (O) of the corneal sphere of the eye ball according to the second and third expressions representing the second and third straight lines passing through the positions of the reflections of light from said first and second light sources calculated by the first arithmetic operation means; and

third arithmetic operation means for calculating a sighting direction of the eye ball according to an expression representing a straight line passing through the center (Q) of the pupil, obtained by the first arithmetic operation means, and the center (O) of the corneal sphere of the eye ball, obtained by said second arithmetic operation means.

2. An apparatus according to claim 1, wherein said first and second light sources emit near infrared rays.

3. An apparatus according to claim 1, wherein said first light source and said camera are located on said coaxial line, and said second light source is on a line other than said coaxial line.

4. An apparatus according to claim 1, further comprising a microcomputer system including said first, second, and third arithmetic operation means.

5. An apparatus according to claim 1, wherein:

said second arithmetic operation means comprises;

means storing a parameter representing a radius of the corneal sphere;

means for calculating the position (P) of reflection of light from said second light source on said third straight line (F1C) according to a position of said focus point (F1) of the camera and the position (F2) of said second light source; and

means for calculating the position of the center (O) of the corneal sphere on the second line (F1B) according to the parameter and the position (P) of reflection of light from said second light source, and

said third arithmetic operation means comprises means for calculating a position of the center (Q) of the pupil on the first line (F1A) defined with the parameter and with the center (O) of the corneal sphere.

6. An apparatus according to claim 1, further comprising computer display means, fourth arithmetic operation means for calculating an intersection between said sighting direction of the eye ball and said computer display means, and display element generating means for generating a display element at said intersection, thereby to provide a contactless interface between a computer activating said computer display means and the operator.

7. An apparatus according to claim 1, wherein said first, second and third arithmetic means operate responsively only to said first and second light sources to calculate said sighting direction of the eye ball.

8. An apparatus according to claim 1, wherein said camera and said first and second light sources are remotely positioned relative to the eye ball of the operator.