Sighting direction detecting device for vehicle

• US 5,621,457 A
• Filed: 09/08/1995
• Issued: 04/15/1997
• Est. Priority Date: 09/26/1994
• Status: Expired due to Term

• Current Assignee: Nissan Motor Co., Ltd.
• Original Assignee: Nissan Motor Co., Ltd.
• Inventors: Ishiwaka, Takuo, Saitou, Hirosi
• Primary Examiner(s): Britton, Howard W.
• Application Number:
  US08/524,950
• Time in Patent Office: 585 Days
• Field of Search: 348/78, 348/164, 348/169, 348/115, 348/116
• US Class Current: 348/78
• CPC Class Codes: B60K 2360/21 using cameras
• CPC Class Codes: G01C 21/3641 Personalized guidance, e.g. limited guidance on previously travelled routes
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 23/00 Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

A sighting direction detecting device including a TV camera which is disposed to face a human being and picks up an image of light invisible to human beings, a first illuminator which is disposed in a coaxial system with the TV camera and illuminates a human'"'"'s eye-ball portion with light which is invisible to human beings, a second illuminator which is disposed at a different place from the first illuminator and illuminates the human'"'"'s eye-ball portion with light which is invisible to human beings, a first calculator for calculating an equation of a line passing the pupil center position of the eye-ball, an equation of a line passing the reflected-light position of the first illuminator and an equation of a line passing the reflected-light position of the second illuminator on the basis of the image which is picked up by the camera, a second calculator for calculating the center position of a cornea ball on the basis of the equation of the line passing the reflected-light position of the first illuminator and the equation of the line passing the reflected-light position of the second illuminator which are calculated by the first calculator, and a third calculator for calculating the sighting direction of the human being on the basis of the equation of the line passing the pupil center position detected by the first calculator and the center position of the cornea ball which is calculated by the second calculator, wherein the image obtained by the TV camera comprises a first image obtained under illumination of the first illuminator and the second illuminator and a second image obtained under illumination of illumination means which does not contain the first illuminator.

Claims

1. A sighting direction detecting device comprising:

a TV camera which is disposed to face a human being and picks up an image of light invisible to human;

first illuminating means which is disposed in a coaxial system with said TV camera and illuminates a human'"'"'s eye-ball portion with light which is invisible to human beings;

second illuminating means which is disposed at a different place from said first illuminating means and illuminates the human'"'"'s eye-ball portion with light which is invisible to human beings;

first calculating means for calculating an equation of a line passing the pupil center position of the eye-ball, an equation of a line passing the reflected-light position of said first illuminating means and an equation of a line passing the reflected-light position of said second illuminating means on the basis of the image which is picked up by said camera;

second calculating means for calculating the center position of a cornea ball on the basis of the equation of the line passing the reflected-light position of said first illuminating means and the equation of the line passing the reflected-light position of said second illuminating means which are calculated by said first calculating means; and

third calculating means for calculating the sighting direction of the human being on the basis of the equation of the line passing the pupil center position detected by said first calculating means and the center position of the cornea ball which is calculated by said second calculating means, wherein the image obtained by said TV camera comprises a first image obtained under illumination of said first illuminating means and said second illuminating means and a second image obtained under illumination of illuminating means which does not contain said first illuminating means.

2. The sighting direction detecting device as claimed in claim 1, further comprising at least one third illuminating means which is disposed at a different place from said first illuminating means and illuminates the human'"'"'s eye-ball with light which is invisible to human beings, wherein the image obtained by said TV camera comprises a first image obtained under illumination of both said first illuminating means and said second illuminating means, and a second image obtained under illumination of at least said third illuminating means of said second illuminating means and said third illuminating means and under non-illumination of said first illuminating means.

3. The sighting direction detecting device as claimed in claim 1, further comprising at least one third illuminating means which is disposed at a different place from said first illuminating means and illuminates the human'"'"'s eye-ball portion with light which is invisible to human beings, wherein the image obtained by said TV camera comprises a first image obtained under illumination of said first illuminating means, said second illuminating means and said third illuminating means, and a second image obtained under illumination of at least said third illuminating means of said second illuminating means and said third illuminating means and under non-illumination of said first illuminating means.

4. A sighting switch for selectively switching on one of various equipments in accordance with a sighting direction of an user, comprising:

a camera for imaging the face of the user;

a first illuminator which is disposed coaxially with said camera and illuminates a human'"'"'s eye-ball portion with light invisible to human beings;

a second illuminator which is disposed at a different place from said first illuminator and illuminates the human'"'"'s eye-ball portion with light invisible to human beings;

a sighting direction calculator for calculating the position of a retina reflected image and the position of a cornea reflected image on the basis of image data which are obtained with said camera under selective illumination of said first illuminator and said second illuminator, and calculating a sighting direction of the user on the basis of the position of the retina reflected image and the position of the cornea reflected image;

an user'"'"'s gaze judgment unit for judging the position at which the user gazes for a predetermined time, and outputting control information; and

a controller for receiving the control information from said user'"'"'s gaze judgment unit and selectively switching on one of the equipments on the basis of the control information, wherein the image data obtained by said camera include first image data obtained when said first and second illuminators are turned on, and second image data obtained when said second illuminator is turned on.

5. The sighting switch as claimed in claim 4, further comprising a third illuminator which is disposed at a different place from said first illuminator and illuminates the human'"'"'s eye-ball with light invisible to human beings, wherein the image data obtained by said camera includes first image data obtained when both said first and second illuminators are turned on, and second image data obtained when said third illuminator is turned on.

6. The sighting switch as claimed in claim 4, further comprising at least a third illuminator which is disposed at a different place from said first illuminator and illuminates the human'"'"'s eye-ball portion with light invisible to human beings, wherein the image data obtained by said camera includes first image data obtained when said first, second and third illuminators are turned on, and second image obtained when said third illuminator is turned on.