Sight-Line Detection Method and Device, and Three-Dimensional View-Point Measurement Device
First Claim
1. A line-of-sight detection method of a subject using:
- a first camera for measuring the position of a pupil relative to a coordinate system;
a second camera having a light source arranged at a known position in the coordinate system and forming a corneal reflection center to obtain data of a size of vector r from the corneal reflection center to a pupil center and an angle φ
of the vector r relative to a coordinate axis of the coordinate system; and
a calculation means for calculating the line-of-sight direction for executing steps below based on information from each of the cameras, comprises the stages of;
determining a relational formula, including the steps of;
obtaining data on a coordinate point O of the position of a pupil of a subject with the first camera by making the subject gaze at on a known point G in the coordinate system;
obtaining, in the state of the subject, data of the corneal reflection center, a size of vector r from the reflection center to a pupil center P, and an inclination φ
of the vector r relative to the coordinate axis with the second camera;
calculating an angle θ
between a line connecting a reference position of the second camera and the pupil center and a line-of-sight of the subject by the calculation means; and
calculating a formula θ
=f(r*) showing a relationship between r* related to r and θ
based on the measured values and calculated value; and
determining a line-of-sight, including the steps of;
obtaining data on a coordinate point O′
of the pupil position of the subject with the first camera by making the subject gaze at an unknown point G′
in the coordinate system;
obtaining data of the corneal reflection center, a size of vector r′
from the reflection center to the pupil center P, and an inclination φ
′
of the vector r′
relative to the coordinate axis with the second camera; and
calculating θ
=f(r*′
) by using the relational formula to obtain the unknown point G′
from the inclination φ
′ and
θ
′
.
1 Assignment
0 Petitions
Accused Products
Abstract
A method and device for detecting a line-of-sight of a subject and a three-dimensional view-point measurement device are provided. The method for detecting a line-of-sight uses a first camera 10, 11 that measure the position of a pupil relative to a coordinate system, a second camera 12 having a light source arranged at a known position in the coordinate system and forming a corneal reflection center to obtain data of a size of vector r from the corneal reflection center to the pupil center and an angle φ of the vector r relative to a coordinate axis of the coordinate system, and a calculation means for calculating a line-of-sight direction based on information from each of the cameras. In a stage of determining a relational formula, a subject is made to gaze at a known point to perform measurement and a relational formula is determined. In a stage of determining a line-of-sight, the subject is measured again to determine the line-of-sight using the relational formula. Further, a three-dimensional view-point measurement device can be configured so as to simultaneously measure the line-of-sights of both eyes with two cameras and two light sources.
45 Citations
13 Claims
-
1. A line-of-sight detection method of a subject using:
-
a first camera for measuring the position of a pupil relative to a coordinate system;
a second camera having a light source arranged at a known position in the coordinate system and forming a corneal reflection center to obtain data of a size of vector r from the corneal reflection center to a pupil center and an angle φ
of the vector r relative to a coordinate axis of the coordinate system; and
a calculation means for calculating the line-of-sight direction for executing steps below based on information from each of the cameras, comprises the stages of;
determining a relational formula, including the steps of;
obtaining data on a coordinate point O of the position of a pupil of a subject with the first camera by making the subject gaze at on a known point G in the coordinate system;
obtaining, in the state of the subject, data of the corneal reflection center, a size of vector r from the reflection center to a pupil center P, and an inclination φ
of the vector r relative to the coordinate axis with the second camera;
calculating an angle θ
between a line connecting a reference position of the second camera and the pupil center and a line-of-sight of the subject by the calculation means; and
calculating a formula θ
=f(r*) showing a relationship between r* related to r and θ
based on the measured values and calculated value; and
determining a line-of-sight, including the steps of;
obtaining data on a coordinate point O′
of the pupil position of the subject with the first camera by making the subject gaze at an unknown point G′
in the coordinate system;
obtaining data of the corneal reflection center, a size of vector r′
from the reflection center to the pupil center P, and an inclination φ
′
of the vector r′
relative to the coordinate axis with the second camera; and
calculating θ
=f(r*′
) by using the relational formula to obtain the unknown point G′
from the inclination φ
′ and
θ
′
. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. An line-of-sight detection device of the subject, comprising:
-
a first camera for measuring a position P of a pupil relative to the coordinate system;
a second camera having a light source arranged at a known position in the coordinate system to obtain data of a size of vector r from a corneal reflection center to a pupil center illuminated by the light source and an angle φ
of r relative to the coordinate axis; and
a calculation means for executing the steps of;
obtaining data on a coordinate point P of the position of a pupil of a subject with the first camera by making the subject gaze at a known point G in the coordinate system;
obtaining, in the state of the subject, data of the corneal reflection center, a size of vector r from the reflection center to a pupil center P, and an inclination φ
of the vector r relative to the coordinate axis with the second camera;
calculating an angle φ
between a line connecting a reference position of the second camera and the pupil center and the line-of-sight of the subject and calculating a formula θ
=f(r*) showing a relationship between r* related to r and θ
;
obtaining data on a coordinate point O′
of the pupil position of the subject with the first camera by making the subject gaze at an unknown point G′
in the coordinate system;
obtaining data of the corneal reflection center, a size of vector r′
from the reflection center to the pupil center P, and an inclination φ
of the vector r′
relative to the coordinate axis with the second camera; and
calculating θ
=f(r*′
) from r*′
related to r′
by using the relational formula to further obtain the unknown point G′
from φ
′ and
θ
′
.
-
-
8. A three-dimensional view-point measurement device, comprising:
- two cameras, a first light source arranged near one of the two cameras, a second light source arranged near another of the two cameras, a control means for controlling ON/OFF of the first light source and the second light source and obtaining an image signal in sync with ON/OFF, and a calculation means for extracting a pupil and corneal reflection from the obtained image signal.
- View Dependent Claims (11)
-
9. A three-dimensional view-point measurement device, comprising:
- two cameras, a first light source arranged near one of the two cameras, a second light source arranged near another of the two cameras, a control means for controlling ON/OFF of the first light source and the second light source and obtaining an image signal in sync with ON/OFF, and a calculation means for extracting a pupil and corneal reflection from the obtained image signal and calculating a line of-sight vector from these positions.
- View Dependent Claims (12)
-
10. A three-dimensional view-point measurement device, comprising:
- two cameras, a first light source arranged near one of the two cameras, a second light source arranged near another of the two cameras, a control means for controlling ON/OFF of the first light source and the second light source and obtaining an image signal in sync with ON/OFF, and a calculation means for extracting a pupil and corneal reflection from the obtained image signal and calculating a three-dimensional position of the pupil from these positions.
- View Dependent Claims (13)
Specification