METHOD AND APPARATUS FOR DETECTING A FIXATION POINT BASED ON FACE DETECTION AND IMAGE MEASUREMENT

• US 20120169596A1
• Filed: 09/29/2009
• Published: 07/05/2012
• Est. Priority Date: 09/29/2009
• Status: Abandoned Application

• Current Assignee: Alcatel-Lucent SA (Nokia Corporation)
• Original Assignee: Alcatel-Lucent SA (Nokia Corporation)
• Inventors: Zhuang, LongPeng
• Application Number:
  US13/496,565
• Publication Number:
  US 20120169596A1
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G06V 40/19 Sensors therefor

Abstract

The present invention provides an apparatus for detecting a fixation point based on face detection and image measurement, comprising: a camera for capturing a face image of a user; a reference table acquiring unit for acquiring a reference table comprising relations between reference face images and line-of-sight directions of the user; and a calculating unit for performing image measurement based on the face image of the user captured by the camera and looking up the reference table in a reference table acquiring unit, so as to calculate the fixation point of the user on the screen.

The present invention further provides a method of detecting a fixation point based on face detection and image measurement.

The present invention can detect a line-of-sight of the user, which provides great convenience for movement of a cursor.

Claims

1. An apparatus configured to detect a fixation point used to calculate a fixation point of a user on a screen, comprising:

a camera to capture a face image of the user;

a reference table acquiring unit to acquire a reference table comprising relations between reference face images and line-of-sight directions of the user; and

a calculating unit to perform image measurement based on the face image of the user captured by the camera and to look up the reference table in the reference table acquiring unit to calculate the fixation point of the user on the screen.

2. The apparatus of claim 1, wherein the reference table acquiring unit comprises at least one of:

a reference table constructing unit to construct the reference table based on at least one reference face image of the user captured by the camera; and

a reference table storing unit that stores the reference table which has already been constructed.

3. The apparatus of claim 1, wherein the calculating unit comprises:

a line-of-sight direction calculating unit to measure a distance between a middle point of two pupils of the user in the face image of the user and the camera based on a location of the camera, and to calculate the line-of-sight direction of the user through looking up the reference table; and

a fixation point calculating unit to calculate the fixation point of the user on the screen based on the location of the camera, the distance between the middle point of two pupils of the user and the camera, and the line-of-sight direction of the user.

4. The apparatus of claim 1, further comprising a cursor moving unit, wherein, after the fixation point is calculated, the cursor moving unit moves the cursor on the screen to the fixation point when the fixation point is located within the screen.

5. The apparatus of claim 1, wherein the cursor moving unit does not move the cursor when the distance between the fixation point and the current cursor is less than a predefined value.

6. The apparatus of claim 4, further comprising an auxiliary unit to perform an operation at the cursor location.

7. The apparatus of claim 6, wherein the auxiliary unit comprises at least one of a mouse, a keyboard, a touchpad, a handle, and a remote controller.

14. A multi-screen computer having multiple screens around a user, wherein the multi-screen computer comprises the apparatus configured to detect the fixation point as in claim 1.

8. A method of detecting a fixation point, for calculating a fixation point of a user on a screen, comprising the steps of:

acquiring a reference table comprising relations between reference face images and line-of-sight directions of the user; and

capturing a face image of the user, performing image measurement and looking up the reference table to calculate the fixation point of the user on the screen.

9. The method of claim 8, wherein the acquiring step further comprises the steps of:

using an image capture device to acquire at least one reference face image of the user to construct the reference table comprising relations between the reference face images and the line-of-sight directions of the user;

or directly obtaining the reference table which has already been constructed.

10. The method of claim 8, wherein the capturing step further comprises the steps of:

measuring a distance between a middle point of two pupils of the user in the face image of the user and an image capture device based on a location of the image capture device, and calculating the line-of-sight direction of the user through looking up the reference table; and

calculating the fixation point of the user on the screen based on the location of the image capture device, the distance between the middle point of two pupils of the user and the image capture device, and the line-of-sight direction of the user.

11. The method of claim 8, further comprising the step of, after calculating the fixation point, moving the cursor on the screen to the fixation point when the fixation point is within the screen.

12. The method of claim 11, wherein the cursor is not moved when the distance between the fixation point and the current cursor is less than a predefined value.

13. The method of claim 12, wherein the predefined value is set as required.