AUTHENTICATION APPARATUS, AUTHENTICATION METHOD, AND PROGRAM

• US 20140099005A1
• Filed: 09/05/2013
• Published: 04/10/2014
• Est. Priority Date: 10/09/2012
• Status: Active Grant

• Current Assignee: Sony Semiconductor Solutions Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Mogi, Hideaki
• Granted Patent: US 9,152,850 B2
• Time in Patent Office: Days
• US Class Current: 382/118
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G06V 40/70 Multimodal biometrics, e.g. combining information from different biometric modalities

Abstract

A face authentication procedure is performed on a face detected in a visible light image of a scene, and correctness of an authentication determination of the face authentication procedure is verified by comparing the visible light image to an infrared light image of the same scene. The verification may be performed by comparing the luminance and/or the size of an eye region in the visible light image to the luminance and/or the size of the eye region in the infrared light image.

Claims

1. An electronic device, comprising:

an imaging section comprising at least one image pickup unit, the imaging section being configured to image a scene and to generate a visible light image of the scene and an infrared light image of the scene;

a face authentication unit configured to perform a face authentication procedure on a face detected in the visible light image;

a verification unit configured to check an authentication determination of the face authentication unit by comparing the visible light image and the infrared light image.

2. The electronic device of claim 1,

wherein the verification unit is configured to check the authentication determination of the face authentication unit by comparing luminance data corresponding to an eye region in the visible light image with luminance data corresponding to an eye region in the infrared light image.

3. The electronic device of claim 2,

wherein the verification unit is configured to indicate that an authentication determination of the face authentication unit is suspect when a difference between the luminance data corresponding to the eye region in the visible light image and the luminance data corresponding to the eye region in the infrared light image is small.

4. The electronic device of claim 3,

wherein the luminance data corresponding to the eye region in the visible light image and the luminance data corresponding to the eye region in the infrared light image comprise binarized data.

5. The electronic device of claim 2, wherein the verification unit is configured to indicate that an authentication determination of the face authentication unit is suspect when a size of an iris region in the infrared light image is different from a size of an iris region in the visible light image.

6. The electronic device of claim 2, wherein the verification unit is configured to indicate that an authentication determination of the face authentication unit is suspect when a distribution of the luminance data corresponding to the eye region in the visible light image is different from a distribution of the luminance data corresponding to the eye region in the infrared light image.

7. The electronic device of claim 3,

wherein the verification unit is configured to detect a Purkinje image in the eye region in the infrared light image and to indicate that an authentication determination of the face authentication unit is suspect when no Purkinje image is detected in the eye region in the infrared light image.

8. The electronic device of claim 2,

wherein the at least one image pickup unit includes an image sensor that has visible light detection pixels that generate the visible light image and infrared light detection pixels that generate the infrared light image configured such that the visible light image and the infrared light image have the same field angle and are taken at the same time.

9. The electronic device of claim 8, further comprising:

a face detection unit configured to detect a face in the visible light image and generate a face image therefrom; and

an eye region detection unit configured to detect the eye region in the visible light image by searching the face image generated by the face detection unit and to output coordinates of the eye region in the visible light image to the verification unit,

wherein the verification unit is configured to determine the eye region in the infrared light image based on the coordinates output by the eye region detection unit, and

wherein the face authentication unit is configured to perform the face authentication procedure based on the face image generated by the face detection unit.

10. The electronic apparatus of claim 8,

further comprising an eye region detection unit configured to detect an eye region in the visible light image and to output coordinates of the eye region in the visible light image to the verification unit,

wherein the verification unit is configured to determine the eye region in the infrared light image based on the coordinates output by the eye region detection unit.

11. The electronic apparatus of claim 8,

further comprising an eye region detection unit configured to detect an eye region in the infrared light image and to output coordinates of the eye region in the infrared light image to the verification unit,

wherein the verification unit is configured to determine the eye region in the visible light image based on the coordinates output by the eye region detection unit.

12. The electronic device of claim 2,

wherein the at least one image pickup unit includes a first image pickup unit having a first image sensor that generates the visible light image and a second image pickup unit having a second image sensor that generates the infrared light image, the first and second image sensors being configured such that the visible light image and the infrared light image are taken at the same time.

13. The electronic device of claim 12, further comprising:

a face detection unit configured to detect a face in the visible light image and generate a face image therefrom;

a first eye region detection unit configured to detect the eye region in the visible light image by searching the face image generated by the face detection unit and to output coordinates of the eye region in the visible light image to the verification unit; and

a second eye region detection unit configured to detect the eye region in the infrared image,

wherein the face authentication unit is configured to perform the face authentication procedure based on the face image generated by the face detection unit.

14. The electronic device of claim 12, further comprising:

a first face detection unit configured to detect a face in the visible light image and generate a first face image therefrom;

a first eye region detection unit configured to detect the eye region in the visible light image by searching the first face image generated by the first face detection unit and to output coordinates of the eye region in the visible light image to the verification unit;

a second face detection unit configured to detect a face in the infrared light image and generate a second face image therefrom; and

a second eye region detection unit configured to detect the eye region in the infrared light image by searching the second face image generated by the second face detection unit and to output coordinates of the eye region in the infrared light image to the verification unit,

wherein the face authentication unit is configured to perform the face authentication procedure based on the first face image generated by the first face detection unit.

15. The electronic device of claim 2,

wherein the at least one image pickup unit includes an image sensor and a filter unit configured to vary a filter over the image sensor such that the image sensor generates the visible light image at a first timing and generates the infrared light image at a second timing, the visible light image and the infrared light image having the same field angle.

16. A mobile terminal apparatus comprising the electronic device of claim 1.

17. A computer system apparatus comprising the electronic device of claim 1.

18. A security system apparatus comprising the electronic device of claim 1.

19. A method of authentication comprising:

imaging a scene and generating a visible light image of the scene and an infrared light image of the scene;

performing a face authentication procedure on a face detected in the visible light image; and

checking a result of said face authentication procedure by comparing luminance data corresponding to an eye region in the visible light image with luminance data corresponding to an eye region in the infrared light image.

20. A non-transitory computer readable medium having program code stored thereon, the program code being executable by a processor to perform operations comprising:

imaging a scene and generating a visible light image of the scene and an infrared light image of the scene;

performing a face authentication procedure on a face detected in the visible light image; and

checking an result of said face authentication procedure by comparing luminance data corresponding to an eye region in the visible light image with luminance data corresponding to an eye region in the infrared light image.

21. An electronic device, comprising:

a face authentication unit configured to perform a face authentication procedure on a face detected in a visible light image of a scene; and

a verification unit configured to check an authentication determination of the face authentication unit by comparing the visible light image to an infrared light image of the same scene.