Electronic device configured to apply facial recognition based upon reflected infrared illumination and related methods

• US 8,831,295 B2
• Filed: 03/21/2012
• Issued: 09/09/2014
• Est. Priority Date: 03/21/2012
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: AuthenTec Incorporated (Apple Inc.)
• Inventors: Coons, David D.
• Primary Examiner(s): Ahmed, Samir
• Assistant Examiner(s): LE, TOTAM HA
• Application Number:
  US13/426,007
• Publication Number:
  US 20130251215A1
• Time in Patent Office: 902 Days
• Field of Search: 382/118
• US Class Current: 382/118
• CPC Class Codes: G06V 10/143 Sensing or illuminating at different wavelengths
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: H04N 23/20 for generating image signals from infrared radiation only
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

An electronic device may include a housing and at least one infrared (IR) proximity sensor carried by the housing. The at least one IR proximity sensor may include an IR emitter configured to emit IR illumination toward a user, and an IR sensor configured to sense reflected IR illumination from the user. The electronic device may also include a camera carried by the housing and configured to capture an image of the user'"'"'s face based upon the reflected IR illumination. The electronic device may further include a controller configured to apply facial recognition to the captured image of the user'"'"'s face based upon the reflected IR illumination.

Claims

1. An electronic device comprising:

a housing;

a finger biometric sensor carried by said housing;

a plurality of spaced apart first infrared (IR) emitters carried by the housing and configured to emit IR illumination toward a user;

at least one IR proximity sensor carried by said housing and comprising at least one second IR emitter configured to emit IR illumination toward the user, and an IR sensor configured to sense reflected IR illumination from the user;

a camera carried by said housing and configured to capture an image of the user'"'"'s face based upon the reflected IR illumination from the plurality of first IR emitters and the at least one second IR emitter; and

a controller configured to

apply facial recognition to the captured image of the user'"'"'s face based upon the reflected IR illumination,

perform at least one authentication function based upon the applied facial recognition, successively enable each of the plurality of first IR emitters,

apply gesture recognition based on the reflected IR illumination reflected by the user'"'"'s hand when each of the plurality of first IR emitters is enabled, and

perform at least one further authentication function based upon the finger biometric sensor.

2. The electronic device of claim 1, wherein said controller is configured to determine user proximity based upon said IR sensor.

3. The electronic device of claim 1, wherein said controller is configured operate said at least one second IR emitter to selectively illuminate the user'"'"'s face with an IR pattern.

4. The electronic device of claim 3, wherein the IR pattern comprises a grid.

5. The electronic device of claim 1, wherein said controller is configured to apply three-dimensional (3D) facial recognition.

6. The electronic device of claim 1, wherein said at least one IR proximity sensor is adjacent said finger biometric sensor.

7. The electronic device of claim 1, wherein said housing has front and back sides;

and further comprising a display coupled to said controller and carried by the front side; and

wherein said controller selectively operates said display based upon said at least one IR proximity sensor.

8. The electronic device of claim 7, wherein said at least one IR proximity sensor and said camera are carried by the front side of said housing.

9. A mobile wireless communications device comprising:

a housing;

a finger biometric sensor carried by said housing;

a plurality of spaced apart first infrared (IR) emitters carried by the housing and configured to emit IR illumination toward a user;

at least one IR proximity sensor carried by said housing and comprising at least one second IR emitter configured to emit IR illumination toward the user, and an IR sensor configured to sense reflected IR illumination from the user;

a camera carried by said housing and configured to capture an image of the user'"'"'s face based upon the reflected IR illumination from the plurality of first IR emitters and the at least one second IR emitter;

a controller configured to

apply facial recognition to the captured image of the user'"'"'s face based upon the reflected IR illumination, perform at least one authentication function based upon the applied facial recognition,

successively enable each of the plurality of first IR emitters,

apply gesture recognition based on the reflected IR illumination reflected by the user'"'"'s hand when each of the plurality of first IR emitters is enabled, and

perform at least one further authentication function based upon the finger biometric sensor; and

a wireless transceiver carried by said housing and coupled to said controller.

10. The mobile wireless communications device of claim 9, wherein said controller is configured to determine user proximity based upon said IR sensor.

11. The mobile wireless communications device of claim 9, wherein said controller is configured operate said at least one second IR emitter to selectively illuminate the user'"'"'s face with an IR pattern.

12. The mobile wireless communications device of claim 11, wherein the IR pattern comprises a grid.

13. The mobile wireless communications device of claim 9, wherein said controller is configured to apply three-dimensional (3D) facial recognition.

14. The mobile wireless communications device of claim 9, wherein said housing has front and back sides;

and further comprising a display coupled to said controller and carried by the front side; and

wherein said controller selectively operates said display based upon said at least one IR proximity sensor.

15. The mobile wireless communications device of claim 14, wherein said at least one IR proximity sensor and said camera are carried by the front side of said housing.

16. A method of applying facial recognition using an electronic device comprising a housing, a finger biometric sensor carried by the housing, a plurality of spaced apart first infrared (IR) emitters carried by the housing and configured to emit IR illumination toward a user, at least one IR proximity sensor carried by the housing and comprising at least one second IR emitter configured to emit IR illumination toward the user and an IR sensor configured to sense reflected IR illumination from the user, and a camera carried by the housing, the method comprising:

using the camera to capture an image of the user'"'"'s face based upon the reflected IR illumination from the plurality of first IR emitters and the at least one second IR emitter;

applying facial recognition to the captured image of the user'"'"'s face;

performing at least one authentication function based upon the applied facial recognition;

successively enable each of the plurality of first IR emitters;

apply gesture recognition based on the reflected IR illumination reflected by the user'"'"'s hand when each of the plurality of first IR emitters is enabled, and

performing at least one further authentication function based upon the finger biometric sensor.

17. The method of claim 16, further comprising determining user proximity based upon the IR sensor.

18. The method of claim 16, further comprising operating the at least one second IR emitter to selectively illuminate the user'"'"'s face with an IR pattern.

19. The method of claim 18, wherein the IR pattern comprises a grid.

20. The method of claim 16, wherein applying facial recognition comprises applying three-dimensional (3D) facial recognition.