Method and apparatus for user recognition using CCD cameras

• US 7,660,444 B2
• Filed: 04/01/2004
• Issued: 02/09/2010
• Est. Priority Date: 02/24/2000
• Status: Expired due to Term

• Current Assignee: RPX Corporation
• Original Assignee: Nokia Corporation
• Inventors: Hämäläinen, Jani
• Primary Examiner(s): Bali; Vikkram
• Assistant Examiner(s): Rice; Elisa M
• Application Number:
  US10/816,523
• Publication Number:
  US 20040218070A1
• Time in Patent Office: 2,140 Days
• Field of Search: None
• US Class Current: 382/118
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G07C 9/37 using biometric data, e.g. fingerprints, iris scans or voice recognition

Abstract

A user recognition system that utilizes two CCD cameras to obtain two images of the user from two different angles of view. A three-dimensional model of the user'"'"'s face is created from the obtained images in addition. The generated model and an additional facial texture image of the user are compared with a stored user profile. When the obtained 3D model and facial texture information matches the stored profile of the user, access is granted to the system.

Claims

1. An apparatus, comprising:

at least one camera directed toward a user'"'"'s face and configured to record at least two still images of a user from at least first and second angles of view and to obtain at least one additional still image of the user'"'"'s face in addition to the at least two still images;

a processor connected to said at least one camera, configured to process the at least two still images obtained by said at least one camera and to generate a 3-dimensional model of the user'"'"'s face using the at least two still images and to generate a facial texture bit map of the user'"'"'s face using the at least one additional still image of the user'"'"'s face, and to compare the generated 3-dimensional model and the facial texture bit map with the stored user profile information to determine whether the user is authorized to access the system, said processor comprising an access device configured to grant access to the system when the generated model and the facial texture bit map matches the profile information of one of the authorized users stored in a memory, thereby indicating recognition and authorization of the user, and an updater configured to update the profile information of the one of the authorized users with the generated model after each grant of access by said access device such that the updated profile information comprises an average of the generated model and the previously stored profile information; and

a transmitter configured to transmit the images to a server over a network and to receive a 3-dimensional model and a facial texture bit map from the server.

2. An apparatus, comprising:

at least one charged coupled camera configured to obtain at least two still images of a user'"'"'s face from at least two different predetermined angles of view and to obtain at least one additional still image of the user'"'"'s face in addition to the at least two still images; and

a processor configured to connect to said at least one charge coupled camera and said light source to generate a 3-dimensional model of the user'"'"'s face using the at least two still images, and to generate a facial texture bit map of the user'"'"'s face using the at least one additional still image, said processor is configured to compare the 3-dimensional model and the facial texture bit map to the stored user profile information contained in a memory and to access the system when the generated 3-dimensional model and facial texture bit map match a user profile stored in said memory, and wherein said apparatus is operatively configured to transmit the images to a server over a network and receive a 3-dimensional model and a facial texture bit map from the server.

3. The apparatus of claim 2, further comprising a light source to project structured light on the user'"'"'s face to obtain said at least two still images of the user'"'"'s face.

4. The apparatus of claim 2, wherein said apparatus is a mobile telephone.

5. A method, comprising:

obtaining, by a mobile apparatus, at least two 2-dimensional still images of a user from at least two different angles of view;

sending the images to a server over a network;

generating, by the server, a 3-dimensional model of a user'"'"'s face from the obtained images;

determining, by the server, the user'"'"'s facial shape using the generated 3-dimensional model;

sending the 3-dimensional model and the user'"'"'s facial shape to the mobile apparatus;

comparing, at the mobile apparatus, the determined facial shape with profile information stored in memory, the profile information comprising data relating to the facial shape of authorized users; and

determining, at the mobile apparatus whether the determined facial shape matches the profile information stored in the memory.

6. The method of claim 5, wherein the mobile apparatus is a mobile telephone.

10. The method of claim 5, wherein said memory comprises at least one of RAM, ROM, EPROM and a magnetic storage media.

11. The method of claim 5, further comprising:

determining an angle between said at least first and second angles of view to determine an orientation of said mobile apparatus.

7. An apparatus, comprising:

at least one camera configured to obtain at least two 2-dimensional still images of a user from at least two different angles of view;

a processor configured to generate a 3-dimensional model of the user'"'"'s face from the obtained images to determine the user'"'"'s facial shape using the generated 3-dimensional model, comparing the determined facial shape with profile information stored in memory, the profile information comprising data relating to the facial shape of authorized users, and determining whether the determined facial shape matches the profile information stored in the memory; and

a transmitter configured to send the images to a server over a network and to send the 3-dimensional model and the user'"'"'s facial shape to the mobile apparatus.

8. An apparatus, comprising:

obtaining means for obtaining at least two 2-dimensional still images of a user from at least two different angles of view;

generating means for generating a 3-dimensional model of the user'"'"'s face from the obtained images;

shape determining means for determining the user'"'"'s facial shape using the generated 3-dimensional model;

comparing means for comparing the determined facial shape with profile information stored in memory, the profile information comprising data relating to the facial shape of authorized users;

match determining means for determining whether the determined facial shape matches the profile information stored in the memory; and

transmitting means for transmitting the images to a server over a network and for transmitting the 3-dimensional model and the user'"'"'s facial shape to a mobile apparatus.

9. A computer program embodied on a computer readable medium, said computer program configured to control a processor to perform:

obtaining, by a mobile apparatus, at least two 2-dimensional still images of a user from at least two different angles of view;

sending the images to a server over a network;

generating, by the server, a 3-dimensional model of a user'"'"'s face from the obtained images;

determining, by the server, the user'"'"'s facial shape using the generated 3-dimensional model;

sending the 3-dimensional model and the user'"'"'s facial shape to the mobile apparatus;

comparing, at the mobile apparatus, the determined facial shape with profile information stored in memory, the profile information comprising data relating to the facial shape of authorized users; and

determining, at the mobile apparatus whether the determined facial shape matches the profile information stored in the memory.