Face image recognition apparatus

• US 20030185423A1
• Filed: 07/26/2002
• Published: 10/02/2003
• Est. Priority Date: 07/27/2001
• Status: Active Grant

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Dobashi, Hironori
• Granted Patent: US 7,239,725 B2
• Time in Patent Office: Days
• US Class Current: 382/118
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G07C 9/37 using biometric data, e.g. fingerprints, iris scans or voice recognition

Abstract

A ten-key section which is used to input identification information such as a password or ID number is disposed on the lower right side of or directly below a camera so that the hand of a to-be-recognized person who inputs identification information such as a password or ID number will not obstruct inputting of a face image

Claims

1. A face image recognition apparatus which recognizes a person based on a face image, comprising:

an image input section which inputs a face image of a to-be-recognized person,

an illuminating section which applies light toward at least a face of the to-be-recognized person,

a feature amount extracting section which extracts a feature amount of the face of the to-be-recognized person based on the face image input by said image input section,

a feature amount registration section in which a reference feature amount is previously registered in correspondence to identification information of the to-be-recognized person,

a key input section which is disposed below said image input section as viewed from the to-be-recognized person and permits the to-be-recognized person to input his own identification information, and

a recognition section which recognizes the face image of the to-be-recognized person by acquiring a reference feature amount corresponding to identification information input by use of said key input section from said feature amount registration section based on the identification information and collating the thus acquired reference feature amount with a feature amount extracted by said feature amount extracting section.

2. The face image recognition apparatus according to claim 1, wherein said key input section is disposed on the lower right side of said image input section as viewed from the to-be-recognized person.

3. The face image recognition apparatus according to claim 1, wherein said key input section is disposed directly below said image input section as viewed from the to-be-recognized person.

4. The face image recognition apparatus according to claim 3, further comprising a display section which displays a face image of a to-be-recognized person input by said image input section.

6. The face image recognition apparatus according to one of the claims 1 and 5, wherein said illuminating section includes a first illuminating section which is disposed on the upper right side or upper left side of said image input section as viewed from the to-be-recognized person and applies light toward at least the face of the to-be-recognized person and a second illuminating section which is disposed below said image input section as viewed from the to-be-recognized person and applies light toward at least the face of the to-be-recognized person.

7. The face image recognition apparatus according to one of the claims 1 and 5, wherein said illuminating section is disposed on the upper right side or upper left side of said image input section as viewed from the to-be-recognized person.

8. The face image recognition apparatus according to one of the claims 1 and 5, further comprising a control section which prevents said key input section from functioning when no face image is input by said image input section.

9. The face image recognition apparatus according to one of the claims 1 and 5, wherein said image input section starts to input a face image of the to-be-recognized person when input of identification information by said key input section is started.

10. The face image recognition apparatus according to one of the claims 1 and 5, wherein the identification information of the to-be-recognized person is configured by characters of n (plural) digits, and said recognition section repeatedly performs a method for reducing the number of registration information items in response to input of the character of the nth digit when the n-digit identification information is input by said key input section and further reducing the number of registration information items in response to input of the character of the (n−

1)th digit until the character of the first digit is input and acquires a reference feature amount corresponding to the n-digit identification information.

5. A face image recognition apparatus which recognizes a person based on a face image, comprising:

a key input section which permits a to-be-recognized person to input his own identification information,

an image input section which is disposed inside said key input section and inputs a face image of a to-be-recognized person,

an illuminating section which applies light toward at least a face of the to-be-recognized person,

a feature amount extracting section which extracts a feature amount of the face of the to-be-recognized person based on the face image input by said image input section,

a feature amount registration section in which a reference feature amount is previously registered in correspondence to identification information of the to-be-recognized person, and

a recognition section which recognizes the face image of the to-be-recognized person by acquiring a reference feature amount corresponding to identification information input by use of said key input section from said feature amount registration section based on the identification information and collating the thus acquired reference feature amount with a feature amount extracted by said feature amount extracting section.

11. A face image recognition apparatus which recognizes a person based on a face image, comprising:

an image input section which inputs a face image of a to-be-recognized person,

a feature amount extracting section which extracts a feature amount of a face of the to-be-recognized person based on the face image input by said image input section,

a feature amount registration section in which a reference feature amount is previously registered in correspondence to identification information of the to-be-recognized person,

a key input section which permits the to-be-recognized person to input his own identification information configured by characters of plural digits, and

a recognition section which recognizes the face image of the to-be-recognized person by collating the face feature amount extracted by said feature amount extracting section with a reference feature amount as registration information of a number reduced and selected from said feature amount registration section based on identification information of at least one digit input by use of said key input section each time the identification information is input by one digit by use of said key input section.

12. The face image recognition apparatus according to claim 11, wherein said recognition section holds identification information as the recognition result in the case where recognition is successfully made by use of the face image before all of the digits of the identification information are input by said key input section and determines whether or not the identification information held as the recognition result and the identification information input by the to-be-recognized person coincide with each other in the case where the to-be-recognized person inputs all of the digits of the identification information by use of said key input section.

13. The face image recognition apparatus according to claim 11, wherein said recognition section includes a searching section which reduces the number of registration information items registered in said feature amount registration section based on identification information of at least one digit input by use of said key input section each time the identification information is input by one digit by use of said key input section, a calculating section which calculates similarities between the registration information items of the number reduced by said searching section and the face feature amount extracted by said feature amount extracting section and derives a maximum similarity, a first determining section which determines a recognition result based on registration information which gives the maximum similarity in the case where the maximum similarity calculated by said calculating section is larger than a preset threshold value, and a second determining section which determines that recognition by use of the face image results in failure in the case where the to-be-recognized person inputs all of the digits of the identification information while the maximum similarity calculated by said calculating section is kept not larger than the preset threshold value.

14. The face image recognition apparatus according to claim 13, wherein said recognition section further includes a holding section which holds identification information as a recognition result in the case where the maximum similarity calculated by said calculating section is larger than a preset threshold value, a determining section which determines whether or not the identification information held in said holding section and the identification information input by use of said key input section coincide with each other when all of the digits of the identification information are input by use of said key input section while the identification information as the recognition result is held in said holding section, said first determining section determines a recognition result based on registration information which gives the maximum similarity in the case where said determining section determines that the identification information items coincide with each other, and said second determining section determines that recognition by use of the face image results in failure in the case where said determining section determines that the identification information items do not coincide with each other.

15. A passage control apparatus which recognizes a face image of a passer and controls the passage of the passer, comprising:

an image input section which inputs a face image of a passer,

an illuminating section which applies light toward at least a face of the passer,

a feature amount extracting section which extracts a feature amount of the face of the passer based on the face image input by said image input section,

a feature amount registration section in which a reference feature amount is previously stored in correspondence to identification information of the passer,

a key input section which is disposed below said image input section as viewed from the passer and permits the passer to input his own identification information,

a recognition section which recognizes the face image of the passer by acquiring a reference feature amount corresponding to identification information input by use of said key input section from said feature amount registration section based on the identification information and collating the thus acquired reference feature amount with the feature amount extracted by said feature amount extracting section, and

a passage control section which controls the passage of the passer based on the recognition result by said recognition section.

16. The passage control apparatus according to claim 15, wherein said key input section is disposed on the lower right side of said image input section as viewed from the passer.

17. The passage control apparatus according to claim 15, wherein said key input section is disposed directly below said image input section as viewed from the passer.

18. The passage control apparatus according to claim 15, further comprising a display section which displays the face image of the passer input by said image input section.

20. The passage control apparatus according to one of the claims 15 and 19, wherein said illuminating section includes a first illuminating section which is disposed on the upper right side or upper left side of said image input section as viewed from the passer and applies light toward at least the face of the passer and a second illuminating section which is disposed below said image input section and applies light toward at least the face of the passer.

21. The passage control apparatus according to one of the claims 15 and 19, wherein said illuminating section is disposed on the upper right side or upper left side of said image input section as viewed from the passer.

22. The passage control apparatus according to one of the claims 15 and 19, further comprising a control section which performs a control operation to prevent said key input section from functioning when no face image is input by said image input section.

23. The passage control apparatus according to one of the claims 15 and 19, wherein said image input section starts to input a face image of the passer when input of identification information by said key input section is started.

24. The passage control apparatus according to one of the claims 15 and 19, wherein identification information of the passer is configured by characters of n (plural) digits, and said recognition section repeatedly performs a method for reducing the number of registration information items in response to input of the character of the nth digit when n-digit identification information is input by said key input section and further reducing the number of registration information items in response to input of the character of the (n−

1)th digit until the character of the first digit is input and acquires a reference feature amount corresponding to the n-digit identification information.

19. A passage control apparatus which recognizes a face image of a passer and controls the passage of the passer, comprising:

a key input section which permits the passer to input his own identification information,

an image input section which is disposed inside said key input section and inputs a face image of a passer,

an illuminating section which applies light toward at least a face of the passer,

a feature amount extracting section which extracts a feature amount of the face of the passer based on the face image input by said image input section,

a feature amount registration section in which a reference feature amount is previously stored in correspondence to identification information of the passer,

a recognition section which recognizes the face image of the passer by acquiring a reference feature amount corresponding to identification information input by use of said key input section from said feature amount registration section based on the identification information and collating the thus acquired reference feature amount with the feature amount extracted by said feature amount extracting section, and

a passage control section which controls the passage of the passer based on the recognition result by said recognition section.

25. A passage control apparatus which recognizes a face image of a passer and controls the passage of the passer, comprising:

an image input section which inputs a face image of a passer,

a feature amount extracting section which extracts a feature amount of a face of the passer based on the face image input by said image input section,

a feature amount registration section in which a reference feature amount corresponding to identification information of each registrant is previously registered as registration information,

a key input section which permits the passer to input his own identification information configured by characters of plural digits, and

a recognition section which recognizes the face image of the passer by collating the face feature amount extracted by said feature amount extracting section with a reference feature amount as the registration information of a number reduced and selected from said feature amount registration section based on identification information of at least one digit input by use of said key input section each time the identification information is input by one digit by use of said key input section.

26. The passage control apparatus according to claim 25, wherein said recognition section holds identification information as the recognition result when recognition is successfully made by use of the face image before all of the digits of the identification information are input by said key input section and determines whether or not the identification information held as the recognition result and the identification information input by the passer coincide with each other when the passer inputs all of the digits of the identification information by use of said key input section.

27. The passage control apparatus according to claim 25, wherein said recognition section includes a searching section which reduces the number of registration information items registered in said feature amount registration section based on identification information of at least one digit input by use of said key input section each time the identification information is input by one digit by use of said key input section, a calculating section which calculates similarities between the registration information items of the number reduced by said searching section and the face feature amount extracted by said feature amount extracting section and derives a maximum one of the similarities, a first determining section which determines a recognition result based on registration information which gives the maximum similarity in the case where the maximum similarity calculated by said calculating section is larger than a preset threshold value, and a second determining section which determines that recognition by use of the face image results in failure in the case where the passer inputs all of the digits of the identification information while the maximum similarity calculated by said calculating section is kept not larger than the preset threshold value.

28. The passage control apparatus according to claim 27, wherein said recognition section further includes a holding section which holds identification information as a recognition result in the case where the maximum similarity calculated by said calculating section is larger than a preset threshold value, a determining section which determines whether or not the identification information held in said holding section and the identification information input by use of said key input section coincide with each other when all of the digits of the identification information are input by use of said key input section while the identification information as the recognition result is held in said holding section, said first determining section determines a recognition result based on registration information which gives the maximum similarity in the case where said determining section determines that the identification information items coincide with each other, and said second determining section determines that recognition by use of the face image results in failure in the case where said determining section determines that the identification information items do not coincide with each other.

29. A passage control apparatus which recognizes a face image of a visitor and controls an open/close state of an entrance/exit door of a visiting destination based on the recognition result, comprising:

an image input section which inputs at least a face image of a visitor,

an illuminating section which applies light toward at least a face of the visitor,

a feature amount extracting section which extracts a face feature amount of the visitor based on the face image input by said image input section,

a feature amount registration section in which a reference feature amount is previously registered in correspondence to identification information of the visiting destination,

a key input section which is disposed below said image input section as viewed from the visitor and permits the visitor to input the identification information of the visiting destination,

a recognition section which recognizes the face image of the visitor by acquiring a reference feature amount corresponding to identification information input by said key input section from said feature amount registration section based on the identification information and collating the thus acquired reference feature amount with a feature amount extracted by said feature amount extracting section, and

a door control section which controls the open/close state of the entrance/exit door of the visiting destination based on the recognition result of said recognition section.

30. The passage control apparatus according to is claim 29, wherein said key input section includes a call button which is used to call a person who lives in a visiting destination and makes it possible to call a person who lives in an object visiting destination by use of said call button when said recognition section cannot recognize the face image of the visitor.

31. The passage control apparatus according to claim 29, further comprising an image recording section which records a face image input by said image input section when said recognition section cannot recognize the face image of the visitor.

32. The passage control apparatus according to claim 29, wherein the identification information of the visiting destination input by said key input section is a number inherent to a person who lives in a visiting destination.

33. The passage control apparatus according to claim 29, wherein the entrance/exit door of the visiting destination can be locked/unlocked by use of a physical key which includes an identifying portion inherent to the visiting destination and the identification information of the visiting destination can be acquired by recognizing the identifying portion.

34. A face image recognition method used in a face image recognition apparatus including a feature amount registration section in which identification information configured by characters of plural digits assigned to at least one registrant and a reference feature amount of at least one registrant corresponding to the identification information are previously registered as registration information, comprising:

inputting a face image of a to-be-recognized person,

extracting a face feature amount of the to-be-recognized person based on the input face image,

permitting the to-be-recognized person to input his own identification information configured by characters of plural digits for each digit by use of an operation key, and

recognizing the face image of the to-be-recognized person by collating the face feature amount extracted based on the input face image with a reference feature amount as registration information of a number reduced and selected from the feature amount registration section based on identification information of at least one digit input each time the identification information is input by one digit by use of the operation key.

35. The A passage control method according to claim 34, wherein said recognizing the face image of the to-be-recognized person includes holding identification information as a recognition result when recognition by use of the face image is successfully made before all of the digits of the identification information are input by use of the operation key, and determining whether or not the identification information held as the recognition result and the identification information input by the to-be-recognized person coincide with each other when the to-be-recognized person inputs all of the digits of the identification information by use of the operation key.

36. A passage control method used in a passage control apparatus including a feature amount registration section in which identification information configured by characters of plural digits assigned to at least one person who is permitted to pass through and a reference feature amount of at least one person corresponding to the identification information are previously registered as registration information, comprising:

inputting a face image of a passer,

extracting a face feature amount of the passer based on the input face image,

permitting the passer to input his own identification information configured by characters of plural digits for each digit by use of an operation key,

recognizing the face image of the passer by collating the face feature amount extracted based on the input face image with a reference feature amount as registration information of a number reduced and selected from the feature amount registration section based on identification information of at least one digit input by use of the operation key each time the identification information is input by one digit by use of the operation key, and

controlling the passage of the passer based on the recognition result obtained by said recognizing the face image of the passer.

37. The passage control method according to claim 36, wherein said recognizing the face image of the passer includes holding identification information as a recognition result when recognition by use of the face image is successfully made before all of the digits of the identification information are input by use of the operation key, and determining whether or not the identification information held as the recognition result and the identification information input by the passer coincide with each other when the passer inputs all of the digits of the identification information by use of the operation key.