Masquerade detection system, masquerade detection method and masquerade detection program

• US 8,315,441 B2
• Filed: 06/17/2008
• Issued: 11/20/2012
• Est. Priority Date: 06/29/2007
• Status: Active Grant

• Current Assignee: NEC Corporation
• Original Assignee: NEC Corporation
• Inventors: Hamada, Yasushi
• Primary Examiner(s): Werner, Brian P
• Application Number:
  US12/602,930
• Publication Number:
  US 20100177939A1
• Time in Patent Office: 1,617 Days
• Field of Search: None
• US Class Current: 382/118
• CPC Class Codes: A61B 5/1176 Recognition of faces
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/40 Spoof detection, e.g. liveness detection

Abstract

To provide a masquerade detection system which can detect a masquerade using a photograph, a picture or the like, without using an additional device other than an image picking-up device. A masquerade detection method includes an image conversion step in which an image conversion from one flat plane to the other flat plane is carried out from a first image of an examining object picked up from a first angle into a second image of an examining object picked up from a second angle different from the first angle to generate a converted image, and a masquerade judging step in which the converted image and the second image are entirely or partially compared with each other and, if a compared result satisfies a predetermined condition, an attempt to do a masquerade is judged.

Claims

1. A masquerade detection method for detecting a masquerade by comparing an image containing an examining object with an image, which is a target for comparison, containing an examining object, comprising:

obtaining an image converting method by comparing an image of a first portion of the examining object picked up from one angle with an image of the first portion of the examining object picked up from other angle;

based on the obtained image converting method, converting an image containing the examining object picked up from the one angle into an image of the examining object picked up from the other angle different from the one angle, by performing an image conversion from one flat plane to other flat plane; and

judging the masquerade by comparing an image of a second portion different from the first portion in the converted image which is converted from one flat plane to other flat plane and an image of the second portion different from the first portion in the image containing the examining object picked up from the other angle.

2. The masquerade detection method as claimed in claim 1, comprising:

obtaining the image converting method by using the image of the first portion and an image of the portion other than the examining object when comparing the image of the first portion of the examining object picked up from the one angle with the image of the first portion of the examining object picked up from the other angle.

3. The masquerade detection method as claimed in claim 1, comprising:

using a picked up facial image as the image of the examining object.

4. The masquerade detection method as claimed in claim 1, comprising:

using a picked up image containing four or more points from among center points or contour points of;

both eyes;

eyebrows;

a mouth;

or nostrils, as the first portion image.

5. The masquerade detection method as claimed in claim 1, comprising:

using a picked up image containing both center points of eyes, and both endpoints of a mouth, as the first portion image.

6. The masquerade detection method as claimed in claim 1, comprising:

using a picked up image showing both center points of eyes;

a center point of a mouth;

a size of the mouth; and

a slope of the mouth, as the first portion image.

7. The masquerade detection method as claimed in claim 1, comprising:

using a picked up image including a facial contour as the second portion image.

8. The masquerade detection method as claimed in claim 1, comprising:

using a picked up image including a nose as the second portion image.

9. The masquerade detection method as claimed in claim 1, comprising:

comparing the images containing the second portions by using images of entire examining object containing the second portion.

10. The masquerade detection method as claimed in claim 1, comprising:

using a picked up image containing the cheek part between the mouth and the facial contour as the image of the second portion; and

comparing the images containing the second portions by setting the length of the cheek part as a reference.

11. The masquerade detection method as claimed in claim 1, comprising:

comparing the images containing the second portions by setting a difference in the luminance values of the images as a reference.

12. The masquerade detection method as claimed in claim 1, comprising:

comparing the images containing the second portions by setting a normalized correlation value of the luminance values of the images as a reference.

13. The masquerade detection method as claimed in claim 1, comprising:

obtaining images picked up from different angles by picking up corresponding to a postural change of the examining object.

14. A masquerade detection system for detecting a masquerade by comparing an image containing an examining object with an image, which is a target for comparison, containing an examining object, comprising:

an image converting device which obtains an image converting method by comparing an image of a first portion of the examining object picked up from one angle with an image of the first portion of the examining object picked up from other angle, and based on the obtained image converting method, converts an image containing the examining object picked up from one angle into an image of the examining object picked up from other angle different from the one angle, by performing an image conversion from one flat plane to other flat plane; and

a judging device which judges the masquerade by comparing an image of a second portion different from the first portion in the converted image which is converted from one flat plane to other flat plane and an image of the second portion different from the first portion in the image containing the examining object picked up from the other angle.

15. The masquerade detection system as claimed in claim 14, wherein:

the image converting device obtains the image converting method by using the image of the first portion and an image of a portion other than the examining object when comparing the image of the first portion of the examining object picked up from the one angle with the image of the first portion of the examining object picked up from the other angle.

16. The masquerade detection system as claimed in claim 14, wherein:

the image converting device uses a picked up facial image as the image of the examining object.

17. The masquerade detection system as claimed in claim 14, wherein:

the image converting device uses a picked up image containing four or more points from among center points or contour points of;

both eyes;

eyebrows;

a mouth;

or nostrils, as the first portion image.

18. The masquerade detection system as claimed in claim 14, wherein:

the image converting device uses a picked up image containing both center points of eyes, and both endpoints of a mouth, as the first portion image.

19. The masquerade detection system as claimed in claim 14, wherein:

the image converting device uses a picked up image showing both center points of eyes;

a center point of a mouth;

a size of the mouth; and

a slope of the mouth, as the first portion image.

20. The masquerade detection system as claimed in claim 14, wherein:

the judging device uses a picked up image including a facial contour as the second portion image.

21. The masquerade detection system as claimed in claim 14, wherein:

the judging device uses a picked up image including a nose as the second portion image.

22. The masquerade detection system as claimed in claim 14, wherein:

the judging device compares the images containing the second portions by using images of the entire examining object containing the second portion.

23. The masquerade detection system as claimed in claim 14, wherein:

the judging device uses a picked up image containing the cheek part between the mouth and the facial contour as the image of the second portion, and compares the images containing the second portions by setting the length of the cheek part as a reference.

24. The masquerade detection system as claimed in claim 14, wherein:

the judging device compares the images containing the second portions by setting a difference in the luminance values of the images as a reference.

25. The masquerade detection system as claimed in claim 14, wherein:

the judging device compares the images containing the second portions by setting a normalized correlation value of the luminance values of the images as a reference.

26. The masquerade detection system as claimed in claim 14, comprising:

a device which obtains images picked up from different angles by picking up corresponding to a postural change of the examining object.

27. A computer readable recording medium storing a masquerade detection program for controlling a detection of a masquerade by comparing an image containing an examining object with an image, which is a target for comparison, containing an examining object, causing a computer to execute:

a function of obtaining an image converting method by comparing an image of a first portion of the examining object picked up from one angle with an image of the first portion of the examining object picked up from other angle;

a function of, based on the obtained image converting method, converting an image containing the examining object picked up from the one angle into an image of the examining object picked up from the other angle different from the one angle, by performing an image conversion from one flat plane to other flat plane; and

a function of judging the masquerade by comparing an image of a second portion, different from the first portion, in the converted image which is converted from one flat plane to other flat plane and an image of the second portion, different from the first portion, in the image containing the examining object picked up from the other angle.

28. The computer readable recording medium storing the masquerade detection program as claimed in claim 27, causing a computer to execute:

a function of obtaining the image converting method by using the image of the first portion and the image of a portion other than the examining object when comparing the image of the first portion of the examining object picked up from the one angle with the image of the first portion of the examining object picked up from the other angle.

29. The computer readable recording medium storing the masquerade detection program as claimed in claim 27, causing a computer to execute:

a function of obtaining the image converting method by using a picked up facial image as the image of the examining object.

30. The computer readable recording medium storing the masquerade detection program as claimed in claim 27, causing a computer to execute:

a function of obtaining the image converting method by using a picked up image containing four or more points from among center points or contour points of;

both eyes;

eyebrows;

a mouth;

or nostrils, as the first portion image.

31. The computer readable recording medium storing the masquerade detection program as claimed in claim 27, causing a computer to execute:

a function of obtaining the image converting method by using a picked up image containing both center points of eyes, and both endpoints of mouth, as the first portion image.

32. The computer readable recording medium storing the masquerade detection program as claimed in claim 27, causing a computer to execute:

a function of obtaining the image converting method by using a picked up image showing both center points of eyes;

a center point of a mouth;

a size of the mouth; and

a slope of the mouth, as the first portion image.

33. The computer readable recording medium storing the masquerade detection program as claimed in claim 27, causing a computer to execute:

a function of judging the masquerade by using a picked up image including a facial contour as the second portion image.

34. The computer readable recording medium storing the masquerade detection program as claimed in claim 27, causing a computer to execute:

a function of judging the masquerade by using a picked up image including a nose as the second portion image.

35. The computer readable recording medium storing the masquerade detection program as claimed in claim 27, causing a computer to execute:

a function of comparing the images containing the second portions by using images of the entire examining object containing the second portion.

36. The computer readable recording medium storing the masquerade detection program as claimed in claim 27, causing a computer to execute:

a function of, by using a picked up image containing the cheek part between the mouth and the facial contour as the image of the second portion, comparing the images containing the second portions by setting the length of the cheek part as a reference.

37. The computer readable recording medium storing the masquerade detection program as claimed in claim 27, causing a computer to execute:

a function of comparing the images containing the second portions by setting a difference in the luminance values of the images as a reference.

38. The computer readable recording medium storing the masquerade detection program as claimed in claim 27, causing a computer to execute:

a function of comparing the images containing the second portions by setting a normalized correlation value of the luminance values of the images as a reference.

39. A masquerade detection system for detecting a masquerade by comparing an image containing an examining object with an image, which is a target for comparison, containing an examining object, comprising:

image converting means for obtaining an image converting method by comparing an image of a first portion of the examining object picked up from one angle with an image of the first portion of the examining object picked up from other angle, and based on the obtained image converting method, converting an image containing the examining object picked up from one angle into an image of the examining object picked up from other angle different from the one angle, by performing an image conversion from one flat plane to other flat plane; and

judging means for judging the masquerade by comparing an image of a second portion different from the first portion in the converted image which is converted from one flat plane to other flat plane and an image of the second portion different from the first portion in the image containing the examining object picked up from the other angle.