Unauthorized person detection device and unauthorized person detection method

• US 20060093183A1
• Filed: 02/12/2004
• Published: 05/04/2006
• Est. Priority Date: 02/13/2003
• Status: Active Grant

• Current Assignee: NEC Corporation
• Original Assignee: NEC Corporation
• Inventors: Hosoi, Toshinori
• Granted Patent: US 7,680,299 B2
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G06V 10/145 Illumination specially adapted for pattern recognition, e.g. using gratings
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/40 Spoof detection, e.g. liveness detection

Abstract

In masquerading determination processing, a masquerading determination unit reads image data representing an image of an identification target on which a striped pattern is projected from an image storage unit to extract the striped pattern appearing in a face region of the image represented by the read image data. Subsequently, the masquerading determination unit determines whether a stripe in the face region in the image is a straight line or not. When the stripe is a straight line, because the identification target is a plane object such as a photograph or an image display device so that it can be determined that the target is at least not a person himself, the masquerading determination unit determines that the target masquerades. On the other hand, unless the stripe is a straight line, because the identification target has a solid configuration having three-dimensional irregularities to have a possibility of being a person himself, the unit determines that the target might not masquerade.

Claims

1. A masquerading detection device which, for use in determining whether a target is a specified person or not, detects the target being a non-specified person who masquerades as said specified person, comprising:

target information obtaining means having a light emitter which irradiates said target with light, as well as projecting a predetermined pattern onto the target, a filter which transmits light emitted by the light emitter disposed in the vicinity of a light source of said light emitter, and target image obtaining means which photographs a target on which a predetermined pattern is projected by light emission of said light emitter to obtain target image data indicative of the target,

image storage means which stores said target image data, and

data processing means having masquerading determination means which determines whether said target is said non-specified person or not, wherein

said masquerading determination means compares a pattern appearing in a face region of a target image represented by said target image data and said predetermined pattern to determine whether said target has a plane configuration or not and when the target has a plane configuration, determines that the target is a non-specified person.

2. The masquerading detection device as set forth in claim 1, wherein

the data processing means includes face detection means which detects a face region of a target image represented by target image data, and

the masquerading determination means determines whether a target has a plane configuration or not by using a pattern appearing in a face region detected by said face detection means.

3. The masquerading detection device as set forth in claim 1, wherein

the filter has a striped pattern drawn with a plurality of straight lines arranged in parallel to each other which cut off light transmission, and

said masquerading determination means compares a pattern appearing in a face region of a target image represented by target image data and said striped pattern having the straight lines arranged in parallel to each other to determine whether said target has a plane configuration.

4. The masquerading detection device as set forth in claim 1, wherein

the target information obtaining means includes filter rotation control means which rotates a filter for changing a pattern to be projected onto a target,

said filter rotation control means rotating said filter while selecting a rotation angle at random, and

the masquerading determination means determines whether a rotation angle of a pattern appearing in a face region detected by said face detection means is proper or not and unless the angle is proper, determines that the target is a non-specified person.

5. The masquerading detection device as set forth in claim 1, wherein

the target information obtaining means includes a plurality of filters on which different patterns are drawn and filter switching control means which executes switching processing of a filter for use in projecting a pattern onto a target,

said filter switching control means selecting any of the plurality of filters at random to execute switching processing, and

the masquerading determination means determines whether a pattern appearing in a face region of said target is a pattern drawn on a filter which is selectively switched by said filter switching control means to determine that the target is a non-specified person unless the pattern is a pattern drawn on the filter.

6. The masquerading detection device as set forth in claim 1, wherein

the target information obtaining means includes a plurality of filters on which patterns are drawn in different colors and filter switching control means which executes switching processing of a filter for use in projecting a pattern onto a target,

said filter switching control means selecting any of the plurality of filters at random to execute switching processing, and

the masquerading determination means determines whether a pattern appearing in a face region of said target has color of a pattern drawn on a filter selectively switched by the filter switching control means to determine that the target is a non-specified person unless the pattern has the same color as the color of the pattern drawn on the filter.

7. The masquerading detection device as set forth in claim 1, wherein

the target information obtaining means includes a distance sensor located adjacent to the target image obtaining means, and which further comprises

feature storage means in which distance information indicative of an appropriate distance between said target image obtaining means and a specified person is stored in advance, wherein

said distance sensor measures a distance between said target image obtaining means and a target, and

the masquerading determination means compares a distance measured by said distance sensor and a distance indicated by said distance information to determine whether the distance between said target image obtaining means and said target is within an appropriate range and when the distance is out of the appropriate range, determines that the target is a non-specified person.

8. The masquerading detection device as set forth in claim 7, wherein

the appropriate range has a lower limit distance set in advance, and

the masquerading determination means determines that a target is a non-specified person unless a distance between the target image obtaining means and the target is not less than said lower limit distance.

9. The masquerading detection device as set forth in claim 7, wherein

the appropriate range has a higher limit distance set in advance, and

the masquerading determination means determines that a target is a non-specified person unless a distance between the target image obtaining means and the target is not more than said higher limit distance.

10. The masquerading detection device as set forth in claim 1, wherein

the target information obtaining means includes an object sensor located adjacent to the target image obtaining means,

said object sensor sensing a target located at a distance shorter than an appropriate distance between said target image obtaining means and a specified person, and which further comprises

feature storage means in which a sensing result of said object sensor is stored, wherein

the masquerading determination means determines whether a target is sensed by said object sensor and when sensed, determines that the target is a non-specified person.

11. The masquerading detection device as set forth in claim 1, wherein

the target information obtaining means includes a weighing unit disposed at a predetermined position set in advance where a target is to be located when determining whether the target is a specified person or not, and

the storage means includes feature storage means in which weight information of each person registered in advance for determining whether the person is a specified person or not is stored,

said weighing unit weighing a target located at said predetermined position, and

the masquerading determination means compares weight of a target obtained by said weighing unit and said weight information stored in said feature storage means to determine whether the weight of said target is within an allowable weight range or not and when the weight is out of the allowable weight range, determines that the target is a non-specified person.

12. The masquerading detection device as set forth in claim 11, wherein

the masquerading determination means determines whether weight of a target is within an allowable weight range or not after deciding the allowable weight range which includes a range from maximum weight to minimum weight in weight information stored in the feature storage means.

13. The masquerading detection device as set forth in claim 1, wherein

the target information obtaining means includes a back light emitter which irradiates a target with light from the back,

the target image obtaining means photographs a target irradiated with light from the back by lighting of said back light emitter to obtain backlighted image data indicative of the backlighted target, and

the masquerading determination means extracts a region whose luminance value in a backlighted image represented by backlighted image data obtained by said target image obtaining means is not more than a predetermined value to separate a target region in the backlighted image from a background region, determines whether a configuration of a boundary between the target region and the background region is a configuration of a human head and unless the configuration is a configuration of a human head, determines that the target is a non-specified person.

14. The masquerading detection device as set forth in claim 13, wherein

the masquerading determination means determines whether a target has a configuration of a human head according to whether a boundary between a target region and a background region takes a configuration approximate to an oval.

15. The masquerading detection device as set forth in claim 13, wherein

the masquerading determination means obtains a width of a target region to determine whether the target has a configuration of a human head according to whether a boundary between the target region and a background region takes a configuration approximate to an oval with the width of said target region as a minor axis.

16. The masquerading detection device as set forth in claim 1, wherein

the target information obtaining means includes two target image obtaining means, and

the masquerading determination means generates a distance image of a target by using a visual difference between said two target image obtaining means to determine whether a configuration of a known face region in said distance image is plane or not and when the configuration is plane, determines that the target is a non-specified person.

17. The masquerading detection device as set forth in claim 1,

wherein the target information obtaining means includes two target image obtaining means, and

the data processing means includes face detection means which detects a face region of a distance image generated by the masquerading determination means, and

said masquerading determination means generates a distance image of a target by using a visual difference between said two target image obtaining means to determine whether a configuration of a face region in said distance image detected by said face detection means is plane or not and when the configuration is plane, determines that the target is a non-specified person.

18. The masquerading detection device as set forth in claim 16, wherein the two target image obtaining means are horizontally disposed, with one of which two target image obtaining means being arranged in front of a target.

19. The masquerading detection device as set forth in claim 1, wherein

the target information obtaining means includes three or more target image obtaining means, and

the masquerading determination means selects two target image obtaining means from among said three or more target image obtaining means, generates a distance image of a target by using a visual difference between the selected two target image obtaining means and determines whether a configuration of a known face region in said distance image is plane or not to determine that the target is a non-specified person when the configuration is plane.

20. The masquerading detection device as set forth in claim 1, wherein

the target information obtaining means includes three or more target image obtaining means,

the data processing means includes face detection means which detects a face region of a distance image generated by the masquerading determination means, and

said masquerading determination means selects two target image obtaining means from among said three or more target image obtaining means, generates a distance image of a target by using a visual difference between the selected two target image obtaining means and determines whether a configuration of a face region in said distance image detected by said face detection means is plane or not to determine that the target is a non-specified person when the configuration is plane.

21. The masquerading detection device as set forth in claim 1, wherein

as the target image obtaining means, image input means which photographs a wavelength of a near infrared region is used, and

the light source of the light emitter emits light of a wavelength of a near infrared region.

22. A masquerading detection device which, for use in determining whether a target is a specified person or not, detects the target being a non-specified person who masquerades as said specified person, comprising:

target information obtaining means having target image obtaining means which photographs a target to obtain target image data indicative of the target and a distance sensor disposed adjacent to said target image obtaining means,

image storage means which stores said target image data and feature storage means in which distance information indicative of an appropriate distance between said target image obtaining means and a specified person is stored in advance, and

data processing means having masquerading determination means which determines whether said target is said non-specified person or not, wherein

said distance sensor measures a distance between said target image obtaining means and a target, and

said masquerading determination means compares a distance measured by said distance sensor and a distance indicated by said distance information to determine whether the distance between said target image obtaining means and said target is within an appropriate range or not and when the distance is out of the appropriate range, determines that the target is a non-specified person.

23. A masquerading detection device which, for use in determining whether a target is a specified person or not, detects the target being a non-specified person who masquerades as said specified person, comprising:

target information obtaining means having target image obtaining means which photographs a target to obtain target image data indicative of the target and an object sensor disposed adjacent to said target image obtaining means,

image storage means which stores said target image data and feature storage means in which a sensing result of said object sensor is stored, and

data processing means having masquerading determination means which determines whether said target is said non-specified person or not, wherein

said object sensor senses a target located at a distance shorter than an appropriate distance between said target image obtaining means and a specified person, and

said masquerading determination means determines whether a target is sensed by said object sensor or not and when sensed, determines that the target is a non-specified person.

24. A masquerading detection device which, for use in determining whether a target is a specified person or not, detects the target being a non-specified person who masquerades as said specified person, comprising:

target information obtaining means having a back light emitter which illuminates a target with light from the back and target image obtaining means which photographs a target illuminated with light from the back by light emission of said back light emitter to obtain backlighted image data indicative of a backlighted target,

image storage means which stores said backlighted image data, and

data processing means having masquerading determination means which determines whether said target is said non-specified person or not, wherein

said masquerading determination means extracts a region whose luminance value in a backlighted image represented by backlighted image data obtained by said target image obtaining means is not more than a predetermined value to separate a target region in the backlighted image from a background region, determines whether a boundary between the target region and the background region has a configuration of a human head and determines that the target is a non-specified person unless the boundary has a configuration of a human head.

25. A masquerading detection device which, for use in determining whether a target is a specified person or not, detects the target being a non-specified person who masquerades as said specified person, comprising:

target information obtaining means having two target image obtaining means which photograph a target to obtain target image data representing the target,

image storage means which stores said target image data, and

data processing means having masquerading determination means which determines whether said target is said non-specified person or not, wherein

said masquerading determination means generates a distance image of a target by using a visual difference between said two target image obtaining means to determine whether a known face region in said distance image has a plane configuration or not and determines that the target is a non-specified person when the region has a plane configuration.

26. A masquerading detection method, for use in determining whether a target is a specified person or not, of detecting the target being a non-specified person who masquerades as said specified person, comprising the steps of:

irradiating said target with light transmitted by a filter on which a predetermined pattern is drawn to project said pattern onto the target,

photographing the target on which the predetermined pattern is projected to obtain target image data indicative of the target, and

comparing a pattern appearing in a face region of a target image represented by said target image data and said predetermined pattern to determine whether said target has a plane configuration or not and when the target has a plane configuration, determining that the target is a non-specified person.

27. A masquerading detection method, for use in determining whether a target is a specified person or not, of detecting the target being a non-specified person who masquerades as said specified person, comprising the steps of:

executing measurement processing of measuring a distance between target image obtaining means for use in photographing a target and said target, and

executing masquerading determination processing of determining whether said target is said non-specified person or not, wherein

said masquerading determination processing includes processing of comparing a distance measured by said measurement processing and a predetermined appropriate distance between said target image obtaining means and a specified person to determine whether the distance between said target image obtaining means and said target is within the appropriate range and determining that the target is a non-specified person when the distance is out of the appropriate range.

28. A masquerading detection method, for use in determining whether a target is a specified person or not, of detecting the target being a non-specified person who masquerades as said specified person, comprising the steps of:

executing sensing processing of sensing a target locating at a distance shorter than an appropriate distance between target image obtaining means which is used for photographing a target and a specified person, and

executing masquerading determination processing of determining whether said target is said non-specified person or not, wherein

said masquerading determination processing includes processing of determining whether a target is sensed by said sensing processing or not and when sensed, determining that the target is a non-specified person.

29. A masquerading detection method, for use in determining whether a target is a specified person or not, of detecting the target being a non-specified person who masquerades as said specified person, comprising the steps of:

executing target image obtaining processing of photographing a target irradiated with light from the back by light emission of a back light emitter which irradiates a target with light from the back to obtain backlighted image data indicative of the target at a backlight state, and

executing masquerading determination processing of determining whether said target is said non-specified person or not, wherein

said masquerading determination processing includes processing of extracting a region whose luminance value in a backlighted image represented by backlighted image data obtained by said target image obtaining processing is not more than a predetermined value to separate a target region in the backlighted image from a background region, determining whether a boundary between the target region and the background region has a configuration of a human head and determining that the target is a non-specified person unless the boundary has a configuration of a human head.

30. A masquerading detection method, for use in determining whether a target is a specified person or not, of detecting the target being a non-specified person who masquerades as said specified person, comprising the steps of:

executing target image obtaining processing of photographing a target from two different directions to obtain two target image data indicative of the target, and

executing masquerading determination processing of determining whether said target is said non-specified person or not, wherein

said masquerading determination processing includes processing of generating a distance image of a target by using a visual difference between two target image obtaining means which execute said target image obtaining processing, determining whether a face region in said distance image has a plane configuration or not and determining that the target is a non-specified person when the region has a plane configuration.