Monitoring system, monitoring device and method, recording medium, and program

• US 20070014439A1
• Filed: 03/14/2006
• Published: 01/18/2007
• Est. Priority Date: 03/15/2005
• Status: Abandoned Application

• Current Assignee: Omron Corporation
• Original Assignee: Omron Corporation
• Inventors: Ando, Tanichi
• Application Number:
  US11/375,273
• Publication Number:
  US 20070014439A1
• Time in Patent Office: Days
• US Class Current: 382/118
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G08B 13/19613 Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion
• CPC Class Codes: G08B 31/00 Predictive alarm systems characterised by extrapolation or other computation using updated historic data

Abstract

A suspicious individual can be detected more accurately. A face detecting unit detects a face image of an approaching individual from a monitor image, and a characteristic amount detecting unit detects the characteristic amount of the approaching individual from the face image. A collating unit identifies an approaching individual by collating the characteristic amount of the approaching individual with the characteristic amount of an authorized individual which is recorded in an authorized individual information recording unit and the characteristic amount of a previously detected individual which is recorded in an approach information recording unit. An approaching activity detecting unit and an abnormal activity detecting unit compute the degree of suspiciousness of the approaching individual on the basis of the frequency with which the approaching individual approaches a target of monitoring, time at which the approaching individual approaches a target of monitoring, distance by which the approaching individual approaches a target of monitoring, and the like. A suspiciousness degree judgment unit judges whether the approaching individual is a suspicious individual or not, on the basis the degree of suspiciousness. The present invention can be applied to an on-vehicle monitoring system.

Claims

1. A monitoring system, comprising:

an image pickup apparatus for imaging monitoring region to output a monitor image;

face detection means for detecting an image of the face of an approaching individual, who approaches an object which is a target of monitoring, from the monitor image;

characteristic amount detection means for detecting amount of characteristics of the approaching individual from the image of the face of the approaching individual;

recording control means for controlling recording of characteristic amount data indicating the characteristic amount of the approaching individual, on recording means;

identifying means for identifying the approaching individual by collating the characteristic amount data on the approaching individual with characteristic amount data on an approaching individual detected in the past and recorded on the recording means; and

judging means for judging whether or not the approaching individual is a suspicious individual, on the basis of the frequency with which the image of the face of the identified approaching individual is detected within a predetermined period of time.

2. The monitoring system according to claim 1, wherein the image pickup apparatus outputs the monitor image comprising pixel values substantially proportional to the logarithm of incident light quantity.

3. A monitoring device, comprising:

face image detection means for detecting an image of the face of an approaching individual, who approaches a target of monitoring, from monitor images obtained by imaging a monitoring region;

characteristic amount detection means for detecting amount of characteristics of the approaching individual from the image of the face of the approaching individual;

first recording control means for controlling recording of characteristic amount data indicating the characteristic amount of the approaching individual, on first recording means;

identifying means for identifying the approaching individual by collating the characteristic amount data on the approaching individual with characteristic amount data on an approaching individual detected in the past and recorded on the first recording means; and

judging means for judging whether or not the approaching individual is a suspicious individual, on the basis of the frequency with which the image of the face of the identified approaching individual is detected within a predetermined period of time.

4. The monitoring device according to claim 3, wherein the judging means further judges whether the approaching individual is a suspicious individual or not, on the basis of a period of time in which the image of the face of the approaching individual is detected continuously.

5. The monitoring device according to claim 3, wherein the judging means further judges whether the approaching individual is a suspicious individual or not, on the basis of the distance between the approaching individual and the object.

6. The monitoring device according to claim 3, further comprising:

sight line detection means for detecting the direction of the line of sight of the approaching individual,

wherein the judging means judges whether the approaching individual is a suspicious individual or not, on the basis of the rate at which the line of sight of the approaching individual focuses on the object within a predetermined period of time.

7. The monitoring device according to claim 3, further comprising:

angle detection means for detecting an angle in which the approaching individual moves around the object, on the basis of the monitor image,

wherein the judging means judges whether the approaching individual is a suspicious individual or not, on the basis of the angle.

8. The monitoring device according to claim 3, further comprising:

disguised suspicious individual detection means for detecting a disguised suspicious individual who is the approaching individual with the face covered, on the basis of a period of time for which a state, in which the approaching individual is rendered in the monitor image but an image of the face of the approaching individual is not detected by the face detection means, lasts.

9. The monitoring device according to claim 3, further comprising protection control means for controlling operation of the object so as to protect the object from a suspicious individual, when judged that the approaching individual is a suspicious individual.

10. The monitoring device according to claim 3, further comprising caution/warning/intimidating means for cautioning, warning, or intimidating the approaching individual to cause the approaching individual to stay away from the object, when judged that the approaching individual is a suspicious individual.

11. The monitoring device according to claim 3, further comprising transmission means for transmitting information on a suspicious individual to other device, when judged that the approaching individual is a suspicious individual.

12. The monitoring device according to claim 3, wherein the identifying means further identifies the approaching individual by collating the characteristic amount data on the approaching individual with characteristic amount data on a non-targeted individual who is not a target of detection of the suspicious individual recorded on second recording means, and the judging means judges that the approaching individual is not a suspicious individual when the approaching individual is identified as the non-targeted individual.

13. The monitoring device according to claim 12, further comprising second recording control means for controlling recording of the characteristic amount data so as to record the characteristic amount data on the approaching individual, who is judged as a suspicious individual, on the second recording means through a user command.

14. The monitoring device according to claim 3, wherein the monitor image is captured by an image pickup apparatus which has a logarithm conversion type image pickup element for outputting a pixel value substantially proportional to the logarithm of incident light quantity by using a subthreshold characteristic of a semiconductor.

15. The monitoring device according to claim 14, wherein the image pickup element outputs a pixel value substantially proportional to the logarithm of incident light quantity by using a subthreshold characteristic of a semiconductor.

16. A monitoring method, comprising the steps of:

detecting an image of the face of an approaching individual, who approaches an object which is a target of monitoring, from monitor images obtained by imaging a monitoring region;

detecting amount of characteristics of the approaching individual from the image of the face of the approaching individual;

controlling recording of characteristic amount data indicating the characteristic amount of the approaching individual, on recording means;

identifying the approaching individual by collating the characteristic amount data on the approaching individual with characteristic amount data on an approaching individual detected in the past and recorded on the recording means; and

judging whether or not the approaching individual is a suspicious individual, on the basis of the frequency with which the image of the face of the identified approaching individual is detected within a predetermined period of time.

17. A program, comprising:

a face image detection step of detecting an image of the face of an approaching individual, who approaches an object which is a target of monitoring, from monitor images obtained by imaging a monitoring region;

a characteristic amount detection step of detecting amount of characteristics of the approaching individual from the image of the face of the approaching individual;

a recording control step of controlling recording of characteristic amount data indicating the characteristic amount of the approaching individual, on recording means;

an identifying step of identifying the approaching individual by collating the characteristic amount data on the approaching individual with characteristic amount data on an approaching individual detected in the past and recorded on the recording means; and

a judging step of judging whether or not the approaching individual is a suspicious individual, on the basis of the frequency with which the image of the face of the identified approaching individual is detected within a predetermined period of time.

18. A recording medium which has recorded therein the program described in claim 17.