PORTABLE SUSPICIOUS INDIVIDUAL DETECTION APPARATUS, SUSPICIOUS INDIVIDUAL DETECTION METHOD, AND COMPUTER-READABLE MEDIUM

• US 20100080418A1
• Filed: 09/28/2009
• Published: 04/01/2010
• Est. Priority Date: 09/29/2008
• Status: Abandoned Application

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: ITO, Atsushi
• Application Number:
  US12/568,546
• Publication Number:
  US 20100080418A1
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16

Abstract

Cameras provided to glasses successively take subject images around a wearer of the glasses. The subject images are searched to detect human face regions, and if human face regions are detected, feature quantities of each face are calculated to detect the face direction and the eye direction, and an eye-gaze direction is detected based on them. Whether or not each person with the detected human face region is looking at the cameras is determined from the eye-gaze direction, and if there is a human face looking at the cameras for a given period of time or more, a person with the human face is determined as being a suspicious individual, and a warning message indicating the detection of the suspicious individual is output to the wearer. Furthermore, the detection information and images can be provided to a device in a remote location.

Claims

1. A portable suspicious individual detection apparatus comprising:

a wearable image pick-up device to be put on a body of a user;

a face detecting device which detects a human face region from subject images successively taken by the image pick-up device detects;

an eye-gaze direction detecting device which detects an eye-gaze direction of a person with the detected human face region;

a sight determining device which determines whether or not the person with the detected human face region is looking at the user, based on the eye-gaze direction detected by the eye-gaze direction detecting device;

a time period detecting device which detects an amount of time during which the person with the detected human face region is looking at the user when the sight determining device determines that the person with the detected human face region is looking at the user;

a suspicious individual determining device which determines that the person with the detected human face region is a suspicious individual when the amount of time detected by the time period detecting device is a predetermined amount of time or more; and

a notification device which provides the user with information indicating the detection of the suspicious individual when the suspicious individual determining device determines that the person with the detected human face region is the suspicious individual.

2. The portable suspicious individual detection apparatus according to claim 1,

wherein the face region detecting device detects, based on the detected human face region, and a face direction and a pupil position of the person with the detected human face region, and

wherein the eye-gaze direction detecting device detects the eye-gaze direction of the person with the detected human face region, based on the face direction and the pupil position of the person detected by the face region detecting device.

3. The portable suspicious individual detection apparatus according to claim 1, further comprising

a person position detecting device which detects a position of the person with the detected human face region relative to the user,

wherein the notification device notifies the user of the position of the person with the detected human face region relative to the user, the position being detected by the person position detecting device when the suspicious individual determining device determines that the person with the detected human face region is a suspicious individual.

4. The portable suspicious individual detection apparatus according to claim 1, further comprising

an age/gender determining device which detects at least one of a gender and an age of the person with the detected human face region, based on the detection result of the human face region,

wherein the notification device notifies the user of at least one of the gender and the age detected by the age/gender determining device when the suspicious individual determining device determines that the person with the detected human face region is a suspicious individual.

5. The portable suspicious individual detection apparatus according to claim 1, further comprising

a distance estimating device which estimates a distance to the person with the detected human face region,

wherein the notification device provides the user with a warning when the suspicious individual determining device determines that the person with the detected human face region is a suspicious individual and when the distance to the person with the detected human face region estimated by the distance estimating device become a predetermined distance or less.

6. The portable suspicious individual detection apparatus according to claim 1, further comprising

a transmission device which transmits information indicating that the suspicious individual is detected, and an image of the suspicious individual taken by the image pick-up device to an external device when the suspicious individual determining device determines that the person with the detected human face region is the suspicious individual.

7. The portable suspicious individual detection apparatus according to claim 6, further comprising

an apparatus position acquiring device that acquires positional information for the portable suspicious individual detection apparatus,

wherein the transmission device transmits the positional information acquired by the device position acquiring device when the suspicious individual determining device determines that the person with the detected human face region is a suspicious individual.

8. The portable suspicious individual detection apparatus according to claim 6, further comprising

a time information acquiring device which acquires information on a time when the suspicious individual determining device determines that the person with the detected human face region is a suspicious individual,

wherein the transmission device transmits the time information acquired by the time information acquiring device when the suspicious individual determining device determines that the person with the detected human face region is a suspicious individual.

9. The portable suspicious individual detection apparatus according to claim 6, further comprising

a microphone which collects sound information around the user,

wherein the transmission device transmits the sound information collected by the microphone when the suspicious individual determining device determines that the person with the detected human face region is a suspicious individual.

10. The portable suspicious individual detection apparatus according to claim 1, wherein the image pick-up device includes:

a plurality of image sensors; and

a plurality of taking lenses which form subject images in different directions from the user on the plurality of image sensors.

11. The portable suspicious individual detection apparatus according to claim 10,

wherein the plurality of taking lenses are provided to the image pick-up device in a manner that the plurality of subject images formed on the plurality of image sensors partially overlap,

the portable suspicious individual detection apparatus further comprises a combination device which combines overlapping parts of the plurality of subject images formed on the plurality of image sensors in a manner that the plurality of subject images partially overlap, to create a composite image, and

the face detecting device detects the human face region from the composite image created by the combination device.

12. The portable suspicious individual detection apparatus according to claim 10, wherein the image pick-up device is provided on a pair of glasses, and takes at least subject images in front of, and to the left and right of the user.

13. The portable suspicious individual detection apparatus according to claim 10, wherein the image pick-up device is provided on a hat or a helmet, and takes at least an subject image behind the user.

14. A suspicious individual detection method comprising:

an image taking step for successively taking subject images using a wearable image pick-up device;

a face detecting step for detecting a human face region from the successively-taken subject images;

an eye-gaze direction detecting step for detecting an eye-gaze direction of a person with the detected human face region;

a sight determining step for determining whether or not the person with the detected human face region is looking at a user of the wearable image pick-up device, based on the detected eye-gaze direction;

a time period detecting step for detecting an amount of time during which the person with the detected human face region is looking at the user when it is determined that the person with the detected human face region is looking at the user at the sight determining step;

a suspicious individual determining step for determining whether or not the person with the detected human face region is a suspicious individual based on the detected amount of time; and

a notification step for providing the user with information indicating the detection of the suspicious individual when it is determined that the person with the detected human face region is a suspicious individual at the suspicious individual determining step.

15. A computer-readable medium encoded with a computer program, the program comprising computer-executable instructions to make a computer execute the portable suspicious individual detection method according to claim 14.