Surveillance recorder and its method

• US RE45,551 E1
• Filed: 02/18/2014
• Issued: 06/09/2015
• Est. Priority Date: 08/31/2004
• Status: Active Grant

• Current Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Inventors: Matsuyama, Yoshiyuki
• Primary Examiner(s): Basehoar, Adam L
• Application Number:
  US14/182,735
• Time in Patent Office: 476 Days
• Field of Search: 382/103, 382/115, 382/118, 382/170, 382/209, 382/224, 382/181, 382/190, 348/143, 348169-172
• US Class Current: 1/1
• CPC Class Codes: G06K 9/00241 using holistic features extraction or representation of holistic features per se G06K9/00275
• CPC Class Codes: G06K 9/00288 Classification, e.g. identification

Abstract

A surveillance recorder (10) comprises: a picture input unit (12) for inputting a surveillance picture; a moving object detection unit (18) for detecting a moving object from a surveillance picture inputted by the picture input unit (12); a face image detection unit (20) for detecting, from an object detected by the moving object detection unit (18), a part having an elliptical outline as a face image; an identity judgment unit (22) for judging whether a face image newly detected by the face image detection unit (20) is of a same person as a face image detected last time or not based on positions of each face image; a storage image choice unit (24) for, when a newly detected face image has been judged to be of a same person by the identity judgment unit (22), choosing one face image from a face image of the same person stored in a recording medium (16) and the newly detected face image; and an image storage unit (26) for, when a newly detected face image has been chosen by the storage image choice unit (24), storing in the recording medium (16) both the newly detected face image and information for searching for the face image together. This allows an image suitable for storage to be detected from a surveillance picture.

Claims

1. A surveillance recorder apparatus comprising:

a picture input unit for inputting a surveillance picture;

a moving object detection unit for detecting a moving object from a surveillance picture inputted by the picture input unit;

a face image detection unit for detecting, a face image from the object detected by the moving object detection unit, a part having an elliptical outline as a face image;

an identity judgment unit for judging whether the face image newly detected by the face image detection unit is the same person as a face image detected last time or not based on positions of each face image;

and

a storage image choice unit for, when a newly detected face image has been judged to be of the same person by the identity judgment unit, choosing another at least one face image from face image(s) of the same person stored in a recording medium and the newly detected face image; and

an image storage unit for, when the newly detected face image has been chosen by the storage image choice unit, storing in the recording medium both the newly detected face image and information for searching for the newly detected face image together, wherein

the identity judgment unit detects a direction of movement of face images detected one after another by the face image detection unit and, if having detected a change in a direction of movement, judges that the face image is of another person.

2. The surveillance recorder apparatus according to claim 1, further comprising:

an image storage unit for, when the newly detected face image has been chosen by the storage image choice unit, storing in the recording medium both the newly detected face image and information for searching for the newly detected face image together,

wherein the image storage unit, when the identity judgment unit has judged that the face image newly detected by the face image detection unit is of a person different from the person whose face image was detected last time, stores in the recording medium the newly detected face image as a person who has newly appeared in the surveillance picture.

3. The surveillance recorder apparatus according to claim 1, wherein the identity judgment unit, if a distance between a position where the face image has been newly detected by the face image detection unit and a position where the face image was detected last time is less than a prescribed threshold, judges that the newly detected face image is of the same person as the face image detected last time.

4. The surveillance recorder apparatus according to claim 1, wherein the identity judgment unit, when a plurality of face images have been detected by the face image detection unit, judges that a face image newly detected in a position nearest to the face image detected last time is of the same person as the face image detected last time.

5. The surveillance recorder apparatus according to claim 1, wherein the identity judgment unit, when there are a plurality of face images detected last time, judges that the face image detected last time in a position nearest to a newly detected face image is of the same person as the newly detected face image.

6. The surveillance recorder apparatus according to claim 1, wherein the identity judgment unit, if a time taken from when the another at least one face image was detected by the face image detection unit to when the face image is newly detected has exceeded a prescribed threshold, judges that the newly detected face image is of another person.

7. The surveillance recorder apparatus according to claim 1, wherein the storage image choice unit chooses, from the another at least one face image stored in the recording medium and the face image newly detected by the face image detection unit, the face image that is larger in size.

8. The surveillance recorder apparatus according to claim 1, wherein the storage image choice unit chooses, from the another at least one face image stored in the recording medium and the face image newly detected by the face image detection unit, the face image whose average of distances from a center position to each pixel on an outline image of the face image is larger than the other.

9. The surveillance recorder apparatus according to claim 1, wherein the storage image choice unit chooses, from the another at least one face image stored in the recording medium and the face image newly detected by the face image detection unit, the face image whose difference in average luminance between left and right is smaller than the other.

10. The surveillance recorder apparatus according to claim 1, wherein the storage image choice unit chooses, from the another at least one face image stored in the recording medium and the face image newly detected by the face image detection unit, the face image more similar to a preset face outline template.

11. The surveillance recorder apparatus according to claim 1, wherein the storage image choice unit gives scores for each of a plurality of judgment items to the another at least one face image stored in the recording medium and to the face image newly detected by the face image detection unit, and chooses the face image whose total score of the plurality of judgment items is higher than the other'"'"'s.

12. The surveillance recorder apparatus according to claim 1, wherein the storage image choice unit gives scores for each of a plurality of judgment items to the face image newly detected by the face image detection unit and, if a total score of the plurality of judgment items has exceeded a prescribed threshold, chooses the detected face image.

13. A surveillance recording method comprising:

a picture input step of using a picture input unit for inputting a surveillance picture into a computerized control unit;

a moving object detection step of using the control unit for detecting a moving object from the surveillance picture inputted in the picture input step;

a face image detection step of using the control unit for detecting, a face image from the object detected in the moving object detection step, a part having an elliptical outline as a face image;

an identity judgment step of using the control unit for judging whether the face image newly detected in the face image detection step is of the same person as another at least one face image detected last time or not based on positions of each face image;

and

a storage image choice step of using the control unit for choosing a face image to be stored from a plurality of face images that have been judged to be of the same person in the identity judgment step; and

an image storage step of storing in a recording medium both the face image chosen in the storage image choice step and information for searching for the newly detected face image together, wherein

the identity judgment step includes detecting a direction of movement of face images detected one after another and, if having detected a change in a direction of movement, judges that the face image is of another person.

14. A surveillance recording method comprising:

a picture input step of using a picture input unit for inputting a surveillance picture into a computerized control unit;

a moving object detection step of using the control unit for detecting a moving object from the surveillance picture inputted in the picture input step;

a face image detection step of using the control unit for detecting, from the object detected in the moving object detection step, a part having an elliptical outline as a face image;

an identity judgment step of using the control unit for judging whether the face image newly detected in the face image detection step is of the same person as another face image detected last time or not based on positions of each face image;

a storage image choice step of using the control unit for, when the newly detected face image has been judged to be of the same person in the identity judgment step, choosing one from the another face image of the same person stored in a recording medium and the newly detected face image; and

an image storage step of, when the newly detected face image has been chosen in the storage image choice step, storing in the recording medium both the newly detected face image and information for searching for the another face image together, wherein

the identity judgment step includes detecting a direction of movement of face images detected one after another and, if having detected a change in a direction of movement, judges that the face image is of another person.