ABNORMAL BEHAVIOR DETECTING APPARATUS AND METHOD THEREOF, AND VIDEO MONITORING SYSTEM

• US 20120314064A1
• Filed: 05/22/2012
• Published: 12/13/2012
• Est. Priority Date: 06/13/2011
• Status: Abandoned Application

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: LIU, Zhou, Wu, Weiguo
• Application Number:
  US13/477,330
• Publication Number:
  US 20120314064A1
• Time in Patent Office: Days
• US Class Current: 348/143
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69

Abstract

The disclosure provides abnormal behavior detecting apparatus and method. The apparatus may include: an extracting device configured to extract, from a video segment to be detected, an image block sequence containing a plurality of image blocks corresponding to a moving range of an object in each image frame in the video segment; a feature calculating device configured to calculate motion vector features of the image block sequence; and an abnormal behavior detecting device comprising two or more stages of classifiers that are connected in series. The classifiers are configured to receive the image block sequence and the motion vector features stage by stage and detect the abnormal behavior of the object. If a previous stage of classifier determines that the to image block sequence contains an abnormal behavior, a next stage of classifier further receives and detects the image block sequence, until last stage of classifier.

Claims

1. An abnormal behavior detecting apparatus, comprising:

an extracting device, configured to extract, from a video segment to be detected, an image block sequence containing a plurality of image blocks corresponding to a moving range of an object in each image frame in the video segment;

a feature calculating device, configured to calculate motion vector features of the image block sequence; and

an abnormal behavior detecting device comprising two or more stages of classifiers that are connected in series, wherein the two or more stages of classifiers are configured to receive the image block sequence and the motion vector features stage by stage and detect the abnormal behavior of the object, if a previous stage of classifier determines that the image block sequence contains an abnormal behavior, a next stage of classifier further receives and detects the image block sequence, until last stage of classifier.

2. The abnormal behavior detecting apparatus according to claim 1, wherein the extracting device is configured to extract the image block sequence by:

constructing a motion history image of the video segment;

performing a connected component analysis according to the motion history image to obtain the moving range of the object; and

extracting the image blocks corresponding to the moving range from each image frame in the video segment, to form the image block sequence.

3. The abnormal behavior detecting apparatus according to claim 1, wherein each stage of the two or more stages of classifiers is a one class support vector machine.

4. The abnormal behavior detecting apparatus according to claim 1, further comprising:

a dividing information acquiring device, configured to obtain information regarding locations of a plurality of sub-regions into which a scenario related to the video segment is divided; and

a locating device, configured to determine in which sub-region the extracted image block sequence is located,

wherein the abnormal behavior detecting device comprises a plurality of sets of two or more stages of classifiers that are connected in series, each set of two or more stages of classifiers corresponds to a sub-region of the plurality of sub-regions.

5. The abnormal behavior detecting apparatus according to claim 1, further comprising a noise removing device, configured to judge whether a lasting time of a behavior of the object in the image block sequence exceeds a second threshold value, and if no, determine the behavior of the object in the image block sequence as noise.

6. The abnormal behavior detecting apparatus according to claim 1, further comprising a noise removing device configured to calculate a ratio of motion vector features having an amplitude less than a third threshold value to all of the motion vector features based on an amplitude histogram of the motion vector features of the image block sequence, and if the ratio is larger than or equal to a fourth threshold value, determine the image block sequence as noise.

7. The abnormal behavior detecting apparatus according to claim 6, wherein the third threshold value meets:

th3=mean value+n1×

variance,

wherein th3 denotes the third threshold value;

the mean value and the variance denote a mean value and a variance of motion vector features extracted from a plurality of video samples, respectively; and

n1 denotes a constant.

8. The abnormal behavior detecting apparatus according to claim 1, further comprising a noise removing device configured to:

extract, from the image block sequence, regions in which amplitude of motion vector feature is larger than a fifth threshold value;

perform a connected component analysis and calculate an area of a largest region in which amplitude of motion vector feature is larger than the fifth threshold value; and

if the area is less than or equal to a sixth threshold value, determine the image block sequence as noise.

9. The abnormal behavior detecting apparatus according to claim 8, wherein the fifth threshold value meets:

th5=mean value+n1×

variance

wherein th5 denotes the fifth threshold value;

the mean value and the variance denote a mean value and a variance of motion vector features extracted from a plurality of video samples, respectively; and

n1 denotes a constant.

10. An abnormal behavior detecting method, comprising:

extracting, from a video segment to be detected, an image block sequence containing a to plurality of image blocks corresponding to a moving range of an object in each image frame in the video segment;

calculating motion vector features of the image block sequence; and

detecting the image block sequence and the motion vector features by two or more stages of classifiers that are connected in series stage by stage, wherein the two or more stages of classifiers are configured to receive the image block sequence and the motion vector features stage by stage and detect the abnormal behavior of the object, if a previous stage of classifier determines that the image block sequence contains an abnormal behavior, a next stage of classifier further receives and detects the image block sequence, until last stage of classifier.

11. The abnormal behavior detecting method according to claim 10, wherein extracting the image block sequence comprises:

constructing a motion history image of the video segment;

performing a connected component analysis according to the motion history image to obtain the moving range of the object; and

extracting the image blocks corresponding to the moving range from each image frame in the video segment, to form the image block sequence.

12. The abnormal behavior detecting method according to claim 10, wherein each stage of the two or more stages of classifiers is a one class support vector machine.

13. The abnormal behavior detecting method according to claim 10, further comprising:

dividing a scenario related to the video segment into a plurality of sub-regions, and

wherein after extracting the image block sequence, the method further comprises;

determining in which sub-region the extracted image block sequence is located, and

wherein the abnormal behavior detecting device comprises a plurality of sets of two or more stages of classifiers that are connected in series, each set of two or more stages of classifiers corresponds to a sub-region of the plurality of sub-regions.

14. The abnormal behavior detecting method according to claim 10, further comprising:

judging whether a lasting time of a behavior of the object in the image block sequence exceeds a second threshold value, and if no, determining the behavior of the object in the image block sequence as noise.

15. The abnormal behavior detecting method according to claim 10, further comprising:

calculating a ratio of motion vector features having an amplitude less than a third threshold value to all of the motion vector features based on an amplitude histogram of the motion vector features of the image block sequence, and if the ratio is larger than or equal to a fourth threshold value, determining the image block sequence as noise.

16. The abnormal behavior detecting method according to claim 15, wherein the third threshold value meets:

th3=mean value+n1×

variance,

wherein th3 denotes the third threshold value;

the mean value and the variance denote a mean value and a variance of motion vector features extracted from a plurality of video samples, respectively; and

n1 denotes a constant.

17. The abnormal behavior detecting method according to claim 10, further comprising:

extracting, from the image block sequence, regions in which amplitude of motion vector feature is larger than a fifth threshold value;

performing a connected component analysis and calculating an area of a largest region in which amplitude of motion vector feature is larger than the fifth threshold value; and

if the area is less than or equal to a sixth threshold value, determining the image block sequence as noise.

18. A video monitoring system, comprising:

a video collecting device, configured to capture a video of a monitored scenario; and

an abnormal behavior detecting apparatus configured to detect an abnormal behavior of an object in the video and comprising;

an extracting device, configured to extract, from a video segment to be detected, an image to block sequence containing a plurality of image blocks corresponding to a moving range of an object in each image frame in the video segment;

a feature calculating device, configured to calculate motion vector features of the image block sequence; and

an abnormal behavior detecting device comprising two or more stages of classifiers that are connected in series, wherein the two or more stages of classifiers are configured to receive the image block sequence and the motion vector features stage by stage and detect the abnormal behavior of the object, if a previous stage of classifier determines that the image block sequence contains an abnormal behavior, a next stage of classifier further receives and detects the image block sequence, until last stage of classifier.

19. A program product, comprising program codes which, when loaded into a memory of a computer and executed by a processor of the computer, cause the processor to perform the following steps of:

extracting, from a video segment to be detected, an image block sequence containing a plurality of image blocks corresponding to a moving range of an object in each image frame in the video segment;

calculating motion vector features of the image block sequence; and

detecting the image block sequence and the motion vector features by two or more stages of classifiers that are connected in series stage by stage, wherein the two or more stages of classifiers are configured to receive the image block sequence and the motion vector features stage by stage and detect the abnormal behavior of the object, if a previous stage of classifier determines that the image block sequence contains an abnormal behavior, a next stage of classifier further receives and detects the image block sequence, until last stage of classifier.

20. A recording medium, that stores program codes which, when loaded into a memory of a computer and executed by a processor of the computer, cause the processor to perform the following steps of:

extracting, from a video segment to be detected, an image block sequence containing a plurality of image blocks corresponding to a moving range of an object in each image frame in the video segment;

calculating motion vector features of the image block sequence; and

detecting the image block sequence and the motion vector features by two or more stages of classifiers that are connected in series stage by stage, wherein the two or more stages of classifiers are configured to receive the image block sequence and the motion vector features stage by stage and detect the abnormal behavior of the object, if a previous stage of classifier determines that the image block sequence contains an abnormal behavior, a next stage of classifier further receives and detects the image block sequence, until last stage of classifier.