Apparatus and method for counting moving objects

• US 9,870,510 B2
• Filed: 07/18/2016
• Issued: 01/16/2018
• Est. Priority Date: 07/31/2015
• Status: Active Grant

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Yang, Yawen
• Primary Examiner(s): Gilliard, Delomia L
• Application Number:
  US15/212,876
• Publication Number:
  US 20170032193A1
• Time in Patent Office: 547 Days
• Field of Search: None
• CPC Class Codes: G06T 2207/30236 Traffic on road, railway or crossing
• CPC Class Codes: G06T 2207/30242 Counting objects in image
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69

Abstract

An apparatus and method for counting moving objects is disclosed that includes: an establishing unit configured to detect moving objects in each frame of image in a surveillance video, establish a moving object track set according to the detected moving objects, and score a track of the moving object according to the number of times of consecutively detecting a moving object in the moving object track in the moving object track set; a filtering unit configured to remove a moving object track in the moving object track set with a score less than or equal to a predefined threshold value; and a counting unit configured to count moving objects according to the moving object tracks in the moving object track set after the removal. With the apparatus and method, completeness of the established moving object track set may be ensured, and accuracy of the counting may be efficiently improved.

Claims

1. An apparatus for counting moving objects, comprising:

an establishing unit configured to detect a moving object in each frame of an image in a surveillance video, establish a moving object track set according to a detected moving object, and score a moving object track of the moving object according to a number of times of consecutively detecting the moving object in the moving object track in the moving object track set;

a filtering unit configured to remove the moving object track in the moving object track set with a score less than or equal to a predefined threshold value; and

a counting unit configured to count moving objects according to moving object tracks in the moving object track set after removal.

2. The apparatus according to claim 1, wherein the establishing unit comprises:

a detecting unit configured to detect the moving object in a predefined area in a current frame;

an updating unit configured to update the moving object track in a preceding frame or establish the moving object track according to a position of the moving object detected in the current frame and the position of the moving object predicted by the moving object track in the preceding frame, to update the moving object track set in the current frame; and

a scoring unit configured to determine the score of the moving object track in the current frame according to the number of times of consecutively detecting the moving object in the moving object track in an updated moving object track set in the current frame and before the current frame.

3. The apparatus according to claim 2, wherein the updating unit comprises:

a first updating unit configured to, when the position of the moving object detected in the current frame is matched with the position of the moving object predicted by the moving object track in the preceding frame, update the moving object track in the preceding frame according to a detected position of the moving object, to form the updated moving object track in the current frame; and

a second updating unit configured to, when the position of the moving object detected in the current frame is not matched with the position of the moving object predicted by the moving object track in the preceding frame, establish the moving object track of the moving object detected in the current frame, and update the moving object track in the preceding frame according to a predicted position, to form the updated moving object track in the current frame.

4. The apparatus according to claim 2, wherein the scoring unit comprises:

a first scoring unit configured to, when the moving object track in an updated moving object track set in the current frame has consecutively detected the moving object in the current frame relative to the preceding frame, determine the score of the moving object track in the current frame as the score of the moving object track in the preceding frame plus the number of times of consecutively detecting the moving object in the current frame and before the current frame; and

a second scoring unit configured to, when a moving object track in the updated moving object track set in the current frame has not consecutively detected the moving object in the current frame relative to the preceding frame, determine the score of the moving object track in the current frame as the score of the moving object track in the preceding frame subtracted by 1.

5. The apparatus according to claim 1, wherein,

the filtering unit is further configured to combine two moving object tracks with a distance less than a predefined distance threshold value in the moving object track set;

and

the counting unit is configured to count moving objects according to moving object tracks in the moving object track set after removal and combining.

6. A method for counting moving objects, comprising:

detecting a moving object in each frame of an image in a surveillance video, establishing a moving object track set according to a detected moving object of the surveillance video, and scoring a moving object track of the moving object according to a number of times of consecutively detecting a moving object in the moving object track in the moving object track set;

removing a moving object track in the moving object track set with a score less than or equal to a predefined threshold value; and

counting moving objects according to the moving object tracks in the moving object track set after removal.

7. The method according to claim 6, wherein the detecting moving object in each frame of the image in the surveillance video, establishing the moving object track set according to the detected moving object of the surveillance video, and scoring the track of the moving object according to the number of times of consecutively detecting the moving object in the moving object track in the moving object track set, comprises:

detecting the moving object in a predefined area in a current frame;

updating the moving object track in a preceding frame or establishing the moving object track according to a position of the moving object detected in the current frame and the position of moving object predicted by the moving object track in the preceding frame, to update the moving object track set in the current frame; and

determining a score of the moving object track in the current frame according to the number of times of consecutively detecting the moving object in the moving object track in an updated moving object track set in the current frame and before the current frame.

8. The method according to claim 7, wherein the updating the moving object track in the preceding frame or establishing the moving object track according to the position of the moving object detected in the current frame and the position of moving object predicted by the moving object track in a preceding frame, to update the moving object track set in the current frame, comprises:

when the position of the moving object detected in the current frame is matched with the position of the moving object predicted by the moving object track in the preceding frame, updating the moving object track in the preceding frame according to a detected position of the moving object, to form the updated moving object track in the current frame; and

when the position of the moving object detected in the current frame is not matched with the position of the moving object predicted by the moving object track in the preceding frame, establishing the moving object track of the moving object detected in the current frame, and updating the moving object track in the preceding frame according to a predicted position, to form the updated moving object track in the current frame.

9. The method according to claim 7, wherein the determining the score of the moving object track in the current frame according to the number of times of consecutively detecting the moving object in the moving object track in the updated moving object track set in the current frame and before the current frame, comprises:

when the moving object track in the updated moving object track set in the current frame has consecutively detected the moving object in the current frame relative to the preceding frame, determining the score of the moving object track in the current frame as the score of the moving object track in the preceding frame plus the number of times of consecutively detecting the moving object in the current frame and before the current frame; and

when the moving object track in the updated moving object track set in the current frame has not consecutively detected the moving object in the current frame relative to the preceding frame, determining the score of the moving object track in the current frame as the score of the moving object track in the preceding frame subtracted by 1.

10. The method according to claim 6, wherein the method further comprises:

combining two moving object tracks with a distance less than a predefined distance threshold value in the moving object track set; and

the counting moving objects according to the moving object tracks in the moving object track set after the removal comprises;

counting moving objects according to the moving object tracks in the moving object track set after removal and combining.

11. An apparatus for counting moving objects, comprising:

a computer system, comprising

an establishing unit configured to detect a moving object in each frame of an image in a surveillance video, establish a moving object track set according to a detected moving object, and score a moving object track of the moving object according to a number of times of consecutively detecting the moving object in the moving object track in the moving object track set;

a filtering unit configured to remove the moving object track in the moving object track set with a score less than or equal to a predefined threshold value; and

a counting unit configured to count moving objects according to moving object tracks in the moving object track set after removal.

12. A non-transitory computer readable storage medium storing a method for counting moving objects, the method comprising:

detecting a moving object in each frame of an image in a surveillance video, establishing a moving object track set according to a detected moving object of the surveillance video, and scoring a moving object track of the moving object according to a number of times of consecutively detecting a moving object in the moving object track in the moving object track set;

removing a moving object track in a moving object track set with a score less than or equal to a predefined threshold value; and

counting moving objects according to the moving object tracks in the moving object track set after removal.