SYSTEM AND METHOD OF DETECTING MOVING OBJECTS

• US 20160210759A1
• Filed: 01/19/2016
• Published: 07/21/2016
• Est. Priority Date: 01/19/2015
• Status: Active Grant

• Current Assignee: Hanwha Vision Company Limited (Hanwha Corporation)
• Original Assignee: Hanwha Techwin Co., Ltd. (Hanwha Corporation)
• Inventors: Baek, Youngmin, Jung, Jikhan, Kim, Jisung
• Granted Patent: US 10,373,015 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 2207/20081 Training; Learning
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 7/194 involving foreground-background segmentation
• CPC Class Codes: G06T 7/254 involving subtraction of images

Abstract

Provided are a system and method of detecting moving objects. The system stores pixel information regarding each of pixels included in frames of the video in a storage, sets a background model comprising at least one background model element, the at least one background model element indicating at least one of a reference visual property and a reference usage time, determines whether the pixels are background pixels or foreground pixels by comparing the pixel information with the at least one background model element, and updating the background model based on a result of the comparing.

Claims

1. A system for detecting a moving object in a video, the system comprising:

at least one memory configured to store pixel information regarding each of pixels included in frames of the video; and

at least one processor configured to implement;

a background model setting unit which sets a background model comprising at least one background model element, the at least one background model element indicating at least one of a reference visual property and a reference usage time;

a background pixel determining unit which determines whether the pixels are background pixels or foreground pixels by comparing the pixel information with the at least one background model element; and

a background model updating unit which periodically updates the background model based on a result of the comparing.

2. The system of claim 1, wherein the background model updating unit deletes a background model element that has not been used at least for a predetermined time period.

3. The system of claim 1, wherein the background model updating unit updates the background model to include a peripheral area of the background model when at least one of the pixels has a video property corresponding to the peripheral area of the background model, the peripheral area representing a predetermined range of similarity to a visual property of the at least one background model element.

4. The system of claim 3, wherein the background model updating unit reduces the peripheral area included in the updated background model by a predetermined rate when no pixels corresponding to the peripheral area are detected for a predetermined time period.

5. The system of claim 1, wherein the background model updating unit stores the usage time information in the at least one background model element according to the pixel information and updates the background model.

6. The system of claim 5, wherein the usage time information comprises:

a first time element which identifies a most recent frame in which a corresponding background model element is used,

a second time element which indicates a number of sequential frames in which the corresponding background model element is not used, and

a third time element which indicates a number of frames in which the corresponding background model element is used.

7. The system of claim 1, wherein the background model updating unit generates at least one background model element candidate which comprises, regarding a foreground pixel, pixel information and usage time information.

8. The system of claim 7, wherein a number of the at least one background model element candidate is smaller than a number of the at least one background model element.

9. The system of claim 7, wherein the background model updating unit updates one of the at least one background model element candidate to one of the at least one background model element and deletes a background model element that has not been used for the longest time among the at least one background model element, when a number of frames in which the one of the at least one background model element candidate is used is greater than a predetermined number.

10. The system of claim 1, wherein the pixel information indicates at least one of brightness, color, and grayscale, and

wherein the background pixel determining unit determines a pixel having a property corresponding to the pixel information as a background pixel.

11. A method of detecting a moving object in a video, the method comprising:

storing pixel information regarding each of pixels included in frames of the video in a storage;

setting a background model comprising at least one background model element, the at least one background model element indicating at least one of a reference visual property and a reference usage time;

determining whether the pixels are background pixels or foreground pixels by comparing the pixel information with the at least one background model element; and

updating the background model based on a result of the comparing.

12. The method of claim 11, wherein the updating comprises deleting a background model element that has not been used at least for a predetermined time period.

13. The method of claim 11, wherein the updating comprises updating the background model to include a peripheral area of the background model when at least one of the pixels has a video property corresponding to the peripheral area of the background model, the peripheral area representing a predetermined range of similarity to a visual property of the at least one background model element.

14. The method of claim 13, wherein the updating comprises reducing the peripheral area by a predetermined rate when no pixels corresponding to the peripheral area are detected for a predetermined time period.

15. The method of claim 11, wherein the updating comprises storing the usage time information in the at least one background model element according to the pixel information and updating the background model.

16. The method of claim 15, wherein the usage time information comprises:

a first time element which identifies a most recent frame in which a corresponding background model element is used,

a second time element which indicates a number of sequential frames in which the corresponding background model element is not used, and

a third time element which indicates a number of frames in which the corresponding background model element is used.

17. The method of claim 11, wherein the updating comprises generating at least one background model element candidate which comprises, regarding a foreground pixel, pixel information and usage time information.

18. The method of claim 17, wherein a number of the at least one background model element candidate is smaller than a number of the at least one background model element.

19. The method of claim 17, wherein the updating comprises, when a number of frames in which the one of the at least one background model element candidate is used is greater than a predetermined number, updating one of the at least one background model element candidate to one of the at least one background model element and deleting a background model element that has not been used for the longest time among the at least one background model element.

20. The method of claim 11, wherein the pixel information indicates at least one of brightness, color, and grayscale, and

the determining comprises determining a pixel having a property corresponding to the pixel information as a background pixel.