SURVEILLANCE SYSTEM

• US 20110228092A1
• Filed: 03/19/2010
• Published: 09/22/2011
• Est. Priority Date: 03/19/2010
• Status: Active Grant

• Current Assignee: University-Industry Cooperation Group of KyungHee University
• Original Assignee: University-Industry Cooperation Group of KyungHee University
• Inventors: Park, Gwang Hoon
• Granted Patent: US 9,082,278 B2
• Time in Patent Office: Days
• US Class Current: 348/154
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/20021 Dividing image into blocks, subimages or windows
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G08B 13/19608 Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position
• CPC Class Codes: H04N 19/102 characterised by the element, parameter or selection affected or controlled by the adaptive coding
• CPC Class Codes: H04N 19/11 among a plurality of spatial predictive coding modes
• CPC Class Codes: H04N 19/139 Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• CPC Class Codes: H04N 19/157 Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/192 the adaptation method, adaptation tool or adaptation type being iterative or recursive
• CPC Class Codes: H04N 19/61 in combination with predictive coding

Abstract

A surveillance system includes an input unit to receive a plurality of video frames that are acquired through the use of a first camera, a video processing unit to perform prediction and encoding processes on the plurality of video frames, a moving-object tracking unit to track a moving object between the video frames based on at least part of the results from the prediction and encoding processes to generate location information of the moving object being tracked, and a control unit to generate a control signal based on the location information and to transmits the control signal to a second camera to control the movement of the second camera

Claims

1. A surveillance system comprising:

an input unit configured to receive a plurality of video frames that are acquired through a first camera;

a video processing unit configured to generate prediction and encoding information on the plurality of video frames;

a moving-object tracking unit configured to track a moving object between the plurality of video frames based on at least part of the prediction and encoding information to generate location information of the moving object; and

a camera control unit configured to generate a control signal based on the location information and to transmit the control signal to a second camera to control the movement of the second camera effective to capture a feature part of the moving object.

2. The system of claim 1, wherein the video processing unit includes:

a prediction module configured to generate the prediction information including at least one of motion vectors, residual data and macroblock type information on the plurality of video frames; and

a transform/encoding module configured to generate the encoding information which indicates the number of bits allocated to encode a macroblock in the plurality of video frames.

3. The system of claim 2, wherein the moving-object tracking unit performs a first motion classification to determine a list of candidate macroblocks including moving objects based on the at least part of the prediction information and the encoding information.

4. The system of claim 3, wherein the moving-object tracking unit performs the first motion classification based a motion vector of a macroblock, wherein if a magnitude of the motion vector is greater than a predetermined value, the macroblock is determined to be included in the list of candidate macroblocks.

5. The system of claim 3, wherein the moving-object tracking unit performs the first motion classification based residual data of a macroblock, wherein if a magnitude of the residual data is greater than a predetermined value, the macroblock is determined to be included in the list of candidate macroblocks.

6. The system of claim 3, wherein the moving-object tracking unit performs the first motion classification based the macroblock type information, wherein if the macroblock type information indicates that a macroblock is to be processed in an intra-coding mode, the macroblock is determined to be included in the list of candidate macroblocks.

7. The system of claim 3, wherein the moving-object tracking unit performs the first motion classification based the macroblock type information, wherein if the macroblock type information indicates that a macroblock includes M×

M image pixels, M being no greater than a predetermined number, the macroblock is determined to be included in the list of candidate macroblocks.

8. The system of claim 3, wherein the moving-object tracking unit performs the first motion classification based the encoding information, wherein if the encoding information indicates that the number of coded bits for the blocks is greater than a predetermined number, the macroblock is determined to be included in the list of candidate macroblocks.

9. The system of claim 3, wherein the moving-object tracking unit performs a second motion classification to eliminate a macroblock out of the list of candidate macroblocks based on at least part of the prediction information, wherein if the prediction information indicates that a macroblock includes M×

M image pixels, M being no greater than a predetermined number, the macroblock is determined to be eliminated out of the list of candidate macroblocks.

10. The system of claim 3, wherein the moving-object tracking unit performs a second motion classification to eliminate a macroblock out of the list of candidate macroblocks based on at least part of the prediction information, wherein if the prediction information indicates that a macroblock is surrounded by skipped macroblocks, the macroblock is determined to be eliminated out of the list of candidate macroblocks.

11. The system of claim 1, wherein the second camera is a PTZ camera, wherein the PTZ camera is panned or tilted to take a video based on the control signal.

12. A surveillance method comprising:

generating prediction information and encoding information on a plurality of video frames that are acquired from a first camera;

tracking a moving object between the plurality of video frames based on at least part of the prediction information and the encoding information, the prediction information including at least one of motion vectors, residual data and macroblock type information on the plurality of video frames;

generating a control signal based on location information of the moving object; and

transmitting the control signal to a second camera to control the movement of the second camera effective to capture a feature part of the moving object.

13. The method of claim 12, wherein the tracking a moving object includes:

performing a first motion classification to determine a list of candidate macroblocks containing moving objects; and

performing a second motion classification to determine a list of final macroblocks containing moving objects.

14. The method of claim 13, wherein in the first motion classification, if a magnitude of the motion vector is greater than a predetermined value, the macroblock is determined to be included in the list of candidate macroblocks.

15. The method of claim 13, wherein in the first motion classification, if a magnitude of the residual data is greater than a predetermined value, the macroblock is determined to be included in the list of candidate macroblocks.

16. The method of claim 13, wherein in the first motion classification, if the macroblock type information indicates that a macroblock is to be processed in an intra-coding mode, the macroblock is determined to be included in the list of candidate macroblocks.

17. The method of claim 13, wherein in the first motion classification, if the macroblock type information indicates that a macroblock includes M×

M image pixels, M being no greater than a predetermined number, the macroblock is determined to be included in the list of candidate macroblocks.

18. The method of claim 13, wherein in the first motion classification, if the encoding information indicates that the number of coded bits for the blocks is greater than a predetermined number, the macroblock is determined to be included in the list of candidate macroblocks.

19. The method of claim 13, wherein in the second motion classification, if the prediction information indicates that a macroblock includes M×

M image pixels, M being no greater than a predetermined number, the macroblock is determined to be eliminated out of the list of candidate macroblocks.

20. The method of claim 13, wherein in the second motion classification, if the prediction information indicates that a macroblock is surrounded by skipped macroblocks, the macroblock is determined to be eliminated out of the list of candidate macroblocks.

21. A surveillance system comprising:

an input unit configured to receive a plurality of video frames that are acquired through a first camera;

a video processing unit configured to generate prediction and encoding information on the plurality of video frames a moving-object tracking unit configured to track a moving object between the plurality of video frames based on at least part of the prediction and encoding information to generate location information of the moving object, wherein the moving-object tracking unit determines a list of candidate macroblocks in the plurality of video frames that include moving objects based on the at least part of the prediction information or the encoding information, wherein the location information is based on at least some of the candidate macroblocks; and

a camera control unit configured to generate a control signal based on the location information and to transmit the control signal to a second camera to control the movement of the second camera.

22. The surveillance system of claim 21, wherein the moving-object tracking unit performs a first motion classification based on one or more of a motion vector of a macroblock, residual data of the macroblock, or type information of the macroblock, wherein the macroblock is included in the list of candidate macroblocks when at least one of a magnitude of the motion vector is greater than a predetermined value, a magnitude of the residual data is greater than a predetermined value, or the macroblock type information indicates that the macroblock is to be processed in an intra-coding mode.

24. The system of claim 22, wherein the moving-object tracking unit performs a second motion classification to eliminate a macroblock out of the list of candidate macroblocks based on at least part of the prediction information, wherein if the prediction information indicates that a macroblock includes M×

M image pixels, M being no greater than a predetermined number, or if the prediction information indicates that a macroblock is surrounded by skipped macroblocks, the macroblock is determined to be eliminated out of the list of candidate macroblocks.

25. The surveillance system of claim 21, wherein the control signal is effective to control the movement of the second camera to capture a feature part of the moving object.

23. The system of claim 23, wherein the moving-object tracking unit performs a first motion classification based on at least one of the encoding information or the macroblock type information, wherein the macroblock is included in the list of candidate macroblocks when the encoding information indicates that the number of coded bits for the blocks is greater than a predetermined number or the macroblock type information indicates that a macroblock includes M×

M image pixels, M being no greater than a predetermined number.