Method and apparatus for controlling a video surveillance display

• US 20060104345A1
• Filed: 11/12/2004
• Published: 05/18/2006
• Est. Priority Date: 11/12/2004
• Status: Active Grant

• Current Assignee: Pelco Incorporated (Motorola Solutions, Inc.)
• Original Assignee: Pelco (Schneider Electric SE)
• Inventors: Grigorian, Samuel Nikolay, Millar, Greg Max
• Granted Patent: US 8,934,533 B2
• Time in Patent Office: Days
• US Class Current: 375/240.10
• CPC Class Codes: G08B 13/19667 Details realated to data compression, encryption or encoding, e.g. resolution modes for reducing data volume to lower transmission bandwidth or memory requirements
• CPC Class Codes: G08B 13/19673 Addition of time stamp, i.e. time metadata, to video stream
• CPC Class Codes: G08B 13/19693 using multiple video sources viewed on a single or compound screen
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/152 by measuring the fullness of the transmission buffer
• CPC Class Codes: H04N 19/159 Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/587 involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/23406 involving management of server-side video buffer
• CPC Class Codes: H04N 21/431 Generation of visual interfaces for content selection or interaction; Content or additional data rendering
• CPC Class Codes: H04N 21/44004 involving video buffer management, e.g. video decoder buffer or video display buffer
• CPC Class Codes: H04N 21/4424 Monitoring of the internal components or processes of the client device, e.g. CPU or memory load, processing speed, timer, counter or percentage of the hard disk space used error monitoring in general G06F11/30; arrangements for monitoring conditions of receiving stations in broadcast systems H04H60/32; diagnosis, testing or measuring for television receivers H04N17/04
• CPC Class Codes: H04N 21/4621 Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen arrangements for using the results of monitoring on user's side in broadcast systems H04H60/65; flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/6377 directed to server one-way streaming services wherein the source is controlled by the destination H04L65/613
• CPC Class Codes: H04N 21/658 Transmission by the client directed to the server
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 21/8453 by locking or enabling a set of features, e.g. optional functionalities in an executable program
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources

Abstract

A method and apparatus for controlling a video surveillance display comprising receiving an MPEG video stream comprising video data in I-frames and P-frames, storing the MPEG video stream in an input buffer, displaying the stored MPEG video stream in full-motion video, monitoring the amount of video data stored in the input buffer; and displaying only the I-frames of the stored MPEG video stream when the amount of video data stored in the input buffer is greater than a predetermined amount.

Claims

1. A method of controlling a video surveillance display comprising the steps of:

receiving an MPEG video stream comprising video data in I-frames and P-frames;

storing the received MPEG video stream in an input buffer;

displaying the stored MPEG video stream in full-motion video;

monitoring the amount of video data stored in the input buffer; and

displaying only the I-frames of the stored MPEG video stream when the amount of video data stored in the input buffer is greater than a predetermined amount.

2. A method as recited in claim 1 further comprising the step of changing the display from I-frames only to full-motion video when the amount of video data stored in the input buffer is less than a predetermined amount.

3. A method as recited in claim 1 further comprising the steps of separating the I-frames from the P-frames in the stored MPEG video stream and storing the separated I-frames and P-frames separately in a storage device.

4. A method as recited in claim 1 further comprising the step of providing a signal to a source of the MPEG video stream instructing the source to provide only the I-frames of the MPEG video stream when the video data stored in the input buffer is greater than a predetermined amount.

5. A method as recited in claim 4 further comprising the step of providing a signal to the source of the MPEG video stream to provide I-frames and P-frames of the MPEG video stream when the video data stored in the input buffer is less than a predetermined amount.

6. A method of controlling a video surveillance display comprising the steps of:

receiving a plurality of MPEG video streams comprising video data in I-frames and P-frames;

receiving a request for the mode in which the received MPEG video streams are to be displayed with at least one of the MPEG video streams requested to be displayed in full-motion video;

displaying the MPEG video streams in the input buffer according to the received request;

monitoring the amount of video data in the input buffer;

determining the number of MPEG video streams that can be displayed in full-motion video and not cause the amount of video data stored in the input buffer to exceed a predetermined amount; and

displaying only the number of MPEG video streams determined in said determining step in full-motion video and the remainder of the MPEG video streams in I-frame mode.

7. A method as recited in claim 6 further comprising the step of changing the display back to the received request when the amount of video data stored in the input buffer is less than a predetermined amount.

8. A method as recited in claim 6 further comprising the steps of separating the I-frames from the P-frames in the received MPEG video streams and storing the separated I-frames and P-frames separately in a storage device.

9. A method as recited in claim 6 wherein said determining step comprises referring to a lookup table to determine the amount of system resources required to display a video stream.

10. A method as recited in claim 6 wherein said determining step comprises calculating in real-time the amount of system resources required to display a video stream.

11. A method as recited in claim 6 further comprising the step of providing a signal to a source of an MPEG video stream instructing the source to provide only the I-frames of the MPEG video stream when the video data stored in the input buffer is greater than a predetermined amount.

12. A method as recited in claim 11 further comprising the step of providing a signal to the source of the MPEG video stream to provide I-frames and P-frames of the MPEG video stream when the video data stored in the input buffer is less than a predetermined amount.

13. A method of controlling a video surveillance display comprising the steps of:

receiving a plurality of MPEG video streams comprising I-frames and P-frames;

receiving an input requesting the number of streams to be displayed on a display screen at the same time and the number of screens to be displayed in full-motion video;

determining the number of streams that can be displayed in full-motion video with the remainder of the requested streams being displayed in I-frame mode; and

displaying some of the requested number of streams in full-motion video and the remainder in I-frame mode.

14. A method as recited in claim 13 wherein said displaying step comprises displaying the maximum number of full-motion video streams with the remainder of the streams being displayed in I-frame mode.

15. A method as recited in claim 14 further comprising the step of separating the I-frames from the remainder of the MPEG video stream for the requested MPEG video streams that cannot be displayed in full-motion video.

16. A method as recited in claim 15 wherein said determining step comprises referring to a lookup table to determine the amount of system resources required to display a video stream.

17. A method as recited in claim 16 wherein said receiving step comprises receiving a request for the resolution for a video stream to be displayed and said determining step comprises referring to a lookup table to determine the amount of system resources required to display a video stream in a requested resolution.

18. A method as recited in claim 16 wherein said determining step comprises calculating in real-time the amount of system resources required to display a video stream.

19. A method as recited in claim 13 further comprising requesting that the source of a video stream that is displayed in I-frame mode send only I-frames from the MPEG video stream.

20. A method of controlling a video surveillance system comprising the steps of:

sending video data comprising full-motion video from a video source;

receiving the video data at a location;

storing the received video data in an input buffer;

displaying the stored video data as full-motion video;

determining when the amount of video data stored in the input buffer is greater than a predetermined level;

notifying the video source to send only I-frames when the amount of video data stored in the input buffer is greater than the predetermined level;

separating the I-frames from the MPEG video data at the video source;

sending video data consisting of only I-frames;

receiving the video data from the source consisting of only I-frames;

storing the video data consisting of only I-frames in the video buffer; and

displaying the I-frames stored in the video buffer.

21. A method as recited in claim 20 further comprising the steps of determining when the amount of video data stored in the input buffer is less than a predetermined level and notifying the video source to send video data comprising full-motion video when the amount of video data stored in the input buffer is less than a predetermined level.

22. A method of controlling a video surveillance system comprising the steps of:

sending video data comprising full-motion video from a video source;

receiving the video data at a location;

storing the received video data in an input buffer;

displaying the stored video data as full-motion video;

determining if the rate that video data is being stored in the input buffer is less than a predetermined level;

notifying the video source to send only I-frames when the rate of video data being stored in the input buffer is less than the predetermined level;

separating the I-frames from the MPEG video data at the video source;

sending video data consisting of only I-frames;

receiving the video data from the source consisting of only I-frames;

storing the video data consisting of only I-frames in the video buffer; and

displaying the I-frames stored in the video buffer.

23. A method as recited in claim 22 further comprising the steps of determining when the rate of video data being stored in the input buffer is greater than a predetermined level and notifying the video source to send video data comprising full-motion video when the rate of video data being stored in the input buffer is greater than a predetermined level.

24. An apparatus for controlling a video surveillance display comprising:

an input for receiving an MPEG video stream comprising video data in I-frames and P-frames;

an input buffer for storing said received MPEG video stream; and

a processor for monitoring the amount of video data stored in said input buffer, said processor providing a signal for displaying said stored MPEG video stream in full-motion video if the amount of video data stored in said input buffer is less than a predetermined amount and for displaying only the I-frames of said stored MPEG video stream when the amount of video data stored in said input buffer is greater than said predetermined amount.

25. An apparatus as recited in claim 24 wherein said processor changes said signal from displaying I-frames only to full-motion video when the amount of video data stored in said input buffer is less than said predetermined amount.

26. An apparatus as recited in claim 24 wherein said processor separates the I-frames from the P-frames in said received MPEG video stream and stores the separated I-frames and P-frames separately in said input buffer.

27. An apparatus as recited in claim 24 wherein said processor provides a signal to a source of the MPEG video stream instructing the source to provide only the I-frames of the MPEG video stream when the video data stored in said input buffer is greater than a predetermined amount.

28. An apparatus as recited claim 27 wherein said processor provides a signal to the source of the MPEG video stream to provide I-frames and P-frames of the MPEG video stream when the video data stored in said input buffer is less than a predetermined amount.

29. An apparatus for controlling a video surveillance display comprising:

an input for receiving a plurality of MPEG video streams comprising video data in I-frames and P-frames;

an input for receiving a request for the mode in which the received MPEG video streams are to be displayed with at least one of the MPEG video streams requested to be displayed in full-motion video;

an input buffer for storing said received MPEG video streams; and

a processor for providing a signal for displaying the MPEG video streams in the input buffer according to the received request, said processor monitoring the amount of video data in said input buffer and determining the number of MPEG video streams that can be displayed in full-motion video and not cause the amount of video data stored in said input buffer to exceed a predetermined amount and said processor changing said signal to display only the determined number of MPEG video streams in full-motion video and the remainder of the MPEG video streams in I-frame mode.

30. An apparatus as recited in claim 29 wherein said processor changes said signal back to display the received request when the amount of video data stored in said input buffer is less than said predetermined amount.

31. An apparatus as recited in claim 29 further comprising a storage device and wherein said processor separates the I-frames from the P-frames in said received MPEG video streams and stores the separated I-frames and P-frames separately in said storage device.

32. An apparatus as recited in claim 29 wherein said processor refers to a lookup table to determine the amount of system resources required to display a video stream.

33. An apparatus as recited in claim 29 wherein said processor provides a signal to be sent to a source of an MPEG video stream instructing the source to provide only the I-frames of the MPEG video stream when the video data stored in said input buffer is greater than a predetermined amount.

34. An apparatus as recited claim 29 wherein said processor provides a signal to be sent to a source of an MPEG video stream to provide I-frames and P-frames of the MPEG video stream when the video data stored in said input buffer is less than a predetermined amount.

35. An apparatus for controlling a video surveillance display comprising:

an input for receiving a plurality of MPEG video streams comprising I-frames and P-frames;

an input for receiving a request for the number of streams to be displayed on a display screen at the same time and the number of screens to be displayed in full-motion video; and

a processor for determining the number of streams that can be displayed in full-motion video with the remainder of the requested streams being displayed in I-frame mode and providing a signal for displaying some of the requested number of streams in full-motion video and the remainder in I-frame mode.

36. An apparatus as recited in claim 35 wherein said processor separates the I-frames from the remainder of the MPEG video stream for the requested MPEG video streams that cannot be displayed in full-motion video.

37. An apparatus as recited in claim 35 wherein said processor refers to a lookup table to determine the amount of system resources required to display a video stream.

38. A video surveillance system comprising:

a network;

a video source for providing an MPEG video stream comprising I-frames and P-frames connected to said network, said video source being able to separate said video stream into I-frames and P-frames; and

a workstation connected to said network and comprising an input buffer for storing video data received from said network and a processor, wherein said workstation monitors the amount of video data in said input buffer and sends a signal to said video source to provide only I-frames when the amount of video data in said input buffer is greater than a predetermined amount.

39. A video surveillance system as recited in claim 38 wherein said workstation sends a signal to said video source to send an MPEG video stream comprising I-frames and P-frames when the amount of video data stored in said input buffer is less than a predetermined amount.

40. A video surveillance system comprising:

a network;

a video source for providing an MPEG video stream comprising I-frames and P-frames connected to said network, said video source being able to separate said video stream into I-frames and P-frames; and

a workstation connected to said network and comprising an input buffer for storing video data received from said network and a processor, wherein said workstation monitors the rate that video data is being stored in said input buffer and sends a signal to said video source to provide only I-frames when the rate that video data is being stored in said input buffer is less than a predetermined amount.

41. A video surveillance system as recited in claim 40 wherein said workstation sends a signal to said video source to send an MPEG video stream comprising I-frames and P-frames when the rate of video data being stored in said input buffer is greater than a predetermined amount.