Video data capture and formatting in intelligent video information management system

• US 5,854,902 A
• Filed: 10/31/1996
• Issued: 12/29/1998
• Est. Priority Date: 10/31/1996
• Status: Expired due to Term

• Current Assignee: Sensormatic Electronics LLC (Johnson Controls International plc)
• Original Assignee: Sensormatic Electronics Corporation (Johnson Controls International plc)
• Inventors: MacCormack, David Ross, Wilson, Charles Park, Auyeung, Alex Kamlun, Pedersen, Chris Harvey Jr.
• Primary Examiner(s): PEESO, THOMAS R
• Application Number:
  US08/741,983
• Time in Patent Office: 789 Days
• Field of Search: 395/200.77, 395/200.32, 395/200.61, 348/180, 348/234, 348/262, 348/407, 348/572, 348/575, 348/663, 348/712, 348/713, 348/714, 348/717, 348/721, 382/162, 382/166, 382/190, 382/206, 382/232, 340/541
• US Class Current: 709/247
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G08B 13/19604 involving reference image or background adaptation with time to compensate for changing conditions, e.g. reference image update on detection of light level change
• CPC Class Codes: G08B 13/19634 Electrical details of the system, e.g. component blocks for carrying out specific functions
• CPC Class Codes: G08B 13/19645 Multiple cameras, each having view on one of a plurality of scenes, e.g. multiple cameras for multi-room surveillance or for tracking an object by view hand-over
• CPC Class Codes: G08B 13/19667 Details realated to data compression, encryption or encoding, e.g. resolution modes for reducing data volume to lower transmission bandwidth or memory requirements
• CPC Class Codes: G08B 13/19673 Addition of time stamp, i.e. time metadata, to video stream
• CPC Class Codes: G08B 13/1968 Interfaces for setting up or customising the system
• CPC Class Codes: G08B 13/19682 Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system
• CPC Class Codes: H04N 5/445 for displaying additional information H04N5/50 takes precedence
• CPC Class Codes: H04N 5/76 Television signal recording
• CPC Class Codes: H04N 5/781 on disks or drums
• CPC Class Codes: H04N 5/782 on tape
• CPC Class Codes: H04N 5/783 Adaptations for reproducing at a rate different from the recording rate
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 9/8042 involving data reduction
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal
• CPC Class Codes: H04N 9/8227 the additional signal being at least another television signal

Abstract

Signals from sixteen video cameras are selectively captured using three video decoding circuits. Each decoding circuit is selectively connectable to each camera. Each of two A/D converters is selectively connectable to each of the three decoding circuits. Two video field buffers are provided to store, respectively, the digital video signals generated by the two A/D converters.

Claims

1. Apparatus for storing video signals, comprising:

a plurality of video cameras, including at least four video cameras;

first, second and third video decoding circuits each for receiving a field of a video signal generated by a respective one of said video cameras currently connected to the video decoding circuit and for extracting luminance, chrominance and reference signal components from the received video signal;

means for selectively connecting each of said video decoding circuits to every one of said plurality of video cameras;

first and second signal conversion circuits, each for converting into digital form the luminance and chrominance signal components extracted by a respective one of said video decoding circuits currently connected to the signal conversion circuit;

means for selectively connecting each of said signal conversion circuits to every one of said first, second and third video decoding circuits;

first storage means connected to said first signal conversion circuit for sequentially storing fields of said luminance and chrominance signal components converted into digital form by said first conversion circuit; and

second storage means connected to said second signal conversion circuit for sequentially storing fields of said luminance and chrominance signal components converted into digital form by said second conversion circuit.

2. Apparatus according to claim 1, further comprising:

a data compression circuit for applying a data compression algorithm to the digital components stored in said first and second storage means to form compressed video data; and

means for selectively connecting said data compression circuit to each of said first and second storage means.

3. Apparatus according to claim 2, further comprising a mass storage device connected to said data compression circuit for storing the compressed video data formed by said data compression circuit.

4. Apparatus according to claim 3, wherein said mass storage device is selected from a group consisting of a hard disk, a magneto-optical disk and a writable optical disk.

5. Apparatus according to claim 1, wherein said chrominance signal components include first and second chrominance signal components, and each one of said first and second signal conversion circuits includes means for formatting digital data representing said luminance signal component and said first and second chrominance signal components according to a 4:

1;

1 data format.

6. Apparatus according to claim 5, wherein each one of said first and second signal conversion circuits includes:

a first analog-to-digital converter for converting said luminance signal component into luminance data; and

a second analog-to-digital converter for converting said chrominance signal components into chrominance data.

7. Apparatus according to claim 6, wherein each one of said first and second signal conversion circuits includes means for demodulating the chrominance signal component extracted by the video decoding circuit currently connected to the signal conversion circuit, on the basis of the reference signal component extracted by the video decoding circuit currently connected to the signal conversion circuit, to form the first and second chrominance signal components.

8. Apparatus according to claim 1, wherein said plurality of video cameras includes sixteen video cameras.

9. Apparatus according to claim 1, said apparatus being operable in a mode wherein two of said video decoding circuits respectively receive alternate ones of fields generated by a single one of said video cameras.

10. A method of updating a display buffer, said display buffer for storing image data to be supplied to a display device to cause the display device to display an image corresponding to the image data, said display device displaying said image in the form of a plurality of rows of picture elements, said rows of picture elements consisting of a first set of rows that are alternate ones of said rows of picture elements and a second set of rows that are all of the rows of picture elements not included in said first set of rows, said display buffer including a first set of memory locations corresponding to said first set of rows and a second set of memory locations corresponding to said second set of rows, the method comprising the steps of:

first updating the image data stored in said first set of memory locations;

upon completion of said first updating step, second updating the image data stored in said second set of memory locations; and

sequentially repeating said first and second updating steps.

11. A method according to claim 10, wherein said image data stored in said display buffer represents a dynamic video image.

12. Apparatus for formatting an image plane represented as a two-dimensional array of pixel locations according to a 4:

1;

1 digital color video format, comprising;

means for dividing said image plane into n rectangular regions having a vertical dimension of m pixels and a horizontal dimension of 4 m pixels, n being an integer greater than 1, m being an even integer greater than 1;

luma block means for forming with respect to each of said n rectangular regions four m×

m luminance-value pixel blocks arranged in a horizontal sequence in the rectangular region; and

chroma block means for forming exactly two m×

m chrominance-value blocks with respect to each of said n rectangular regions, a first one of said two chrominance-value blocks corresponding to a first chrominance signal, and each value of said first chrominance-value block representing an area corresponding to four horizontally-sequential pixels of the respective rectangular region, the second one of said two chrominance-value blocks corresponding to a second chrominance signal different from said first chrominance signal, each value of said second chrominance-value block representing an area corresponding to four horizontally-sequential pixels of the respective rectangular region.

13. Apparatus according to claim 12, wherein m=8.

14. Apparatus according to claim 13, wherein n=600.

15. Apparatus according to claim 14, wherein said means for dividing divides said image plane into 20 of said rectangular regions in a horizontal direction and into 30 of said rectangular regions in a vertical direction.

16. Apparatus according to claim 12, wherein said first chrominance signal is a U signal and said second chrominance signal is a V signal.

17. A method of formatting an image plane represented as a two-dimensional array of pixel locations according to a 4:

1;

1 digital color video format, the method comprising the steps of;

dividing said image plane into n rectangular regions having a vertical dimension of m pixels and a horizontal dimension of 4 m pixels, n being an integer greater than 1, m being an even integer greater than 1;

forming with respect to each of said n rectangular regions four m×

m luminance-value pixel blocks arranged in a horizontal sequence in the rectangular region; and

forming exactly two m×

m chrominance-value blocks with respect to each of said n rectangular regions, a first one of said two chrominance-value blocks corresponding to a first chrominance signal, and each value of said first chrominance-value block representing an area corresponding to four horizontally-sequential pixels of the respective rectangular regions, the second one of said two chrominance-value blocks corresponding to a second chrominance signal different from said first chrominance signal, each value of said second chrominance-value block representing an area corresponding to four horizontally-sequential pixels of the respective rectangular region.

18. A method according to claim 17, wherein m=8.

19. A method according to claim 18, wherein n=600.

20. A method according to claim 19, wherein said dividing step includes dividing said image plane into 20 of said rectangular regions in a horizontal direction and into 30 of said rectangular regions in a vertical direction.

21. A method according to claim 17, wherein said first chrominance signal is a U signal and said second chrominance signal is a V signal.

22. A method of transmitting a field of video data on a multi-bit parallel data bus, said field of video data corresponding to an image, the method comprising the steps of:

dividing said field of video data into first video data portions each corresponding to at least one and no more than m raster-scan lines of said field, m being a positive integer that is less than a number of raster-scan lines making up said field of video data;

transmitting each of said first video data portions in a respective one of a first sequence of discrete time intervals;

formatting said field of video data into a plurality of n×

p data blocks, each of said data blocks corresponding to a respective rectangular portion of said image that overlaps at least two raster-scan lines, n and p both being positive integers greater than one;

dividing said block-formatted video data into second data portions each consisting of a plurality of said n×

p data blocks; and

transmitting each of said second data portions in a respective one of a second sequence of discrete time intervals, said second sequence of discrete time intervals being interleaved with said first sequence of discrete time intervals.

23. A method according to claim 22, wherein m=1.

24. A method according to claim 22, wherein n=p=8.

25. A method according to claim 24, wherein each of said second data portions consists of 15 of said 8×

8 data blocks.

26. A method according to claim 25, wherein m=1.

27. A method according to claim 26, wherein each of the intervals of said first sequence is 27 microseconds and each of said intervals of said second sequence is 40 microseconds.

28. A method according to claim 27, wherein said field of video data is made up of 240 raster-scan lines, each including 640 pixels.

29. A method according to claim 22, wherein two-thirds of said data blocks are formed of luminance data, one-sixth of said data blocks are formed of a first kind of chrominance data, and one-sixth of said data blocks are formed of a second kind of chrominance data different from said first kind of chrominance data.

30. A method according to claim 22, further comprising the steps of:

selecting one of a first transmission mode and a second transmission mode; and

varying the number of said n×

p data blocks which forms each of said second data portions in dependence on the selected transmission mode.

31. A method according to claim 22, further comprising the steps of:

selecting one of a normal display mode and a reduced-resolution display mode; and

when said reduced-resolution display mode is selected, subsampling said first data portions prior to transmission thereof.

32. A method according to claim 31, wherein said reduced-resolution display mode is a zoom display mode.

33. A method according to claim 22, further comprising the step of supplying the transmitted first data portions to a display buffer used for driving a video display device.

34. A method according to claim 22, further comprising the step of applying a video data analysis algorithm to said second data portions.

35. A method according to claim 34, further comprising the step of applying a video data compression algorithm to said second data portions.

36. A method according to claim 22, further comprising the step of applying a video data compression algorithm to said second data portions.

37. A method according to claim 22, further comprising the step of appending header data to each of said transmitted n×

p data blocks, said appended header data for indicating whether the respective data block is different from a corresponding data block of an earlier field of video data.

38. Video data transmission apparatus, comprising:

a multi-bit parallel data bus;

means for dividing a field of video data into first video data portions each corresponding to at least one and no more than m raster-scan lines of said field, m being a positive integer that is less than a number of raster-scan lines making up said field of video data;

means for transmitting, on said parallel data bus, each of said first data portions in a respective one of a first sequence of discrete line intervals;

means for formatting said field of video data into a plurality of n×

p data blocks, each of said data blocks corresponding to a respective rectangular portion of said image that overlaps at least two raster-scan lines, n and p both being positive integers greater than one;

means for dividing said block-formatted video data into second data portions each consisting of a plurality of said n×

p data blocks; and

means for transmitting, on said parallel data bus, each of said second data portions in a respective one of a second sequence of discrete time intervals, said second sequence of discrete time intervals being interleaved with said first sequence of discrete time intervals.

39. Video data transmission apparatus according to claim 38, wherein m=1.

40. Video data transmission apparatus according to claim 38, wherein n=p=8.

41. Video data transmission apparatus according to claim 40, wherein each of said second data portions consists of 15 of said 8×

8 data blocks.

42. Video data transmission apparatus according to claim 41, wherein m=1.

43. Video data transmission apparatus according to claim 42, wherein each of the intervals of said first sequence is 27 microseconds and each of the intervals of said second sequence is 40 microseconds.

44. Video data transmission apparatus according to claim 38, further comprising:

means for selecting one of a first transmission mode and a second transmission mode; and

means for varying the number of said n×

p data blocks which forms each of said second data portions in dependence on the selected transmission mode.

45. Video data transmission apparatus according to claim 38, further comprising:

means for selecting one of a normal display mode and a reduced-resolution display mode; and

means for subsampling said first data portions prior to transmission thereof, when said reduced-resolution display mode is selected.

46. Video data transmission apparatus according to claim 38, wherein said multi-bit parallel data bus includes:

16 parallel data transmission lines for simultaneously transmitting a pair of eight-bit bytes of said video data; and

3 parallel data transmission lines for transmitting three bits of identifying data simultaneously with each pair of video data bytes.

47. A method of updating a display buffer, said display buffer for storing image data to be supplied to a display device to cause the display device to display an image corresponding to the image data, said display device displaying said image in the form of a two-dimensional array of picture elements, said array of picture elements defining an image plane, the method comprising the steps of:

dividing the image plane into a plurality of rectangular regions;

generating a present field of video data representative of an image formed in the image plane; and

for each respective one of the rectangular regions of the image plane;

detecting a characteristic of a portion of the present field of video data, said portion corresponding to the respective one of the rectangular regions;

comparing the detected characteristic with a reference characteristic; and

selectively storing the portion of the present field of video data in the display buffer, in dependence upon a result of said comparing step.

48. A method according to claim 47, wherein the respective portion of the present field of video data is stored in the display buffer only if the detected characteristic differs from the reference characteristic by more than a threshold amount.

49. A method according to claim 47, wherein each of said plurality of rectangular regions corresponds to a 4 m×

m array of the picture elements, m being an integer greater than 1.

50. A method according to claim 47, wherein the portion of said present video field which corresponds to each rectangular region consists of four m×

m arrays of luminance data, one m×

m array of a first type of chrominance data, and one m×

m array of a second type of chrominance data.

51. A method according to claim 50, wherein m=8.