Intelligent video information management system performing multiple functions in parallel

• US 6,031,573 A
• Filed: 10/31/1996
• Issued: 02/29/2000
• Est. Priority Date: 10/31/1996
• Status: Expired due to Term

• Current Assignee: Sensormatic Electronics LLC (Johnson Controls International plc)
• Original Assignee: Sensormatic Electronics Corporation (Johnson Controls International plc)
• Inventors: Nunally, Patrick O., Winter, Gerhard Josef, MacCormack, David Ross, Wilson, Charles Park
• Primary Examiner(s): Britton, Howard
• Assistant Examiner(s): DIEP, NHON THANH
• Application Number:
  US08/741,650
• Time in Patent Office: 1,216 Days
• Field of Search: 348/401, 348/402, 348/404, 348/405, 348/409, 348/413-418, 348/154, 348/155, 386/35, 386/46
• US Class Current: 375/240.16
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G08B 13/19604 involving reference image or background adaptation with time to compensate for changing conditions, e.g. reference image update on detection of light level change
• CPC Class Codes: G08B 13/19634 Electrical details of the system, e.g. component blocks for carrying out specific functions
• CPC Class Codes: G08B 13/19645 Multiple cameras, each having view on one of a plurality of scenes, e.g. multiple cameras for multi-room surveillance or for tracking an object by view hand-over
• CPC Class Codes: G08B 13/19667 Details realated to data compression, encryption or encoding, e.g. resolution modes for reducing data volume to lower transmission bandwidth or memory requirements
• CPC Class Codes: G08B 13/19673 Addition of time stamp, i.e. time metadata, to video stream
• CPC Class Codes: G08B 13/1968 Interfaces for setting up or customising the system
• CPC Class Codes: G08B 13/19682 Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system
• CPC Class Codes: H04N 5/445 for displaying additional information H04N5/50 takes precedence
• CPC Class Codes: H04N 5/76 Television signal recording
• CPC Class Codes: H04N 5/781 on disks or drums
• CPC Class Codes: H04N 5/782 on tape
• CPC Class Codes: H04N 5/783 Adaptations for reproducing at a rate different from the recording rate
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 9/8042 involving data reduction
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal
• CPC Class Codes: H04N 9/8227 the additional signal being at least another television signal

Abstract

In an intelligent video information management (IVIM) system, a first sequence of dynamic video images is generated by a first video camera on a first occasion and is recorded on a hard disk. The same camera, or a different camera, generates a second sequence of dynamic video images on a second occasion that is later than the first occasion, and the second sequence is recorded on the hard disk. Both sequences are reproduced from the hard disk and are displayed simultaneously. Alternatively, the first sequence is reproduced and displayed while the second sequence is being recorded.

Claims

1. A method of processing fields of video data, comprising the steps of:

dividing each of said fields of video data into a plurality of rectangular data blocks, each said data block consisting of an n×

m array of picture elements, where n and m are positive integers greater than 1;

comparing each said data block with a corresponding data block in a preceding field to generate comparison data;

performing a data compression algorithm with respect to said data blocks on the basis of said comparison data, said data compression algorithm including selecting for storage, on the basis of said comparison data, ones of said data blocks, applying an orthogonal transform to said selected data blocks to produce coefficient data, and quantizing said coefficient data; and

performing a moving image content analysis algorithm with respect to said data blocks on the basis of said comparison data.

2. A method according to claim 1, wherein said step of performing said moving image content analysis algorithm includes detecting moving objects represented by said fields of video data.

3. A method according to claim 2, wherein said step of performing said moving image content analysis algorithm includes detecting whether at least one of said moving objects has crossed a predetermined perimeter.

4. A method according to claim 1, wherein n=m=8.

5. A method according to claim 1, wherein said step of performing said moving image content analysis algorithm includes detecting whether an object is removed from a predetermined location.

6. Video information storage and analysis apparatus, comprising:

video information source means for generating a dynamic sequence of video data frames;

compression means for applying a data compression algorithm to said dynamic sequence of video data frames to form compressed video data, by selecting for storage certain portions of said video data frames and applying an orthogonal transform to said selected portions of said video data frames;

display means for displaying a dynamic image which corresponds to said dynamic sequence of video data frames;

analysis means for receiving said dynamic sequence of video data frames and performing a moving image content analysis algorithm with respect to the received dynamic sequence of video data frames; and

signal transmission means for simultaneously transmitting said dynamic sequence of video data frames from said video information source means to all three of said compression means, said display means and said analysis means;

wherein said compression means, said display means and said analysis means are connected in parallel to said signal transmission means to receive said dynamic sequence of video data frames from said signal transmission means.

7. Apparatus according to claim 6, wherein said video information source means includes a video camera.

8. Apparatus according to claim 7, wherein said video camera generates a dynamic analog video signal, and said video information source means further includes conversion means for converting said dynamic analog video signal into said dynamic sequence of video data frames.

9. Apparatus according to claim 6, further comprising storage means for receiving and storing said compressed video data formed by said compression means.

10. Apparatus according to claim 9, wherein said storage means includes a hard disk.

11. Apparatus according to claim 9, further comprising a housing in which said compression means, said analysis means and said storage means are contained.

12. Apparatus according to claim 6, wherein said display means includes an NTSC monitor.

13. Apparatus according to claim 6, wherein said display means includes an SVGA monitor.

14. Apparatus according to claim 6, wherein said display means includes an NTSC monitor and an SVGA monitor.

15. Apparatus according to claim 6, wherein said analysis means detects moving objects represented by said dynamic sequence of video data frames.

16. Apparatus according to claim 15, wherein said analysis means detects whether at least one of said moving objects has crossed a predetermined perimeter.

17. Apparatus according to claim 6, wherein said analysis means detects whether an object is removed from a predetermined location.

18. Apparatus according to claim 6, wherein said signal transmission means transmits said dynamic sequence of video data frames to said display means in the form of data words corresponding to a sequence of raster-scan lines;

and

said signal transmission means transmits said dynamic sequence of video data frames to said compression means and said analysis means in the form of a sequence of n×

p data blocks, each of said data blocks corresponding to a respective rectangular portion of an image plane, each said rectangular portion overlapping at least two of said raster-scan lines;

n and p being positive integers greater than one.

19. Apparatus according to claim 6, wherein:

said signal transmission means includes a video data bus;

said compression means includes a first digital signal processing integrated circuit connected to said video data bus;

said display means includes a second digital signal processing integrated circuit, and a video data processing circuit connected to said video data bus and controlled by said second digital signal processing integrated circuit; and

said analysis means includes a third digital signal processing integrated circuit connected to said video data bus.

20. Apparatus according to claim 19, wherein said video data bus, said first, second and third digital signal processing integrated circuits and said video data processing circuit are all provided on a single printed wiring board.

21. Apparatus according to claim 20, wherein said printed wiring board includes a control signal bus to which said first, second and third digital signal processing integrated circuits are connected.

22. Apparatus according to claim 19, wherein said video data bus includes 19 parallel signal lines.

23. Apparatus for storing video data, comprising:

a plurality of source means each for providing a respective stream of video signals;

difference means for detecting differences between successive frames in each of said streams of video signals and for generating difference data indicative of the detected differences;

compression means for processing said difference data to form compression-encoded data representative of said streams of video signals;

storage means for storing said compression-encoded data formed by said compression means;

a housing in which said difference means, said compression means and said storage means are contained; and

analysis means, contained within said housing, for processing said difference data in accordance with a moving image content analysis algorithm to form analysis data indicative of respective characteristics of said streams of video signals.

24. Apparatus according to claim 23, wherein said storage means also stores said analysis data formed by said analysis means.

25. Apparatus according to claim 23, wherein said difference means includes means for storing data indicative of at least one frame of each of said streams of video signals.

26. Apparatus according to claim 25, wherein said difference means further includes comparison means for comparing data representative of an incoming frame of said streams of video signals with said stored data indicative of at least one frame of a corresponding one of said streams of video signals.

27. Apparatus according to claim 23, further comprising means, installed in said housing, for simultaneously receiving said streams of video signals.

28. Apparatus according to claim 23, wherein said analysis means detects moving objects represented by said streams of video signals.

29. Apparatus according to claim 28, wherein said analysis means detects whether at least one of said moving objects has crossed a predetermined perimeter.

30. Apparatus according to claim 23, wherein said analysis means detects whether an object is removed from a predetermined location.

31. Apparatus for storing video data, comprising:

means for simultaneously receiving a plurality of streams of video signals, each generated by a respective video camera;

means for simultaneously storing a set of reference characteristics for each of said streams of video signals;

means for comparing fields of said received plural streams of video signals with corresponding ones of said sets of reference characteristics to generate comparison data;

a housing in which said means for receiving, said means for storing and said means for comparing are installed;

compression means for applying a data compression algorithm to said fields of said received plural streams of video signals on the basis of said comparison data generated by said means for comparing, and

analysis means for performing a moving image content analysis algorithm with respect to said fields of said received plural streams of video signals on the basis of said comparison data generated by said means for comparing.