Data identification in an intelligent video information management system

• US 5,884,042 A
• Filed: 10/31/1996
• Issued: 03/16/1999
• Est. Priority Date: 10/31/1996
• Status: Expired due to Term

• Current Assignee: Sensormatic Electronics LLC (Johnson Controls International plc)
• Original Assignee: Sensormatic Electronics Corporation (Johnson Controls International plc)
• Inventors: Nguyen, Lyn, Nunally, Patrick O., Lin-Liu, Sen, Winter, Gerhard Josef, MacCormack, David Ross, Wilson, Charles Park, Klein, Harry Eric, Auyeung, Alex Kamlun
• Primary Examiner(s): PEESO, THOMAS R
• Application Number:
  US08/740,627
• Time in Patent Office: 866 Days
• Field of Search: 395/200.61, 395/200.63, 345/334, 345/339, 345/340, 360/22, 360/24, 360/27, 360/32, 348/262, 348/588, 348/590, 348/840, 382/107, 382/123, 382/190, 382/203, 382/206
• US Class Current: 709/231
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G08B 13/19604 involving reference image or background adaptation with time to compensate for changing conditions, e.g. reference image update on detection of light level change
• CPC Class Codes: G08B 13/19634 Electrical details of the system, e.g. component blocks for carrying out specific functions
• CPC Class Codes: G08B 13/19645 Multiple cameras, each having view on one of a plurality of scenes, e.g. multiple cameras for multi-room surveillance or for tracking an object by view hand-over
• CPC Class Codes: G08B 13/19667 Details realated to data compression, encryption or encoding, e.g. resolution modes for reducing data volume to lower transmission bandwidth or memory requirements
• CPC Class Codes: G08B 13/19673 Addition of time stamp, i.e. time metadata, to video stream
• CPC Class Codes: G08B 13/1968 Interfaces for setting up or customising the system
• CPC Class Codes: G08B 13/19682 Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system
• CPC Class Codes: H04N 5/445 for displaying additional information H04N5/50 takes precedence
• CPC Class Codes: H04N 5/76 Television signal recording
• CPC Class Codes: H04N 5/781 on disks or drums
• CPC Class Codes: H04N 5/782 on tape
• CPC Class Codes: H04N 5/783 Adaptations for reproducing at a rate different from the recording rate
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 9/8042 involving data reduction
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal
• CPC Class Codes: H04N 9/8227 the additional signal being at least another television signal

Abstract

Video data storage apparatus stores on a hard disk plural fields of video data and header data associated with each field of video data. The video data is reproduced from the hard disk and the reproduced video data is processed by an image analysis algorithm. Data indicative of the outcome of the image analysis is then recorded on the hard disk as part of the header data.

Claims

1. A video information analysis apparatus, comprising:

storage means for storing a video information data base;

analysis means for analyzing video information in the data base in accordance with a predetermined analysis algorithm, said predetermined analysis algorithm for assigning to respective portions of said video information analysis scores each indicative of a degree to which the respective portion of said video information represents a predetermined analysis feature, each said analysis score being a value within a predetermined range of values comprising at least three values.

2. A video information analysis apparatus according to claim 1, wherein said range of values comprises at least eight values.

3. A video information analysis apparatus according to claim 2, wherein said range of values comprises at least one hundred values.

4. A video information analysis apparatus according to claim 1, further comprising:

selection means for selecting a specific one of said range of values; and

search means for identifying portions of said video information having analysis scores greater than or equal to said selected one of said range of values.

5. A method of operating an apparatus for storing and retrieving video data, the method comprising the steps of:

storing a plurality of fields of video data on a first hard disk;

storing index data on said first hard disk. said index data including data indicative of respective times at which said fields of video data were generated and respective locations on said first hard disk at which said fields of video data are stored; and

storing said index data on a second hard disk;

wherein said video data stored on said first hard disk includes video data representative of respective streams of video signals generated by a plurality of cameras, and said index data stored on said first and second hard disks includes data indicative of respective cameras by which said fields of video data stored on said first hard disk were generated.

6. A method according to claim 5, further comprising the steps of searching for a desired field of the video data stored on the first hard disk on the basis of index data read out from the second hard disk.

7. A method according to claim 5, further comprising the step of storing on said second hard disk a quantity of video data read out from said first hard disk.

8. A method of operating an apparatus for storing and retrieving video data. the method comprising the steps of:

storing a plurality of fields of video data on a first hard disk;

storing index data on said first hard disk. said index data including data indicative of respective times at which said fields of video data were generated and respective locations on said first hard disk at which said fields of video data are stored; and

storing said index data on a second hard disk;

wherein said index data stored on said first and second hard disks includes data indicative of characteristics of said video data stored on said first hard disk, said characteristics of said video data having been detected by applying a video data analysis algorithm to said video data.

9. A method according to claim 8, wherein said video data analysis algorithm was applied to said video data before said video data was stored on said first hard disk.

10. A method according to claim 8, wherein said video data analysis algorithm was applied to said video data after said video data was stored on said first hard disk.

11. A video data storage apparatus, comprising:

a video data source for providing a dynamic stream of video data frames;

a data memory device for storing the dynamic stream of video data frames provided by the video data source; and

control means for designating a main portion of said data memory device, said main portion for recording said dynamic stream of video data frames at a first frame rate, said control means also designating a buffer portion of said data memory device, said buffer portion for recording said dynamic stream of video data frames at a second frame rate that is higher than said first frame rate.

12. A video data storage apparatus according to claim 11, wherein said data memory device comprises a hard disk.

13. A video data storage apparatus according to claim 11, further comprising detection means for detecting an alarm condition, and wherein said control means designates said buffer portion of said data memory device by maintaining a pointer indicative of where said buffer portion is located in said data memory device, and said control means responds to detection of said alarm condition by said detection means by changing a value of said pointer, whereby said buffer portion is moved to a new location in said data memory device.

14. A data storage medium on which is stored video data representing a plurality of video image frames, frame identification data indicative of respective times at which said video image frames were generated, and characteristic data indicative of respective characteristics of the video image frames represented by said video data, said respective characteristics having been detected by applying an image analysis algorithm to said video data.

15. A data storage medium according to claim 14, wherein said characteristic data includes first subdata indicative of a type of characteristic represented by said characteristic data, and second subdata indicative of a degree to which a respective video image frame exhibits said type of characteristic represented by said characteristic data.

16. A data storage medium according to claim 14, wherein said image analysis algorithm was applied to said video data before said video data was stored on the storage medium.

17. A data storage medium according to claim 14, wherein said image analysis algorithm was applied to said video data by reading said video data from the storage medium.

18. A data storage medium according to claim 14, wherein said characteristic data includes first characteristic data generated by applying a first image analysis algorithm to said video data, and second characteristic data generated by applying a second image analysis algorithm, different from said first image analysis algorithm, to said video data.

19. A data storage medium according to claim 18, wherein said first image analysis algorithm was applied to said video data before said video data was stored on the storage medium, and said second image analysis algorithm was applied to said video data after reading said video data from the storage medium.

20. A data storage medium according to claim 14, on which is also stored data indicative of an alarm condition detected at a time at which at least one of said video image frames was generated.

21. A data storage medium according to claim 14, on which is also stored data indicative of audio signals generated at times when said video image frames were generated.

22. A data storage medium according to claim 14, wherein said video data represents respective streams of video image frames generated by a plurality of video cameras, and there is also stored on the storage medium data identifying the respective one of said plurality of video cameras which generated each of the video image frames.

23. A data storage medium according to claim 14, comprising a hard disk.

24. A data storage medium according to claim 14, comprising a magnetic tape.

25. A data storage medium according to claim 14, wherein said video data is recorded in a plurality of parallel oblique recording tracks on said magnetic tape.

26. A video information storage apparatus, comprising:

a video camera for generating a stream of dynamic images;

storage means for storing respective video data portions each of which represents an image from said stream of dynamic images, each said video data portion including header data;

means for moving the video camera to change a field of view of the video camera; and

control means for providing control signals to said means for moving to control movement of the video camera;

said control means being connected to said storage means to provide to said storage means signals indicative of times when said control means is causing said camera to be moved;

said storage means responding to said signals provided to said storage means from said control means, by including a motion signal in the header data included in the video data portions corresponding to images generated at said times when said camera is moved, said motion signal indicating that the respective image was taken by said camera when said camera was moving.

27. A video information storage apparatus according to claim 26, further comprising:

means for retrieving the stored video data portions from the storage means;

analysis means for analyzing the retrieved video data portions to detect a predetermined feature in the images represented by the retrieved video data portions, and for generating a detection signal indicative of the detected feature;

means for transmitting the detection signal to the storage means to store the detection signal as an index signal in association with the stored video data portions; and

inhibit means for reading the movement signal included in the header data of respective ones of the stored video data portions and for inhibiting the analysis means from analyzing the respective ones of the stored video data portions.

28. A video information storage apparatus according to claim 27, wherein said index signal is included in the header data corresponding to the stored video data portions with respect to which the predetermined feature was detected by the analysis means.

29. A video information storage apparatus according to claim 27, wherein the predetermined feature detected by said analysis means is a moving object represented by the stream of dynamic images.

30. A method of storing and indexing video information, comprising the steps of:

using a movable video camera to generate a stream of dynamic images;

storing video data representing the stream of dynamic images; and

storing indexing data in association with the stored video data, said stored indexing data including movement data indicating, as to each image represented by the stored video data, whether the respective image was generated at a time when the camera was being moved.

31. A method according to claim 30, further comprising the steps of:

reading the movement data; and

on the basis of the read movement data, selectively analyzing the stored video data to detect a predetermined feature represented by the stored video data.

32. A method of transmitting and displaying video information, comprising the steps of:

receiving a plurality of streams of video information each generated by a respective video camera;

transmitting said plural streams of video information to display means field by field; and

displaying each of said plural streams of video information in a respective display window on a display screen;

wherein said transmitting step includes appending, to each field of each of said plural streams of video information, header data which includes data indicative of the one of said display windows in which the field is to be displayed.

33. A method according to claim 32, wherein the appended header data includes data for identifying the one of said video cameras which generated the field.

34. Apparatus for transmitting and displaying video information, comprising:

means for receiving a plurality of streams of video information each generated by a respective video camera;

display means for simultaneously displaying each of said plural streams of video information in a respective display window on a display screen;

means for appending, to each field of said received plural stream of video information, header data which includes data indicative of the one of said display windows in which the respective field is to be displayed; and

means for transmitting the received fields of video information, with the appended header data, to the display means.

35. Apparatus according to claim 34, wherein said means for transmitting includes a multi-bit parallel data bus.

36. Apparatus according to claim 34, wherein the appended header data includes data for identifying the one of said video cameras which generated the field.

37. Apparatus according to claim 34, wherein said display means simultaneously displays four video information streams in respective windows on said display screen.

38. Apparatus according to claim 37, wherein said display means simultaneously displays nine video information streams in respective windows on said display screen.

39. Apparatus according to claim 38, wherein said display means simultaneously displays sixteen video information streams in respective windows on said display screen.

40. A method of storing video information, comprising the steps of:

recording plural fields of video data on a recording medium, each of said fields of video data representing a respective image;

recording on said recording medium, in association with each of said fields of video data, header data including data indicative of a source of the image represented by the respective field;

reproducing from the recording medium the recorded fields of video data;

processing at least one of the header data and the reproduced fields of video data to obtain a processing result; and

on the basis of said processing result, recording process result data on said recording medium in the header data for at least one of said reproduced fields of video data.

41. A method according to claim 40, wherein said processing step includes applying a moving image content analysis algorithm to the reproduced fields of video data.

42. A method according to claim 41, wherein said moving image content analysis algorithm is for detecting moving objects represented by the reproduced fields of video data, and said process result is data indicative of detection of a moving object.

43. A method according to claim 40, wherein said recording medium is a hard disk.

44. A method according to claim 40, wherein said header data includes data for identifying a camera which generated the respective field of video data, and data indicative of a time at which the field of video data was generated.

45. Apparatus for storing video data, comprising:

means for recording plural fields of video data on a recording medium, each of said fields of video data representing a respective image;

means for recording on said recording medium, in association with each of said fields of video data, header data including data indicative of a source of the image represented by the respective field;

means for reproducing from the recording medium the recorded fields of video data;

processing means for processing at least one of the header data and the reproduced fields of video data, to generate process result data; and

means, responsive to said processing means, for recording the process result data on said recording medium in the header data for at least one of said reproduced fields of video data.

46. Apparatus according to claim 45, wherein said processing means includes analysis means for applying a moving image content analysis algorithm to the reproduced fields of video data.

47. Apparatus according to claim 46, wherein said moving image content analysis algorithm applied by said analysis means is for detecting moving objects represented by the reproduced fields of video data, and said process result data generated by said processing means is data indicative of detection of a moving object.

48. Apparatus according to claim 45, wherein said recording medium is a hard disk.

49. Apparatus according to claim 45, wherein said header data includes data for identifying a camera which generated the respective field of video data, and data indicative of a time at which the field of video data was generated.

50. A method of operating an apparatus for storing and retrieving video data, the method comprising the steps of:

storing a plurality of fields of video data on a first hard disk;

storing index data on said first hard disk. said index data including data indicative of respective times at which said fields of video data were generated and respective locations on said first hard disk at which said fields of video data are stored; and

storing said index data on a second hard disk;

wherein said index data stored on said first and second hard disks includes data indicative of alarm conditions detected at times when respective portions of the video data stored on said first hard disk were generated.

51. A video data storage apparatus, comprising:

a video data source for providing a dynamic stream of video data fields;

a data memory device for storing the dynamic stream of video data fields provided by the video data source; and

control means for designating a main portion of said data memory device, said main portion for recording said dynamic stream of video data fields at a first field rate, said control means also designating a buffer portion of said data memory device, said buffer portion for recording said dynamic stream of video data fields at a second field rate that is higher than said first field rate.

52. A video data storage apparatus according to claim 51, wherein said data memory device comprises a hard disk.

53. A data storage medium on which is stored video data representing a plurality of video image fields, field identification data indicative of respective times at which said video image fields were generated, and characteristic data indicative of respective characteristics of the video image fields represented by said video data, said respective characteristics having been detected by applying an image analysis algorithm to said video data.