Video information management system which provides intelligent responses to video data content features

• US 5,875,305 A
• Filed: 10/31/1996
• Issued: 02/23/1999
• Est. Priority Date: 10/31/1996
• Status: Expired due to Term

• Current Assignee: Sensormatic Electronics LLC (Johnson Controls International plc)
• Original Assignee: Sensormatic Electronics Corporation (Johnson Controls International plc)
• Inventors: Auyeung, Alex Kamlun, Nguyen, Lyn, Lin-Liu, Sen, Winter, Gerhard Josef, MacCormack, David Ross, Klein, Harry Eric
• Primary Examiner(s): PEESO, THOMAS R
• Application Number:
  US08/741,982
• Time in Patent Office: 845 Days
• Field of Search: 395/200.61, 395/200.63, 345/334, 345/339, 345/340, 360/22, 360/24, 360/27, 360/32, 348/262, 348/588, 348/590, 348/840, 382/107, 382/123, 382/190, 382/203, 382/206
• US Class Current: 709/231
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G08B 13/19604 involving reference image or background adaptation with time to compensate for changing conditions, e.g. reference image update on detection of light level change
• CPC Class Codes: G08B 13/19634 Electrical details of the system, e.g. component blocks for carrying out specific functions
• CPC Class Codes: G08B 13/19645 Multiple cameras, each having view on one of a plurality of scenes, e.g. multiple cameras for multi-room surveillance or for tracking an object by view hand-over
• CPC Class Codes: G08B 13/19667 Details realated to data compression, encryption or encoding, e.g. resolution modes for reducing data volume to lower transmission bandwidth or memory requirements
• CPC Class Codes: G08B 13/19673 Addition of time stamp, i.e. time metadata, to video stream
• CPC Class Codes: G08B 13/1968 Interfaces for setting up or customising the system
• CPC Class Codes: G08B 13/19682 Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system
• CPC Class Codes: H04N 5/445 for displaying additional information H04N5/50 takes precedence
• CPC Class Codes: H04N 5/76 Television signal recording
• CPC Class Codes: H04N 5/781 on disks or drums
• CPC Class Codes: H04N 5/782 on tape
• CPC Class Codes: H04N 5/783 Adaptations for reproducing at a rate different from the recording rate
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 9/8042 involving data reduction
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal
• CPC Class Codes: H04N 9/8227 the additional signal being at least another television signal

Abstract

Apparatus for analyzing and storing video data includes a video camera for generating video data and analysis circuitry for analyzing the video data generated by the video camera to detect a predetermined characteristic of the video data. The apparatus also includes first and second storage devices, and routes the analyzed video data to a selected one of the first and second storage devices in response to detection of the predetermined characteristic of the video data.

Claims

1. Apparatus for analyzing and storing video data, comprising:

means for generating said video data;

analysis means for analyzing the video data generated by said means for generating to detect a predetermined characteristic of said video data; and

storage means for storing the analyzed video data, said storage means including a first data storage device and a second data storage device, said storage means routing said analyzed video data to a selected one of said first and second data storage devices in response to detection by said analysis means of said predetermined characteristic of said video data;

wherein said second data storage device is selectively connectable to said means for generating said video data, and said storage means establishes a data communication path connection between said means for generating and said second data storage device in response to detection by said analysis means of said characteristic of said video data.

2. Apparatus according to claim 1, wherein said data communication path connection includes a dial-up telephone connection between said means for generating and said second data storage device.

3. Apparatus according to claim 1, wherein each of said first and second data storage devices includes means for storing a plurality of frames of said video data.

4. Apparatus for analyzing and storing video data, comprising:

means for generating said video data;

analysis means for analyzing the video data generated by said means for generating to detect a characteristic of an object represented by said video data; and

storage means for storing the analyzed video data, said storage means including a first data storage device and a second data storage device, said storage means routing said analyzed video data to a selected one of said first and second data storage devices in response to detection by said analysis means of said predetermined characteristic of said video data;

wherein said characteristic of said object represented by said video data is a characteristic selected from the group consisting of size of the object, change of size of the object, motion of the object, velocity of the object, acceleration of the object, change in rate of acceleration of the object, shape of the object, change of shape of the object, and texture of the object.

5. Apparatus according to claim 4, wherein each of said first and second data storage devices includes means for storing a plurality of frames of said video data.

6. Apparatus for analyzing and storing video data, comprising:

means for generating said video data;

analysis means for analyzing the video data generated by said means for generating to detect a predetermined characteristic of said video data; and

storage means for storing the analyzed video data, said storage means including a first data storage device and a second data storage device, said storage means routing said analyzed video data to a selected one of said first and second data storage devices in response to detection by said analysis means of said predetermined characteristic of said video data;

wherein said predetermined characteristic of said video data is a characteristic selected from the group consisting of a chrominance characteristic of said video data and a change of a chrominance characteristic of said video data.

7. Apparatus according to claim 6, wherein each of said first and second data storage devices includes means for storing a plurality of frames of said video data.

8. Apparatus for analyzing video data, comprising:

a first video camera for generating first video data;

analysis means for analyzing the first video data generated by said first video camera to detect a predetermined characteristic of said first video data;

a second video camera for generating second video data; and

means, responsive to said analysis means, for selectively storing the second video data generated by said second video camera in response to detection of said predetermined characteristic of said first video data by said analysis means.

9. Apparatus according to claim 8, wherein said predetermined characteristic of said first video data is a characteristic of an object represented by said first video data.

10. Apparatus according to claim 9, wherein said characteristic of said object represented by said first video data is a characteristic selected from the group consisting of size of the object, change of size of the object, motion of the object, velocity of the object, acceleration of the object, change in rate of acceleration of the object, shape of the object, change of shape of the object, and texture of the object.

11. Apparatus according to claim 8, wherein said predetermined characteristic of said first video data is a characteristic selected from the group consisting of a chrominance characteristic of said first video data and a change of a chrominance characteristic of said first video data.

12. Apparatus for analyzing video data, comprising:

a first video camera for generating first video data;

analysis means for analyzing the first video data generated by said first video camera to detect a predetermined characteristic of said first video data;

a second video camera for generating second video data; and

said analysis means selectively performing a predetermined analysis algorithm with respect to said second video data generated by said second video camera when said analysis means detects said predetermined characteristic of said first video data.

13. Apparatus according to claim 12, wherein said predetermined characteristic of said first video data is a characteristic of an object represented by said first video data.

14. Apparatus according to claim 13, wherein said characteristic of said object represented by said first video data is a characteristic selected from the group consisting of size of the object, change of size of the object, motion of the object, velocity of the object, acceleration of the object, change in rate of acceleration of the object, shape of the object, change of shape of the object, and texture of the object.

15. Apparatus according to claim 14, wherein said predetermined characteristic of said first video data is a characteristic selected from the group consisting of a chrominance characteristic of said first video data and a change of a chrominance characteristic of said first video data.

16. Apparatus for analyzing video data, comprising:

a source of video data; and

means for analyzing video data provided by said source of video data to detect a first predetermined characteristic of said video data by performing a first predetermined analysis algorithm, and for performing a second predetermined analysis algorithm to detect a second predetermined characteristic of said video data when said means for analyzing detects said first predetermined characteristic.

17. Apparatus according to claim 16, wherein said source of video data includes a video camera;

and

further comprising storage means for storing said video data, and for supplying said stored video data for analysis in accordance with said second predetermined analysis algorithm when said means for analyzing detects said first predetermined characteristic of said video data.

18. Apparatus for analyzing and storing video data, comprising:

a video camera for generating video data;

alarm means for detecting an alarm condition;

compression means for performing compression processing on the video data generated by said video camera according to a predetermined compression algorithm to form compressed video data; and

storage means for storing the compressed video data formed by said compression means;

said compression means being responsive to said alarm means so as to vary said compression algorithm in dependence upon whether said alarm means detects an alarm condition.

19. Apparatus according to claim 18, wherein said predetermined compression algorithm includes:

comparing predetermined portions of a present field of said video data to corresponding portions of a reference image generated by said video camera, to form comparison statistics;

comparing said comparison statistics with a threshold that is set at a first value when said alarm means does not detect an alarm condition and that is set at a second value, different from said first value, when said alarm means detects an alarm condition; and

selectively discarding said predetermined portions of the present field on the basis of the comparing of the comparison statistics with the threshold.

20. Apparatus according to claim 18, wherein said alarm means includes means for analyzing the video data generated by said video camera to detect a predetermined characteristic of said video data.

21. Apparatus according to claim 20, wherein said predetermined characteristic is a spectral characteristic of said video data.

22. Apparatus according to claim 21, wherein said predetermined characteristic is a measure of information content per unit quantity of the video data.

23. Apparatus for analyzing and storing video data, comprising:

a first video camera for generating first video data;

a second video camera for generating second video data;

storage means for storing the second video data generated by said second video camera; and

means for analyzing said first video data generated by said first video camera to detect a predetermined characteristic of said first video data, and for selectively analyzing said second video data stored in said storage means to detect a predetermined characteristic of said second stored video data in dependence upon whether said predetermined characteristic of said first video data is detected by said means for analyzing.

24. Apparatus according to claim 23, wherein said predetermined characteristic of said first video data is a characteristic of an object represented by said first video data.

25. Apparatus according to claim 24, wherein said characteristic of said object represented by said first video data is a characteristic selected from the group consisting of size of the object, change of size of the object, motion of the object, velocity of the object, acceleration of the object, change in rate of acceleration of the object, shape of the object, change of shape of the object, and texture of the object.

26. Apparatus according to claim 23, wherein said predetermined characteristic of said first video data is a characteristic selected from the group consisting of a chrominance characteristic of said first video data a change of a chrominance characteristic of said first video data, a luminance characteristic of said first video data, and a change of a luminance characteristic of said first video data.

27. An apparatus for analyzing and storing video data, comprising:

a first video camera for generating first video data;

a second video camera for generating second video data;

storage means for storing the second video data generated by said second video camera; and

means for analyzing said first video data generated by said first video camera to detect a predetermined characteristic of said first video data;

wherein said storage means stores a first predetermined number of fields of said second video data per unit time during periods in which said means for analyzing does not detect said predetermined characteristic of said first video data, and said storage means stores a second predetermined number of fields, larger than said first predetermined number of fields, of said second video data per unit time during periods in which said means for analyzing detects said predetermined characteristic of said first video data.

28. An apparatus for analyzing, storing and displaying video information, comprising:

first camera means for generating a first stream of video data;

second camera means for generating a second stream of video data;

first storage means for selectively storing at least one of said first and second streams of video data;

second storage means for selectively storing at least one of said first and second streams of video data;

transmission means for selecting one of said first and second storage means to receive said first stream of video data;

display means for selectively displaying at least one of said first and second streams of video data;

analysis means for analyzing said first stream of video data to detect a predetermined characteristic of said first stream of video data; and

action means, responsive to said analysis means, for performing at least one of the following actions in dependence upon whether said analysis means detects said predetermined characteristic of said first stream of video data;

changing a characteristic of an image displayed on said display means, at least part of said image representing said first stream of video data;

controlling said transmission means to change over between said first and second storage means;

changing a field of view of at least one of said first camera means and said second camera means;

causing said analysis means to carry out a video data analysis algorithm with respect to said second stream of video data;

selecting said second stream of video data for storage in at least one of said first and second storage means;

causing said display means to display an image at least part of which is representative of said second stream of video data; and

causing said analysis means to carry out a video data analysis algorithm with respect to video data stored in and read out from one of said first and second storage means;

wherein said predetermined characteristic of said first stream of video data detected by said analysis means is selected from the group consisting of;

acceleration of an object represented by said first stream of video data;

change in acceleration of an object represented by said first stream of video data;

shape of an object represented by said first stream of video data;

change of shape of an object represented by said first stream of video data; and

texture of an object represented by said first stream of video data.

29. An apparatus for analyzing, storing and displaying video information, comprising:

first camera means for generating a first stream of video data;

second camera means for generating a second stream of video data;

first storage means for selectively storing at least one of said first and second streams of video data;

second storage means for selectively storing at least one of said first and second streams of video data;

transmission means for selecting one of said first and second storage means to receive said first stream of video data;

display means for selectively displaying at least one of said first and second streams of video data;

analysis means for analyzing said first stream of video data to detect a plurality of predetermined characteristics of said first stream of video data; and

action means, responsive to said analysis means, for performing at least one of the following actions in dependence upon whether said analysis means detects said plurality of predetermined characteristics of said first stream of video data;

changing a characteristic of an image displayed on said display means, at least part of said image representing said first stream of video data;

controlling said transmission means to change over between said first and second storage means;

changing a field of view of at least one of said first camera means and said second camera means;

causing said analysis means to carry out a video data analysis algorithm with respect to said second stream of video data;

selecting said second stream of video data for storage in at least one of said first and second storage means;

causing said display means to display an image at least part of which is representative of said second stream of video data; and

causing said analysis means to carry out a video data analysis algorithm with respect to video data stored in and read out from one of said first and second storage means;

wherein said plurality of predetermined characteristics of said first stream of video data detected by said analysis means are selected from the group consisting of;

motion of an object represented by said first stream of video data;

acceleration of an object represented by said first stream of video data;

change in acceleration of an object represented by said first stream of video data;

shape of an object represented by said first stream of video data;

change of shape of an object represented by said first stream of video data; and

texture of an object represented by said first stream of video data.

30. An apparatus for storing, analyzing and displaying video information, comprising:

storage means for storing a stream of video data, said stream of video data representing a dynamic video image;

detecting means for detecting a predetermined characteristic of said stream of video data stored in said storage means;

display means for displaying images corresponding to said stream of video data stored in said storage means;

a display buffer for storing image data transferred from said storage means and for reading out image data stored in said display buffer, said image data read out from said display buffer being supplied to said display means to cause the display means to display an image corresponding to said supplied image data; and

action means, responsive to said detecting means, for performing at least one of the following actions in dependence upon whether said detecting means detects said predetermined characteristic of said stream of video data stored in said storage means;

selecting between a first display buffer update mode in which the data stored in said display buffer is updated according to a progressive image scan and a second display buffer update mode in which the data stored in said display buffer is updated according to an interlaced image scan;

selecting a rate at which the data stored in said display buffer is updated;

selecting a spatial resolution with which said display means displays said images corresponding to said stream of video data stored in said storage means; and

selecting for updating a portion of an image plane corresponding to the image plane displayed on said display means;

wherein said predetermined characteristic of said stream of video data stored in said storage means is selected from the group consisting of;

motion of an object represented by said stream of video data stored in said storage means;

texture of an object represented by said stream of video data stored in said storage means;

amplitude of a high frequency component of said stream of video data stored in said storage means;

a degree to which said stream of video data stored in said storage means has been compressed;

a degree to which said stream of video data stored in said storage means exhibits spatial correlation; and

a degree to which said stream of video data stored in said storage means exhibits temporal correlation.

31. Apparatus according to claim 30, wherein said storage means includes a hard disk.

32. A method of analyzing video data, comprising the steps of:

generating a stream of dynamic images;

applying a moving image content analysis algorithm to said stream of dynamic images; and

inhibiting application of said analysis algorithm to said stream of dynamic images, in response to detection of an alarm condition.

33. A method according to claim 32, wherein said alarm condition is detected by application of said analysis algorithm.

34. A method according to claim 32, wherein said analysis algorithm is for detecting a moving object represented by said stream of dynamic images.

35. Apparatus for analyzing video data, comprising:

means for generating a stream of dynamic images;

analysis means for applying a moving image content analysis algorithm to said stream of dynamic images;

means for detecting an alarm condition; and

means, responsive to said means for detecting, for selectively inhibiting said analysis means from applying said analysis algorithm to said stream of dynamic images.

36. Apparatus according to claim 35, wherein said analysis means applied to said stream of dynamic images an analysis algorithm for detecting a moving object represented by said stream of dynamic images.

37. Apparatus according to claim 35, wherein said means for detecting includes means for comparing a result of said analysis algorithm with an alarm detection threshold.

38. A method of simultaneously recording on a recording medium a plurality of streams of video information each generated by a respective video camera, comprising the steps of:

determining whether an alarm condition is present;

if no alarm condition is present, recording images generated by said video cameras on said recording medium at a first aggregate image rate, said aggregate image rate defining a total number of images currently being recorded on said recording medium per unit time; and

if an alarm condition is determined to be present, recording images generated by said video cameras on said recording medium at a second aggregate image rate that is higher than said first aggregate image rate.

39. A method according to claim 38, wherein said step of determining whether an alarm condition is present includes analyzing content of at least one of said streams of video information.

40. A method according to claim 38, wherein said step of determining whether an alarm condition is present includes receiving a signal from an alarm sensor.

41. A method according to claim 38, wherein said first aggregate image rate is 30 images per second and said second aggregate image rate is 45 images per second.

42. Video information recording apparatus, comprising:

a plurality of video cameras each generating a respective stream of video information;

recording means for simultaneously recording on a recording medium the plural streams of video information, at a variable aggregate image rate, said aggregate image rate defining a total number of images currently being recorded on said recording medium per unit time; and

alarm means for determining whether an alarm condition is present;

said recording means operating at a first aggregate image rate when said alarm means does not determine that an alarm condition is present and said recording means operating at second aggregate image rate, higher than said first aggregate image rate, when said alarm means determines that an alarm condition is present.

43. Video information recording apparatus according to claim 42, wherein said alarm means includes means for analyzing content of at least one of said streams of video information.

44. Video information recording apparatus according to claim 42, further comprising at least one alarm sensor for selectively providing an alarm signal to said alarm means.

45. Video information recording apparatus according to claim 42, wherein said first aggregate image rate is 30 images per second and said second aggregate image rate is 45 images per second.

46. Video information recording apparatus according to claim 42, wherein said recording medium is selected from a group consisting of a hard disk, a magneto-optical disk, and a writable optical disk.