User-settable features of an intelligent video information management system

• US 5,875,304 A
• Filed: 10/31/1996
• Issued: 02/23/1999
• Est. Priority Date: 10/31/1996
• Status: Expired due to Term

• Current Assignee: Sensormatic Electronics LLC (Johnson Controls International plc)
• Original Assignee: Sensormatic Electronics Corporation (Johnson Controls International plc)
• Inventors: Nguyen, Lyn, Nunally, Patrick O., Lin-Liu, Sen, Winter, Gerhard Josef, MacCormack, David Ross, Wilson, Charles Park, Nguyen, William Thanh, Klein, Harry Eric, Auyeung, Alex Kamlun
• Primary Examiner(s): PEESO, THOMAS R
• Application Number:
  US08/741,715
• Time in Patent Office: 845 Days
• Field of Search: 395/200.61, 395/200.77, 358/538, 358/539, 358/261.2, 348/394, 348/407, 348/415, 348/416, 382/236, 382/238, 382/246
• US Class Current: 709/231
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G08B 13/19604 involving reference image or background adaptation with time to compensate for changing conditions, e.g. reference image update on detection of light level change
• CPC Class Codes: G08B 13/19634 Electrical details of the system, e.g. component blocks for carrying out specific functions
• CPC Class Codes: G08B 13/19645 Multiple cameras, each having view on one of a plurality of scenes, e.g. multiple cameras for multi-room surveillance or for tracking an object by view hand-over
• CPC Class Codes: G08B 13/19667 Details realated to data compression, encryption or encoding, e.g. resolution modes for reducing data volume to lower transmission bandwidth or memory requirements
• CPC Class Codes: G08B 13/19673 Addition of time stamp, i.e. time metadata, to video stream
• CPC Class Codes: G08B 13/1968 Interfaces for setting up or customising the system
• CPC Class Codes: G08B 13/19682 Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system
• CPC Class Codes: H04N 5/445 for displaying additional information H04N5/50 takes precedence
• CPC Class Codes: H04N 5/76 Television signal recording
• CPC Class Codes: H04N 5/781 on disks or drums
• CPC Class Codes: H04N 5/782 on tape
• CPC Class Codes: H04N 5/783 Adaptations for reproducing at a rate different from the recording rate
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 9/8042 involving data reduction
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal
• CPC Class Codes: H04N 9/8227 the additional signal being at least another television signal

Abstract

A digital recording device records and displays plural streams of video information. Portions of an image plane are assigned among image streams each generated by a respective video camera. A mouse is used to drag a camera icon into a region corresponding to a portion of the image plane to indicate assignment of the portion of the image plane to the stream of images generated by a corresponding camera. Other operating modes of the recording device are selectable by the user.

Claims

1. A method of analyzing a sequence of video information frames to detect changes in said video information frames, comprising the steps of:

displaying in an image plane an image of an object represented by said video information frames;

manipulating a graphic image element to select a region of the image plane corresponding to the object to designate the object for surveillance;

selecting portions of said designated object; and

sequentially examining portions of said video information frames corresponding to said selected portions of said designated object to determine whether said designated object remains in a predetermined position in said video information frames.

2. A method according to claim 1, wherein said selected portions of said designated object are portions of said object at mutually remote locations at said periphery of said object.

3. A video data storage apparatus, comprising:

means for receiving video data which represents an image in an image plane;

discard means for selecting a portion of the image plane as to which data storage is not required; and

storage means, responsive to said discard means, for storing such portions of said received video data as do not correspond to said selected portion of said image plane;

wherein such portions of said received video data as correspond to said selected portion of said image plane are not stored in said storage means.

4. An apparatus according to claim 3, further comprising display means for displaying an image which corresponds to an image represented by said received video data, wherein said discard means includes drawing means for superimposing on said image displayed by said display means an image element indicative of said portion of an image plane as to which data storage is not required.

5. An apparatus according to claim 4, wherein said drawing means includes a mouse.

6. A video data storage apparatus according to claim 3, further comprising a video camera for generating the video data received by said means for receiving.

7. A video data storage apparatus according to claim 3, wherein said storage means includes a recording medium on which are recorded the portions of the video data not selected by said discard means, said recording medium being selected from the group consisting of a hard disk, a magneto-optical disk, and a writable optical disk.

8. A method of storing video data, comprising the steps of:

receiving video data which represents an image in an image plane;

selecting a portion of the image plane as to which data storage is not required; and

storing on a recording medium only such portions of the received video data as do not correspond to said selected portion of said image plane.

9. A method according to claim 8, wherein said selecting step includes manipulating a graphic element on a display screen to indicate the selected portion of the image plane.

10. A video signal processing apparatus, comprising:

means for receiving a video signal which represents an image in an image plane;

selection means for selecting a portion of the image plane for contrast enhancement; and

enhancement means, connected to said means for receiving, and responsive to said selection means, for expanding a dynamic range of portions of said received video signal which correspond to said selected portion of the image plane, and for outputting a selectively enhanced video signal.

11. An apparatus according to claim 10, further comprising display means for displaying an image which corresponds to an image represented by said received video signal, and wherein said selection means includes drawing means for superimposing on said image displayed by said display means an image element indicative of said portion of an image plane selected for contrast enhancement.

12. An apparatus according to claim 10, wherein said selection means includes means, connected to said receiving means, for detecting a contrast characteristic of said received video signal.

13. An apparatus according to claim 10, wherein said selectively enhanced video signal is an analog signal, and further comprising A/D conversion means, for converting said selectively enhanced video signal into video data corresponding to said selectively enhanced video signal.

14. An apparatus according to claim 13, further comprising storage means, connected to said A/D conversion means, for storing said video data.

15. A video information storage apparatus, comprising:

video information source means for generating a dynamic video signal formed of a sequence of video signal frames, each of said frames representing a respective image in an image plane, said dynamic video signal having a time resolution corresponding to a frame rate at which successive frames of said sequence are produced, said dynamic video signal also having a space resolution corresponding to a density at which pixels of said signal are formed in said image plane;

signal processing means for receiving said dynamic video signal generated by said video information source means and for selectively varying at least one of the time resolution and the space resolution of the received dynamic video signal;

user adjustable means for entering a control signal for controlling whether and to what degree said signal processing means varies said at least one of the time resolution and the space resolution of the received dynamic video signal, said signal processing means outputting a processed dynamic video signal having a time resolution and a space resolution at least one of which is determined in accordance with said control signal; and

storage means for storing said processed dynamic video signal.

16. Apparatus according to claim 15, wherein said video information source means includes a video camera.

17. Apparatus according to claim 15, wherein said signal processing means selectively varies both of the time resolution and the space resolution of the received dynamic video signal in response to the control signal entered by the user adjustable means.

18. Apparatus according to claim 15, further comprising display means for displaying a selected one of said dynamic video signal generated by said video information source means and said processed video signal outputted from said signal processing means.

19. Apparatus according to claim 18, wherein said user adjustable means includes means for generating said control signal by manipulating a cursor displayed on said display means.

20. Apparatus according to claim 19, wherein said user adjustable means includes a mouse.

21. Apparatus according to claim 18, wherein said storage means includes a recording medium selected from the group consisting of a hard disk, a magneto-optical disk and a writable optical disk.

22. Apparatus according to claim 21, wherein said display means selectively displays an image corresponding to a processed dynamic video signal retrieved from said hard disk.

23. A method of performing data compression with respect to plural sequences of image data frames which each represent a dynamic sequence of video images, each sequence generated by a respective video camera, the method comprising the steps of:

encoding every nth frame of each said sequence of image data frames in accordance with an intra-frame compression algorithm in which each of said every nth frame is encoded without reference to any other image data frame, n being an integer greater than 1;

encoding every frame other than said intraframe-encoded frames in accordance with a difference encoding compression algorithm which includes forming difference data by reference to at least one data frame in the respective sequence which precedes the frame which is being difference-encoded;

receiving a camera-selection signal input by a user;

receiving a compression parameter setting signal input by the user; and

varying a value of n, camera-by-camera, in accordance with the received camera-selection and compression parameter setting signals.

24. A method of performing data compression with respect to plural sequences of image data frames which each represent a dynamic sequence of video images, each sequence generated by a respective video camera, the method comprising the steps of:

receiving a first compression parameter setting signal input by a user with respect to a first one of said sequences of image data frames;

selecting a first frame interval with respect to said first sequence of image data frames in accordance with the received first compression parameter setting signal;

compression-encoding in accordance with a first compression algorithm ones of said image data frames occurring at said selected first frame interval in said first sequence;

compression-encoding in accordance with a second compression algorithm all other of said image data frames of said first sequence, said second compression algorithm being different from said first compression algorithm;

receiving a second compression parameter setting signal input by the user with respect to a second one of said sequences of image data frames, said second compression parameter setting signal being different from said first compression parameter setting signal;

selecting a second frame interval with respect to said second sequence of image data frames in accordance with the received second compression parameter setting signal, said second frame interval being different from said first frame interval;

compression-encoding in accordance with the first compression algorithm ones of said image data frames occurring at said second selected frame interval in said second sequence; and

compression-encoding in accordance with the second compression algorithm all other of said image data frames of said second sequence.

25. A method according to claim 24, wherein said first compression algorithm is an intra-frame compression algorithm and said second compression algorithm is a compression algorithm in which an image is compared with a preceding reference image.

26. A method of assigning regions of an image plane among streams of dynamic images each generated by a respective one of a plurality of video cameras, comprising the steps of:

displaying in a first portion of a display screen a plurality of icons each representing a respective one of said plurality of video cameras;

displaying in a second portion of said display screen a representation of said image plane including regions of said second portion of said display screen corresponding to said regions of said image plane; and

moving at least one of said icons from said first portion of said display screen to said second portion of said display screen, to position each said moved icon in a respective one of said regions of said second portion to indicate that the image stream generated by the video camera represented by said moved icon is to be displayed in the image plane region corresponding to said respective one of said regions of said second portion.

27. A method according to claim 26, wherein said plurality of camera-representing icons includes at least four icons.

28. A method according to claim 27, wherein said plurality of camera-representing icons includes sixteen icons.

29. A method according to claim 26, wherein said regions of said second portion of said display screen consist of four regions each occupying a quadrant of said second portion and each representing a respective quadrant of said image plane.

30. A method according to claim 26, wherein said regions of said second portion of said display screen include at least nine regions.

31. A method according to claim 30, wherein said regions of said second portion of said display screen consist of sixteen regions.

32. A method according to claim 30, wherein said regions of said second portion of said display screen consist of eight regions including one large region located at a corner of said second portion and seven small regions, all of said small regions being equal in size to each other, said large region having an area that is nine times as large as the area of each of said small regions.

33. A method according to claim 26, wherein said icon-moving step includes operating a mouse.

34. Video display apparatus, comprising:

a plurality of video cameras each for generating a respective stream of dynamic images;

display means including a display screen for displaying at least selected ones of said streams of dynamic images;

control means for controlling said display means to display in a first portion of said display screen a plurality of icons each representing a respective one of said plurality of video cameras and to display in a second portion of said display screen a representation of an image plane including regions of said second portion corresponding to respective regions of said image plane; and

instruction means for inputting first instructions from a user of the apparatus to said control means to cause said control means to move at least one of said icons from said first portion of said display screen to said second portion of said display screen, to position each said moved icon in a respective one of said regions of said second portion to indicate that the image stream generated by the video camera represented by said moved icon is to be displayed in the image plane region corresponding to said respective one of said regions of said second portion, said instruction means also for inputting a second instruction from said user to said control means to cause said display means to display said image plane in which respective image streams generated by selected ones of said video cameras are displayed in respective regions of said image plane in accordance with said image plane region assignment indicated by said first instructions.

35. Video display apparatus according to claim 34, wherein said plurality of video cameras includes at least four cameras and said camera-representing icons includes at least four icons.

36. Video display apparatus according to claim 35, wherein said regions of said second portion of said display screen consist of four regions each occupying a quadrant of said second portion and each representing a respective quadrant of said image plane.

37. Video display apparatus according to claim 36, wherein said plurality of video cameras includes 16 cameras and said plurality of camera-representing icons includes 16 icons.

38. Apparatus for storing video information, comprising:

a plurality of video cameras;

recording means for recording on a recording medium video information generated by said plurality of video cameras, said recording means being selectively operable in accordance with a plurality of recording modes with respect to each one of said plurality of video cameras;

storage means for storing scheduling information, said scheduling information including a plurality of scheduling information portions each corresponding to a respective 24-hour period, each of said scheduling information portions including a plurality of subportions each corresponding to a respective one of said plurality of video cameras, each of said subportions defining times during the respective 24-hour period for which ones of said recording modes have been selected for the respective one of said plurality of video cameras; and

control means for controlling said recording means in accordance with the scheduling information stored in said storage means.

39. Apparatus according to claim 38, wherein a first one of said scheduling information portions corresponds to weekdays, a second one of said scheduling information portions corresponds to weekend-days, and a third one of said scheduling information portions corresponds to holidays.

40. Apparatus according to claim 39, wherein said scheduling information includes additional information for defining said holidays by month and day of the month.

41. Apparatus according to claim 38, wherein said scheduling information includes further information for partitioning each of said 24-hour periods into day and night parts of said 24-hour period.

42. Apparatus according to claim 38, wherein said recording modes include a first recording mode in which images generated by a respective one of said video cameras are continuously recorded at intervals that do not exceed a maximum interval, a second recording mode in which images generated by the respective video camera are only recorded in response to detection of an alarm condition, and a third recording mode in which there is no recording of images generated by the respective video camera.

43. Apparatus according to claim 38, wherein said recording medium is a hard disk.

44. Apparatus according to claim 43, wherein said storage means includes a storage device selected from the group consisting of a hard disk, a magneto-optical disk and a writable optical disk.

45. Apparatus according to claim 38, further comprising override means, actuatable by a user of the apparatus to select one of said plurality of video cameras, for causing said recording means to operate with respect to the selected camera in a recording mode that is different from the recording mode for the selected camera indicated by the scheduling information as being applicable to a time at which the override means is actuated.

46. A method of scheduling recording modes with respect to a plurality of video cameras included in a closed-circuit video surveillance system, comprising the steps of:

storing scheduling information, said scheduling information including a plurality of scheduling information portions each corresponding to a respective 24-hour period, each of said scheduling information portions including a plurality of subportions each corresponding to a respective one of said plurality of video cameras, each of said subportions defining times during the respective 24-hour period for which ones of said recording modes have been selected for the respective one of said plurality of video cameras; and

controlling, in accordance with the stored scheduling information, recording of images generated by said plurality of video cameras.

47. A method according to claim 46, wherein a first one of said scheduling information portions corresponds to weekdays, a second one of said scheduling information portions corresponds to weekend-days, and a third one of said scheduling information portions corresponds to holidays.

48. A method according to claim 47, wherein said scheduling information includes additional information for defining said holidays by month and day of the month.

49. A method according to claim 46, wherein said scheduling information includes further information for partitioning each of said 24-hour periods into day and night parts of said 24-hour period.

50. A method according to claim 46, wherein said recording modes include a first recording mode in which images generated by a respective one of said video cameras are continuously recorded at intervals that do not exceed a maximum interval, a second recording mode in which images generated by the respective video camera are only recorded in response to detection of an alarm condition, and a third recording mode in which there is no recording of images generated by the respective video camera.

51. A video information storage apparatus, comprising:

a plurality of video cameras each for generating a dynamic video signal formed of a sequence of video signal fields, each of said fields representing a respective image;

recording means for recording each of said sequences of video signal fields at regular intervals at a field storage rate which is variable from sequence to sequence, the field storage rate defining a duration of the regular intervals at which the respective sequence of video signal fields is recorded; and

user actuatable means for selectively inputting to the recording means selection signals for selecting with respect to each of said sequences of video signal fields the field storage rate for the respective sequence.

52. A video information storage apparatus according to claim 51, wherein a selection signal input by said user actuatable means includes numerical data indicative of a selected field storage rate for a respective one of said sequences of video signal fields and camera identification data for identifying the video camera which is generating the respective sequence.

53. A video information storage apparatus according to claim 51, wherein said user actuatable means includes a mouse for inputting cursor control signals to said recording means.

54. A video information storage apparatus according to claim 51, wherein said recording means includes a hard disk on which the sequences of video signal fields are recorded.

55. A method of storing video information, comprising the steps of:

simultaneously generating a plurality of dynamic video signals each formed of a sequence of video signal fields, each of said fields representing a respective image;

recording each of said sequences of video signal fields at regular intervals at a field storage rate which is variable from sequence to sequence, the field storage rate defining a duration of the regular intervals at which the respective sequence of video signal fields is recorded; and

selectively manipulating a user input device to generate selection signals for selecting with respect to each of said sequences of video signal fields the field storage rate for the respective sequence.

56. A method according to claim 55, wherein a selection signal input by selectively manipulating the user input device includes numerical data indicative of a selected field storage rate for a respective one of said sequences of video signal fields and camera identification data for identifying a video camera which is generating the respective sequence.

57. A method according to claim 56, wherein said user input device is a mouse.

58. A method according to claim 55, wherein said recording step includes recording said sequences of video signal fields on a hard disk in the form of digital data.

59. Apparatus for analyzing video information, comprising:

a video camera;

analysis means for analyzing video information generated by said video camera in accordance with a moving image content analysis algorithm, said analysis means being selectively operable in accordance with a plurality of operating modes;

storage means for storing scheduling information, said scheduling information including a plurality of scheduling information portions each corresponding to a respective different future period of time, and each indicating an operating mode of said analysis means that has been selected for said period of time; and

control means for controlling said analysis means so as to operate in accordance with the selected operating modes during the periods of time indicated by the scheduling information stored in said storage means.

60. Apparatus according to claim 59, wherein said plurality of operating modes includes a first mode in which said analysis means performs said analysis algorithm according to a first parameter for constraining operation of said algorithm and a second mode in which said analysis means performs said analysis algorithm according to a second parameter for constraining operation of said algorithm, said second algorithm being different from said first algorithm.

61. Apparatus according to claim 59, wherein a first one of said periods of time corresponds to a part of a 24-hour period and a second one of said periods of time corresponds to all of said 24-hour period except for said part.

62. A method according to claim 59, wherein said plurality of operating modes of said analysis means include a first mode in which said analysis means detects an illumination condition represented by said video information and a second mode in which said analysis means determines whether said video information represents a moving object crossing a perimeter.

63. A method of scheduling operating modes of a video information analysis device, comprising the steps of:

storing scheduling information, said scheduling information including a plurality of scheduling information portions each corresponding to a respective different future period of time, and each indicating an operating mode of said analysis device that has been selected for said period of time; and

controlling said analysis device so as to operate in accordance with the selected operating modes during the periods of time indicated by the stored scheduling information.

64. A method according to claim 63, wherein said selected operating modes include a first mode in which said analysis device detects an illumination condition represented by video information analyzed by the analysis device and a second mode of operation in which said analysis device determines whether the video information analyzed by the analysis device represents a moving object crossing a perimeter.

65. A video information storage apparatus, comprising:

video information source means for generating a dynamic video signal formed of a sequence of video signal fields, each of said fields representing a respective image in an image plane, said dynamic video signal having a time resolution corresponding to a field rate at which successive fields of said sequence are produced, said dynamic video signal also having a space resolution corresponding to a density at which pixels of said signal are formed in said image plane;

signal processing means for receiving said dynamic video signal generated by said video information source means and for selectively varying at least one of the time resolution and the space resolution of the received dynamic video signal;

user adjustable means for entering a control signal for controlling whether and to what degree said signal processing means varies said at least one of the time resolution and the space resolution of the received dynamic video signal, said signal processing means outputting a processed dynamic video signal having a time resolution and a space resolution at least one of which is determined in accordance with said control signal; and

storage means for storing said processed dynamic video signal.