Displaying graphical output representing the activity of a plurality of monitoring detection devices

• US 8,948,245 B2
• Filed: 12/02/2004
• Issued: 02/03/2015
• Est. Priority Date: 12/03/2003
• Status: Active Grant

• Current Assignee: Envysion Incorporated (Motorola Solutions, Inc.)
• Original Assignee: LightHaus Logic, Inc.
• Inventors: Henson, Michael Anthony, Sherrah, Jamie Roy, Quartermain, Peter Richard, van den Bergen, Mark Adrian
• Primary Examiner(s): LEE, Y YOUNG
• Application Number:
  US11/002,447
• Publication Number:
  US 20050163212A1
• Time in Patent Office: 3,715 Days
• Field of Search: 375/240.01, 375/240.26, 375/240.09, 128/845, 348/159, 348/156, 348/153, 348/155
• US Class Current: 375/240.01
• CPC Class Codes: G06T 11/206 Drawing of charts or graphs
• CPC Class Codes: G06V 10/993 Evaluation of the quality of the acquired pattern
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G08B 13/19604 involving reference image or background adaptation with time to compensate for changing conditions, e.g. reference image update on detection of light level change
• CPC Class Codes: G08B 13/19608 Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position
• CPC Class Codes: G08B 13/19613 Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion
• CPC Class Codes: G08B 13/19645 Multiple cameras, each having view on one of a plurality of scenes, e.g. multiple cameras for multi-room surveillance or for tracking an object by view hand-over
• CPC Class Codes: G08B 13/19667 Details realated to data compression, encryption or encoding, e.g. resolution modes for reducing data volume to lower transmission bandwidth or memory requirements
• CPC Class Codes: G08B 13/19671 Addition of non-video data, i.e. metadata, to video stream
• CPC Class Codes: G08B 13/19682 Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system
• CPC Class Codes: G08B 13/19686 Interfaces masking personal details for privacy, e.g. blurring faces, vehicle license plates
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

Graphical output representing the activity of a plurality of monitoring detection devices over a region is displayed. The detection devices are represented as an array of regular polygons in an arrangement substantially analogous to the monitored region, and a characteristic of the graphical output is adjusted within a displayed polygon by a degree dependent upon the level of activity detected by its respective detection device.

Claims

1. A method comprising displaying graphical output to an operator representing the activity in a monitored space detected by a plurality of detection devices, each one of which is configured to output a sequence of images, said method comprising the steps of:

representing said plurality of detection devices on a display device as an array of regular polygons, wherein each one of the regular polygons represents a different one of the plurality of detection devices and the regular polygons are arranged topologically according to locations of the plurality of detection devices in the monitored region;

for each of the sequence of images outputted by each one of the plurality of detection devices;

deriving, by a processor, a background model from the sequence of images detected by the detection device, which background model defines expected pixel values for said sequence of images,

performing, by a processor, foreground classification of pixels in each one of the images with reference to said background model, in which pixels having expected values are classified as belonging to the background and pixels having unexpected values are classified as belonging to the foreground,

analyzing, by a processor, the level of activity in each one of the sequence of images by measuring a number of pixels in each one of the images that have been classified as belonging to the foreground as a proportion to the total number of pixels in the image to obtain the level of activity for each one of the images; and

displaying graphical output within each one of the regular polygons, said graphical output having a characteristic that is dependent upon the analyzed level of activity within the images outputted by its respective one of the plurality of detection devices, wherein said graphical output is different from the image outputted by said respective one of the plurality of detection devices.

2. A method according to claim 1, wherein said regular polygons are quadrilaterals.

3. A method according to claim 2, wherein said quadrilaterals are squares.

4. A method according to claim 1, wherein a plurality of arrays are displayable representing respective areas that are being monitored.

5. A method according to claim 4, wherein said plurality of arrays are arranged topologically according to the locations of the respective areas which are being monitored.

6. A method according to claim 4, wherein said plurality of arrays are arranged logically according to the types of areas being monitored.

7. A method according to claim 1, wherein part of said polygon changes colour and the proportion of the polygon that changes colour is dependent upon the level of detected activity.

8. A method according to claim 7, wherein a central portion of a displayed polygon appears to flash in response to increased activity.

9. A method according to claim 1, further comprising the step of displaying, on said display device, a polygon that has not been assigned to a detection device.

10. Apparatus configured to display graphical output to an operator comprising:

a plurality of detection devices located in and configured to monitor a monitored region, each one of which is configured to output a sequence of images;

display means arranged to display a representation of said plurality of detection devices as an array of regular polygons, wherein each one of the regular polygons represents a different one of said plurality of detection devices and the regular polygons are arranged topologically according to locations of the plurality of detection devices in the monitored region; and

a processor configured to, for each of the sequence of images outputted by each one of said plurality of detection devices;

derive a background model from the sequence of images outputted by the detection device;

perform foreground classification of pixels in each one of the images with reference to said background model to determine whether they belong to the foreground or the background;

analyze the level of activity in each of the images detected by said detection device by measuring a number of pixels in each one of the images that have been classified as belonging to the foreground as a proportion to the total number of pixels in the image to obtain the level of activity for each one of the images;

determine a graphical output having a characteristic that is dependent upon said analyzed level of activity within the images, and

display said graphical output within the regular polygon representing said detection device, wherein said graphical output is different from the image outputted by said detection device.

11. Apparatus according to claim 10, wherein said detection devices are digital video cameras.

12. A non-transitory computer readable medium having computer readable instructions such that when executing said instructions a computer will perform the steps of:

representing a plurality of detection devices as an array of regular polygons, said detection devices being located in and configured to monitor a monitored region, and each one of which is configured to output a sequence of images, and wherein each regular polygon represents a different one of said plurality of detection devices and the regular polygons are arranged topologically according to locations of the plurality of detection devices in the monitored region;

for each sequence of images outputted by each one of the plurality of detection devices;

deriving, by a processor, a background model from the sequence of images detected by the detection device,

performing, by a processor, foreground classification of pixels in each one of the images with reference to said background model to determine whether they belong to the foreground or the background,

analyzing, by a processor, the level of activity in each one of the sequence of images by measuring a number of pixels in each one of the images that have been classified as belonging to the foreground as a proportion to the total number of pixels in the image to obtain the level of activity for each one of the images; and

displaying graphical output within each one of the regular polygons, said graphical output having a characteristic that is dependent upon the analyzed level of activity within the images outputted by its respective one of the plurality of detection devices, wherein said graphical output is different from the image outputted by said respective one of the plurality of detection devices.

13. A non-transitory computer readable medium having computer readable instructions according to claim 12, such that when executing said instructions a computer will also perform the step of displaying a plurality of arrays representing respective areas that are being monitored.

14. A non-transitory computer readable medium having computer readable instructions according to claim 13, such that when executing said instructions a computer will also perform the step of displaying said plurality of arrays arranged topologically according to the locations of the respective areas which are being monitored.

15. A non-transitory computer readable medium having computer readable instructions according to claim 13, such that when executing said instructions a computer will also perform the step of displaying said plurality of arrays arranged logically according to the types of areas being monitored.

16. A method comprising displaying graphical output to an operator representing the activity in a monitored region detected by a plurality of detection devices, each one of which is configured to output a sequence of images, said method comprising the steps of:

representing said monitored region on a display device as a grid of regular quadrilaterals arranged topologically according to the layout of said monitored region;

assigning each one of said plurality of detection devices to one of said regular quadrilaterals dependent upon its position in said monitored region; and

for each of the sequence of images outputted by each one of said plurality of detection devices;

deriving, by a processor, a background model from the sequence of images detected by the detection device,

performing, by a processor, foreground classification of pixels in each one of the images with reference to said background model to determine whether they belong to the foreground or the background,

analyzing, by a processor, the level of activity in each of the images by measuring a number of pixels in each one of the images that have been classified as belonging to the foreground to obtain the level of activity for each one of the images, and

displaying an icon within the regular quadrilateral to which said detection device is assigned, wherein the appearance of said icon is dependent upon said analyzed level of activity within each of the images outputted by said detection device.