Window blanking for pan/tilt/zoom camera

• US 9,319,635 B2
• Filed: 11/30/2012
• Issued: 04/19/2016
• Est. Priority Date: 11/30/2012
• Status: Active Grant

• Current Assignee: Pelco Incorporated (Motorola Solutions, Inc.)
• Original Assignee: Pelco Incorporated (Motorola Solutions, Inc.)
• Inventors: Huang, Chien-Min, Aghdasi, Farzin, Ma, Zhan Jiang
• Primary Examiner(s): Chevalier, Robert
• Application Number:
  US13/690,244
• Publication Number:
  US 20140152815A1
• Time in Patent Office: 1,236 Days
• Field of Search: 348/143, 348/147, 348/144, 348/151, 386/226
• US Class Current: 1/1
• CPC Class Codes: H04N 21/4542 Blocking scenes or portions of the received content, e.g. censoring scenes
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

Network cameras employing advanced video analytics are increasingly being used in both public and private settings. Unlike fixed surveillance cameras, pan/tilt/zoom cameras provide a dynamic field-of-view. Some regions within a given field-of-view can be designated as private and may not be recorded. A window-blanking feature, according to an embodiment of the invention, enables an ability to block out defined portions of the video where a privacy zone may otherwise appear. Through use of the embodiment, consistent privacy is provided during dynamic surveillance to ensure compliance with privacy regulations or contractual arrangements relating to use of a surveillance camera having a privacy zone within the given field-of-view.

Claims

1. A method of window-blanking for a pan/tilt/zoom camera, the method comprising:

obtaining a panoramic image from the camera;

enabling a user to interact with the panoramic image as an interface for defining a privacy zone through a defined input mode;

providing a selection of layers including a panoramic image layer, map layer, hybrid panoramic image map layer, and annotations layer with the panoramic image interface;

computing a pan/tilt angle relative to world ground coordinates for each vertex of the privacy zone within a field-of-view of the camera;

determining coordinates for each vertex based on an updated or predicted camera field-of-view; and

blocking-out the privacy zone using the coordinates for each vertex.

2. The method of claim 1, further comprising:

calculating the pan/tilt angles for each vertex of the privacy zone based, at least in part, on an internal camera location and an external camera location, wherein the internal camera location is defined by a pan attribute, tilt attribute, and zoom attribute and the external camera location is defined relative to the world ground coordinate by an x-attribute, y-attribute, and height attribute.

3. The method of claim 2, further comprising determining an adjusted pan/tilt angle for each vertex of the privacy zone.

4. The method of claim 3, further comprising generating a predictive pan/tilt adjustment angle for each vertex in the privacy zone as a function of the adjusted pan/tilt angle.

5. The method of claim 2, wherein blocking-out the privacy zone includes effecting color at a display location by a change to values received from an image sensor.

6. The method of claim 5, wherein effecting the color at the display location includes applying a scanline polygon fill to form a privacy representation in a location within an image where a representation of objects in the privacy zone would otherwise have been located or adding or removing color or intensity within the location.

7. The method of claim 1, further comprising obtaining a privacy zone demarcation input for blocking-out the privacy zone.

8. The method of claim 7, further comprising enabling a mapping application to obtain the privacy zone demarcation input.

9. The method of claim 1, further comprising:

enabling the user to engage in a selection mode, draw mode and gesture mode as available input modes for the panoramic image interface; and

storing the vertices of input received from the panoramic image interface to enable blocking-out of the privacy zone.

14. The method of claim 1, wherein blocking-out the privacy zone using the coordinates for each vertex includes applying window-blanking at the camera.

15. The method of claim 14, wherein applying window-blanking at the camera includes sending from the camera data stream before encoding or compressing the data stream.

16. The method of claim 15 wherein the data stream is an analog data stream or a digital data stream.

17. The method of claim 1, wherein calculating pan/tilt angles includes considering ground coordinates, rotating or translating camera coordinates, redactions from one or more users.

18. The method of claim 1, wherein determining coordinates includes calculating no coordinate transformation, image coordinates or pan/tilt/zoom coordinates.

10. A window-blanking image sensor system, comprising:

an image sensor;

a computer memory storing program instructions in communication with the image sensor, the program instructions being loadable and executable by a processor, and when executed, cause the processor to;

compute an absolute pan/tilt angle relative to world ground coordinates for each vertex of a privacy zone within a field-of-view for the image sensor;

determine coordinates for each vertex based on an updated or predicted image sensor field-of-view; and

block-out the privacy zone using the coordinates for each vertex; and

a privacy engine stored in the computer memory, wherein the privacy engine includes a mapping component configured to;

receive a panoramic image from the image sensor;

enable a user to interact with the panoramic image as an interface for defining the privacy zone through a defined input mode; and

provide a selection of layers including a panoramic image layer, a map layer, a hybrid panoramic image map layer, and an annotations layer with the panoramic image interface.

11. The system of claim 10 wherein the privacy engine includes a window blanking component, a coordinates component, a mapping component, a camera component, an encoder component, or a user interface component.

12. The system of claim 10 wherein the privacy engine is accessible through a remote client device.

13. The system of claim 10, wherein the privacy engine simultaneously adjusts the privacy zone with movement of the image sensor.

19. A method of enabling window-blanking by a camera, comprising:

obtaining a panoramic image for a pan/tilt/zoom camera;

enabling a user to interact with the panoramic image as an interface for defining the privacy zone through a defined input mode and to define at least one blanking zone within the panoramic image;

providing a selection of layers including a panoramic image layer, map layer, hybrid panoramic image map layer, and annotations layer with the panoramic image interface; and

storing vertices of the at least one blanking zone in a manner that enables blanking of the at least one blanking zone during imaging by the camera.