Multiple view and multiple object processing in wide-angle video camera

• US 8,427,538 B2
• Filed: 05/04/2009
• Issued: 04/23/2013
• Est. Priority Date: 04/30/2004
• Status: Expired due to Fees

• Current Assignee: Grandeye Limited (Oncam Global Group AG)
• Original Assignee: Oncam Grandeye (Oncam Technologies AG)
• Inventors: Ahiska, Yavuz
• Primary Examiner(s): Feild, Lynn
• Assistant Examiner(s): ELFERVIG, TAYLOR A
• Application Number:
  US12/434,837
• Publication Number:
  US 20100002071A1
• Time in Patent Office: 1,450 Days
• Field of Search: 348/143
• US Class Current: 348/143
• CPC Class Codes: G03B 15/16 for photographing the track of moving objects high-speed photography G03B39/00
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 5/80 Geometric correction
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G08B 13/19641 Multiple cameras having overlapping views on a single scene
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/695 Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/81 for suppressing or minimising disturbance in the image signal generation
• CPC Class Codes: H04N 25/61 the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253

Abstract

Methods and systems of transmitting a plurality of views from a video camera are disclosed. A multi object processing camera captures a wide-angle field of view in high resolution and a processing circuit executes a plurality of software tasks on a plurality of regions extracted from the wide-angle view. Multiple objects can be processed by the camera to detect various events, and the results of the processing transmitted to a base station. The camera removes the need for mechanical pan, tilt, and zoom apparatus by correcting distortions in the electronic image introduced by the wide-angle optical system and image sensor to electronically emulate the pan, tilt, and zoom movement.

Claims

1. A video camera system, comprising:

a wide-angle camera system configured to generate a digital video image using a lens providing an approximate hemispherical field of view and an image sensor, the digital video image distorted by the lens;

an image processing circuit that receives said distorted digital image, and corrects optical distortion in portions of said distorted digital image correlating to at least one automatically generated virtual camera simultaneously detecting and tracking objects within said digital video image, while continuing to track previously detected objects,

a control circuit that transmits commands to the image processing circuit, the image processing circuit executing said commands by correcting optical distortion to emulate pan, tilt, or zoom commands in corresponding ones of at least one specified virtual camera without interrupting said detecting and tracking;

a command received at the camera in a data packet used on a network;

a digital image transmitted from the camera in a data packet used on the network; and

the data packets are addressed using a network address,

wherein said automatically generated virtual camera and said specified virtual camera correspond to portions within and smaller than said digital video image, and

wherein said image processing circuit and/or said control circuit sends at least one of said automatically generated virtual cameras and at least one of said specified virtual cameras to an output.

2. The video camera system of claim 1, wherein the network address comprises an Internet Protocol address.

3. The video camera system of claim 1, further comprising:

a network connection used to upload software for use by the processing circuit.

4. The video camera system of claim 1, further comprising:

image data monitoring to autonomously designate at least one region of interest based on the result of algorithms, wherein said image data monitoring includes results of an algorithm performing at least one of;

behavior detection;

movement detection;

smoke detection;

left package detection;

face recognition;

object detection; and

event detection.

5. The video camera system of claim 1, wherein said tracking includes tracking object movement, wherein the object'"'"'s spatial coordinates and/or trajectory can be transmitted to one or more base stations or other cameras.

6. The video camera system of claim 1, wherein the image processing circuit can perform image analysis on distorted electronic image data or the corrected electronic image data.

7. The video camera system of claim 1, wherein the image processing circuit can execute movement commands while performing image analysis on the portions of the uncorrected digital electronic image data or on corrected portions of the electronic image data to detect an event and react to said detection.

8. The video camera system of claim 1, wherein the image processing circuit is programmable and image processing software used to process the distorted electronic image data can be modified or uploaded.

9. A video camera system comprising:

a wide-angle optical unit connected to an image sensor and a capture circuit configured to capture a wide-angle field of view video image;

a processing circuit which;

detects one or more events, maintaining said detection within said field of view;

generates at least one automatically generated virtual camera monitoring regions of interest within the digital video image, ones of said regions of interest corresponding to said events;

receives movement and zoom commands and generates at least one specified virtual camera corresponding to said commands without interrupting said detection, said automatically generated virtual camera and said specified virtual camera corresponding to portions within and smaller than said video image;

dewarps at least one of said automatically generated virtual cameras and said specified virtual cameras;

sends at least one of said automatically generated virtual cameras and at least one of said specified virtual cameras, at least one of which are dewarped, to an output;

a command received at the optical unit in a data packet used on a network;

a digital image transmitted from the optical unit in a data packet used on the network; and

the data packets are addressed using a network address.

10. The video camera system of claim 9, wherein the network address comprises an Internet Protocol address.

11. The video camera system of claim 9, further comprising:

a

network connection used to upload software for use by the processing circuit.

12. The video camera system of claim 9, further comprising:

image data monitoring to autonomously designate at least one region of interest based on the result of algorithms, wherein said image data monitoring includes results of an algorithm performing at least one of;

behavior detection;

movement detection;

smoke detection;

left package detection;

face recognition;

object etection; and

event detection.

13. The video camera system of claim 9, wherein said tracking includes tracking object movement, wherein the object'"'"'s spatial coordinates and/or trajectory can be transmitted to one or more base stations or other cameras.

14. The video camera system of claim 9, wherein the image processing circuit can perform image analysis on distorted electronic image data or the corrected electronic image data.

15. The video camera system of claim 9, wherein the image processing circuit can execute movement commands while performing image analysis on the portions of the uncorrected digital electronic image data or on corrected portions of the electronic image data to detect an event and react to said detection.

16. The video camera system of claim 9, wherein the image processing circuit is programmable and image processing software use to process the distorted electronic image data modified or uploaded.

17. A video camera system, comprising:

a wide-angle camera system configured to generate a digital video image using a lens providing an approximate hemispherical field of view and an image sensor, the digital video image distorted by the lens;

an image processing circuit that receives said distorted digital image, and corrects optical distortion in portions of said distorted digital image correlating to at least one automatically generated virtual camera simultaneously detecting and tracking objects within said digital video image, while continuing to track previously detected objects;

a control circuit that transmits commands to the image processing circuit, the image processing circuit executing said commands by correcting optical distortion to emulate pan, tilt, or zoom commands in corresponding ones of at least one specified virtual camera without interrupting said detecting and tracking,

wherein said tracking includes tracking object movement,

wherein the object'"'"'s spatial coordinates and/or trajectory can be transmitted to one or more base stations or other cameras,

wherein said automatically generated virtual camera and said specified virtual camera correspond to portions within and smaller than said digital video image, and

wherein said image processing circuit and/or said control circuit sends at least one of said automatically generated virtual cameras and at least one of said specified virtual cameras to an output.

18. The video camera system of claim 17, further comprising:

a command received at the camera in a data packet used on a network;

a digital image transmitted from the camera in a data packet used on the network; and

the data packets are addressed using a network address.

19. The video camera system of claim 18, wherein the network address comprises an Internet Protocol address.

20. A video camera system comprising:

a wide-angle optical unit connected to an image sensor and a capture circuit configured to capture a wide-angle field of view video image; and

a processing circuit which;

detects one or more events, maintaining said detection within said field of view;

generates at least one automatically generated virtual camera monitoring regions of interest within the digital video image, ones of said regions of interest corresponding to said events;

receives movement and zoom commands and generates at least one specified virtual camera corresponding to said commands without interrupting said detection, said automatically generated virtual camera and said specified virtual camera corresponding to portions within and smaller than said video image;

dewarps at least one of said automatically generated virtual cameras and said specified virtual cameras; and

sends at least one of said automatically generated virtual cameras and at least one of said specified virtual cameras, at least one of which are dewarped, to an output,

wherein said monitoring includes tracking object movement, and

wherein the object'"'"'s spatial coordinates and/or trajectory can be transmitted to one or more base stations or other cameras.