Automatically expanding the zoom capability of a wide-angle video camera

• US 20060056056A1
• Filed: 07/19/2005
• Published: 03/16/2006
• Est. Priority Date: 07/19/2004
• Status: Active Grant

• Current Assignee: Grandeye Limited (Oncam Global Group AG)
• Original Assignee: Grandeye Limited (Oncam Global Group AG)
• Inventors: Davey, Mark Kenneth, Cetin, Ahmet Enis, Ahiska, Bartu
• Granted Patent: US 7,990,422 B2
• Time in Patent Office: Days
• US Class Current: 359/690
• CPC Class Codes: G08B 13/19606 Discriminating between target movement or movement in an area of interest and other non-signicative movements, e.g. target movements induced by camera shake or movements of pets, falling leaves, rotating fan
• CPC Class Codes: G08B 13/19608 Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position
• CPC Class Codes: G08B 13/19628 of wide angled cameras and camera groups, e.g. omni-directional cameras, fish eye, single units having multiple cameras achieving a wide angle view
• CPC Class Codes: G08B 13/19643 wherein the cameras play different roles, e.g. different resolution, different camera type, master-slave camera
• CPC Class Codes: G08B 13/19686 Interfaces masking personal details for privacy, e.g. blurring faces, vehicle license plates
• CPC Class Codes: G08B 13/19689 Remote control of cameras, e.g. remote orientation or image zooming control for a PTZ camera
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A system for automatically expanding the zoom capability of a wide-angle video camera using images from multiple camera locations. One preferred embodiment achieves this using images from the wide-angle video camera that are analyzed to identify regions of interest (RoI). Pan-Tilt-Zoom (PTZ) controls are then sent to aim slave cameras toward the RoI. Processing circuitry is then used to replace the RoI from the wide-angle images with the higher-resolution images from one of the slave cameras. In addition, motion-detecting software can be utilized to automatically detect, track, and/or zoom in on moving objects.

Claims

1. A video camera system comprising of:

a master video camera capable of capturing a wide angle image;

one or more steerable slave video cameras in (close proximity to said master camera) and capable of monitoring at least part(s) of the area covered by said master camera;

automatically controlling the field of vision of said slave camera or cameras from said master camera wherein at least some of the control signals to said slave camera or cameras are fed from the master camera and based on information available to said master camera.

2. A system as recited in claim 1 wherein said control signals to said slave camera(s) include an adjustment calculated at least in part from the relative positions of said master and slave cameras or from feedback from the slave camera(s).

5. A system as recited in claim 1 wherein one or more image qualities, including brightness, exposure level or color balance, of said master or slave camera(s) video are automatically adjusted by comparing the images in said master camera to that from said slave camera(s).

7. A system as recited in claim 1 wherein said wide angle video camera has a fish eye lens or a purpose designed lens to amplify peripheral vision.

12. A system as recited in claim 1 wherein said information is based on a computation that involves automatic motion analysis selected from the group consisting of:

motion detection, moving region tracking, and object tracking.

18. A system as recited in claim 1 wherein said master camera assigns a detected moving region or regions to one or more slave camera(s) by controlling the field of vision of said slave camera(s).

20. A system as recited in claim 7 wherein said slave camera(s) may have automatic moving object or motion tracking capability and they can be assigned the task of independently tracking moving regions by the master camera.

24. A system as recited in claim 1 wherein at least part of said information available to said master is obtained from external signals which include commands issued by an operator or external alarm signals.

91. The system of claim 1,

Wherein said information is based on a computation of said wide angle image.

92. A system as recited in claim 1 where in said master camera is capable of relinquishing said control signals of said slave(s).

93. A system as recited in claim 1 wherein video output(s) from slave camera(s) is fed to said master camera for image analysis or forming a portion of master camera output depending on information available to said master camera.

94. A system as recited in claim 1 wherein said master and said slave camera(s) are in a common enclosure and maybe sharing circuitry.

3. (canceled)

4. (canceled)

6. (canceled)

8. (canceled)

9. (canceled)

10. (canceled

11. (canceled)

13. (canceled)

14. (canceled)

15. (canceled

16. (canceled)

17. (canceled)

19. (canceled)

21. (canceled)

22. (canceled)

23. (canceled)

25-90. -90. (canceled)

95. A video camera system comprising of:

a master video camera capable of capturing a wide angle image;

one or more steerable slave video cameras in close proximity to said master camera and capable of monitoring at least part(s) of the area covered by said master camera;

wherein said master camera is capable of generating one or more transformed views of full or portion of said wide angle image;

wherein the field of vision of said slave camera or cameras is automatically controlled from said master camera wherein at least some of the control signals to said slave camera or cameras are fed from the master camera and based on information available to said master camera, some of which may be from computation on said wide angle or transformed image; and

wherein a portion or whole of an output from said master camera is based on said transformed image(s).

96. A system as recited in claim 95 where in said master camera is capable of relinquishing said control signals of said slave(s).

97. A system as recited in claim 95 wherein said control signals to said slave camera(s) include an adjustment calculated at least in part from the relative positions of said master and slave cameras or from feedback from the slave camera(s).

98. A system as recited in claim 95 wherein any image qualities, including brightness, exposure level or color balance, of said master or slave camera(s) video are automatically adjusted by comparing the images in said master camera to that from said slave camera(s).

99. A system as recited in claim 95 wherein said wide angle video camera has a fish eye lens or a purpose designed lens to amplify peripheral vision.

100. A system as recited in claim 95 wherein said computation involves automatic motion analysis, which may include motion detection, moving region tracking or object tracking.

101. A system as recited in claim 95 wherein said master camera assigns a detected moving region or regions to one or more slave camera(s) by controlling the field of vision of said slave camera(s).

102. A system as recited in claim 95 wherein said slave camera(s) has automatic moving object or motion tracking capability and they can be assigned the task of independently tracking moving regions by the master camera.

103. A system as recited in claim 95 wherein at least part of said information available to said master is obtained from external signals which include commands issued by an operator or external alarm signals.

104. A system as recited in claim 95 wherein video output(s) from slave camera(s) is fed to said master camera for image analysis or forming a portion of master camera output depending on information available to said master camera.

105. A system as recited in claim 95 wherein commands are transmitted to a slave camera from said master camera to approximately track said transformed view when a predetermined threshold zoom level is exceeded by the emulated zoom level of said transformed view or views.

106. A system as recited in claim 95 wherein said master and said slave camera(s) are in a common enclosure and share circuitry.

107. A system as recited in claim 95 wherein said transformed image(s) is based on a cylindrical projection or stereographic projection.

108. A method of automatically controlling a steerable slave camera or cameras from a wide angle video camera comprising the steps of:

capturing a wide angle video image using a master camera;

monitoring at least parts of an area covered by said master camera from a steerable slave video camera(s) in close proximity to said master camera;

automatically controlling the field of vision of said slave camera or cameras from said master camera wherein at least some of the control signals to said slave camera or cameras are fed from the master camera and based on information available to said master camera, some of which are from computation on said wide angle image.

109. A method as recited in claim 108 wherein said control signals to said slave camera(s) include an adjustment calculated at least in part from the relative positions of said master and slave cameras or from feedback from the slave camera(s).

110. A method as recited in claim 108 wherein any image qualities, including brightness, exposure level or color balance, of said master or slave camera(s) video are automatically adjusted by comparing the images in said master camera to that from said slave camera(s).

111. A method as recited in claim 108 wherein said wide angle video camera has a fish eye lens or a purpose designed lens to amplify peripheral vision.

112. A method as recited in claim 108 wherein said computation involves automatic motion analysis, which may include motion detection, moving region tracking or object tracking.

113. A method as recited in claim 108 wherein said master camera assigns a detected moving region or regions to one or more slave camera(s) by controlling the field of vision of said slave camera(s).

114. A method as recited in claim 113 wherein said slave camera(s) may have automatic moving object or motion tracking capability and they can be assigned the task of independently tracking moving regions by the master camera.

115. A method as recited in claim 108 wherein at least part of said information available to said master is obtained from external signals which include commands issued by an operator or external alarm signals.

116. A method as recited in claim 108 wherein video output(s) from slave camera(s) is fed to said master camera for image analysis or forming a portion of master camera output depending on information available to said master camera.

117. A method as recited in claim 108 wherein said master and said slave camera(s) are in a common enclosure and maybe sharing circuitry.

118. A method of automatically controlling a steerable slave camera or cameras from a wide angle video camera comprising the steps of:

capturing a wide angle video image using a master camera;

monitoring at least part(s) of area covered by said master camera from a steerable slave video camera(s) in close proximity to said master camera;

generating one or more transformed view image(s) of full or portion of said wide angle image;

automatically controlling the field of vision of said slave camera or cameras from said master camera wherein at least some of the control signals to said slave camera(s) are fed from the master camera and based on information available to said master camera, some of which is from computation on said wide angle or transformed image;

basing portion or whole of an output from said master camera on said transformed image(s).

119. A method as recited in claim 118 wherein said control signals to said slave camera(s) include an adjustment calculated at least in part from the relative positions of said master and slave cameras or from feedback from the slave camera(s).

120. A method as recited in claim 118 wherein any image qualities, including brightness, exposure level or color balance, of said master or slave camera(s) video are automatically adjusted by comparing the images in said master camera to that from said slave camera(s).

121. A method as recited in claim 118 wherein said wide angle video camera has a fish eye lens or a purpose designed lens to amplify peripheral vision.

122. A method as recited in claim 118 wherein said computation involves automatic motion analysis, which may include motion detection, moving region tracking or object tracking.

123. A method as recited in claim 118 wherein said master camera assigns a detected moving region or regions to one or more slave camera(s) by controlling the field of vision of said slave camera(s).

124. A method as recited in claim 123 wherein said slave camera(s) may have automatic moving object or motion tracking capability and they can be assigned the task of independently tracking moving regions by the master camera.

125. A method as recited in claim 118 wherein at least part of said information available to said master is obtained from external signals which include commands issued by an operator or external alarm signals.

126. A method as recited in claim 118 wherein video output(s) from slave camera(s) is fed to said master camera for image analysis or forming a portion of master camera output depending on information available to said master camera.

127. A method as recited in claim 118 wherein commands are transmitted to a slave camera from said master camera to approximately track said transformed view when a predetermined threshold zoom level is exceeded by the emulated zoom level of said transformed view or views.

128. A method as recited in claim 118 wherein said master and said slave camera(s) are in a common enclosure and maybe sharing circuitry.

129. A method as recited in claim 118 wherein said transformed image(s) is based on a cylindrical projection or stereographic projection.

130. A method of automatically expanding the zoom capability of a wide angle video camera comprising the steps of:

capturing a wide angle video image using a master camera which is capable of generating a transformed view image of full or portion of said wide angle image;

monitoring at least part of area covered by master camera from a steerable slave video camera in close proximity to said master camera;

automatically controlling the field of vision of said slave camera from said master camera wherein at least some of the control signals to said slave camera are fed from the master camera to achieve an approximate match between said transformed view and estimated said slave camera view;

replacing said transformed view of master camera by said image from slave camera in master camera output to achieve expanded zoom capability for said master camera.

131. A method as recited in claim 130 wherein said wide angle video camera has a fish eye lens or a purpose designed lens to amplify peripheral vision.

132. A method as recited in claim 130 wherein video output from said slave camera is fed to said master camera for reverse transformation into a similar projection as said wide angle image.

133. A method as recited in claim 132 wherein said reverse transformed image is compared to said wide angle image for determining adjustments to said control signals for controlling slave camera.

134. A method as recited in claim 133 wherein said method of reverse transformation and control signal adjustment is repeated in order to achieve a desired view matching accuracy.

135. A method as recited in claim 130 wherein said control signals to said slave camera include an adjustment calculated at least in part from the relative positions of said master and slave camera or from feedback from the slave camera.

136. A method as recited in claim 130 wherein the zoom capability of said master camera can be expanded by using more than one slave camera within close proximity of said master camera.