Surveillance camera apparatus and surveillance camera system

• US 8,390,686 B2
• Filed: 09/19/2006
• Issued: 03/05/2013
• Est. Priority Date: 09/20/2005
• Status: Active Grant

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: Tanaka, Yasunori
• Primary Examiner(s): Ustaris, Joseph
• Assistant Examiner(s): Bailey, Frederick
• Application Number:
  US11/523,006
• Publication Number:
  US 20100265331A1
• Time in Patent Office: 2,359 Days
• Field of Search: None
• US Class Current: 348/159
• CPC Class Codes: G08B 13/19602 Image analysis to detect motion of the intruder, e.g. by frame subtraction
• CPC Class Codes: G08B 13/19608 Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position
• CPC Class Codes: G08B 13/19628 of wide angled cameras and camera groups, e.g. omni-directional cameras, fish eye, single units having multiple cameras achieving a wide angle view
• CPC Class Codes: G08B 13/1963 Arrangements allowing camera rotation to change view, e.g. pivoting camera, pan-tilt and zoom [PTZ]
• CPC Class Codes: G08B 13/19643 wherein the cameras play different roles, e.g. different resolution, different camera type, master-slave camera
• CPC Class Codes: G08B 13/19673 Addition of time stamp, i.e. time metadata, to video stream
• CPC Class Codes: H04N 23/50 Constructional details
• CPC Class Codes: H04N 23/695 Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A wide-angle camera is fixed to direct an optical axis in a fixed direction. A telephotographic camera can be inclined in panning and tilting directions to change an aiming direction of its optical axis. An image signal from the wide-angle camera is evaluated. When an image of a moving object is identified in a frame captured by the wide-angle camera, directivity information corresponding to a position of the moving object is calculated based on a relative position to the center of the frame. In accordance with the directivity information, posture of the telephotographic camera is controlled to aim its optical axis at the moving object. Thereafter, the posture of the telephotographic camera is controlled continuously to place the image of the moving object in the center of the frame captured by the telephotographic camera. The telephotographic camera captures the moving object while tracking it.

Claims

1. A surveillance camera apparatus comprising:

a wide-angle camera that converts an optical image obtained through a wide-angle lens into a first image signal, the wide-angle camera that outputs the first image signal, an optical axis of the wide-angle camera being fixed in a constant direction;

a telephotographic camera that converts an optical image obtained through a telephotographic lens into a second image signal, the telephotographic camera that outputs the second image signal, the telephotographic camera supported to be rotatable around at least one pivot axis so that an optical axis of the telephotographic camera can be tilted and panned;

a directivity information calculating unit that identifies an image of a moving object within a image-capturing range of the wide-angle camera based on the first image signal from the wide-angle camera, the directivity information calculating unit that calculates directivity information corresponding to a position of the image of the moving object within the image-capturing range;

a camera posture control unit that rotates the telephotographic camera around the pivot axis in accordance with the directivity information so as to direct the optical axis of the telephotographic camera at the moving object captured by the wide-angle camera; and

a tracking information calculating unit that calculates tracking information, which is used to direct the optical axis of the telephotographic camera so as to place the image of the moving object at a center region of a image-capturing range of the telephotographic camera, based on second image signals sequentially output from the telephotographic camera, wherein;

after the tracking information is calculated, the camera posture control unit is controlled in real time using the tracking information in place of the directivity information and the telephotographic camera continuously captures the moving object, and

wherein the tracking information includes a movement vector of the moving object, and the movement vector is calculated based on the second image signal and an automatically adjustable magnification of the telephotographic camera based on a size of the captured moving object.

2. The apparatus according to claim 1, wherein the telephotographic lens has a variable magnification capability.

3. The apparatus according to claim 1, wherein:

a plurality of wide-angle cameras are provided, and

the wide-angle cameras have different image-capturing ranges and have the same angle of view.

4. The apparatus according to claim 2, wherein:

a plurality of wide-angle cameras are provided, and

the wide-angle cameras have different image-capturing ranges and have the same angle of view.

5. The apparatus according to claim 1, wherein:

the wide-angle camera comprises plural kinds of stationary cameras, which have different focal lengths, focus on longer distances as the focal lengths are longer and have image-capturing ranges substantially equivalent to each other, and

a near-side of a depth of field of one stationary camera overlaps a far-side of a depth of field of another stationary camera, whose focused position is adjacent to that of the one stationary camera.

6. The apparatus according to claim 5, wherein:

at least one of the stationary cameras includes a combination of a plurality of camera modules, which have angles of view equal to each other, have focal lengths equal to each other and are arranged so that directions of capturing optical axes are different from each other, and

the camera modules individually captures areas, which are defined by dividing the image-capturing range equally.

7. The apparatus according to claim 2, wherein:

the wide-angle camera comprises plural kinds of stationary cameras, which have different focal lengths, focus on longer distances as the focal lengths are longer and have image-capturing ranges substantially equivalent to each other, and

a near-side of a depth of field of one stationary camera overlaps a far-side of a depth of field of another stationary camera, whose focused position is adjacent to that of the one stationary camera.

8. The apparatus according to claim 7, wherein:

at least one of the stationary cameras includes a combination of a plurality of camera modules, which have angles of view equal to each other, have focal lengths equal to each other and are arranged so that directions of capturing optical axes are different from each other, and

the camera modules individually captures areas, which are defined by dividing the image-capturing range equally.

9. The apparatus according to claim 1, wherein:

a plurality of telephotographic cameras and a plurality of camera posture control units are provided,

when one or more wide-angle camera captures a plurality of images of moving objects, the directivity information calculating unit calculates plural pieces of directivity information, and

the pieces of directivity information are input to the plurality of camera posture control units individually.

10. The apparatus according to claim 2, wherein:

a plurality of telephotographic cameras and a plurality of camera posture control units are provided,

when one or more wide-angle camera captures a plurality of images of moving objects, the directivity information calculating unit calculates plural pieces of directivity information, and

the pieces of directivity information are input to the plurality of camera posture control units individually.

11. The apparatus according to claim 3, wherein:

a plurality of telephotographic cameras and a plurality of camera posture control units are provided,

when one or more wide-angle camera captures a plurality of images of moving objects, the directivity information calculating unit calculates plural pieces of directivity information, and

the pieces of directivity information are input to the plurality of camera posture control units individually.

12. The apparatus according to claim 5, wherein:

a plurality of telephotographic cameras and a plurality of camera posture control units are provided,

when one or more wide-angle camera captures a plurality of images of moving objects, the directivity information calculating unit calculates plural pieces of directivity information, and

the pieces of directivity information are input to the plurality of camera posture control units individually.

13. A surveillance camera system comprising:

a plurality of surveillance camera apparatuses according to claim 1, wherein;

the surveillance camera apparatuses are disposed so that optical axes of wide-angle cameras of the surveillance camera apparatuses are different from one another, and

the directivity information and the tracking information are shared among the surveillance camera apparatuses.

14. A surveillance camera system comprising:

a plurality of surveillance camera apparatuses according to claim 2, wherein;

the surveillance camera apparatuses are disposed so that optical axes of wide-angle cameras of the surveillance camera apparatuses are different from one another, and the directivity information and the tracking information are shared among the surveillance camera apparatuses.

15. A surveillance camera system comprising:

a plurality of surveillance camera apparatuses according to claim 3, wherein;

the surveillance camera apparatuses are disposed so that optical axes of wide-angle cameras of the surveillance camera apparatuses are different from one another, and the directivity information and the tracking information are shared among the surveillance camera apparatuses.

16. A surveillance camera system comprising:

a plurality of surveillance camera apparatuses according to claim 5, wherein;

the surveillance camera apparatuses are disposed so that optical axes of wide-angle cameras of the surveillance camera apparatuses are different from one another, and the directivity information and the tracking information are shared among the surveillance camera apparatuses.

17. A surveillance camera apparatus comprising:

a wide-angle camera that converts an optical image obtained through a wide-angle lens into a first image signal, the wide-angle camera that outputs the first image signal, an optical axis of the wide-angle camera being fixed in a constant direction;

a telephotographic camera that converts an optical image obtained through a telephotographic lens into a second image signal, the telephotographic camera that outputs the second image signal, the telephotographic camera supported to be rotatable around at least one pivot axis so that an optical axis of the telephotographic camera can be tilted and panned;

a directivity information calculating unit that identifies an image of a moving object within a image-capturing range of the wide-angle camera based on the first image signal from the wide-angle camera, the directivity information calculating unit that calculates directivity information corresponding to a position of the image of the moving object within the image-capturing range;

a camera posture control unit that rotates the telephotographic camera around the pivot axis in accordance with the directivity information so as to direct the optical axis of the telephotographic camera at the moving object captured by the wide-angle camera; and

a tracking information calculating unit that calculates tracking information, which is used to direct the optical axis of the telephotographic camera so as to place the image of the moving object at a center region of a image-capturing range of the telephotographic camera, based on second image signals sequentially output from the telephotographic camera, wherein;

after the tracking information is calculated, the camera posture control unit is controlled in real time using the tracking information in place of the directivity information and the telephotographic camera continuously captures the moving object,

wherein the tracking information includes a movement angle of the moving object, and the movement angle is calculated based on the second image signal and a view angle of the telephotographic camera, and

wherein the tracking information includes a movement vector of the moving object, and the movement vector is calculated based on the second image signal and an automatically adjustable magnification of the telephotographic camera based on a size of the captured moving object.

18. A surveillance camera apparatus comprising:

a wide-angle camera that converts an optical image obtained through a wide-angle lens into a first image signal, the wide-angle camera that outputs the first image signal, an optical axis of the wide-angle camera being fixed in a constant direction;

a telephotographic camera that converts an optical image obtained through a telephotographic lens into a second image signal, the telephotographic camera that outputs the second image signal, the telephotographic camera supported to be rotatable around at least one pivot axis so that an optical axis of the telephotographic camera can be tilted and panned;

a directivity information calculating unit that identifies an image of a moving object within a image-capturing range of the wide-angle camera based on the first image signal from the wide-angle camera, the directivity information calculating unit that calculates directivity information corresponding to a position of the image of the moving object within the image-capturing range;

a camera posture control unit that rotates the telephotographic camera around the pivot axis in accordance with the directivity information so as to direct the optical axis of the telephotographic camera at the moving object captured by the wide-angle camera; and

a tracking information calculating unit that calculates tracking information, which is used to direct the optical axis of the telephotographic camera so as to place the image of the moving object at a center region of a image-capturing range of the telephotographic camera, based on second image signals sequentially output from the telephotographic camera, wherein;

after the tracking information is calculated, the camera posture control unit is controlled in real time using the tracking information in place of the directivity information and the telephotographic camera continuously captures the moving object,

wherein the tracking information calculating unit obtains the tracking information by comparing sequential second image signals from the telephotographic camera to calculate movement information of the image of the moving object, and

wherein the tracking information includes a movement vector of the moving object, and the movement vector is calculated based on the second image signal and an automatically adjustable magnification of the telephotographic camera based on a size of the captured moving object.