Omnidirectional monitoring control system, omnidirectional monitoring control method, omnidirectional monitoring control program, and computer readable recording medium

• US 7,479,979 B2
• Filed: 02/27/2003
• Issued: 01/20/2009
• Est. Priority Date: 02/28/2002
• Status: Expired due to Fees

• Current Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.), TOA Kabushiki Kaisha
• Original Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Fukuhara, Yoshio, Kakou, Noritoshi, Misawa, Masahiro
• Primary Examiner(s): VO, TUNG T
• Application Number:
  US10/376,927
• Publication Number:
  US 20030160863A1
• Time in Patent Office: 2,154 Days
• Field of Search: 348 36- 37, 348/39, 348/46, 348/47, 348/143, 348/159, 348/38, 348/42, 348/211.11, 348/256, 348/170, 348/152, 348/148, 382/293, 382/113, 382/284
• US Class Current: 348/143
• CPC Class Codes: G08B 13/19602 Image analysis to detect motion of the intruder, e.g. by frame subtraction
• CPC Class Codes: G08B 13/19628 of wide angled cameras and camera groups, e.g. omni-directional cameras, fish eye, single units having multiple cameras achieving a wide angle view
• CPC Class Codes: G08B 13/19643 wherein the cameras play different roles, e.g. different resolution, different camera type, master-slave camera
• CPC Class Codes: G08B 13/19652 Systems using zones in a single scene defined for different treatment, e.g. outer zone gives pre-alarm, inner zone gives alarm
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: G08B 13/1968 Interfaces for setting up or customising the system
• CPC Class Codes: G08B 13/19689 Remote control of cameras, e.g. remote orientation or image zooming control for a PTZ camera
• CPC Class Codes: G08B 13/19691 Signalling events for better perception by user, e.g. indicating alarms by making display brighter, adding text, creating a sound
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253

Abstract

An omnidirectional monitoring control system includes an omnidirectional camera for taking an omnidirectional image over a viewing angle of a maximum of 360 degrees; at least one zoom camera for performing positional control and magnification ratio control; a control section for rotating the omnidirectional image about a central axis of the omnidirectional image at a prescribed angle such that an apparent reference position of the omnidirectional camera is matched with an apparent reference position for driving the at least one zoom camera, and driving the at least one zoom camera to allow a prescribed monitoring position of omnidirectional image data obtained by the rotation to be photographed by the at least one zoom camera; and a display section for displaying the omnidirectional image taken by the omnidirectional camera and a zoom image taken by the at least one zoom camera.

Claims

1. An omnidirectional monitoring control system, comprising:

an omnidirectional camera for taking an omnidirectional image over a viewing angle of a maximum of 360 degrees;

at least one zoom camera for performing positional control and magnification ratio control;

a control section for rotating the omnidirectional image about a central axis of the omnidirectional image at a prescribed angle such that an apparent reference position of the omnidirectional camera is matched with an apparent reference position for driving the at least one zoom camera, and driving the at least one zoom camera to allow a prescribed monitoring position of omnidirectional image data obtained by the rotation to be photographed by the at least one zoom camera; and

a display section for displaying the omnidirectional image taken by the omnidirectional camera and a zoom image taken by the at least one zoom camera.

2. An omnidirectional monitoring control system according to claim 1, wherein the positional control is performed for controlling a photographic position by pan driving and tilt driving, and the magnification ratio control is performed by zoom driving.

3. An omnidirectional monitoring control system according to claim 1, wherein the prescribed monitoring position of the omnidirectional image data is a position where a moving subject has been detected or a manually specified position.

4. An omnidirectional monitoring control system according to claim 1, wherein the control section includes:

an image processing section for processing the omnidirectional image;

a monitoring area setting section for setting a prescribed monitoring range of the omnidirectional image as an omnidirectional monitoring range, and dividing the omnidirectional monitoring range into a plurality of monitoring areas;

a detecting area for detecting a movement of a subject in the omnidirectional monitoring range;

a specifying area for specifying one of the plurality of monitoring areas based on a detection result obtained by the detecting section or manually;

a converting section for converting information on the monitoring area specified by the specifying section into control information for controlling the zoom camera to be at a prescribed position and to have a prescribed magnification ratio for photographing the monitoring area specified by the specifying section; and

a zoom camera control section for controlling the zoom camera to be at the prescribed position and to have the prescribed magnification ratio for zoom-photographing the monitoring area specified by the specifying section, based on the control information converted by the converting section.

5. An omnidirectional monitoring control system according to claim 1, wherein the omnidirectional camera includes an optical system for projecting the omnidirectional image using a minor of a parabolic or hyperbolic convex body of revolution, or a fish-eye lens.

6. An omnidirectional monitoring control system according to claim 4, wherein the omnidirectional camera includes an optical system for projecting the omnidirectional image using a minor of a parabolic or hyperbolic convex body of revolution, or a fish-eye lens.

7. An omnidirectional monitoring control system according to claim 6, wherein the image processing section inverts the omnidirectional image taken by the omnidirectional camera with respect to the optical image obtained by the mirror of convex body of revolution and rotating the omnidirectional image about a central axis of the minor of convex body of revolution by a prescribed angle in a prescribed direction, and displays the obtained image on a display screen of the display section.

8. An omnidirectional monitoring control system according to claim 4, wherein when the omnidirectional image is circular, the monitoring area setting section sets a circular omnidirectional monitoring range such that a reference position thereof is fine-tunable by a cursor, divides the omnidirectional monitoring range concentrically and radially into the plurality of monitoring areas, and identifiably displays the plurality of monitoring areas together with area frames or area numbers respectively defining the plurality of image areas.

9. An omnidirectional monitoring control system according to claim 4, further comprising:

a control information setting section for sequentially setting the control information for controlling the zoom camera to beat the prescribed position by pan driving and tilt driving and to have the prescribed magnification ratio by zoom driving for each of the plurality of monitoring areas displayed on the display screen of the display section using a specific operation input section; and

a control information table for storing the sequentially set control information in correspondence with each of the plurality of monitoring areas,

wherein the converting section obtains the control information for the monitoring area specified by the specifying section from the control information table and/or from calculation using a prescribed calculation procedure.

10. An omnidirectional monitoring control system according to claim 9, wherein the control information setting section sets the control information such that the zoom camera is at different pan positions for the monitoring areas arranged in different concentric regions with the same tilt position and the same magnification ratio, and such that the zoom camera has different magnification ratios for the monitoring areas arranged in different radial regions with the same pan position and the same tilt position.

11. An omnidirectional monitoring control system according to claim 9, wherein the control information setting section sets a reference value of the control information for the monitoring areas arranged in one radial region, and thus automatically sets a value of the control information for all the remaining monitoring areas.

12. An omnidirectional monitoring control system according to claim 9, wherein when the zoom camera and the omnidirectional camera are separated by a prescribed distance or greater, the control information setting section corrects a value for each of the pan position, the tilt position and the magnification ratio of the control information for each monitoring area, such that an apparent reference position of the omnidirectional camera is matched with an apparent reference position for driving the zoom camera.

13. An omnidirectional monitoring control system according to claim 4, further comprising an image memory section for temporarily storing the omnidirectional image taken by the omnidirectional camera frame by frame sequentially, wherein the detecting section creates a difference image by performing pattern matching of successive frames of the omnidirectional image stored in the image memory section, and identifiably displays the difference image as the movement of the subject on a display screen of the display section.

14. An omnidirectional monitoring control system according to claim 13, wherein the detecting section displays, on the omnidirectional image, a vertical cursor and a horizontal cursor which cross each other at a position representing a difference image having a prescribed number of pixels, and outputs the area number of the monitoring area having an intersection of the vertical cursor and the horizontal cursor to the specifying section at a prescribed cycle.

15. An omnidirectional monitoring control system according to claim 13, wherein when a binary difference image is created using a prescribed number of pixels and a prescribed density value as threshold values, the detecting section changes the threshold values in accordance with the position of the monitoring area with respect to the omnidirectional monitoring range.

16. An omnidirectional monitoring control system according to claim 13, wherein when a binary difference image is created using a prescribed number of pixels and a prescribed density value as threshold values, the detecting section detects, from an average density value of an image of one monitoring area, a change in brightness around the one monitoring area and change the threshold values based on the change in brightness.

17. An omnidirectional monitoring control system according to claim 4, further comprising an invalid area setting section for presetting, as invalid, an arbitrary area of the omnidirectional monitoring range by an input operation performed through an operation input section, and identifiably displays the monitoring area which has been preset as invalid on the display screen of the display section.

18. An omnidirectional monitoring control method, comprising the steps of:

processing an omnidirectional image taken by an omnidirectional camera capable of taking an omnidirectional image over a viewing angle of a maximum of 360 degrees;

displaying the processed omnidirectional image;

setting a prescribed range of the omnidirectional image as an omnidirectional monitoring range, and when the omnidirectional monitoring range is circular, dividing the omnidirectional monitoring range concentrically and radially into a plurality of monitoring areas based on input data representing the number of monitoring areas;

detecting a movement of a subject in the omnidirectional monitoring range;

specifying one of the monitoring areas based on a detection result obtained by the detecting section or manually;

converting information on the monitoring area specified by the specifying section into control information for controlling the zoom camera to be at a prescribed position and to have a prescribed magnification ratio for zoom-photographing the monitoring area specified by the specifying section; and

controlling the zoom camera to be at the prescribed position and to have the prescribed magnification ratio for zoom-photographing the monitoring area specified by the specifying section, based on the control information converted by the converting section.

19. A zoom camera control program embodied in a computer-readable medium for executing an omnidirectional monitoring control method comprising the steps of:

processing an omnidirectional image taken by an omnidirectional camera capable of taking an omnidirectional image over a viewing angle of a maximum of 360 degrees;

displaying the processed omnidirectional image;

setting a prescribed range of the omnidirectional image as an omnidirectional monitoring range, and when the omnidirectional monitoring range is circular, dividing the omnidirectional monitoring range concentrically and radially into a plurality of monitoring areas based on input data representing the number of monitoring areas;

detecting a movement of a subject in the omnidirectional monitoring range;

specifying one of the monitoring areas based on a detection result obtained by the detecting section or manually;

converting information on the monitoring area specified by the specifying section into control information for controlling the zoom camera to be at a prescribed position and to have a prescribed magnification ratio for zoom-photographing the monitoring area specified by the specifying section; and

controlling the zoom camera to be at the prescribed position and to have the prescribed magnification ratio for zoom-photographing the monitoring area specified by the specifying section, based on the control information converted by the converting section.