Monitoring system and monitoring method

• US 6,577,335 B2
• Filed: 03/10/1998
• Issued: 06/10/2003
• Est. Priority Date: 10/20/1997
• Status: Expired due to Fees

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Edanami, Takafumi, Kobayashi, Kenzo
• Primary Examiner(s): WONG, ALLEN C
• Application Number:
  US09/038,148
• Publication Number:
  US 20010040624A1
• Time in Patent Office: 1,918 Days
• Field of Search: 348/152, 348/153, 348/154, 348/155, 348/36, 348/42, 348/43, 345/425
• US Class Current: 348/152
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253

Abstract

A first camera 12 having a fish-eye lens 13 and a second camera 14 having a fish-eye lens 15 are disposed with the respective fish-eye lenses faced with each other. An image pick-up range of the first camera 12 and an image pick-up range of the second camera 14 are partially overlapped, and only a relatively narrow area at the backside of each camera becomes a blind area. A processor 30 sets a frame F in the image pick-up area of the first camera 12 and the image pick-up area of the second camera 14 respectively corresponding to a set monitoring range. The image data within these frames F are taken out and distortions of the image due to the characteristics of the fish-eye lenses 13 and 15 are eliminated to obtain first and second transformed frame data. These transformed frame data are combined by an image combining unit 25, to obtain image data corresponding the monitoring range free from any gap. The combined image data is displayed in a monitor 8 through a PC 7.

Claims

1. A monitoring system, comprising:

a first camera having a fish-eye lens;

a second camera having a fish-eye lens, said first and second cameras being disposed in opposite directions and aligned with the lens of said first camera and the lens of said second camera facing one another, each fish-eye lens of the first camera and the second camera having a dead angle of approximately 22 degrees;

image data extracting means for extracting first and second frame data corresponding to a monitoring range from first image data captured by said first camera and second image data captured by said second camera; and

image combining means for generating combined frame data corresponding to the monitoring range by combining the first and second frame data extracted by said image data extracting means,

wherein said first and second cameras are arranged sufficiently close together without creating parallax and without an object to be photographed being located between said first and second cameras, and said image combining means generates the combined frame data having a seamless connection between the first image data and the second image data.

2. A monitoring system according to claim 1, further comprising display means for displaying an image within the monitoring range based on combined frame data output from said image combining means.

3. A monitoring system according to claim 1, wherein said first and second cameras are disposed so that optical axes of the fish-eye lenses of said cameras are substantially parallel with a vertical direction.

4. A monitoring system according to claim 1, wherein said first and second cameras are disposed so that optical axes of the fish-eye lenses of said cameras substantially match together.

5. A monitoring system according to claim 1, further comprising means for transforming the first and second frame data extracted by said image data extracting means, before combining the frame data by said image combining means.

6. A monitoring system according to claim 5, wherein said transforming means eliminates distortions of an image due to characteristics of the fish-eye lenses of said first camera and said second camera.

7. A monitoring system according to claim 2, further comprising image compressing means for compressing the combined frame data output from said image combining means and for sending the compressed frame data to said display means.

8. A monitoring system according to claim 5, wherein said image combining means extracts frame data of a non-overlapped range captured by only said first camera from the first transformed frame data, extracts frame data of a non-overlapped range captured by only said second camera from the second transformed frame data, extracts frame data of an overlapped range from at least one of the first and second transformed frame data, and combines the frame data of the two non-overlapped ranges and the frame data of the overlapped range to generate the combined frame data.

9. A monitoring system according to claim 8, wherein said image combining means extracts frame data of an overlapped range from both the first and second transformed frame data to improves the resolution of the frame data of the overlapped range by interpolating the overlapped frame data.

10. A monitoring method, comprising:

picking up an image by a first camera having a fish-eye lens and an image by a second camera having a fish-eye lens, the first and second cameras being disposed in opposite directions and aligned with the lens of the first camera and the lens of the second camera facing one another, each fish-eye lens of the first camera and the second camera having a dead angle of approximately 22 degrees;

extracting image data of a range corresponding to a monitoring range from first image data captured by the first camera and second image data captured by the second camera, respectively;

transforming the extracted first image data and the extracted second image data into first transformed frame data and second transformed frame data, respectively;

generating combined image data by combining the first transformed frame data and the second transformed frame data; and

displaying in a display unit an image based on the combined image data,

wherein the first and second cameras are arranged sufficiently close together without creating parallax and without an object to be photographed being located between the first and second cameras, and the combined image data have a seamless connection between the first image data and the second image data.

11. A monitoring method according to claim 10, further comprising compressing the combined image data and sending the compressed data to the display unit.

12. A monitoring method according to claim 10, wherein said generating combined image data comprises extracting the frame data of a non-overlapped range obtained by only the first camera, the frame data of a non-overlapped range obtained by only the second camera, and the frame data of an overlapped range obtained in superposition by the first camera and the second camera, respectively, from the first transformed frame data and the second transformed frame data, and combining the frame data to generate the combined image data.

13. A monitoring system, comprising:

a first camera having a first fish-eye lens; and

a second camera having a second fish-eye lens, said first and second cameras being disposed with the first and second fish-eye lenses facing one another and an optical axis of the first fish-eye lens and an optical axis of the second fish-eye lens substantially aligning, each fish-eye lens of the first camera and the second camera having a dead angle of approximately 22 degrees,

wherein said first and second cameras are arranged sufficiently close together without creating parallax and without an object to be photographed being located between said first and second cameras, and combined image data are generated having a seamless connection between first image data photographed by said first camera and second image data photographed by said second camera.

14. A monitoring method, comprising:

arranging a first camera having a first fish-eye lens and a second camera having a second fish-eye lens with the first and second lenses facing one another and an optical axis of the first fish-eye lens and an optical axis of the second fish-eye lens substantially aligning, each fish-eye lens of the first camera and the second camera having a dead angle of approximately 22 degrees,

wherein the first and second cameras are arranged sufficiently close together without creating parallax and without an object to be photographed being located between the first and second cameras, and combined image data having a seamless connection between first image data photographed by the first camera and second image data photographed by the second camera.