DEVICE AND METHOD FOR PRODUCING BIRD'S-EYE VIEW HAVING FUNCTION OF AUTOMATICALLY CORRECTING IMAGE

• US 20150029338A1
• Filed: 10/16/2014
• Published: 01/29/2015
• Est. Priority Date: 10/24/2012
• Status: Abandoned Application

• Current Assignee: Sekonix Company Limited
• Original Assignee: Sekonix Company Limited
• Inventors: Lee, Hee Joong, Kwon, Rakbeom
• Application Number:
  US14/516,111
• Publication Number:
  US 20150029338A1
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/607 from a bird's eye viewpoint
• CPC Class Codes: B60R 2300/806 for aiding parking
• CPC Class Codes: B60W 2040/0881 Seat occupation; Driver or passenger presence
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 40/02 related to ambient conditions
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 7/80 Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: H04N 17/002 for television cameras
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

The present invention discloses a bird'"'"' s-eye view image-producing device having a function of automatically calibrating an image. The bird'"'"'s-eye view image-producing device automatically corrects a change in camera location due to a passenger getting into an automobile even if a driver does not perform a separate calibration step to produce the bird'"'"'s-eye view image. The bird'"'"'s-eye view image-producing device may include: a first camera and a second camera for taking images of perimeters of a vehicle to generate a first image and a second image, a tilt calibrating unit for calibrating a tilt of the first camera caused by the passenger'"'"'s weight, by comparing an image acquired through the first camera when the vehicle starts with a reference image for the first camera taken before a passenger has gotten into the vehicle; and a bird'"'"'s-eye view image producing unit for producing a bird'"'"'s-eye view image having a perspective that views the perimeter of the vehicle from an upper part of the vehicle by combining a first image with the second image, the first image being taken by the first camera that is calibrated with regard to the tilt.

Claims

1. A bird'"'"'s-eye view image-producing device having a function of automatically calibrating an image, comprising:

a first camera and a second camera for taking images of perimeters of a vehicle to generate a first image and a second image, respectively;

a tilt calibrating unit for calibrating a boarding tilt of the first camera by comparing a reference image with an image taken by the first camera when the vehicle starts, said reference image being taken from one part of the vehicle body before a passenger gets in the vehicle, and being stored in the tilt calibrating unit; and

a bird'"'"'s-eye view image producing unit for producing a bird'"'"'s-eye view image by combining a first image with the second image, said bird'"'"'s-eye view image having a perspective that views the perimeter of the vehicle from an upper part of the vehicle, said the first image being taken by the first camera that is calibrated with regard to the tilt.

2. The bird'"'"'s-eye view image-producing device of claim 1, wherein the first camera takes a front view of the vehicle.

3. The bird'"'"'s-eye view image-producing device of claim 1, wherein the tilt calibrating unit calibrates a boarding tilt for the first image through a horizontal adjustment of an outline of a bonnet of the vehicle taken by the first camera

4. The bird'"'"'s-eye view image-producing device of claim 1, wherein:

the first camera takes an image of a side view of the vehicle; and

the tilt calibrating unit calibrates the image of the side view of the first camera by comparing a tire outline of the vehicle taken by the first camera with a reference image taken in which no passenger has gotten in the vehicle.

5. The bird'"'"'s-eye view image-producing device of claim 1, wherein:

the first camera takes an image of a rear view of the vehicle; and

the tilt calibrating unit calibrates the image of the rear view of the first camera by comparing a back bumper outline of the vehicle taken by the first camera with a reference image taken in which no passenger has gotten in the vehicle.

6. A method for automatically calibrating a bird'"'"'s-eye view image, carried out using a bird'"'"'s-eye view image-producing device configured to produce a bird'"'"'s-eye view image based on a first and a second image taken of a perimeter of a vehicle by a first and a second camera, respectively, comprising:

acquiring a comparative image from the first camera when the vehicle starts;

comparing the comparative image with a reference image taken by the first camera in which no passenger has gotten into the vehicle;

calibrating the first image taken by the first camera, by revising a deviation between the reference image and the comparative image; and

producing a bird'"'"'s-eye view image by combining the second image with the calibrated first image.

7. The method of claim 6, wherein the comparative image is taken after a passenger has gotten into the vehicle.

8. The method of claim 6, wherein the comparative image is an image taken of one selected from among a bonnet, a tire, and a back bumper of the vehicle.

9. The method of claim 8, wherein the step of calibrating the first image is carried out by a horizontal adjustment of an outline of one selected from among the bonnet, the tire, and the back bumper.