Rear-view multi-functional camera system with panoramic image display features

• US 9,061,635 B2
• Filed: 12/13/2013
• Issued: 06/23/2015
• Est. Priority Date: 11/19/2009
• Status: Active Grant

• Current Assignee: Robert Bosch GmbH, Robert Bosch LLC (Robert Bosch GmbH)
• Original Assignee: Robert Bosch GmbH
• Inventors: Luo, Yun, Hoetzer, Dieter
• Primary Examiner(s): POPE, DARYL C
• Application Number:
  US14/105,869
• Publication Number:
  US 20140118484A1
• Time in Patent Office: 557 Days
• Field of Search: 340/436, 340/425.5, 340/435, 340/933, 340/937
• US Class Current: 1/1
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 1/30 providing vision in the non-visible spectrum, e.g. night or infrared vision
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/307 virtually distinguishing relevant parts of a scene from the background of the scene
• CPC Class Codes: B60R 2300/602 with an adjustable viewpoint
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture

Abstract

A rear-viewing camera system for a vehicle is described. The rear-viewing system includes a first camera, a second camera, an electronic control unit, and a display. The electronic control unit receives a first image data set from the first camera and a second image data set from the second camera. The electronic control unit then produces a panoramic image based on the first image data set and the second image data set and displays the panoramic image on the display.

Claims

1. A rear-view camera system for a vehicle, the rear-view camera system comprising:

a first camera configured to capture a first image set corresponding to a first field of view;

a second camera spaced a distance from the first camera and configured to capture a second image set corresponding to a second field of view; and

an electronic control unit configured to

receive the first image data set from the first camera and the second image data set from the second camera,

produce a panoramic image based on the first image data set and the second image data set, and

a display configured to receive the panoramic image from the electronic control unit and to display the panoramic image,

wherein the first camera and the second camera are positioned such that the first field of view partially overlaps with the second field of view,

wherein the electronic control unit is configured to produce the panoramic image by incorporating image data corresponding to a non-overlapping portion of the first field of view, image data corresponding to a non-overlapping portion of the second field of view, and combined image data corresponding to overlapping portions of the first field of view and the second field of view.

2. The rear-view camera system of claim 1, wherein the first camera is positioned on a rear side of the vehicle, and wherein the first field of view covers a first space adjacent to the rear side of the vehicle.

3. The rear-view camera system of claim 2, wherein the second camera is positioned on the rear side of the vehicle and the distance from the first camera is a horizontal distance, and wherein the second field of view covers a second space adjacent to the rear side of the vehicle.

4. The rear-view camera system of claim 1, wherein the electronic control unit is further configured to process the first image data set and the second image data set to determine a presence of an object in the space adjacent to the rear side of the vehicle.

5. The rear-view camera system of claim 4, wherein the electronic control unit is further configured to:

calculate a driving corridor,

determine a time to collision of the object with the vehicle within the driving corridor, and

provide a warning to the operator of the vehicle.

6. The rear-view camera system of claim 5, wherein the warning is at least one selected from a group consisting of an audible warning, a visual warning, and a haptic warning.

7. The rear-view camera system of claim 5, wherein the warning is provided by highlighting the object in the panoramic image on the display.

8. The rear-view camera system of claim 5, wherein the electronic control unit is further configured to

determine whether the operator of the vehicle has taken appropriate action in response to the warning, and

activate a collision mitigation system when the electronic control unit determines that the operator of the vehicle has not taken appropriate action in response to the warning.

9. The rear-view camera system of claim 1, wherein the first image data set and the second image data set each include a video stream of image data.

10. The rear-view camera system of claim 1, wherein the electronic control unit is further configured to adjust an angle of the first camera and an angle of the second camera in response to receiving a user input requesting a change in a viewing angle of the panoramic image.

11. The rear-view camera system of claim 1, wherein the first camera and the second camera are operable to capture image data in a visible spectrum and an infrared spectrum.

12. The rear-view camera system of claim 11, further comprising an infrared light source operable to illuminate the first field of view and the second field of view with infrared light.

13. The rear-view camera system of claim 1, wherein the electronic control unit is further configured to

determine whether the vehicle is operating in reverse, and

display the panoramic image on the display when the vehicle is operating in reverse.

14. A rear-view camera system for a vehicle, the rear-view camera system comprising:

a first camera positioned on a rear side of the vehicle, the first camera producing a first data set that includes image data corresponding to a first field of view;

a second camera positioned on the rear side of the vehicle spaced a horizontal distance from the first camera, the second camera producing a second data set that includes image data corresponding to a second field of view, the first field of view and the second field of view covering a space adjacent the rear side of the vehicle;

an electronic control unit configured to produce a panoramic image that corresponds to the space adjacent the rear side of the vehicle by combining data from the first data set and data from the second data set; and

a viewing screen positioned in an interior of the vehicle and configured to receive the panoramic image from the electronic control unit and display the panoramic image,

wherein the first camera and the second camera are positioned such that the first field of view partially overlaps with the second field of view,

wherein the electronic control unit is configured to produce the panoramic image by incorporating image data corresponding to a non-overlapping portion of the first field of view, image data corresponding to a non-overlapping portion of the second field of view, and combined image data corresponding to overlapping portions of the first field of view and the second field of view.