Vehicle vision system with multiple cameras

• US 10,354,155 B2
• Filed: 11/12/2018
• Issued: 07/16/2019
• Est. Priority Date: 11/21/2014
• Status: Active Grant

• Current Assignee: Manga Electronics Incorporated
• Original Assignee: Manga Electronics Incorporated
• Inventors: Fursich, Manfred
• Primary Examiner(s): Jones, Heather R
• Application Number:
  US16/188,139
• Publication Number:
  US 20190080185A1
• Time in Patent Office: 246 Days
• Field of Search: None
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/304 using merged images, e.g. merging camera image with stored images
• CPC Class Codes: B60R 2300/70 characterised by an event-triggered choice to display a specific image among a selection of captured images
• CPC Class Codes: B60R 2300/8093 for obstacle warning
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A vision system for a vehicle includes a plurality of cameras having respective fields of view exterior of the vehicle. The plurality of cameras includes driver and passenger side wide angle cameras having wide angle fields of view, driver and passenger side rearward viewing cameras having fields of view sideward and rearward of the vehicle, and a rear camera having a wide angle field of view rearward of the vehicle. A display is operable to display images derived from image data captured by at least some of the cameras. The display displays a panoramic view derived from image data captured by the rear camera, the left-side rearward viewing camera and the right-side rearward viewing camera. The display displays a surround view derived from image data captured by at least some of the plurality of cameras.

Claims

1. A vehicular vision system, said vehicular vision system comprising:

a plurality of cameras configured to be disposed at a vehicle;

wherein the vehicle has a left-side exterior mirror disposed at a left side of the vehicle and a right-side exterior mirror disposed at a right side of the vehicle, and wherein the left-side exterior mirror, as viewed by a driver of the vehicle, provides a mirror-reflected rearward and sideward view at the left side of the vehicle, and wherein the right-side exterior mirror, as viewed by the driver of the vehicle, provides a mirror-reflected rearward and sideward view at the right side of the vehicle;

wherein said plurality of cameras, when disposed at the vehicle, comprises a left-side wide angle camera disposed at a left-side location of the vehicle and having a wide angle field of view at the left side of the vehicle, and wherein the wide angle field of view of said left-side wide angle camera, with said left-side wide angle camera disposed at the left-side location of the vehicle, encompasses at least a forward ground region, a sideward ground region and a rearward ground region;

wherein, with said left-side wide angle camera disposed at the vehicle, the wide angle field of view of said left-side wide angle camera has its principal axis angled toward the ground at the left side of the vehicle;

wherein said plurality of cameras, when disposed at the vehicle, comprises a left-side rearward viewing camera disposed at the left side of the vehicle and having a field of view sideward and rearward of the vehicle;

wherein said plurality of cameras, when disposed at the vehicle, comprises a right-side wide angle camera disposed at a right-side location of the vehicle and having a wide angle field of view at the right side of the vehicle, and wherein the wide angle field of view of said right-side wide angle camera, with said right-side wide angle camera disposed at the right-side location of the vehicle, encompasses at least a forward ground region, a sideward ground region and a rearward ground region;

wherein, with said right-side wide angle camera disposed at the vehicle, the wide angle field of view of said right-side wide angle camera has its principal axis angled toward the ground at the right side of the vehicle;

wherein said plurality of cameras, when disposed at the vehicle, comprises a right-side rearward viewing camera disposed at the right side of the vehicle and having a field of view sideward and rearward of the vehicle;

wherein said plurality of cameras, when disposed at the vehicle, comprises a rear camera disposed at a rear portion of the vehicle and having a wide angle field of view that encompasses a ground region rearward of the vehicle;

wherein, with said left-side rearward viewing camera disposed at the vehicle, said left-side rearward viewing camera views at least 20 meters rearward of the vehicle, and wherein, with said right-side rearward viewing camera disposed at the vehicle, said right-side rearward viewing camera views at least 20 meters rearward of the vehicle;

wherein, with said plurality of cameras disposed at the vehicle, the field of view of said left-side rearward viewing camera overlaps the field of view of said right-side rearward viewing camera rearward of the vehicle;

an image processor that, with said plurality of cameras disposed at the vehicle, processes image data captured by said cameras;

a display disposed in the vehicle, wherein, with said plurality of cameras disposed at the vehicle, said display displays images derived from image data captured by said plurality of cameras;

wherein, with said plurality of cameras disposed at the vehicle, said display displays a panoramic view derived from image data captured by said rear camera, said left-side rearward viewing camera and said right-side rearward viewing camera;

wherein, with said plurality of cameras disposed at the vehicle, said display displays a surround view derived from image data captured by at least some of said plurality of cameras;

wherein, with said left-side rearward viewing camera disposed at the vehicle, said left-side rearward viewing camera views a left-side blind spot region at the left side of the vehicle, and wherein the left-side blind spot region is outside the mirror-reflected rearward and sideward view provided by the left-side exterior mirror as viewed by the driver of the vehicle;

wherein, with said right-side rearward viewing camera disposed at the vehicle, said right-side rearward viewing camera views a right-side blind spot region at the right side of the vehicle, and wherein the right-side blind spot region is outside the mirror-reflected rearward and sideward view provided by the right-side exterior mirror as viewed by the driver of the vehicle; and

wherein, with said plurality of cameras disposed at the vehicle, said image processor processes image data captured by at least said left-side rearward viewing camera and said right-side rearward viewing camera to detect objects in the respective fields of view of said left-side rearward viewing camera and said right-side rearward viewing camera.

2. The vehicular vision system of claim 1, wherein, with said plurality of cameras disposed at the vehicle, and with said display displaying the surround view, (i) images derived from image data captured by said left-side wide angle camera are stitched with images derived from image data captured by said left-side rearward viewing camera, (ii) images derived from image data captured by said right-side wide angle camera are stitched with images derived from image data captured by said right-side rearward viewing camera, (iii) images derived from image data captured by said left-side rearward viewing camera are stitched with images derived from image data captured by said rear camera, and (iv) images derived from image data captured by said right-side rearward viewing camera are stitched with images derived from image data captured by said rear camera.

3. The vehicular vision system of claim 1, wherein, with said plurality of cameras disposed at the vehicle, said left-side rearward viewing camera is disposed at the left-side exterior mirror of the vehicle and said right-side rearward viewing camera is disposed at the right-side exterior mirror of the vehicle.

4. The vehicular vision system of claim 3, wherein, with said plurality of cameras disposed at the vehicle, said left-side rearward viewing camera is disposed at an outboard region of the left-side exterior mirror of the vehicle and said right-side rearward viewing camera is disposed at an outboard region of the right-side exterior mirror of the vehicle.

5. The vehicular vision system of claim 3, wherein, with said plurality of cameras disposed at the vehicle, said left-side wide angle camera is disposed in the left-side exterior mirror and said right-side wide angle camera is disposed in the right-side exterior mirror.

6. The vehicular vision system of claim 1, wherein said plurality of cameras, when disposed at the vehicle, comprises a forward viewing camera disposed at a front portion of the vehicle and viewing a ground region forward of the vehicle.

7. The vehicular vision system of claim 6, wherein, with said plurality of cameras disposed at the vehicle, and with said display displaying the surround view, (i) images derived from image data captured by said left-side wide angle camera are stitched with images derived from image data captured by said left-side rearward viewing camera, (ii) images derived from image data captured by said right-side wide angle camera are stitched with images derived from image data captured by said right-side rearward viewing camera, (iii) images derived from image data captured by said left-side rearward viewing camera are stitched with images derived from image data captured by said rear camera, (iv) images derived from image data captured by said right-side rearward viewing camera are stitched with images derived from image data captured by said rear camera, (v) images derived from image data captured by said left-side wide angle camera are stitched with the images derived from image data captured by said forward viewing camera, and (vi) images derived from image data captured by said right-side wide angle camera are stitched with the images derived from image data captured by said forward viewing camera.

8. The vehicular vision system of claim 1, wherein, with said plurality of cameras disposed at the vehicle, said image processor processes image data of the overlapping portions of the field of view of said left-side rearward viewing camera and the field of view of said right-side rearward viewing camera.

9. The vehicular vision system of claim 8, wherein, with said plurality of cameras disposed at the vehicle, said image processor processes image data of the overlapping portions of the field of view of said left-side rearward viewing camera and the field of view of said right-side rearward viewing camera as stereo vision.

10. The vehicular vision system of claim 1, wherein said plurality of cameras, when disposed at the vehicle, comprises a second rear camera disposed at a rear portion of the vehicle and having a narrower field of view than the wide angle field of view of said rear camera, and wherein said second rear camera views further rearward of the vehicle than said rear camera.

11. The vehicular vision system of claim 1, wherein said vehicular vision system comprises a left-side forward viewing camera having a field of view sideward and forward of the vehicle and a right-side forward viewing camera having a field of view sideward and forward of the vehicle, and wherein the field of view of said left-side forward viewing camera overlaps the field of view of said right-side forward viewing camera at a region forward of the vehicle.

12. A vehicular vision system, said vehicular vision system comprising:

a plurality of cameras configured to be disposed at a vehicle;

wherein the vehicle has a left-side exterior mirror disposed at a left side of the vehicle and a right-side exterior mirror disposed at a right side of the vehicle, and wherein the left-side exterior mirror, as viewed by a driver of the vehicle, provides a mirror-reflected rearward and sideward view at the left side of the vehicle, and wherein the right-side exterior mirror, as viewed by the driver of the vehicle, provides a mirror-reflected rearward and sideward view at the right side of the vehicle;

wherein said plurality of cameras, when disposed at the vehicle, comprises a left-side wide angle camera disposed at the left-side exterior mirror of the vehicle and having a wide angle field of view at the left side of the vehicle, and wherein the wide angle field of view of said left-side wide angle camera, with said left-side wide angle camera disposed at the left-side exterior mirror, encompasses at least a forward ground region, a sideward ground region and a rearward ground region;

wherein, with said left-side wide angle camera disposed at the left-side exterior mirror, the wide angle field of view of said left-side wide angle camera has its angled toward the ground at the left side of the vehicle;

wherein said plurality of cameras, when disposed at the vehicle, comprises a left-side rearward viewing camera disposed at the left-side exterior mirror of the vehicle and having a field of view sideward and rearward of the vehicle;

wherein said plurality of cameras, when disposed at the vehicle, comprises a right-side wide angle camera disposed at the right-side exterior mirror of the vehicle and having a wide angle field of view at the right side of the vehicle, and wherein the wide angle field of view of said right-side wide angle camera, with said right-side wide angle camera disposed at the right-side exterior mirror, encompasses at least a forward ground region, a sideward ground region and a rearward ground region;

wherein, with said right-side wide angle camera disposed at the right-side exterior mirror, the wide angle field of view of said right-side wide angle camera has its principal axis angled toward the ground at the right side of the vehicle;

wherein said plurality of cameras, when disposed at the vehicle, comprises a right-side rearward viewing camera disposed at the right-side exterior mirror of the vehicle and having a field of view sideward and rearward of the vehicle;

wherein said plurality of cameras, when disposed at the vehicle, comprises a rear camera disposed at a rear portion of the vehicle and having a wide angle field of view that encompasses a ground region rearward of the vehicle;

wherein said plurality of cameras, when disposed at the vehicle, comprises a forward viewing camera disposed at a front portion of the vehicle and viewing a ground region forward of the vehicle;

wherein, with said left-side rearward viewing camera disposed at the left-side exterior mirror, said left-side rearward viewing camera views a region at least 20 meters rearward of the vehicle, and wherein, with said right-side rearward viewing camera disposed at the right-side exterior mirror, said right-side rearward viewing camera views a region at least 20 meters rearward of the vehicle;

wherein, with said plurality of cameras disposed at the vehicle, the field of view of said left-side rearward viewing camera overlaps the field of view of said right-side rearward viewing camera rearward of the vehicle;

an image processor that, with said plurality of cameras disposed at the vehicle, processes image data captured by said cameras;

a display disposed in the vehicle, wherein, with said plurality of cameras disposed at the vehicle, said display displays images derived from image data captured by said plurality of cameras;

wherein, with said plurality of cameras disposed at the vehicle, said display displays a panoramic view derived from image data captured by said rear camera, said left-side rearward viewing camera and said right-side rearward viewing camera;

wherein, with said plurality of cameras disposed at the vehicle, said display displays a surround view derived from image data captured by at least some of said plurality of cameras;

wherein, with said left-side rearward viewing camera disposed at the left-side exterior mirror, said left-side rearward viewing camera views a left-side blind spot region at the left side of the vehicle, and wherein the left-side blind spot region is outside the mirror-reflected rearward and sideward view provided by the left-side exterior mirror as viewed by the driver of the vehicle;

wherein, with said right-side rearward viewing camera disposed at the right-side exterior mirror, said right-side rearward viewing camera views a right-side blind spot region at the right side of the vehicle, and wherein the right-side blind spot region is outside the mirror-reflected rearward and sideward view provided by the right-side exterior mirror as viewed by the driver of the vehicle; and

wherein, with said plurality of cameras disposed at the vehicle, said image processor processes image data captured by at least said left-side rearward viewing camera and said right-side rearward viewing camera to detect objects in the respective fields of view of said left-side rearward viewing camera and said right-side rearward viewing camera.

13. The vehicular vision system of claim 12, wherein, with said plurality of cameras disposed at the vehicle, and with said display displaying the surround view, (i) images derived from image data captured by said left-side wide angle camera are stitched with images derived from image data captured by said left-side rearward viewing camera, (ii) images derived from image data captured by said right-side wide angle camera are stitched with images derived from image data captured by said right-side rearward viewing camera, (iii) images derived from image data captured by said left-side rearward viewing camera are stitched with images derived from image data captured by said rear camera, (iv) images derived from image data captured by said right-side rearward viewing camera are stitched with images derived from image data captured by said rear camera, (v) images derived from image data captured by said left-side wide angle camera are stitched with the images derived from image data captured by said forward viewing camera, and (vi) images derived from image data captured by said right-side wide angle camera are stitched with the images derived from image data captured by said forward viewing camera.

14. The vehicular vision system of claim 12, wherein, with said plurality of cameras disposed at the vehicle, said left-side wide angle camera is disposed at an outboard region of the left-side exterior mirror of the vehicle and said right-side wide angle camera is disposed at an outboard region of the right-side exterior mirror of the vehicle.

15. The vehicular vision system of claim 12, wherein, with said plurality of cameras disposed at the vehicle, said left-side wide angle camera is disposed in the left-side exterior mirror and said right-side wide angle camera is disposed in the right-side exterior mirror.

16. The vehicular vision system of claim 12, wherein, with said plurality of cameras disposed at the vehicle, said image processor processes image data of the overlapping portions of the field of view of said left-side rearward viewing camera and the field of view of said right-side rearward viewing camera.

17. The vehicular vision system of claim 12, wherein said vehicular vision system comprises a left-side forward viewing camera having a field of view sideward and forward of the vehicle and a right-side forward viewing camera having a field of view sideward and forward of the vehicle, and wherein the field of view of said left-side forward viewing camera overlaps the field of view of said right-side forward viewing camera at a region forward of the vehicle.

18. A vehicular vision system, said vehicular vision system comprising:

a plurality of cameras configured to be disposed at a vehicle;

wherein the vehicle has a left-side exterior mirror disposed at a left side of the vehicle and a right-side exterior mirror disposed at a right side of the vehicle, and wherein the left-side exterior mirror, as viewed by a driver of the vehicle, provides a mirror-reflected rearward and sideward view at the left side of the vehicle, and wherein the right-side exterior mirror, as viewed by the driver of the vehicle, provides a mirror-reflected rearward and sideward view at the right side of the vehicle;

wherein said plurality of cameras, when disposed at the vehicle, comprises a left-side wide angle camera disposed at a left-side location of the vehicle and having a wide angle field of view at the left side of the vehicle, and wherein the wide angle field of view of said left-side wide angle camera, with said left-side wide angle camera disposed at the left-side location of the vehicle, encompasses at least a forward ground region, a sideward ground region and a rearward ground region;

wherein, with said left-side wide angle camera disposed at the vehicle, the wide angle field of view of said left-side wide angle camera has its principal axis angled toward the ground at the left side of the vehicle;

wherein said plurality of cameras, when disposed at the vehicle, comprises a left-side rearward viewing camera disposed at the left side of the vehicle and having a field of view sideward and rearward of the vehicle;

wherein said plurality of cameras, when disposed at the vehicle, comprises a right-side wide angle camera disposed at a right-side location of the vehicle and having a wide angle field of view at the right side of the vehicle, and wherein the wide angle field of view of said right-side wide angle camera, with said left-side wide angle camera disposed at the left-side location of the vehicle, encompasses at least a forward ground region, a sideward ground region and a rearward ground region;

wherein, with said right-side wide angle camera disposed at the vehicle, the wide angle field of view of said right-side wide angle camera has its principal axis angled toward the ground at the right side of the vehicle;

wherein said plurality of cameras, when disposed at the vehicle, comprises a right-side rearward viewing camera disposed at the right side of the vehicle and having a field of view sideward and rearward of the vehicle;

wherein said plurality of cameras, when disposed at the vehicle, comprises a first rear camera disposed at a first rear portion of the vehicle and having a wide angle field of view that encompasses a ground region rearward of the vehicle;

wherein said plurality of cameras, when disposed at the vehicle, comprises a second rear camera disposed at a second rear portion of the vehicle and having a narrower field of view than the wide angle field of view of said first rear camera, and wherein said second rear camera views further rearward of the vehicle than said first rear camera;

wherein said plurality of cameras, when disposed at the vehicle, comprises a forward viewing camera disposed at a front portion of the vehicle and viewing a ground region forward of the vehicle;

wherein, with said left-side rearward viewing camera disposed at the vehicle, said left-side rearward viewing camera views a region at least 20 meters rearward of the vehicle, and wherein, with said right-side rearward viewing camera disposed at the vehicle, said right-side rearward viewing camera views a region at least 20 meters rearward of the vehicle;

wherein, with said plurality of cameras disposed at the vehicle, the field of view of said left-side rearward viewing camera overlaps the field of view of said right-side rearward viewing camera rearward of the vehicle;

an image processor that, with said plurality of cameras disposed at the vehicle, processes image data captured by said cameras;

a display disposed in the vehicle, wherein, with said plurality of cameras disposed at the vehicle, said display displays images derived from image data captured by said plurality of cameras;

wherein, with said plurality of cameras disposed at the vehicle, said display displays a panoramic view derived from image data captured by said second rear camera, said left-side rearward viewing camera and said right-side rearward viewing camera;

wherein, with said plurality of cameras disposed at the vehicle, said display displays a surround view derived from image data captured by at least said left-side wide angle camera, said right-side wide angle camera, said first rear camera and said forward viewing camera;

wherein, with said left-side rearward viewing camera disposed at the vehicle, said left-side rearward viewing camera views a left-side blind spot region at the left side of the vehicle, and wherein the left-side blind spot region is outside the mirror-reflected rearward and sideward view provided by the left-side exterior mirror as viewed by the driver of the vehicle;

wherein, with said right-side rearward viewing camera disposed at the vehicle, said right-side rearward viewing camera views a right-side blind spot region at the right side of the vehicle, and wherein the right-side blind spot region is outside the mirror-reflected rearward and sideward view provided by the right-side exterior mirror as viewed by the driver of the vehicle; and

wherein, with said plurality of cameras disposed at the vehicle, said image processor processes image data captured by at least said left-side rearward viewing camera and said right-side rearward viewing camera to detect objects in the respective fields of view of said left-side rearward viewing camera and said right-side rearward viewing camera.

19. The vehicular vision system of claim 18, wherein, with said plurality of cameras disposed at the vehicle, and with said display displaying the surround view, (i) images derived from image data captured by said left-side wide angle camera are stitched with images derived from image data captured by said left-side rearward viewing camera, (ii) images derived from image data captured by said right-side wide angle camera are stitched with images derived from image data captured by said right-side rearward viewing camera, (iii) images derived from image data captured by said left-side rearward viewing camera are stitched with images derived from image data captured by said first rear camera, (iv) images derived from image data captured by said right-side rearward viewing camera are stitched with images derived from image data captured by said first rear camera, (v) images derived from image data captured by said left-side wide angle camera are stitched with the images derived from image data captured by said forward viewing camera, and (vi) images derived from image data captured by said right-side wide angle camera are stitched with the images derived from image data captured by said forward viewing camera.

20. The vehicular vision system of claim 18, wherein, with said plurality of cameras disposed at the vehicle, said image processor processes image data of the overlapping portions of the field of view of said left-side rearward viewing camera and the field of view of said right-side rearward viewing camera.

21. The vehicular vision system of claim 18, wherein said vehicular vision system comprises a left-side forward viewing camera having a field of view sideward and forward of the vehicle and a right-side forward viewing camera having a field of view sideward and forward of the vehicle, and wherein the field of view of said left-side forward viewing camera overlaps the field of view of said right-side forward viewing camera at a region forward of the vehicle.