Vehicular vision system

• US 10,315,572 B2
• Filed: 03/05/2018
• Issued: 06/11/2019
• Est. Priority Date: 05/16/2008
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Nix, Axel, Lu, Yuesheng
• Primary Examiner(s): Pham, Toan N
• Application Number:
  US15/911,454
• Publication Number:
  US 20180186289A1
• Time in Patent Office: 463 Days
• Field of Search: 340435, 3404255, 340426, 340901, 340461, 340438, 3408154, 340433, 340937, 359601, 359603, 359604, 359265, 348148, 348151
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/002 specially adapted for covering the peripheral part of the vehicle, e.g. for viewing tyres, bumpers or the like integrated in the windows B60R1/001; combined with rear-view mirrors B60R1/08
• CPC Class Codes: B60R 1/28 with an adjustable field of view
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/207 using multi-purpose displays, e.g. camera image and navigation or video on same display
• CPC Class Codes: B60R 2300/806 for aiding parking
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 5/268 Signal distribution or switching
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A vehicular vision system includes a plurality of cameras mounted at the vehicle and having respective fields of view exterior of the vehicle. The cameras include a video output for transmitting a stream of video to a control via a serial data bus linking the respective camera to the control. The control includes a serial data interface for communication with at least one electronic device of the vehicle. The control sends instructions to the cameras via the respective serial data bus linking the camera to the control. The control activates one of the cameras and deactivates at least one other of the cameras responsive to (i) a user input and/or (ii) a driving condition. Video images derived at least in part from image data captured by the activated camera are displayed at a video display screen of the vehicle for viewing by a driver of the vehicle.

Claims

1. A vehicular vision system, said vehicular vision system comprising:

a plurality of cameras mounted at a vehicle equipped with said vehicular vision system;

wherein said plurality of cameras comprises a rear-mounted camera mounted at a rear portion of the equipped vehicle;

said rear-mounted camera comprising an image sensor;

said rear-mounted camera having a field of view at least rearward of the equipped vehicle;

wherein said plurality of cameras comprises a driver side-mounted camera mounted at a driver side portion of the equipped vehicle;

said driver side-mounted camera comprising an image sensor;

said driver side-mounted camera having a field of view at least sideward of the driver side of the equipped vehicle;

wherein said plurality of cameras comprises a passenger side-mounted camera mounted at a passenger-side portion of the equipped vehicle;

said passenger side-mounted camera comprising an image sensor;

said passenger side-mounted camera having a field of view at least sideward of the passenger side of the equipped vehicle;

a control;

said rear-mounted camera comprising a video output configured for transmitting to said control a stream of video captured by the image sensor of said rear- mounted camera;

said driver side-mounted camera comprising a video output configured for transmitting to said control a stream of video captured by the image sensor of said driver side-mounted camera;

said passenger side-mounted camera comprising a video output configured for transmitting to said control a stream of video captured by the image sensor of said passenger side-mounted camera;

wherein the stream of video captured by the image sensor of said rear-mounted camera is transmitted to said control via a serial data bus linking said rear-mounted camera to said control;

wherein the stream of video captured by the image sensor of said driver side-mounted camera is transmitted to said control via a serial data bus linking said driver side-mounted camera to said control;

wherein the stream of video captured by the image sensor of said passenger side-mounted camera is transmitted to said control via a serial data bus linking said passenger side-mounted camera to said control;

said control comprising a serial data interface for communication with at least one electronic device of the equipped vehicle;

wherein said control sends instructions to said rear-mounted camera of the equipped vehicle via said serial data bus linking said rear-mounted camera to said control;

wherein said control sends instructions to said driver side-mounted camera of the equipped vehicle via said serial data bus linking said driver side-mounted camera to said control;

wherein said control sends instructions to said passenger side-mounted camera of the equipped vehicle via said serial data bus linking said passenger side-mounted camera to said control;

wherein said control activates one camera of said plurality of cameras and deactivates at least one of the other cameras of said plurality of cameras responsive to at least one of (i) a user input and (ii) a driving condition; and

wherein video images derived at least in part from image data captured by the activated one camera of said plurality of cameras are displayed at a video display screen of the equipped vehicle for viewing by a driver of the equipped vehicle.

2. The vehicular vision system of claim 1, wherein said control receives signals from the at least one electronic device of the equipped vehicle via said serial data interface.

3. The vehicular vision system of claim 1, wherein said serial data bus linking said rear-mounted camera to said control comprises an Ethernet bus, and wherein said serial data bus linking said driver side-mounted camera to said control comprises an Ethernet bus, and wherein said serial data bus linking said passenger side-mounted camera to said control comprises an Ethernet bus.

4. The vehicular vision system of claim 1, wherein said control at least one of (i) activates said driver side-mounted camera via instructions sent via said serial data bus linking said driver side-mounted camera to said control and (ii) deactivates said driver side-mounted camera via instructions via said serial data bus linking said driver side-mounted camera to said control.

5. The vehicular vision system of claim 1, wherein said control activates the one camera of said plurality of cameras and deactivates the at least one of the other cameras of said plurality of cameras responsive to a signal received at said serial data interface.

6. The vehicular vision system of claim 5, wherein said signal received at said serial data interface provides information pertaining to at least one of (i) gear position, (ii) steering angle, (iii) parking orientation information, (iv) information derived from an image processing system, (v) information derived from a radar sensor system, (vi) information derived from an ultrasonic sensor system and (vii) information derived from a LIDAR sensor system.

7. The vehicular vision system of claim 6, wherein said serial data interface comprises an Ethernet interface.

8. The vehicular vision system of claim 6, wherein said serial data interface comprises a CAN interface.

9. The vehicular vision system of claim 1, wherein said control activates one camera of said plurality of cameras and deactivates at least one of the other cameras of said plurality of cameras responsive to a user input, and wherein the user input comprises a camera selection user input of the equipped vehicle that generates a signal responsive to actuation by a user of the camera selection user input.

10. The vehicular vision system of claim 9, wherein the camera selection user input of the equipped vehicle selects display at said video display screen of the equipped vehicle of video images derived, at least in part, from the stream of video captured by the image sensor of the selected and activated one camera of said plurality of cameras that is transmitted to said control via said serial data bus linking the selected and activated one camera of said plurality of cameras to said control.

11. The vehicular vision system of claim 10, wherein the camera selection user input comprises a user selectable menu in a cabin of the equipped vehicle that is actuatable by the user of the equipped vehicle to select which camera of said plurality of cameras to activate.

12. The vehicular vision system of claim 1, wherein said control activates one camera of said plurality of cameras and deactivates at least one of the other cameras of said plurality of cameras responsive to a driving condition.

13. The vehicular vision system of claim 12, wherein said control determines which camera of said plurality of cameras of the equipped vehicle to activate based on the driving condition.

14. The vehicular vision system of claim 13, wherein the driving condition is associated with a least one of (i) gear position of a gear of the equipped vehicle, (ii) steering angle of the equipped vehicle, (iii) parking of the equipped vehicle, (iv) image processing of captured image data, (v) processing of radar data sensed by a radar sensor system of the equipped vehicle, (vi) processing of ultrasonic data sensed by an ultrasonic sensor system of the equipped vehicle and (vii) processing of LIDAR data sensed by a LIDAR sensor system of the equipped vehicle.

15. A vehicular vision system, said vehicular vision system comprising:

a plurality of cameras mounted at a vehicle equipped with said vehicular vision system;

wherein said plurality of cameras comprises a rear-mounted camera mounted at a rear portion of the equipped vehicle;

said rear-mounted camera comprising an image sensor;

said rear-mounted camera having a field of view at least rearward of the equipped vehicle;

wherein said plurality of cameras comprises a driver side-mounted camera mounted at a driver-side portion of the equipped vehicle;

said driver side-mounted camera comprising an image sensor;

said driver side-mounted camera having a field of view at least sideward of the driver side of the equipped vehicle;

wherein said plurality of cameras comprises a passenger side-mounted camera mounted at a passenger-side portion of the equipped vehicle;

said passenger side-mounted camera comprising an image sensor;

said passenger side-mounted camera having a field of view at least sideward of the passenger side of the equipped vehicle;

a control;

said rear-mounted camera comprising a video output configured for transmitting to said control a stream of video captured by the image sensor of said rear-mounted camera;

said driver side-mounted camera comprising a video output configured for transmitting to said control a stream of video captured by the image sensor of said driver side-mounted camera;

said passenger side-mounted camera comprising a video output configured for transmitting to said control a stream of video captured by the image sensor of said passenger side-mounted camera;

wherein the stream of video captured by the image sensor of said rear-mounted camera is transmitted to said control via a serial data bus linking said rear-mounted camera to said control;

wherein said serial data bus linking said rear-mounted camera to said control comprises an Ethernet bus;

wherein the stream of video captured by the image sensor of said driver side-mounted camera is transmitted to said control via a serial data bus linking said driver side-mounted camera to said control;

wherein said serial data bus linking said driver side-mounted camera to said control comprises an Ethernet bus;

wherein the stream of video captured by the image sensor of said passenger side-mounted camera is transmitted to said control via a serial data bus linking said passenger side-mounted camera to said control;

wherein said serial data bus linking said passenger side-mounted camera to said control comprises an Ethernet bus;

said control comprising a serial data interface for communication with at least one electronic device of the equipped vehicle;

wherein said control receives signals from the at least one electronic device of the equipped vehicle via said serial data interface;

wherein said control sends instructions to said rear-mounted camera of the equipped vehicle via said serial data bus linking said rear-mounted camera to said control;

wherein said control sends instructions to said driver side-mounted camera of the equipped vehicle via said serial data bus linking said driver side-mounted camera to said control;

wherein said control sends instructions to said passenger side-mounted camera of the equipped vehicle via said serial data bus linking said passenger side-mounted camera to said control;

wherein said control activates one camera of said plurality of cameras and deactivates at least one of the other cameras of said plurality of cameras responsive to at least one of (i) a user input and (ii) a driving condition; and

wherein video images derived at least in part from image data captured by the activated one camera of said plurality of cameras are displayed at a video display screen of the equipped vehicle for viewing by a driver of the equipped vehicle.

16. The vehicular vision system of claim 15, wherein said control at least one of (i) activates said driver side-mounted camera via instructions sent via said serial data bus linking said driver side-mounted camera to said control and (ii) deactivates said driver side-mounted camera via instructions via said serial data bus linking said driver side-mounted camera to said control.

17. The vehicular vision system of claim 15, wherein said control activates one camera of said plurality of cameras and deactivates at least one of the other cameras of said plurality of cameras responsive to a driving condition, and wherein the driving condition is associated with a least one of (i) gear position of the equipped vehicle, (ii) steering angle of the equipped vehicle, (iii) parking of the equipped vehicle, (iv) image processing of captured image data, (v) processing of radar data sensed by a radar sensor system of the equipped vehicle, (vi) processing of ultrasonic data sensed by an ultrasonic sensor system of the equipped vehicle and (vii) processing of LIDAR data sensed by a LIDAR sensor system of the equipped vehicle.

18. A vehicular vision system, said vehicular vision system comprising:

a plurality of cameras mounted at a vehicle equipped with said vehicular vision system;

wherein said plurality of cameras comprises a rear-mounted camera mounted at a rear portion of the equipped vehicle;

said rear-mounted camera comprising an image sensor;

said rear-mounted camera having a field of view at least rearward of the equipped vehicle;

wherein said plurality of cameras comprises a driver side-mounted camera mounted at a driver-side portion of the equipped vehicle;

said driver side-mounted camera comprising an image sensor;

said driver side-mounted camera having a field of view at least sideward of the driver side of the equipped vehicle;

wherein said plurality of cameras comprises a passenger side-mounted camera mounted at a passenger-side portion of the equipped vehicle;

said passenger side-mounted camera comprising an image sensor;

said passenger side-mounted camera having a field of view at least sideward of the passenger side of the equipped vehicle;

a control;

said rear-mounted camera comprising a video output configured for transmitting to said control a stream of video captured by the image sensor of said rear-mounted camera;

said driver side-mounted camera comprising a video output configured for transmitting to said control a stream of video captured by the image sensor of said driver side-mounted camera;

said passenger side-mounted camera comprising a video output configured for transmitting to said control a stream of video captured by the image sensor of said passenger side-mounted camera;

wherein the stream of video captured by the image sensor of said rear-mounted camera is transmitted to said control via a serial data bus linking said rear-mounted camera to said control;

wherein the stream of video captured by the image sensor of said driver side-mounted camera is transmitted to said control via a serial data bus linking said driver side-mounted camera to said control;

wherein the stream of video captured by the image sensor of said passenger side-mounted camera is transmitted to said control via a serial data bus linking said passenger side-mounted camera to said control;

said control comprising a serial data interface for communication with at least one electronic device of the equipped vehicle;

wherein said control sends instructions to said rear-mounted camera of the equipped vehicle via said serial data bus linking said rear-mounted camera to said control;

wherein said control sends instructions to said driver side-mounted camera of the equipped vehicle via said serial data bus linking said driver side-mounted camera to said control;

wherein said control sends instructions to said passenger side-mounted camera of the equipped vehicle via said serial data bus linking said passenger side-mounted camera to said control;

wherein said control activates one camera of said plurality of cameras and deactivates at least one of the other cameras of said plurality of cameras responsive to a user input;

wherein video images derived at least in part from image data captured by the activated one camera of said plurality of cameras are displayed at a video display screen of the equipped vehicle for viewing by a driver of the equipped vehicle; and

wherein said control activates the one camera of said plurality of cameras and deactivates the at least one of the other cameras of said plurality of cameras responsive to a signal received at said serial data interface.

19. The vehicular vision system of claim 18, wherein the signal received at said serial data interface provides information pertaining to the group consisting of (i) gear position of the equipped vehicle, (ii) steering angle of the equipped vehicle, (iii) parking of the equipped vehicle, (iv) information derived from an image processing system of the equipped vehicle, (v) information derived from a radar sensor system of the equipped vehicle, (vi) information derived from an ultrasonic sensor system of the equipped vehicle and (vii) information derived from a LIDAR sensor system of the equipped vehicle.

20. The vehicular vision system of claim 18, wherein the user input comprises a camera selection user input of the equipped vehicle that generates a signal responsive to actuation by a user of the camera selection user input, and wherein actuation by the user of the camera selection user input of the equipped vehicle selects display at said video display screen of the equipped vehicle of video images derived, at least in part, from a stream of video captured by the image sensor of the selected and activated one camera of said plurality of cameras that is transmitted to said control via said serial data bus linking the selected and activated one camera of said plurality of cameras to said control.

21. The vehicular vision system of claim 20, wherein said camera selection user input comprises a user selectable menu in a cabin of the equipped vehicle that is actuatable by the user of the equipped vehicle to select which camera of said plurality of cameras to activate.