VEHICULAR CAMERA MONITORING SYSTEM

• US 20170166130A1
• Filed: 02/27/2017
• Published: 06/15/2017
• Est. Priority Date: 08/09/2007
• Status: Active Grant

• Current Assignee: Donnelly Corporation (Magna International Incorporated)
• Original Assignee: Donnelly Corporation (Magna International Incorporated)
• Inventors: Lynam, Niall R., Foote, Keith D., Benthem, Kevin P.
• Granted Patent: US 10,793,068 B2
• Time in Patent Office: Days
• CPC Class Codes: B60K 2360/143 Touch sensitive instrument input devices
• CPC Class Codes: B60K 2360/173 Reversing assist
• CPC Class Codes: B60K 2360/21 using cameras
• CPC Class Codes: B60K 2360/777 on or in sun visors
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/22 Display screens
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60K 35/60 Instruments characterised by their location or relative disposition in or on vehicles arrangements of lighting devices on dashboards B60Q3/10
• CPC Class Codes: B60Q 1/2665 on rear-view mirrors lighting devices for vehicle interior on or for rear-view mirrors B60Q3/258
• CPC Class Codes: B60Q 1/2696 Mounting of devices using LEDs
• CPC Class Codes: B60Q 1/34 for indicating change of drive direction B60Q1/22 takes precedence
• CPC Class Codes: B60R 1/04 mounted inside vehicle B60R1/025, B60R1/08 take precedence
• CPC Class Codes: B60R 1/0602 comprising means for cleaning or deicing
• CPC Class Codes: B60R 1/062 with remote control for adjusting position B60R1/0607 takes precedence
• CPC Class Codes: B60R 1/082 using a single wide field mirror or an association of rigidly connected mirrors
• CPC Class Codes: B60R 1/083 Anti-glare mirrors, e.g. "day-night" mirrors
• CPC Class Codes: B60R 1/12 Mirror assemblies combined with other articles, e.g. clocks
• CPC Class Codes: B60R 1/1207 with lamps; with turn indicators
• CPC Class Codes: B60R 2001/1215 with information displays
• CPC Class Codes: B60R 2001/123 : with thermometers
• CPC Class Codes: B60R 2001/1246 : with clocks
• CPC Class Codes: B60R 2001/1253 : with cameras, video cameras or video screens
• CPC Class Codes: B60R 2001/1284 : with communication systems other than radio-receivers, e.g. keyless entry systems, navigation systems; with anti-collision systems
• CPC Class Codes: B60R 2300/105 : using multiple cameras
• CPC Class Codes: B60R 2300/207 : using multi-purpose displays, e.g. camera image and navigation or video on same display
• CPC Class Codes: B60R 2300/8026 : in addition to a rear-view mirror system
• CPC Class Codes: B60R 2300/804 : for lane monitoring
• CPC Class Codes: B60R 2300/806 : for aiding parking
• CPC Class Codes: B60R 2300/8066 : for monitoring rearward traffic
• CPC Class Codes: B62D 1/046 : Adaptations on rotatable parts of the steering wheel for accommodation of switches
• CPC Class Codes: G06V 20/56 : exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: H04N 23/63 : by using electronic viewfinders
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/188 : Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253

Abstract

A camera monitoring system for a vehicle includes an interior rearview mirror assembly with a video display screen disposed behind the interior mirror reflective element. The video display screen is operable to display video images derived at least in part from image data captured by at least one video camera of a plurality of video cameras of the equipped vehicle. Image data captured by at least a driver-side viewing video camera and a passenger-side viewing video camera is provided to an image processor and is processed by the image processor to detect vehicles present exterior of the equipped vehicle. Responsive at least in part to detection of another vehicle, video images derived at least in part from image data captured by the driver-side viewing video camera, a rear viewing video camera and/or the passenger-side viewing video camera are displayed by the video display screen.

Claims

1. A camera monitoring system for a vehicle, said camera monitoring system comprising:

an interior rearview mirror assembly configured for mounting at an interior portion of a vehicle equipped with said camera monitoring system;

said interior rearview mirror assembly comprising an interior mirror reflective element having a front side and a rear side;

wherein, when said interior rearview mirror assembly is mounted at the interior portion of the equipped vehicle, the front side of the interior mirror reflective element is closer to a driver of the equipped vehicle who views the interior mirror reflective element than is the rear side of the interior mirror reflective element;

wherein a video display screen is disposed behind the rear side of the interior mirror reflective element;

wherein the interior mirror reflective element comprises a transflective mirror reflector that is partially transmissive and partially reflective, so that light emanating from the video display screen disposed behind the rear side of the interior mirror reflective element when the video display screen is activated to display video images is transmitted through the transflective mirror reflector of the interior mirror reflective element;

wherein, when the video display screen is not activated to display video images, the presence of the video display screen disposed behind the rear side of the interior mirror reflective element is covert to the driver of the equipped vehicle viewing the interior mirror reflective element;

wherein the video display screen is operable to display video images derived at least in part from image data captured by at least one video camera of a plurality of video cameras of the equipped vehicle;

wherein said plurality of video cameras comprises at least (i) a driver-side viewing video camera disposed in a driver-side exterior mirror assembly that is attached at a driver-side portion of the equipped vehicle, said driver-side viewing video camera having a field of view at least rearward and sideward of the equipped vehicle and operable to capture image data, (ii) a rear viewing video camera that is attached at a rear portion of the equipped vehicle, said rear viewing video camera having a field of view at least rearward of the equipped vehicle and operable to capture image data, and (iii) a passenger-side viewing video camera disposed in a passenger-side exterior mirror assembly that is attached at a passenger-side portion of the equipped vehicle, said passenger-side viewing video camera having a field of view at least rearward and sideward of the equipped vehicle and operable to capture image data;

wherein at least said driver-side viewing video camera and said passenger-side viewing video camera of said plurality of video cameras are components of a camera-based sensing system of the equipped vehicle;

wherein said camera-based sensing system comprises an image processor;

wherein image data captured by at least said driver-side viewing video camera and said passenger-side viewing video camera is provided to said image processor and is processed by said image processor to detect vehicles present exterior of the equipped vehicle; and

wherein, responsive at least in part to detection by said camera-based sensing system of a vehicle present exterior of the equipped vehicle, video images derived at least in part from image data captured by at least one of said driver-side viewing video camera, said rear viewing video camera and said passenger-side viewing video camera are displayed by the video display screen disposed behind the rear side of the interior mirror reflective element.

2. The camera monitoring system of claim 1, wherein, when the equipped vehicle is changing lanes, video images derived at least in part from image data captured by at least one of said driver-side viewing video camera and said passenger-side viewing video camera are displayed by the video display screen disposed behind the rear side of the interior mirror reflective element.

3. The camera monitoring system of claim 2, wherein video images derived at least in part from image data captured by one of said driver-side viewing video camera and said passenger-side viewing video camera are displayed by the video display screen disposed behind the rear side of the interior mirror reflective element upon actuation of a turn signal indicator of the equipped vehicle.

4. The camera monitoring system of claim 3, wherein video images derived at least in part from image data captured by the one of said driver-side viewing video camera and said passenger-side viewing video camera cease being displayed by the video display screen disposed behind the rear side of the interior mirror reflective element after deactuation of the turn signal indicator.

5. The camera monitoring system of claim 3, wherein video images derived at least in part from image data captured by the one of said driver-side viewing video camera and said passenger-side viewing video camera cease being displayed by the video display screen disposed behind the rear side of the interior mirror reflective element within 10 seconds after deactuation of the turn signal indicator.

6. The camera monitoring system of claim 2, wherein video images derived at least in part from image data captured by the at least one of said driver-side viewing video camera and said passenger-side viewing video camera cease being displayed by the video display screen disposed behind the rear side of the interior mirror reflective element after a period of time.

7. The camera monitoring system of claim 1, wherein said image processor comprises an image processing chip that utilizes object detection software to analyze captured image data to detect vehicles within the field of view of at least one of said driver-side viewing video camera and said passenger-side viewing video camera.

8. The camera monitoring system of claim 1, wherein the equipped vehicle comprises a front viewing camera that is attached at a front portion of the equipped vehicle, said front viewing camera having a field of view at least forward of the equipped vehicle and operable to capture image data, and wherein said image processor processes image data captured by said front viewing camera for a driver assistance system of the equipped vehicle, said driver assistance system comprising at least one of (i) an automatic headlamp control system of the equipped vehicle, (ii) a lane departure warning system of the equipped vehicle and (iii) a traffic sign recognition system of the equipped vehicle.

9. The camera monitoring system of claim 1, wherein said driver-side viewing video camera is disposed in a driver-side exterior mirror assembly that comprises (i) a driver-side exterior mirror reflective element and (ii) a fixed portion that is fixed relative to the equipped vehicle when said driver-side exterior mirror assembly is attached at the driver-side portion of the equipped vehicle, and wherein said driver-side viewing video camera is fixedly mounted in the fixed portion of said driver-side exterior mirror assembly so as to have a desired at least rearward and sideward field of view at the side of the equipped vehicle to which said driver-side exterior mirror assembly is attached.

10. The camera monitoring system of claim 1, wherein said driver-side viewing video camera is fixedly mounted in said driver-side exterior mirror assembly so as to have a desired at least rearward and sideward field of view at the side of the equipped vehicle to which said driver-side exterior mirror assembly is attached, and wherein said passenger-side viewing video camera is fixedly mounted in said passenger-side exterior mirror assembly so as to have a desired at least rearward and sideward field of view at the side of the equipped vehicle to which said passenger-side exterior mirror assembly is attached.

11. The camera monitoring system of claim 10, wherein said driver-side viewing video camera is disposed in a driver-side exterior mirror assembly that comprises a driver-side exterior mirror reflective element, and wherein said driver-side exterior mirror reflective element comprises (a) a principal mirror element, said principal mirror element comprising a glass substrate and a first reflector coating disposed at a surface of said glass substrate to establish a principal reflector portion of said driver-side exterior mirror reflective element, and (b) a wide angle mirror element, said wide angle mirror element comprising (i) a glass element having a second reflector coating disposed at a surface of said glass element to establish an auxiliary reflector portion of said driver-side exterior mirror reflective element, and (ii) an illumination element comprising an illumination source, and wherein said illumination element at least partially circumscribes said glass element of said wide angle mirror element, and wherein said illumination source comprises at least one light emitting diode, and wherein said illumination element, when said illumination source is activated, emits illumination at least partially around said glass element that is viewable by a person viewing said driver-side exterior mirror assembly equipped with said driver-side exterior mirror reflective element when said driver-side exterior mirror assembly is disposed at the driver side of the equipped vehicle, and wherein said wide angle mirror element is disposed at an upper outboard portion of said driver-side exterior mirror reflective element when said driver-side exterior mirror assembly is disposed at the driver side of the equipped vehicle, and wherein said glass element of said wide angle mirror element is adhered at a rear side of said glass substrate via an optical adhesive, and wherein said optical adhesive has an index of refraction that is substantially similar to a refractive index of said glass substrate, and wherein said first reflector coating comprises a different material than said second reflector coating, and wherein at least one of (i) said illumination element, responsive to determination that an ambient light level is below a threshold level, is operable to provide a light level that is less than 100 candelas per square meter, and (ii) said illumination element, responsive to determination that an ambient light level is above a threshold level, is operable to provide a light level that is greater than 200 candelas per square meter.

12. The camera monitoring system of claim 1, wherein the video display screen disposed behind the rear side of the interior mirror reflective element encompasses the entirety of the interior mirror reflective element.

13. The camera monitoring system of claim 1, wherein the video display screen disposed behind the rear side of the interior mirror reflective element encompasses substantially the entirety of the interior mirror reflective element.

14. The camera monitoring system of claim 1, wherein said driver-side viewing video camera is disposed in a driver-side exterior mirror assembly that comprises a driver-side exterior mirror reflective element, and wherein said driver-side exterior mirror reflective element is adjustable when said driver-side exterior mirror assembly is attached at the driver-side portion of the equipped vehicle, and wherein said driver-side viewing video camera adjusts in response to adjustment of said driver-side exterior mirror reflective element when the equipped vehicle adjusts said driver-side exterior mirror reflective element to adjust the rearward field of view of said driver-side exterior mirror reflective element.

15. The camera monitoring system of claim 14, wherein said driver-side exterior mirror reflective element comprises an electrochromic driver-side exterior mirror reflective element.

16. A camera monitoring system for a vehicle, said camera monitoring system comprising:

an interior rearview mirror assembly configured for mounting at an interior portion of a vehicle equipped with said camera monitoring system;

said interior rearview mirror assembly comprising an interior mirror reflective element having a front side and a rear side;

wherein, when said interior rearview mirror assembly is mounted at the interior portion of the equipped vehicle, the front side of the interior mirror reflective element is closer to a driver of the equipped vehicle who views the interior mirror reflective element than is the rear side of the interior mirror reflective element;

wherein a video display screen is disposed behind the rear side of the interior mirror reflective element;

wherein the interior mirror reflective element comprises a transflective mirror reflector that is partially transmissive and partially reflective, so that light emanating from the video display screen disposed behind the rear side of the interior mirror reflective element when the video display screen is activated to display video images is transmitted through the transflective mirror reflector of the interior mirror reflective element;

wherein, when the video display screen is not activated to display video images, the presence of the video display screen disposed behind the rear side of the interior mirror reflective element is covert to the driver of the equipped vehicle viewing the interior mirror reflective element;

wherein the video display screen is operable to display video images derived at least in part from image data captured by at least one video camera of a plurality of video cameras of the equipped vehicle;

wherein said plurality of video cameras comprises at least (i) a driver-side viewing video camera disposed in a driver-side exterior mirror assembly that is attached at a driver-side portion of the equipped vehicle, said driver-side viewing video camera having a field of view at least rearward and sideward of the equipped vehicle and operable to capture image data, (ii) a rear viewing video camera that is attached at a rear portion of the equipped vehicle, said rear viewing video camera having a field of view at least rearward of the equipped vehicle and operable to capture image data, and (iii) a passenger-side viewing video camera disposed in a passenger-side exterior mirror assembly that is attached at a passenger-side portion of the equipped vehicle, said passenger-side viewing video camera having a field of view at least rearward and sideward of the equipped vehicle and operable to capture image data;

wherein video images derived at least in part from image data captured by said rear viewing video camera are displayed by the video display screen disposed behind the rear side of the interior mirror reflective element; and

wherein, responsive at least in part to a detection system of the equipped vehicle detecting the presence of a vehicle in a lane adjacent to the equipped vehicle, video images derived at least in part from image data captured by at least one of said driver-side viewing video camera and said passenger-side viewing video camera are displayed by the video display screen disposed behind the rear side of the interior mirror reflective element.

17. The camera monitoring system of claim 16, wherein said detection system of the equipped vehicle comprises a camera-based sensing system, and wherein said camera-based sensing system comprises an image processor, and wherein image data captured by at least one of said driver-side viewing video camera, said rear viewing video camera and said passenger-side viewing video camera is provided to said image processor and is processed by said image processor to detect vehicles present exterior of the equipped vehicle.

18. The camera monitoring system of claim 17, wherein image data captured by said driver-side viewing video camera and by said passenger-side viewing video camera is provided to said image processor and is processed by said image processor to detect vehicles present exterior of the equipped vehicle.

19. The camera monitoring system of claim 16, wherein said driver-side viewing video camera is fixedly mounted in said driver-side exterior mirror assembly so as to have a desired at least rearward and sideward field of view at the side of the equipped vehicle to which said driver-side exterior mirror assembly is attached, and wherein said passenger-side viewing video camera is fixedly mounted in said passenger-side exterior mirror assembly so as to have a desired at least rearward and sideward field of view at the side of the equipped vehicle to which said passenger-side exterior mirror assembly is attached.

20. The camera monitoring system of claim 16, wherein, when the equipped vehicle is changing lanes, video images derived at least in part from image data captured by at least one of said driver-side viewing video camera and said passenger-side viewing video camera are displayed by the video display screen disposed behind the rear side of the interior mirror reflective element.

21. The camera monitoring system of claim 16, wherein said detection system of the equipped vehicle comprises a radar detection system.

22. The camera monitoring system of claim 16, wherein said driver-side viewing video camera is disposed in a driver-side exterior mirror assembly that comprises a driver-side exterior mirror reflective element, and wherein said driver-side exterior mirror reflective element is adjustable when said driver-side exterior mirror assembly is attached at the driver-side portion of the equipped vehicle, and wherein said driver-side viewing video camera adjusts in response to adjustment of said driver-side exterior mirror reflective element when the equipped vehicle adjusts said driver-side exterior mirror reflective element to adjust the rearward field of view of said driver-side exterior mirror reflective element.

23. A camera monitoring system for a vehicle, said camera monitoring system comprising:

an interior rearview mirror assembly configured for mounting at an interior portion of a vehicle equipped with said camera monitoring system;

said interior rearview mirror assembly comprising an interior electrochromic mirror reflective element having a front side and a rear side;

wherein, when said interior rearview mirror assembly is mounted at the interior portion of the equipped vehicle, the front side of the interior electrochromic mirror reflective element is closer to a driver of the equipped vehicle who views the interior electrochromic mirror reflective element than is the rear side of the interior electrochromic mirror reflective element;

wherein a video display screen is disposed behind the rear side of the interior electrochromic mirror reflective element;

wherein the interior electrochromic mirror reflective element comprises a transflective mirror reflector that is partially transmissive and partially reflective, so that light emanating from the video display screen disposed behind the rear side of the interior electrochromic mirror reflective element when the video display screen is activated to display video images is transmitted through the transflective mirror reflector of the interior electrochromic mirror reflective element;

wherein, when the video display screen is not activated to display video images, the presence of the video display screen disposed behind the rear side of the interior electrochromic mirror reflective element is covert to the driver of the equipped vehicle viewing the interior electrochromic mirror reflective element;

wherein the video display screen is operable to display video images derived at least in part from image data captured by at least one video camera of a plurality of video cameras of the equipped vehicle;

wherein said plurality of video cameras comprises at least (i) a driver-side viewing video camera disposed in a driver-side exterior mirror assembly that is attached at a driver-side portion of the equipped vehicle, said driver-side viewing video camera having a field of view at least rearward and sideward of the equipped vehicle and operable to capture image data, and (ii) a passenger-side viewing video camera disposed in a passenger-side exterior mirror assembly that is attached at a passenger-side portion of the equipped vehicle, said passenger-side viewing video camera having a field of view at least rearward and sideward of the equipped vehicle and operable to capture image data;

wherein said driver-side viewing video camera is mounted in said driver-side exterior mirror assembly so as to have a desired at least rearward and sideward field of view at the side of the equipped vehicle to which said driver-side exterior mirror assembly is attached, and wherein said passenger-side viewing video camera is mounted in said passenger-side exterior mirror assembly so as to have a desired at least rearward and sideward field of view at the side of the equipped vehicle to which said passenger-side exterior mirror assembly is attached; and

wherein, responsive at least in part to a detection system of the equipped vehicle detecting the presence of a vehicle in a lane adjacent to the equipped vehicle, video images derived at least in part from image data captured by at least one of said driver-side viewing video camera and said passenger-side viewing video camera are displayed by the video display screen disposed behind the rear side of the interior electrochromic mirror reflective element.

24. The camera monitoring system of claim 23, wherein said detection system of the equipped vehicle comprises a camera-based sensing system and wherein said camera-based sensing system comprises an image processor, and wherein image data captured by at least said driver-side viewing video camera and said passenger-side viewing video camera is provided to said image processor and is processed by said image processor to detect vehicles present exterior of the equipped vehicle.

25. The camera monitoring system of claim 24, wherein said driver-side viewing video camera is fixedly mounted in said driver-side exterior mirror assembly so as to have a desired at least rearward and sideward field of view at the side of the equipped vehicle to which said driver-side exterior mirror assembly is attached, and wherein said passenger-side viewing video camera is fixedly mounted in said passenger-side exterior mirror assembly so as to have a desired at least rearward and sideward field of view at the side of the equipped vehicle to which said passenger-side exterior mirror assembly is attached.

26. The camera monitoring system of claim 23, wherein said detection system of the equipped vehicle comprises a radar detection system.

27. The camera monitoring system of claim 23, wherein said driver-side viewing video camera is disposed in a driver-side exterior mirror assembly that comprises a driver-side exterior mirror reflective element, and wherein said driver-side exterior mirror reflective element is adjustable when said driver-side exterior mirror assembly is attached at the driver-side portion of the equipped vehicle, and wherein said driver-side viewing video camera adjusts in response to adjustment of said driver-side exterior mirror reflective element when the equipped vehicle adjusts said driver-side exterior mirror reflective element to adjust the rearward field of view of said driver-side exterior mirror reflective element.

28. The camera monitoring system of claim 23, wherein the video display screen disposed behind the rear side of the interior electrochromic mirror reflective element encompasses the entirety of the interior electrochromic mirror reflective element.

29. The camera monitoring system of claim 23, wherein the video display screen disposed behind the rear side of the interior electrochromic mirror reflective element encompasses substantially the entirety of the interior electrochromic mirror reflective element.

30. The camera monitoring system of claim 23, wherein said plurality of video cameras comprises a rear viewing video camera that is attached at a rear portion of the equipped vehicle, said rear viewing video camera having a field of view at least rearward of the equipped vehicle and operable to capture image data, and wherein video images derived at least in part from image data captured by said rear viewing video camera are displayed by the video display screen disposed behind the rear side of the interior electrochromic mirror reflective element.

31. The camera monitoring system of claim 30, wherein, when the equipped vehicle is changing lanes, video images derived at least in part from image data captured by at least one of said driver-side viewing video camera and said passenger-side viewing video camera are displayed by the video display screen disposed behind the rear side of the interior mirror reflective element.