Device and method for detecting and displaying the rear and/or side view of a motor vehicle

• US 8,830,319 B2
• Filed: 04/23/2009
• Issued: 09/09/2014
• Est. Priority Date: 04/29/2008
• Status: Active Grant

• Current Assignee: Magna Electronics Europe Gmbh & Co. Kg, Magna Mirrors Engineering GmbH (Magna International Incorporated)
• Original Assignee: Magna Electronics Europe Gmbh & Co. Kg, Magna Mirrors Engineering GmbH (Magna International Incorporated)
• Inventors: Stegmann, Rainer, Krebs, Peter
• Primary Examiner(s): Rao, Andy
• Assistant Examiner(s): WALKER, JARED T
• Application Number:
  US12/990,011
• Publication Number:
  US 20110043634A1
• Time in Patent Office: 1,965 Days
• Field of Search: 348/148, 348/118, 382/104
• US Class Current: 348/148
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 1/28 with an adjustable field of view
• CPC Class Codes: B60R 2300/302 combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/70 characterised by an event-triggered choice to display a specific image among a selection of captured images
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: B60R 2300/8046 for replacing a rear-view mirror system
• CPC Class Codes: B60R 2300/8066 for monitoring rearward traffic

Abstract

A device for detecting and displaying the rear and/or side traffic of a motor vehicle is to be improved upon such that the driver can safely and quickly detect the present traffic situation by way of the overall image shown, in particular when the direction of travel is changed. This is accomplished in that the device for detecting and displaying the rear and/or side view of a motor vehicle (1) comprises a first apparatus (3) for producing images of the optically detected rear view (A), one or more further apparatuses (2) for producing images of the optical side view (B,C) of the motor vehicle (1), a display apparatus (6) adapted to display images or image sections of the first and/or the further apparatuses (2, 3) in partial areas (T1, T2), and a control apparatus (5) adapted to select the images or image sections and to assign them to the partial areas (T1, T2). The images or image sections are selected according to the signals of a driving direction indicator (7) and/or the signals of a sensor (8) that represents the steering direction and are assigned to the partial areas (T1, T2). Also provided is a method for detecting and displaying an overall image from an image section or overlapping image sections.

Claims

1. A device for sensing and displaying the surroundings at the rear and sides of a motor vehicle, said device comprising:

a first apparatus for generating images of the optically sensed surroundings rearward of the motor vehicle, wherein said first apparatus comprises a first camera disposed at a rear portion of the motor vehicle, and wherein said firs camera is generally centrally located at the rear portion of the motor vehicle;

second and third apparatuses for generating images of the optical surroundings at first and second sides of the motor vehicle, respectively, wherein said second apparatus comprises a second camera disposed at an exterior rearview mirror assembly at the first side of the motor vehicle and wherein said third apparatus comprises a third camera disposed at an exterior rearview mirror assembly at the second side of the motor vehicle;

a display apparatus operable to display images generated by the first apparatus and the second and third apparatuses at respective center, first side and second side partial regions of a display screen of the display apparatus;

a control apparatus operable to select and assign the images to the respective center partial region, first side partial region and second side partial region;

wherein, during forward travel of the motor vehicle, the control apparatus is operable to vary the horizontal extents of the partial regions and respective displayed images responsive to signals of a sensor that represent the steering angle of the motor vehicle;

wherein, during forward travel of the motor vehicle, the images are selected and the images are assigned to and displayed at the respective partial regions of the display screen as a function of (i) a signal of a travel direction indicator and (ii) a signal of a sensor which represents the steering angle of the motor vehicle;

wherein, during forward travel of the motor vehicle, the horizontal extents of the partial regions are dynamically adjusted according to the steering angle in order to display a dynamic composite seamless image which is composed of image sections with dynamically adaptive horizontal extents;

wherein, during forward travel of the motor vehicle, at least the first side partial region and second side partial region are varied in their horizontal extents responsive to a change in the steering angle, and wherein the degree of variation of their horizontal extents is a function of a degree of chance in the steering angle of the motor vehicle;

wherein the displayed images at adjacent partial regions are merged together in such a way that the displayed dynamic composite seamless image has seamless transitions in the boundary regions; and

wherein, during forward travel of the motor vehicle, and as the steering angle to the first side of the motor vehicle increases, the horizontal extent of the image displayed at the first side partial region increases and the horizontal extent of the image displayed at the second side partial region decreases, and wherein the degree of variation of the horizontal extent of the images displayed at the first side partial region increases as a function of a degree of change in the steering angle of the motor vehicle and wherein the degree of variation of the horizontal extent of the images displayed at the second side partial region decreases as a function of a degree of change in the steering angle of the motor vehicle.

2. The device for sensing and displaying the surroundings at the rear and sides of a motor vehicle as claimed in claim 1, wherein the partial regions are displayed one next to the other on the display screen of the display apparatus.

3. The device for sensing and displaying the surroundings at the rear and sides of a motor vehicle as claimed in claim 1, wherein, as the steering angle to the second side of the motor vehicle increases, the horizontal extent of the image displayed at the second side partial region increases and the horizontal extent of the image displayed at the first side partial region decreases.

4. A method for sensing and displaying the surroundings at the rear and sides of a motor vehicle, said method comprising:

a first step, wherein, in the first step, images of the surroundings to the rear and sides of the motor vehicle are acquired via a central rear view sensing device and opposite side sensing devices;

a further step, wherein, in the further step, and during forward travel of the motor vehicle, one or more of the acquired images are selected and displayed on a display apparatus in partial regions;

wherein signals of a travel direction indicator and signals which represent the steering angle are acquired and the images are selected as a function of the acquired signals and the images are assigned to the partial regions;

wherein, during forward travel of the motor vehicle, the partial regions are variable in terms of their horizontal extent depending on the steering angle in order to provide a dynamic composite seamless image which is composed of images displayed at partial regions with dynamically adaptive horizontal extents, and wherein the degree of variation of the horizontal extents of the partial regions and displayed images is a function of a degree of change in the steering angle of the motor vehicle; and

wherein, during forward travel of the motor vehicle, and as the steering angle to the first side of the motor vehicle increases, the horizontal extent of the displayed image generated by said camera at a first side of the motor vehicle and its respective first side partial region increases and the horizontal extent of the displayed image generated by said camera at a second side of the motor vehicle and its respective second side partial region decreases, and wherein the degree of variation of the horizontal extent of the image displayed at the first side partial region increases as a function of a degree of change in the steering angle of the motor vehicle and wherein the degree of variation of the horizontal extent of the image displayed at the second side partial region decreases as a function of a degree of change in the steering angle of the motor vehicle.

5. The method for sensing and displaying the surroundings at the rear and sides of a motor vehicle as claimed in claim 4, wherein, in a travel situation in which the signals of the travel direction indicator indicate a neutral position and the steering angle is zero degrees, the image of the surroundings at the rear, which is generated by the central rear view sensing device, is represented in a partial region on the display apparatus, and the partial region covers the entire display apparatus.

6. The method for sensing and displaying the surroundings at the rear and sides of a motor vehicle as claimed in claim 4, wherein, in a travel situation in which the signals of the travel direction indicator indicate a change in the direction of travel towards the first side of the motor vehicle and the steering angle is zero degrees, the image of the surroundings at the first side of the motor vehicle, which is assigned to the determined direction of travel, is displayed at the first side partial region, and the image of the surroundings at the rear is displayed at another partial region.

7. The method for sensing and displaying the surroundings at the rear and sides of a motor vehicle as claimed in claim 6, wherein, in a travel situation in which signals of the steering angle which are unequal to zero degrees are sensed, the sizes of the partial regions are changed as a function of the signals of the steering angle.

8. The method for sensing and displaying the surroundings at the rear and sides of a motor vehicle as claimed in claim 4, wherein the images displayed at adjacent partial regions are joined together in such a way that they are displayed as a composite image having a seamless transition in their boundary regions.

9. The method for sensing and displaying the surroundings at the rear and sides of a motor vehicle as claimed in claim 5, wherein the images displayed at adjacent partial regions are joined together in such a way that they are displayed as a composite image having a seamless transition in their boundary regions.

10. The method for sensing and displaying the surroundings at the rear and sides of a motor vehicle as claimed in claim 6, wherein the images displayed at adjacent partial regions are joined together in such a way that they are displayed as a composite image having a seamless transition in their boundary regions.

11. The method for sensing and displaying the surroundings at the rear and sides of a motor vehicle as claimed in claim 7, wherein the images displayed at adjacent partial regions are joined together in such a way that they are displayed as a composite image having a seamless transition in their boundary regions.

17. The device for sensing and displaying the surroundings at the rear and sides of a motor vehicle as claimed in claim 4, wherein said images are displayed in a seamless fashion.

18. The device for sensing and displaying the surroundings at the rear and sides of a motor vehicle as claimed in claim 17, wherein said display apparatus is located in the front upper region of the windshield of the motor vehicle.

20. The method for sensing and displaying the surroundings at the rear and sides of a motor vehicle as claimed in claim 8, wherein said images are displayed in a seamless fashion.

21. The device for sensing and displaying the surroundings at the rear and sides of a motor vehicle as claimed in claim 17, wherein said rear image sensing camera is arranged at a region of the bumper at the rear of the motor vehicle and wherein, when the motor vehicle is traveling in the longitudinal direction with the steering angle at around zero degrees and with the travel direction indicator in its neutral central position, an image generated by said first apparatus is displayed to the driver on the display of the display apparatus, and wherein, when the travel direction indicator is activated to the right by the driver of the motor vehicle, an image generated by said first side image sensing camera integrated into the right-hand exterior mirror of the motor vehicle is displayed to the driver on the display of the display apparatus to the right of said image generated by said first apparatus, and wherein the horizontal extent of said image generated by said first side image sensing camera integrated into the right-hand exterior mirror of the motor vehicle increases as the steering angle to the right of the motor vehicle increases and wherein the horizontal extent of said image generated by said first apparatus decreases as the steering angle to the right of the motor vehicle increases.

22. The method for sensing and displaying the surroundings at the rear and sides of a motor vehicle as claimed in claim 4, wherein said display apparatus is located in the front upper region of the windshield of the motor vehicle and wherein said display apparatus comprises a part of an interior rearview mirror assembly.

12. A device for sensing and displaying the surroundings at the rear and sides of a motor vehicle, said device comprising:

a first apparatus for generating images of the optically sensed surroundings to the rear of a motor vehicle equipped with the device;

two or more further apparatuses for generating images of the optical surroundings at the sides of the motor vehicle;

a display apparatus operable to display images generated by the first apparatus and the further apparatuses in respective partial regions of a display screen of said display apparatus;

a control apparatus operation to select the images and assign them to respective partial regions;

wherein the images are selected and assigned as a function of (i) the signals of a travel direction indicator and (ii) the signals of a sensor which represent the steering angle, and wherein, during forward travel of the motor vehicle, said images and their respective partial regions are variable in terms of their horizontal extent depending on the steering angle in order to display a dynamic composite seamless image comprising image sections with dynamically adaptive horizontal extents;

wherein said first apparatus comprises a rear image sensing camera disposed at a rear portion of the motor vehicle;

wherein one of said two or more further apparatuses comprises a first side image sensing camera integrated into the right-hand exterior mirror of the motor vehicle and wherein another of said two or more further apparatuses comprises a second side image sensing camera integrated into the left-hand exterior mirror of the motor vehicle;

wherein said images assigned to a central partial region are generated by said first apparatus and wherein said images assigned to a first side partial region are generated by said first side image sensing camera and wherein said images assigned to a second side partial region are generated by said second side image sensing camera;

wherein, during forward travel of the motor vehicle, at least the first side and second side partial regions change in their horizontal extents as a function of the size of the steering angle, and wherein a degree of variation other horizontal extents is a function of a degree of change in the steering angle of the motor vehicle; and

wherein, during forward travel of the motor vehicle, and as the steering angle to the first side of the motor vehicle increases, the horizontal extent of the image generated by said first side image sensing camera and displayed at the first side partial region increases and the horizontal extent of the image generated by said second side image sensing camera and displayed at the second side partial region decrease, and wherein the degree of variation of the horizontal extent of the image displayed at the first side partial region increases as a function of a degree of change in the steering angle of the motor vehicle and wherein the degree of variation of the horizontal extent of the image displayed at the second side partial region decreases as a function of a degree of change in the steering angle of the motor vehicle.

13. The device for sensing and displaying the surroundings at the rear and sides of a motor vehicle as claimed in claim 12, wherein said rear image sensing camera is disposed at a region of the bumper at the rear of the motor vehicle.

14. The device for sensing and displaying the surroundings at the rear and sides of a motor vehicle as claimed in claim 13, wherein, when the motor vehicle is traveling in the longitudinal direction with the steering angle at around zero degrees and with the travel direction indicator in its neutral central position, an image generated by said first apparatus is displayed to the driver on the display of the display apparatus, and wherein, when the travel direction indicator is activated to the right by the driver of the motor vehicle, an image generated by said first side image sensing camera integrated into the right-hand exterior mirror of the motor vehicle is displayed to the driver on the display of the display apparatus to the right of said image generated by said first apparatus.

15. The device for sensing and displaying the surroundings at the rear and sides of a motor vehicle as claim in claim 14, wherein the horizontal extent of the displayed image generated by said first side image sensing camera integrated into the right-hand exterior mirror of the motor vehicle increases as the steering angle to the right of the motor vehicle increases.

16. The device for sensing and displaying the surroundings at the rear and sides of a motor vehicle as claimed in claim 15, wherein the horizontal extent of the image generated by said first apparatus decreases as the steering angle to the right of the motor vehicle increases.

19. The device for sensing and displaying the surroundings to the rear and/or side of a motor vehicle as claimed in claim 14, wherein said display apparatus comprises a part of an interior rearview mirror assembly.