Vehicle side and rear monitoring system with fail-safe function and method thereof

• US 10,106,085 B2
• Filed: 10/19/2016
• Issued: 10/23/2018
• Est. Priority Date: 12/11/2015
• Status: Active Grant

• Current Assignee: Hyundai Motor Company (Hyundai Motor Group), Kia Motors Corporation (Kia Corp.), SL Corporation
• Original Assignee: Hyundai Motor Company (Hyundai Motor Group), Kia Motors Corporation (Kia Corp.), SL Corporation
• Inventors: Kim, Hyun Sub, Lim, Keun Sig, Choi, Chan Mook, Kim, Chang Ju, Kang, Dong Uk, Kwon, Seok Keon
• Primary Examiner(s): Shibru, Helen
• Application Number:
  US15/297,224
• Publication Number:
  US 20170166129A1
• Time in Patent Office: 734 Days
• Field of Search: 348148, 701 41, 701 43, 701 53, 701 65, 701 76
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/30 characterised by the type of image processing
• CPC Class Codes: B60R 2300/607 from a bird's eye viewpoint
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle

Abstract

A vehicle side and rear monitoring system with a fail-safe function and a method thereof are provided. The system provides a fail-safe function for safe driving of a vehicle when an abnormality occurs in a side monitoring system of the vehicle, and a technique that provides a continuous side field of view of the vehicle when an abnormality occurs in the side monitoring system in the vehicle equipped with an AVM system. In addition, the system and provides a technique that corrects the distortion of an image captured by an AVM camera and performs an image rotation transformation to provide the image captured by the AVM camera at the same angle as that provided by side-view cameras. Therefore, when an abnormality occurs in the side monitoring system, the vehicle side and rear monitoring system with a fail-safe function continuously provides the same image as captured by the side-view cameras.

Claims

1. A vehicle side and rear monitoring system with a fail-safe function, comprising:

first connection units including imaging device controllers connected to side-view imaging devices of a vehicle, the imaging device controllers display a side-view image captured by the side-view imaging devices on side-view monitors disposed at a side within the vehicle; and

a second connection unit including a controller connected to an around view monitoring (AVM) imaging device, the controller displays an around-view image captured by the AVM imaging device on an AVM monitor located within the vehicle,

wherein the controller determines whether an abnormality occurs in the first connection units, displays the side-view image captured by the AVM imaging device captured through the second connection unit on the side-view monitors when the abnormality occurs in the first connection units, and performs an image rotation transformation after distortion of the image captured by the AVM imaging device is corrected to be identical with the image captured by the side-view imaging devices when the image is displayed on the side-view monitors through the second connection unit.

2. The vehicle side and rear monitoring system of claim 1, wherein the abnormality of the first connection units includes at least one selected from the group consisting of:

an abnormality of the imaging device controllers, an abnormality of the side-view imaging devices, and a communication abnormality of the first connection units.

3. The vehicle side and rear monitoring system of claim 1, wherein, when the distortion of the image captured by the AVM imaging device is corrected and the image rotation transformation is performed, the image is vehicle side and rear images captured by the AVM imaging device.

4. The vehicle side and rear monitoring system of claim 1, wherein the image provided to the side-view monitors through the second connection unit is a side image captured by the AVM imaging device.

5. The vehicle side and rear monitoring system of claim 1, wherein the image provided to the side-view monitors through the second connection unit is an image generated by collecting side and rear images captured by the AVM imaging device.

6. The vehicle side and rear monitoring system of claim 1, wherein an image output to the side-view monitors through the second connection unit includes a message regarding the abnormality of the first connection units.

7. The vehicle side and rear monitoring system of claim 1, wherein the first connection units are disposed at respective left and right sides of the vehicle.

8. The vehicle side and rear monitoring system of claim 1, wherein the controller includes a video distributor module (VDM) that corrects distortion of the image captured by the AVM imaging device and perform an image rotation transformation.

9. A vehicle side and rear monitoring method with a fail-safe function, comprising:

determining, by a controller, whether an abnormality occurs in side-view imaging devices, imaging device controllers, and side-view monitors of a vehicle; and

displaying, by the controller, an around view image captured by an around view monitoring (AVM) imaging device on the side-view monitors when the abnormality is detected in the side-view imaging devices, the imaging device controllers, and the side-view monitors of the vehicle,

wherein the displaying of an image captured by the AVM camera on the side-view monitors includes correcting, by the controller, distortion of the image captured by the AVM imaging device and performing an image rotation transformation to be identical with the image captured by the side-view imaging device.

10. The vehicle side and rear monitoring method of claim 9, wherein the determining of whether an abnormality occurs in side-view imaging devices, imaging device controllers, and side-view monitors of a vehicle includes:

determining, by the controller, whether the abnormality of the imaging device controllers, the abnormality of the side-view imaging devices, and a communication abnormality between the side-view imaging devices, the imaging device controllers and the side-view monitors occur.

11. The vehicle side and rear monitoring method of claim 9, wherein, in correcting distortion of the image captured by the AVM imaging device and performing an image rotation transformation, the image is vehicle side and rear images captured by the AVM imaging device.

12. The vehicle side and rear monitoring method of claim 9, wherein, in the displaying of an image captured by the AVM imaging device on the side-view monitors, the image is a side image captured by the AVM imaging device.

13. The vehicle side and rear monitoring method of claim 9, wherein, in the displaying of an image captured by an AVM imaging device on the side-view monitors, the image is an image generated by collecting side and rear images captured by the AVM imaging device.

14. The vehicle side and rear monitoring method of claim 9, wherein the displaying of an image captured by an AVM imaging device on the side-view monitors includes outputting, by the controller, an image that includes a warning message.

15. The vehicle side and rear monitoring method of claim 9, wherein the side-view imaging devices, the imaging device controllers, and the side-view monitors are disposed at respective left and right sides of the vehicle.

16. The vehicle side and rear monitoring method of claim 9, wherein the controller includes a video distributor module (VDM) that corrects distortion of the image captured by the AVM imaging device and perform an image rotation transformation.