Driver assistance apparatus and control method for the same

• US 10,377,309 B2
• Filed: 03/17/2016
• Issued: 08/13/2019
• Est. Priority Date: 06/09/2015
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Lee, Jinkyo, Oh, Nami
• Primary Examiner(s): Luo, Kate H
• Application Number:
  US15/073,133
• Publication Number:
  US 20160362050A1
• Time in Patent Office: 1,244 Days
• Field of Search: None
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 1/28 with an adjustable field of view
• CPC Class Codes: B60R 1/31 providing stereoscopic vision
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/302 combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/50 characterised by the display information being shared, e.g. external display, data transfer to other traffic participants or centralised traffic controller
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: B60R 2300/8093 for obstacle warning
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/584 of vehicle lights or traffic lights
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road

Abstract

Disclosed are a driver assistance apparatus and a control method for the same. The driver assistance apparatus includes at least one camera configured to generate a main image by capturing an image of a periphery of a vehicle, a communication unit configured to receive a plurality of sub images generated by at least one other vehicle, and a processor configured to: select at least one of the sub images based on a predetermined condition or user input; and to generate an expanded image using the main image and the selected sub image.

Claims

1. A driver assistance apparatus comprising:

a processor configured to;

generate, based on at least one image of a periphery of a vehicle from at least one camera, a main image;

receive, through a communication unit, a plurality of sub images generated by at least one other vehicle;

select at least one of the sub images based on a predetermined condition or user input; and

generate an expanded image using the main image and the selected at least one of the sub images,

wherein the communication unit is configured to;

transmit an image request signal to the at least one other vehicle; and

receive the plurality of sub images transmitted by the at least one other vehicle in response to the image request signal,

wherein the communication unit is configured to further receive location information of the vehicle, and

wherein the processor is configured to;

determine whether a caution zone is present within a predetermined distance from the vehicle based on the location information;

based on the caution zone being present within the predetermined distance from the vehicle, identify the at least one other vehicle as being located in the caution zone;

control the communication unit to transmit the image request signal to the at least one other vehicle located in the caution zone,

wherein the processor is configured to determine whether the caution zone is present within the predetermined distance from the vehicle by determining whether at least one of an intersection, an uphill road, a downhill road, a crosswalk, a tunnel, or a curved road is present within the predetermined distance from the vehicle, and

wherein the processor is configured to generate a control signal for displaying the expanded image and transmit the control signal to a display unit.

2. The driver assistance apparatus according to claim 1, wherein the processor is configured to generate the expanded image by generating an around-view image of the vehicle using the main image and the selected at least one of the sub images.

3. The driver assistance apparatus according to claim 1, wherein the processor is configured to control the communication unit to transmit the image request signal to the at least one other vehicle shown in the main image.

4. The driver assistance apparatus according to claim 1, wherein the communication unit is configured to further receive location information of the vehicle and traffic information, and

wherein the processor is configured to:

determine whether a congested zone is present within a predetermined distance from the vehicle based on the location information and the traffic information;

based on the congested zone being present within the predetermined distance from the vehicle, identify the at least one other vehicle as being located in the congested zone; and

control the communication unit to transmit the image request signal to the at least one other vehicle located in the congested zone.

5. The driver assistance apparatus according to claim 1, wherein the processor is configured to select at least one of the sub images based on a predetermined condition or user input by selecting, from among the plurality of sub images, a sub image showing an obstacle.

6. The driver assistance apparatus according to claim 1, wherein the processor is configured to determine whether the main image and the at least one of the sub images have an overlapping region in which a portion of the main image overlaps with a portion of the at least one of the sub images and, based on a determination that the main image and the at least one of the sub images have the overlapping region, generate the expanded image by combining the main image and the at least one of the sub images with each other based on the overlapping region.

7. The driver assistance apparatus according to claim 1, wherein the communication unit is configured to further receive location information of the vehicle and location information of the at least one other vehicle, and

wherein the processor is configured to determine whether the main image and the at least one of the sub images have an overlapping region in which a portion of the main image overlaps with a portion of the at least one of the sub images and, based on a determination that the main image and the at least one of the sub images do not have the overlapping region, generate the expanded image by combining the main image and the selected at least one of the sub images with each other based on the location information of the vehicle and the location information of the at least one other vehicle.

8. The driver assistance apparatus according to claim 7, wherein the communication unit is configured to further receive vehicle body direction information of the at least one other vehicle, and

wherein the processor is configured to:

receive vehicle body direction information of the vehicle from a sensing unit of the vehicle; and

generate the expanded image by combining the main image and the selected at least one of the sub images with each other based on the location information of the vehicle, the vehicle body direction information of the vehicle, the location information of the at least one other vehicle, and the vehicle body direction information of the at least one other vehicle.

9. The driver assistance apparatus according to claim 1, wherein the processor is configured to generate information regarding an obstacle that is shown only in the selected at least one of the sub images based on the expanded image including the main image and the selected at least one of the sub images.

10. The driver assistance apparatus according to claim 9, wherein the processor is configured to generate a control signal to change at least one of a speed and direction of the vehicle based on the information regarding the obstacle.

11. The driver assistance apparatus according to claim 1, wherein the processor is configured to generate a route for the vehicle based on the expanded image.

12. The driver assistance apparatus according to claim 11, wherein the processor is configured to generate a control signal to enter an autonomous driving mode with respect to the route.

13. The driver assistance apparatus according to claim 1, further comprising a display unit configured to display the expanded image.

14. The driver assistance apparatus according to claim 13, wherein the processor is configured to divide a screen of the display unit into a plurality of sub screens, and

wherein the processor is configured to display the expanded image on one of the sub screens and display information regarding the expanded image on another one of the sub screens.

15. The driver assistance apparatus according to claim 13, wherein the processor is configured to control the display unit to provide a visual effect to a region within the expanded image that includes an obstacle.

16. The driver assistance apparatus according to claim 13, wherein the processor is configured to control the display unit to rotate and display the expanded image by an angle corresponding to user input.

17. The driver assistance apparatus according to claim 13, wherein the processor is configured to control the display unit to distinguish and display an image corresponding to the vehicle from an image corresponding to the at least one other vehicle.

18. The driver assistance apparatus according to claim 1, wherein the processor is configured to generate the expanded image, either in real time or periodically.

19. The driver assistance apparatus according to claim 18, wherein the processor is configured to change a generation period of the expanded image according to a speed of the vehicle.

20. The driver assistance apparatus according to claim 1, wherein the processor is configured to control the communication unit to transmit the main image to the at least one other vehicle.

21. The driver assistance apparatus according to claim 20, wherein the communication unit is configured to receive an image request signal with respect to the main image from the at least one other vehicle, and

wherein the processor is configured to control the communication unit to transmit the main image to the at least one other vehicle in response to the image request signal.

22. The driver assistance apparatus according to claim 20, wherein the processor is configured to control the communication unit to transmit the main image to the at least one other vehicle based on determining that an obstacle is present in the main image.