SYSTEM AND METHOD TO PROVIDE DRIVING ASSISTANCE

• US 20170076606A1
• Filed: 09/11/2015
• Published: 03/16/2017
• Est. Priority Date: 09/11/2015
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: GUPTA, MANISH, CHINTALAPOODI, PRAMOD, TANAKA, SHO
• Granted Patent: US 10,181,266 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B60K 2360/186 Displaying information according to relevancy
• CPC Class Codes: B60K 2360/21 using cameras
• CPC Class Codes: B60K 2360/334 Projection means
• CPC Class Codes: B60K 2360/347 Optical elements for superposition of display information
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/29 Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
• CPC Class Codes: B60Q 1/0023 the element being a sensor, e.g. distance sensor, camera
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: B60R 1/12 Mirror assemblies combined with other articles, e.g. clocks
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection

Abstract

Various aspects of a system and method to provide driving assistance are disclosed herein. The system comprises one or more circuits in an electronic control unit used in a vehicle configured to detect one or more actions associated with the vehicle based on one or more signals generated by one or more sensors embedded in the vehicle. The electronic control unit may be further configured to control the activation of an imaging device located on the vehicle at an opposite side of a driver of the vehicle, based on the detected one or more actions. The imaging device is operable to capture one or more images in a forward-facing direction of the vehicle.

Claims

1. A system for driving assistance, said system comprising:

one or more circuits in an electronic control unit used in a vehicle, said one or more circuits being configured to;

detect one or more actions associated with said vehicle based on one or more signals generated by one or more sensors embedded in said vehicle; and

control activation of an imaging device located on said vehicle at an opposite side of a driver of said vehicle, based on said detected one or more actions, wherein said imaging device is operable to capture one or more images in a forward-facing direction of said vehicle.

2. The system according to claim 1, wherein said imaging device is activated in an operational mode that corresponds to one of:

a first mode or a second mode, wherein said first mode and said second mode are based on at least said detected one or more actions and/or said captured one or more images by said imaging device, wherein said first mode is used for surpassing a front vehicle and said second mode is used for turning at an intersection.

3. The system according to claim 2, wherein said imaging device is activated to capture said one or more images in said forward-facing direction for said first mode to detect a front vehicle based on said detected said one or more actions that comprise one or more of:

deceleration of said vehicle below a pre-defined speed threshold for first mode activation, selection of a manual button for said first mode activation, a lateral displacement of said vehicle above a pre-defined distance threshold for first mode activation, push of a brake pedal of said vehicle, an activation of a turn signal of said vehicle, a presence of another vehicle within a pre-defined proximity range of said vehicle, a low visibility associated with a view in a frontward direction of said vehicle from a driver, a blocking of said view by said other vehicle, a reduction in speed of said other vehicle to a value below a pre-defined speed threshold for first mode activation, and/or a change in a steering angle above a pre-defined angle threshold for first mode activation.

4. The system according to claim 2, wherein said imaging device is activated to capture said one or more images in a rearward-facing direction or a sideward-facing direction for said second mode to detect an obstacle or a life-form based on said detected said one or more actions that comprise one or more of:

activation of a turn signal, selection of a manual button for said second mode activation, detection of a lane change by said vehicle, detection of an intersection in a direction of motion of said vehicle, detection of a turn at an intersection on an upcoming driving route set in a navigation application, detection of a reduction in speed of said vehicle to a value below a pre-defined speed threshold for said second mode activation, detection of a change in a steering angle above a pre-defined angle threshold for second mode activation, and/or detection of a traffic signal.

5. The system according to claim 1, wherein said one or more circuits are configured to control a display of said captured one or more images on a display screen of said vehicle and/or display an alert indication with said captured one or more images when said captured one or more images correspond to another detected vehicle and/or a life-form.

6. The system according to claim 1, wherein said activation of said imaging device comprises an adjustment of a line-of-sight of said imaging device.

7. The system according to claim 1, wherein said one or more circuits are configured to control an adjustment of a line-of-sight of said activated imaging device based on one or more road surface characteristics of a road surface beneath said vehicle, wherein said one or more road surface characteristics comprise one or more of:

an upward slope, a downward slope, a bank angle, a curvature, a boundary, a speed limit, a road texture, a pothole, and/or a lane marking.

8. The system according to claim 1, wherein said control of said activation of said imaging device is based on one or more of:

a voice based command, a gesture-based command, and/or a selection of a manual button disposed on a panel or a steering wheel of said vehicle.

9. The system according to claim 1, wherein said one or more circuits are configured to control display of said one or more captured images by use of one of:

an infotainment display, a heads-up display (HUD), an augmented reality (AR)-HUD, a driver information console (DIC), a see-through display, or a smart-glass display.

10. The system according to claim 1, wherein said one or more circuits are configured to deactivate said activated imaging device based on one or more of:

acceleration of said vehicle above a pre-defined speed threshold for a mode deactivation, a lateral displacement of said vehicle below a pre-defined distance threshold for mode deactivation, an absence of one or more other vehicles from said captured one or more images, a change in said lateral displacement with respect to a time of activation of said imaging device, a change in a steering angle below an angle threshold for mode deactivation, a detection of a completion of a turning action of said vehicle at an intersection, deactivation of a turn signal, and/or selection of a manual button for said deactivation.

11. The system according to claim 1, wherein said one or more circuits are configured to generate information indicating whether said vehicle can safely pass said front vehicle based on said activation of said imaging device, wherein said generated information comprises one or more of:

visual information, haptic information, and/or audio information.

12. The system according to claim 11, wherein said one or more circuits are configured to utilize one or more of:

said imaging device, a radio wave-based object detection device, a laser-based object detection device, and/or a wireless communication device, for detection of one or more other vehicles.

13. The system according to claim 1, wherein said imaging device is mounted on or integrated into a passenger side rear-view mirror or an external body of said vehicle.

14. The system according to claim 1, wherein said imaging device is adjustably mounted on a passenger side rear-view mirror or an external body of said vehicle to capture one or more images in a rearward-facing direction or a sideward-facing direction.

15. A method for driving assistance, said method comprising:

detecting, by an electronic control unit used in a vehicle, one or more actions associated with said vehicle based on one or more signals generated by one or more sensors embedded in said vehicle; and

controlling, by said electronic control unit used in said vehicle, activation of an imaging device located on said vehicle at an opposite side of a driver of said vehicle, based on said detected one or more actions, wherein said imaging device is operable to capture one or more images in a forward-facing direction of said vehicle.

16. The method according to claim 15, wherein said imaging device is activated in an operational mode that corresponds to one of:

a first mode or a second mode, wherein said first mode and said second mode are based on at least said detected one or more actions and/or said captured one or more images by said imaging device, wherein said first mode is used for surpassing a front vehicle and said second mode is used for turning at an intersection.

17. The method according to claim 15, further comprising controlling a display of said captured one or more images on a display screen of said vehicle and/or displaying an alert indication with said captured one or more images when said captured one or more images correspond to another detected vehicle and/or a life-form.

18. The method according to claim 15, wherein said activation of said imaging device comprises adjustment of a line-of-sight of said imaging device.

19. A non-transitory computer readable storage medium having stored thereon, a program having at least one code section executable by a computer, thereby causing the computer to perform steps method for driving assistance, said method comprising:

detecting, by an electronic control unit used in a vehicle, one or more actions associated with said vehicle based on one or more signals generated by one or more sensors embedded in said vehicle; and

controlling, by said electronic control unit used in said vehicle, activation of an imaging device located on said vehicle at an opposite side of a driver of said vehicle, based on said detected one or more actions, wherein said imaging device is operable to capture one or more images in a forward-facing direction of said vehicle.

20. A vehicle comprising:

a battery;

a sensing system configured to detect an action associated with said vehicle;

an imaging device configured to be powered by said battery and capture one or more images in a forward-facing direction of said vehicle;

a display device configured to render said captured one or more images; and

one or more circuits in an electronic control unit (ECU), said one or more circuits being configured to;

detect one or more actions associated with said vehicle based on one or more signals generated by said sensing system embedded in said vehicle; and

control activation of said imaging device located on said vehicle at an opposite side of a driver of said vehicle, based on said detected one or more actions and/or said captured one or more images.