SENSOR BLIND SPOT INDICATION FOR VEHICLES

• US 20170221359A1
• Filed: 01/28/2016
• Published: 08/03/2017
• Est. Priority Date: 01/28/2016
• Status: Active Grant

• Current Assignee: Toyota Jidosha Kabushiki Kaisha (Toyota Motor Corporation)
• Original Assignee: Toyota Motor Engineering & Manufacturing North America Incorporated (Toyota Motor Corporation)
• Inventors: Kamata, Nobuhide
• Granted Patent: US 10,328,949 B2
• Time in Patent Office: Days
• CPC Class Codes: B60K 2360/178 Warnings
• CPC Class Codes: B60K 2360/179 Distances to obstacles or vehicles
• CPC Class Codes: B60K 2360/334 Projection means
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60W 2050/143 Alarm means
• CPC Class Codes: B60W 30/143 Speed control B60W30/16 takes precedence
• CPC Class Codes: B60W 50/085 Changing the parameters of the control units, e.g. changing limit values, working points by control input
• CPC Class Codes: B60W 50/14 Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: G07C 5/0825 using optical means
• CPC Class Codes: G07C 5/0833 using audio means
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks

Abstract

A vehicle can be configured to indicate sensor blind spots to a vehicle occupant (e.g., a driver). Using one or more sensors, the vehicle can acquire driving environment data of an external environment of the vehicle. It can be determined whether one or more portions of the acquired driving environment data is unreliable. Responsive to determining that one or more portions of the acquired driving environment data is unreliable, an alert can be caused to be presented within the vehicle. The alert can indicate one or more locations in the external environment in which the driving environment data that is determined to be unreliable. In some instances, the alert can be a visual alert and/or an audial alert.

Claims

1. A method of indicating sensor blind spots for a vehicle, the method comprising:

acquiring, using one or more sensors, driving environment data of an external environment of the vehicle;

determining whether one or more portions of the acquired driving environment data is unreliable; and

responsive to determining that one or more portions of the acquired driving environment data is unreliable, causing an alert to be presented within the vehicle, the alert indicating one or more locations in the external environment which correspond to the driving environment data that is determined to be unreliable.

2. The method of claim 1, wherein the vehicle is an autonomous vehicle, and wherein causing the alert to be presented within the vehicle is performed while maintaining an autonomous operational mode.

3. The method of claim 1, wherein the alert is a visual alert, and wherein causing the visual alert to be presented within the vehicle includes causing the visual alert to be presented on a display within the vehicle.

4. The method of claim 3, wherein the visual alert includes a graphical representation of the vehicle and a graphical representation of the one or more portions of the external environment is not reliably detectable by the one or more sensors.

5. The method of claim 1, wherein the alert is a wherein the alert is an audial alert.

6. The method of claim 5, wherein causing the audial alert to be presented within the vehicle includes causing the audial alert to be presented within the vehicle in one or more locations that spatially correspond to the one or more locations in the external environment in which the driving environment data that is determined to be unreliable.

7. The method of claim 1, wherein the vehicle is an autonomous vehicle, and wherein, responsive to determining that sensor data is completely occluded in one or more portions of the driving environment, causing the vehicle to transition to a manual operational mode or safety operational mode.

8. The method of claim 1, wherein the vehicle is an autonomous vehicle, and further including:

responsive to determining that one or more portions of the driving environment data is unreliable, determining a modification to a current driving maneuver of the vehicle; and

causing the determined modification to the current driving maneuver of the vehicle to be implemented.

9. The method of claim 8, wherein the determined modification to a current driving maneuver of the vehicle includes reducing a current speed of the vehicle.

10. The method of claim 1, wherein determining whether one or more portions of the driving environment data is unreliable includes:

detecting whether any of the one or more sensors are inoperative or faulting; and

responsive to detecting that any of the one or more sensors are inoperative or faulty, determining that that portion of the driving environment data associated with the inoperative or faulting sensors to be unreliable.

11. The method of claim 1, wherein determining whether one or more portions of the driving environment data is unreliable includes:

comparing the acquired driving environment data to a map;

determining whether there is a difference between the acquired driving environment data and an expected feature included in the map; and

responsive to determining whether there is a difference between the acquired driving environment data and an expected feature included in the map, determining that that portion of the driving environment data associated with the difference between the acquired driving environment data and an expected feature included in the map to be unreliable.

12. A sensor blind spot indication system for a vehicle, the system comprising:

a sensor system, the sensor system being configured to acquire driving environment data of at least a portion of the external environment of the vehicle; and

a processor operatively connected to the sensor system, the processor being programmed to initiate executable operations comprising;

determining whether one or more portions of the acquired driving environment data is unreliable; and

responsive to determining that one or more portions of the acquired driving environment data is unreliable, causing an alert to be presented within the vehicle, the alert indicating one or more locations in the external environment which correspond to the driving environment data that is determined to be unreliable.

13. The system of claim 12, further including a display, wherein the display is operatively connected to the processor, wherein the alert is a visual alert, and wherein causing an alert to be presented within the vehicle includes causing the visual alert to be presented on the display.

14. The system of claim 12, wherein the alert is a visual alert, and further including:

a projector; and

a projection surface,

wherein causing an alert to be presented within the vehicle includes causing the projector to present the visual alert on the projection surface.

15. The system of claim 14, wherein the visual alert includes a graphical representation of the vehicle and a graphical representation of the one or more portions of the external environment is not reliably detectable by the one or more sensors.

16. The system of claim 12, further including a plurality of speakers, wherein the plurality speakers are operatively connected to the processor, wherein the alert is a audial alert, and wherein causing an alert to be presented within the vehicle includes causing the audial alert to be presented by one or more of the plurality of speakers.

17. The system of claim 16, wherein causing the audial alert to be presented within the vehicle includes causing the audial alert to be presented within the vehicle by one or more of the plurality of speakers in one or more locations that spatially correspond to the one or more locations in the external environment in which the driving environment data that is determined to be unreliable.

18. The system of claim 12, wherein the vehicle is an autonomous vehicle, and wherein the executable operations further include:

responsive to determining that one or more portions of the driving environment data is unreliable, determining a modification to a current driving maneuver of the vehicle; and

causing the determined modification to the current driving maneuver of the vehicle to be implemented.

19. The system of claim 18, wherein the determined modification to a current driving maneuver of the vehicle includes reducing a current speed of the vehicle.

20. A computer program product for indicating sensor blind spots for a vehicle, the computer program product comprising a computer readable storage medium having program code embodied therein, the program code executable by a processor to perform a method comprising:

acquiring, using one or more sensors, driving environment data of an external environment of the vehicle;

determining whether one or more portions of the acquired driving environment data is unreliable; and

responsive to determining that one or more portions of the acquired driving environment data is unreliable, causing an alert to be presented within the vehicle, the alert indicating one or more locations in the external environment which correspond to the driving environment data that is determined to be unreliable.