Vehicle-to-pedestrian-communication systems and methods for using the same

• US 9,881,503 B1
• Filed: 09/08/2016
• Issued: 01/30/2018
• Est. Priority Date: 09/08/2016
• Status: Active Grant

• Current Assignee: GM Global Technology Operations LLC (General Motors Company)
• Original Assignee: GM Global Technology Operations LLC (General Motors Company)
• Inventors: Goldman-Shenhar, Claudia V., Shmueli Friedland, Yael, Riess, Eilon, Philosof, Tal, Tsimhoni, Omer
• Primary Examiner(s): Goldman, Richard
• Application Number:
  US15/260,058
• Time in Patent Office: 509 Days
• Field of Search: 701 23, 701 26, 701300, 701301, 701302, 340901, 340902, 340904
• CPC Class Codes: B60Q 1/50 for indicating other intentions or conditions, e.g. request for waiting or overtaking
• CPC Class Codes: B60Q 1/525 automatically indicating risk of collision between vehicles in traffic or with pedestrians, e.g. after risk assessment using the vehicle sensor data
• CPC Class Codes: B60Q 5/005 automatically actuated
• CPC Class Codes: B60Q 5/006 indicating risk of collision between vehicles or with pedestrians
• CPC Class Codes: B60W 2554/4029 Pedestrians
• CPC Class Codes: G05D 1/0088 characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours using knowledge based models G06N5/00
• CPC Class Codes: G08G 1/005 including pedestrian guidance indicator
• CPC Class Codes: G08G 1/162 event-triggered
• CPC Class Codes: G08G 1/163 involving continuous checking
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes

Abstract

An autonomous-driving vehicle system, for implementation at an autonomous-driving vehicle. The autonomous-driving vehicle system includes a hardware-based processing unit and a non-transitory computer-readable storage device comprising and input module and an activity module. The input module, when executed by the hardware-based processing unit, obtains input data indicating presence of a pedestrian communication device near the autonomous-driving vehicle. The activity module, when executed by the hardware-based processing unit: (i) determines, based on the input data, in a pedestrian-presence determination, that the pedestrian communication device is or will soon be near the autonomous-driving vehicle, and (ii) determines, based on the pedestrian-presence determination, an autonomous-driving action to be implemented by the autonomous-driving vehicle. In other aspects, the present technology relates to a method or a non-transitory computer readable storage device, for performing any of the operations described.

Claims

1. A vehicle system, for implementation at a subject vehicle, comprising:

a non-transitory computer-readable storage device comprising;

an input module that, when executed by a hardware-based processing unit, obtains input data indicating presence of a pedestrian communication device proximate the subject vehicle, wherein the input module includes a subject-vehicle-inputs sub-module that, when executed by the hardware-based processing unit, obtains vehicle context portions of the input data, the vehicle context portions comprising first context data about the subject vehicle and second context data about an other proximate vehicle; and

an activity module that, when executed by the hardware-based processing unit;

determines, based on the input data, in a pedestrian-presence determination, that the pedestrian communication device is or will soon be in or near a potential path for the subject vehicle; and

determines, based on the pedestrian-presence determination, a subject-vehicle action to be implemented by the subject vehicle,

wherein the activity module comprises a pedestrian-communications sub-module that, when executed by the hardware-based processing unit, determines, based on the first context data and the second context data, a pedestrian notification for use at the pedestrian communication device to alert a pedestrian using the pedestrian communication device of context involving the subject vehicle and the other proximate vehicle.

2. The vehicle system of claim 1, wherein the input module comprises a pedestrian-device inputs sub-module that, when executed by the hardware-based processing unit, receives, from the pedestrian communication device, a pedestrian-device-to-vehicle instruction communication instructing the subject vehicle of a specified manner for the subject vehicle to operate or be operated with respect to the pedestrian holding or wearing the pedestrian communication device.

3. The vehicle system of claim 2, wherein the pedestrian-device-to-vehicle instruction communication instructs the subject vehicle to at least one of:

blink or illuminate subject-vehicle headlights;

actuate a subject-vehicle horn;

decelerate the subject vehicle; and

move the subject vehicle to change driving lanes.

4. The vehicle system of claim 1, wherein the non-transitory computer-readable storage device comprises an outputs module including a subject-vehicle-controls sub-module that, when executed by the hardware-based processing unit, initiates performance of the subject-vehicle-driving action by the subject-driving vehicle.

5. The vehicle system of claim 1, wherein the pedestrian-communications sub-module determines the pedestrian notification to alert the pedestrian about the other proximate vehicle in response to determining that, based on the first context data, the second context data, and pedestrian location, the pedestrian cannot or may not notice the other proximate vehicle.

6. The vehicle system of claim 5, wherein the pedestrian-communications sub-module determines the pedestrian notification to alert the pedestrian about the other proximate vehicle in response to determining that the pedestrian cannot or may not notice the other proximate vehicle because the other proximate vehicle is or will be positioned behind a physical impediment, including the subject vehicle or another physical obstacle, between the pedestrian and the subject vehicle, from a perspective of the pedestrian.

7. The vehicle system of claim 1, wherein:

the pedestrian-communications sub-module determines the pedestrian notification to alert the pedestrian about the other proximate vehicle in response to determining that, based on the first context data, the second context data, and pedestrian location, the pedestrian cannot or may not notice the subject vehicle; and

the pedestrian-communications sub-module determines the pedestrian notification to alert the pedestrian about the subject vehicle in response to determining that the pedestrian cannot or may not notice the subject vehicle because the subject vehicle is or will be positioned behind a physical impediment, including the other proximate vehicle or another physical obstacle, between the pedestrian and the subject vehicle, from a perspective of the pedestrian.

8. The vehicle system of claim 1, wherein:

the input module includes a subject-vehicle-inputs sub-module that, when executed by the hardware-based processing unit, obtains vehicle context portions of the input data;

the vehicle context portions comprise first context data about the subject vehicle and second context data about an other proximate vehicle and

the activity module comprises a subject-vehicle-occupant-communications sub-module that, when executed by the hardware-based processing unit, determines, based on the first context data and the second context data, a subject-vehicle-occupant notification to alert a subject-vehicle occupant of context involving the pedestrian communication device, the subject vehicle, and the other proximate vehicle.

9. The vehicle system of claim 8, wherein the subject-vehicle-occupant-communications sub-module determines the subject-vehicle-occupant notification to alert the subject-vehicle occupant that a nearby pedestrian cannot or may not notice the other proximate vehicle and/or the subject automated-driving vehicle because of a physical impediment, including the other proximate vehicle, the subject vehicle, or another physical obstacle, between the pedestrian and the other proximate vehicle and/or the subject vehicle, from a perspective of the pedestrian.

10. The vehicle system of claim 1, wherein:

the input data comprises vehicle-occupant profile information; and

the activity module, when executed by the hardware-based processing unit, determines the subject-vehicle action based on the subject-vehicle-occupant profile information.

11. The vehicle system of claim 1, wherein obtaining the input data indicating presence of the pedestrian communication device by the input module comprises the input module receiving output from the pedestrian communication device.

12. The vehicle system of claim 1, wherein the activity module comprises a pedestrian-communications sub-module that, when executed by the hardware-based processing unit, determines, based on the input data, a pedestrian notification for use at the pedestrian communication device to advise a pedestrian using the pedestrian communication device of a manner that the pedestrian should move.

16. The vehicle system of claim 1, wherein the subject vehicle is an autonomous vehicle operating in an autonomous-driving mode.

13. A vehicle system, for implementation at a subject vehicle, comprising a non-transitory computer-readable storage device, the non-transitory computer-readable storage device comprising:

an input module that, when executed by a hardware-based processing unit, obtains input data indicating presence of a pedestrian communication device proximate the subject vehicle, wherein the input module includes a subject-vehicle-inputs sub-module that, when executed by the hardware-based processing unit, obtains vehicle context portions of the input data, the vehicle context portions including first context data about the subject vehicle and second context data about an other proximate vehicle; and

an activity module that, when executed by the hardware-based processing unit;

determines, based on the input data, in a pedestrian-presence determination, that the pedestrian communication device is or will soon be in or near a potential path for the subject vehicle; and

determines, based on the pedestrian-presence determination, a subject-vehicle action to be implemented by the subject vehicle,

wherein, the activity module comprises a subject-vehicle-occupant-communications sub-module that, when executed by the hardware-based processing unit, determines, based on the first context data and the second context data, a subject-vehicle-occupant notification to alert a subject-vehicle occupant of context involving the pedestrian communication device, the subject vehicle, and the other proximate vehicle,

wherein the subject-vehicle-occupant-communications sub-module determines the subject-vehicle-occupant notification to alert the subject-vehicle occupant that a nearby pedestrian cannot or may not notice the other proximate vehicle and/or the subject automated-driving vehicle because of a physical impediment, including the other proximate vehicle, the subject vehicle, or another physical obstacle, from a perspective of the pedestrian.

14. The vehicle system of claim 13, wherein the subject-vehicle occupant is a subject-vehicle driver.

17. The vehicle system of claim 13, wherein the subject vehicle is an autonomous vehicle operating in an autonomous-driving mode.

15. A vehicle system, for implementation at a subject vehicle, comprising a non-transitory computer-readable storage device, the non-transitory computer-readable storage device comprising:

an input module that, when executed by a hardware-based processing unit, obtains input data indicating presence of a pedestrian communication device proximate the subject vehicle, wherein the input module includes a subject-vehicle-inputs sub-module that, when executed by the hardware-based processing unit, obtains vehicle context portions of the input data, the vehicle context portions including first context data about the subject vehicle and second context data about an other proximate vehicle; and

an activity module that, when executed by the hardware-based processing unit;

determines, based on the input data, in a pedestrian-presence determination, that the pedestrian communication device is or will soon be in or near a potential path for the subject vehicle; and

determines, based on the pedestrian-presence determination, a subject-vehicle action to be implemented by the subject vehicle,

wherein, the activity module comprises a subject-vehicle communications sub-module that, when executed by the hardware-based processing unit, determines, based on the first context data and the second context data, a pedestrian notification to alert a pedestrian of context involving the pedestrian communication device, the subject vehicle, and the other proximate vehicle,

wherein the subject-vehicle communications sub-module determines the pedestrian notification in response to determining that the pedestrian cannot or may not notice the other proximate vehicle and/or the subject automated-driving vehicle because of a physical impediment, including the other proximate vehicle, the subject vehicle, or another physical obstacle, from a perspective of the pedestrian, and

wherein the pedestrian notification is configured to alert the pedestrian, via the pedestrian communication device, of the proximate vehicle and/or the subject automated-driving vehicle.

18. The vehicle system of claim 15, wherein the subject vehicle is an autonomous vehicle operating in an autonomous-driving mode.