PRESENTATION OF SHARED THREAT INFORMATION IN A TRANSPORTATION-RELATED CONTEXT

• US 20130144490A1
• Filed: 03/29/2012
• Published: 06/06/2013
• Est. Priority Date: 12/01/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Lowell L. Wood Jr, William H. Gates
• Inventors: Lord, Richard T., Lord, Robert W., Myhrvold, Nathan P., Tegreene, Clarence T., Hyde, Roderick A., Wood, Lowell L. Jr., Ishikawa, Muriel Y., Wood, Victoria Y.H., Whitmer, Charles, Bahl, Paramvir, Burger, Douglas C., Chandra, Ranveer, Gates, William H. III, Holman, Paul, Kare, Jordin T., Mundie, Craig J., Paek, Tim, Tan, Desney S., Zhong, Lin, Dyor, Matthew G.
• Granted Patent: US 9,159,236 B2
• Time in Patent Office: Days
• US Class Current: 701/41
• CPC Class Codes: B60T 17/22 Devices for monitoring or checking brake systems; Signal devices
• CPC Class Codes: B60T 2201/022 Collision avoidance systems
• CPC Class Codes: B60T 2210/36 Global Positioning System [GPS]
• CPC Class Codes: G08G 1/164 Centralised systems, e.g. external to vehicles

Abstract

Techniques for ability enhancement are described. In some embodiments, devices and systems located in a transportation network share threat information with one another, in order to enhance a user'"'"'s ability to operate or function in a transportation-related context. In one embodiment, a process in a vehicle receives threat information from a remote device, the threat information based on information about objects or conditions proximate to the remote device. The process then determines that the threat information is relevant to the safe operation of the vehicle. Then, the process modifies operation of the vehicle based on the threat information, such as by presenting a message to the operator of the vehicle and/or controlling the vehicle itself.

Claims

1. A method for enhancing ability in a transportation-related context, the method comprising:

at a first vehicle, receiving threat information from a remote device, the threat information based at least in part on information about objects and/or conditions proximate to the remote device;

determining that the threat information is relevant to safe operation of the first vehicle; and

modifying operation of the first vehicle based on the threat information.

2. The method of claim 1, wherein the receiving threat information includes:

receiving threat information determined based on information about driving conditions proximate to the remote device.

3. The method of claim 2, wherein the information about driving conditions indicates that icy surface conditions are present proximate to the remote device.

4. The method of claim 2, wherein the information about driving conditions indicates that wet surface conditions are present proximate to the remote device.

5. The method of claim 2, wherein the information about driving conditions indicates that oily surface conditions are present proximate to the remote device.

6. The method of claim 2, wherein the information about driving conditions indicates that a limited visibility condition is present proximate to the remote device.

7. The method of claim 2, wherein the information about driving conditions indicates that there is an accident proximate to the remote device.

8. The method of claim 1, wherein the receiving threat information includes:

receiving threat information determined based on information about a second vehicle proximate to the remote device, wherein the information about the second vehicle indicates at least one of;

that the second vehicle is driving erratically, that the second vehicle is driving with excessive speed; and

/or that the second vehicle is driving too slowly.

12. The method of claim 1, wherein the receiving threat information includes:

receiving threat information determined based on information about a pedestrian proximate to the remote device.

15. The method of claim 1, wherein the receiving threat information includes:

receiving threat information determined at a second vehicle with respect to information about objects and/or conditions received at the second vehicle.

16. The method of claim 15, wherein the receiving threat information determined at a second vehicle includes:

receiving threat information determined by a wearable device of an occupant of the second vehicle.

17. The method of claim 15, wherein the receiving threat information determined at a second vehicle includes:

receiving threat information determined by a computing device installed in the second vehicle.

18. The method of claim 15, wherein the receiving threat information determined at a second vehicle includes:

receiving motion-related information from a velocity and/or position sensor attached to the second vehicle.

21. The method of claim 1, wherein the receiving threat information includes:

receiving threat information determined by a road-based device with respect to information about objects and/or conditions received at the road-based device.

22. The method of claim 21, wherein the receiving threat information determined by a road-based device includes:

receiving threat information determined by a road-based computing device configured to receive the information about objects and/or conditions from vehicles proximate to the road-based computing device.

23. The method of claim 21, wherein the receiving threat information determined by a road-based device includes:

receiving threat information determined by a road-based computing device configured to receive the information about objects and/or conditions from road-based sensors.

24. The method of claim 21, wherein the road-based device is a sensor attached to a structure proximate to the first vehicle.

25. The method of claim 24, wherein the structure proximate to the first vehicle is one of a utility pole, a traffic control signal support, a building, a street light, a tunnel wall, a bridge, an overpass, a flyover, a communication tower, a traffic kiosk, an advertisement structure, a roadside sign, an information/regulatory display, and/or a vehicle toll reader.

26. The method of claim 24, wherein the receiving threat information determined by a road-based device includes:

receiving an image of a second vehicle from a camera deployed at an intersection.

27. The method of claim 24, wherein the receiving threat information determined by a road-based device includes:

receiving ranging data from a range sensor deployed at an intersection, the ranging data representing a distance between a second vehicle and the intersection.

28. The method of claim 24, wherein the road-based device includes at least one of:

a camera, a microphone, a radar gun, and/or a range sensor.

32. The method of claim 24, wherein the road-based device includes a receiver operable to receive motion-related information transmitted from a second vehicle, the motion-related information including at least one of a position of the second vehicle, a velocity of the second vehicle, and/or a trajectory of the second vehicle.

33. The method of claim 21, wherein the road-based device is embedded in a roadway.

34. The method of claim 33, wherein the road-based device includes an induction loop embedded in the roadway, the induction loop configured to detect the presence and/or velocity of a second vehicle.

35. The method of claim 34, wherein the receiving threat information determined by a road-based device includes:

receiving motion-related information from the induction loop, the motion-related information including at least one of a position of the second vehicle, a velocity of the second vehicle, and/or a trajectory of the second vehicle.

36. The method of claim 1, wherein the determining that the threat information is relevant to safe operation of the first vehicle includes:

determining a location associated with the remote device; and

determining whether the first vehicle is approaching the location.

37. The method of claim 36, wherein the location associated with the remote device includes the location of a road-based device.

38. The method of claim 36, wherein the location associated with the remote device includes a location of a second vehicle that includes the remote device.

39. The method of claim 36, wherein the determining whether the first vehicle is approaching the location includes:

determining whether the first vehicle is within a threshold distance from the location associated with the remote device.

40. The method of claim 36, wherein the determining whether the first vehicle is approaching the location includes:

determining whether the first vehicle is moving on trajectory that intersects the location associated with the remote device.

41. The method of claim 1, wherein the determining that the threat information is relevant to safe operation of the first vehicle includes:

determining a threat to the first vehicle based on the threat information;

determining a likelihood associated with the threat; and

determining that the likelihood is greater than a threshold level.

42. The method of claim 41, wherein the determining a threat to the first vehicle based on the threat information includes:

predicting a path of an object identified by the threat information;

predicting a path of the first vehicle; and

determining, based on the paths of the object and the first vehicle, whether the first vehicle and the object will come within a threshold distance of one another.

43. The method of claim 41, wherein the determining a likelihood associated with the threat includes:

determining a likelihood that the first vehicle will collide with a second vehicle identified by the threat information.

45. The method of claim 41, wherein the determining a likelihood associated with the threat includes:

determining a likelihood that the first vehicle will collide with an animal identified by the threat information.

46. The method of claim 41, wherein the determining a likelihood associated with the threat includes:

determining a likelihood that surface conditions identified by the threat information will cause an operator to lose control of the first vehicle.

47. The method of claim 1, wherein the determining that the threat information is relevant to safe operation of the first vehicle includes:

determining that the threat information is relevant based on gaze information associated with an operator of the first vehicle.

48. The method of claim 47, further comprising:

determining that the operator has not looked at the road for more than a threshold amount of time.

50. The method of claim 1, wherein the modifying operation of the first vehicle includes:

presenting a message based on the threat information to an operator of the first vehicle.

51. The method of claim 50, wherein the presenting a message based on the threat information to an operator of the first vehicle includes at least one of:

presenting a warning to the operator;

presenting an instruction to the operator;

directing the operator to accelerate or decelerate;

directing the operator to turn or not to turn.

55. The method of claim 50, wherein the presenting a message based on the threat information to an operator of the first vehicle includes:

presenting the message via an audio output device that is a speaker of a wearable device of the operator.

59. The method of claim 50, wherein the presenting a message based on the threat information to an operator of the first vehicle includes:

presenting the message via a visual display device of a wearable device of the operator, the message instructing the operator to accelerate, decelerate, turn, and/or look towards an oncoming vehicle identified by the threat information.

64. The method of claim 50, wherein the presenting a message based on the threat information to an operator of the first vehicle includes:

providing tactile feedback to the user.

65. The method of claim 64, wherein the providing tactile feedback to the user includes:

causing a steering device, seat, and/or pedal of the first vehicle to vibrate.

66. The method of claim 1, wherein the modifying operation of the first vehicle includes:

controlling the first vehicle by performing at least one of;

decreasing speed of the first vehicle by applying brakes of the first vehicle and/or by reducing output of an engine of the first vehicle;

increasing speed of the first vehicle by releasing brakes of the first vehicle and/or by increasing output of an engine of the first vehicle; and

/or changing direction of the first vehicle.

70. The method of claim 1, wherein the receiving threat information includes:

receiving threat information determined based on image data received from a camera that is attached to at least one of;

a road-side structure, a wearable device of a pedestrian, or a second vehicle, the image data including multiple images of a second vehicle taken at different times.

80. The method of claim 1, further comprising:

identifying multiple threats to the first vehicle, at least one of which is based on the threat information;

identifying a first one of the multiple threats that is more significant than at least one other of the multiple threats; and

instructing an operator of the first vehicle to avoid the first one of the multiple threats.

9-11. -11. (canceled)

13. (canceled)

14. (canceled)

19. (canceled)

20. (canceled)

29-31. -31. (canceled)

44. (canceled)

49. (canceled)

52-54. -54. (canceled)

56-58. -58. (canceled)

60-63. -63. (canceled)

67-69. -69. (canceled)

71-78. -78. (canceled)

81-279. -279. (canceled)