DETERMINING THREATS BASED ON INFORMATION FROM ROAD-BASED DEVICES IN A TRANSPORTATION-RELATED CONTEXT

• US 20160286026A1
• Filed: 06/09/2016
• Published: 09/29/2016
• Est. Priority Date: 12/01/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Lord, Richard T., Lord, Robert W., Myhrvold, Nathan P., Tegreene, Clarence T., Hyde, Roderick A., Wood, Lowell L. Jr., Ishikawa, Muriel Y., Wood, Victoria Y. H., Whitmer, Charles, Bahl, Paramvir, Burger, Douglas C., Chandra, Ranveer, Gates, William H. III, Holman, Paul, Kare, Jordin T., Mundie, Craig J., Paek, Tim, Tan, Desney S., Zhong, Lin, Dyor, Matthew G.
• Granted Patent: US 10,079,929 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G01S 3/802 Systems for determining direction or deviation from predetermined direction
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G08G 1/04 using optical or ultrasonic detectors
• CPC Class Codes: G08G 1/042 using inductive or magnetic detectors
• CPC Class Codes: G08G 1/052 with provision for determining speed or overspeed speed measuring in general G01P
• CPC Class Codes: G08G 1/056 with provision for distinguishing direction of travel
• CPC Class Codes: G08G 1/087 Override of traffic control, e.g. by signal transmitted by an emergency vehicle
• CPC Class Codes: G08G 1/096716 where the received information does not generate an automatic action on the vehicle control
• CPC Class Codes: G08G 1/096741 where the source of the transmitted information selects which information to transmit to each vehicle
• CPC Class Codes: G08G 1/096775 where the origin of the information is a central station
• CPC Class Codes: G08G 1/096791 where the origin of the information is another vehicle
• CPC Class Codes: G08G 1/162 event-triggered
• CPC Class Codes: G08G 1/164 Centralised systems, e.g. external to vehicles
• CPC Class Codes: H04B 1/385 Transceivers carried on the body, e.g. in helmets
• CPC Class Codes: H04B 2001/3866 carried on the head
• CPC Class Codes: H04M 1/724097 Worn on the head
• CPC Class Codes: H04M 1/724098 Interfacing with an on-board device of a vehicle for hands-free speaking in vehicles H04M1/6075
• CPC Class Codes: H04W 4/40 for vehicles, e.g. vehicle-to-pedestrians [V2P]
• CPC Class Codes: H04W 4/70 : Services for machine-to-machine communication [M2M] or machine type communication [MTC]

Abstract

Techniques for ability enhancement are described. Some embodiments provide an ability enhancement facilitator system (“AEFS”) configured to enhance a user'"'"'s ability to operate or function in a transportation-related context as a pedestrian or a vehicle operator. In one embodiment, the AEFS is configured perform vehicular threat detection based on information received at a road-based device, such as a sensor or processor that is deployed at the side of a road. An example AEFS receives, at a road-based device, information about a first vehicle that is proximate to the road-based device. The AEFS analyzes the received information to determine threat information, such as that the vehicle may collide with the user. The AEFS then informs the user of the determined threat information, such as by transmitting a warning to a wearable device configured to present the warning to the user.

Claims

1. (canceled)

2. A computer-readable medium including contents that are configured, when executed, to cause a computing system to perform a method for enhancing ability in a transportation-related context, the method comprising:

receiving, from a road-based device, information about a first vehicle that is proximate to the road-based device;

receiving, from a wearable device, motion-related information, the motion-related information including position information obtained from a position sensor of the wearable device;

determining threat information based at least in part on the information about the first vehicle and the motion-related information about the wearer of the wearable device; and

presenting the threat information via the wearable device.

3. The computer-readable medium of claim 2, the method further comprising at least one of:

receiving motion-related information about the first vehicle and/or other objects moving about a roadway;

transmitting to the first vehicle a warning based on the threat information;

presenting the threat information via an output device of a vehicle of the wearer of the wearable device, the output device including a visual display and/or an audio speaker;

transmitting the threat information to a second vehicle;

or

transmitting the threat information to a second road-based device situated along a projected course of travel of the first vehicle and causing the second road-based device to warn drivers that the first vehicle is driving erratically.

4. The computer-readable medium of claim 3, wherein the transmitting the threat information to a second vehicle includes:

transmitting the threat information to an intermediary server system for distribution to other vehicles in proximity to the wearer of the wearable device.

5. The computer-readable medium of claim 2, the method further comprising:

Performing, at the road-based device, the determining threat information and/or the presenting the threat information; and

transmitting the threat information from the road-based device to the wearable device.

6. The computer-readable medium of claim 2, wherein the determining threat information includes at least one of:

determining a likelihood that the first vehicle will collide with the wearer of the wearable device;

determining a likelihood that the first vehicle will collide with some other object;

or

determining that the first vehicle is driving with excessive speed.

7. The computer-readable medium of claim 2, the method further comprising:

receiving data representing threat information relevant to a second vehicle, the second vehicle not being used for travel by the wearer of the wearable device; and

determining the threat information based on the data representing threat information relevant to the second vehicle.

8. The computer-readable medium of claim 7, wherein the receiving data representing threat information relevant to a second vehicle includes at least one of:

receiving from the second vehicle at least one of an indication of stalled or slow traffic encountered by the second vehicle, an indication of poor driving conditions experienced by the second vehicle, an indication that the first vehicle is driving erratically, or an image of the first vehicle.

9. The computer-readable medium of claim 2, wherein the road-based device is a sensor:

attached to a utility pole, a traffic control signal support, a building, and/or a structure proximate to the first vehicle;

or

embedded in a roadway being traveled over by the first vehicle.

10. The computer-readable medium of claim 2, wherein the receiving information about a first vehicle includes at least one of:

receiving an image of the first vehicle from a camera deployed at an intersection;

receiving ranging data from a range sensor deployed at an intersection, the ranging data representing a distance between the first vehicle and the intersection;

receiving the information about the first vehicle from a sensor attached to the first vehicle;

receiving the information about the first vehicle from a sensor attached to a second vehicle;

receiving the information about the first vehicle from a sensor of the wearable device;

or

receiving data representing an audio signal emitted or reflected by the first vehicle.

11. The computer-readable medium of claim 2, wherein the presenting the threat information includes at least one of:

presenting the threat information via an audio output device of the wearable device;

presenting the threat information via a visual display device of the wearable device, wherein the visual display device displays at least one of an indicator that instructs the wearer of the wearable device to look towards the first vehicle or an indicator that instructs the wearer of the wearable device to accelerate, decelerate, and/or turn.

12. A computing system comprising:

a processor;

memory storing instructions that, when executed by the processor, cause the computing system to perform operations comprising;

receiving, from a road-based device, information about a first vehicle that is proximate to the road-based device;

receiving, from a wearable device, motion-related information, the motion-related information including position information obtained from a position sensor of the wearable device;

determining threat information based at least in part on the information about the first vehicle and the motion-related information; and

presenting the threat information via the wearable device.

13. The computing system of claim 12, further comprising:

identifying multiple threats to the wearer of the wearable device;

identifying a first one of the multiple threats that is more significant than at least one other of the multiple threats; and

instructing the wearer of the wearable device to avoid the first one of the multiple threats.

14. The computing system of claim 12, further comprising at least one of:

receiving motion-related information about the first vehicle and/or other objects moving about a roadway;

transmitting to the first vehicle a warning based on the threat information;

presenting the threat information via an output device of a vehicle of the wearer of the wearable device, the output device including a visual display and/or an audio speaker;

transmitting the threat information to a second vehicle;

transmitting the threat information to a second road-based device situated along a projected course of travel of the first vehicle;

or

causing the second road-based device to warn drivers that the first vehicle is driving erratically.

15. The computing system of claim 12, further comprising:

performing at the road-based device the determining threat information and/or the presenting the threat information; and

transmitting the threat information from the road-based device to the wearable device.

16. The computing system of claim 12, further comprising:

receiving data representing threat information relevant to a second vehicle, the second vehicle not being used for travel by the wearer of the wearable device; and

determining the threat information based on the data representing threat information relevant to the second vehicle.

17. The computing system of claim 12, wherein the road-based device is a sensor:

attached to a structure proximate to the first vehicle, wherein the structure is one of a utility pole, a traffic control signal support, and/or a building;

or

embedded in a roadway being traveled over by the first vehicle.

18. The computer-readable medium of claim 17, wherein the road-based device includes at least one of:

a camera, a microphone, a radar-based speed sensor, light detection and ranging-based speed sensor, a range sensor, and/or a receiver operable to receive motion-related information about the first vehicle transmitted from the first vehicle.

19. The computing system of claim 12, wherein the receiving information about a first vehicle includes at least one of:

receiving ranging data from a range sensor deployed at an intersection, the ranging data representing a distance between the first vehicle and the intersection;

receiving the information about the first vehicle from a sensor attached to the first vehicle;

receiving the information about the first vehicle from a sensor attached to a second vehicle;

receiving the information about the first vehicle from a sensor of the wearable device;

receiving image data from a camera, the image data representing an image of the first vehicle;

receiving an image from a camera that is attached to a road-side structure or the wearable device;

or

receiving data representing an audio signal emitted or reflected by the first vehicle.

20. The computing system of claim 12, wherein the determining threat information includes at least one of:

determining a likelihood that the first vehicle will collide with some other object;

determining that the first vehicle is driving with excessive speed;

or

determining that there is slow traffic in proximity to the wearer of the wearable device.

21. The computer-readable medium of claim 12, wherein the wearable device comprises a helmet, goggles, eyeglasses, and/or a hat worn by the wearer of the wearable device.