Early warning and collision avoidance
First Claim
1. A method comprisingusing electronic sensors located in a vicinity of a crosswalk that crosses a road to monitor an area in and nearby the crosswalk, the electronic sensors generating motion data about vulnerable roadway users who are in or nearby the crosswalk, the motion data including location and direction of the vulnerable roadway users,applying the generated motion data to a machine learning model running in equipment located in the vicinity of the crosswalk to make a prediction that one of the vulnerable roadway users is about to enter the road in or nearby the crosswalk, the prediction being made prior to the vulnerable roadway user entering the road in or nearby the crosswalk, the machine learning model having been trained using motion data generated in the vicinity of the crosswalk and indicative of intent or behavior of vulnerable roadway users who previously had been in or nearby the crosswalk, the motion data comprising location, speed, acceleration, and orientation, andbefore the vulnerable roadway user has entered the road in or nearby the crosswalk, transmitting a warning to at least one of:
- a device associated with the vulnerable roadway user, a device associated with another ground transportation entity approaching the crosswalk on the road, or a road sign configured to alert the vulnerable roadway user or a driver.
1 Assignment
0 Petitions
Accused Products
Abstract
Among other things, equipment is located at an intersection of a transportation network. The equipment includes an input to receive data from a sensor oriented to monitor ground transportation entities at or near the intersection. A wireless communication device sends to a device of one of the ground transportation entities, a warning about a dangerous situation at or near the intersection, there is a processor and a storage for instructions executable by the processor to perform actions including the following. A machine learning model is stored that can predict behavior of ground transportation entities at or near the intersection at a current time. The machine learning model is based on training data about previous motion and related behavior of ground transportation entities at or near the intersection. Current motion data received from the sensor about ground transportation entities at or near the intersection is applied to the machine learning model to predict imminent behaviors of the ground transportation entities. An imminent dangerous situation for one or more of the ground transportation entities at or near the intersection is inferred from the predicted imminent behaviors. The wireless communication device sends the warning about the dangerous situation to the device of one of the ground transportation entities.
142 Citations
23 Claims
-
1. A method comprising
using electronic sensors located in a vicinity of a crosswalk that crosses a road to monitor an area in and nearby the crosswalk, the electronic sensors generating motion data about vulnerable roadway users who are in or nearby the crosswalk, the motion data including location and direction of the vulnerable roadway users, applying the generated motion data to a machine learning model running in equipment located in the vicinity of the crosswalk to make a prediction that one of the vulnerable roadway users is about to enter the road in or nearby the crosswalk, the prediction being made prior to the vulnerable roadway user entering the road in or nearby the crosswalk, the machine learning model having been trained using motion data generated in the vicinity of the crosswalk and indicative of intent or behavior of vulnerable roadway users who previously had been in or nearby the crosswalk, the motion data comprising location, speed, acceleration, and orientation, and before the vulnerable roadway user has entered the road in or nearby the crosswalk, transmitting a warning to at least one of: - a device associated with the vulnerable roadway user, a device associated with another ground transportation entity approaching the crosswalk on the road, or a road sign configured to alert the vulnerable roadway user or a driver.
- View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
13. An apparatus comprising
equipment located at a level crossing of a transportation network, the level crossing comprising an intersection of a road, a pedestrian crossing, and a rail line, the equipment comprising inputs to receive data from sensors oriented to monitor road vehicles and pedestrians at and near the level crossing and to receive phase and timing data for signals on the road and on the rail line, a wireless communication device to send to a device of one of the ground transportation entities, pedestrians, or rail vehicles on the rail line, a warning about a dangerous situation at or near the level crossing, a processor, and a storage for instructions executable by the processor to store a machine learning model that can predict behavior of ground transportation entities at or near the level crossing at a current time, the machine learning model being based on training data about previous motion and related behavior of road vehicles and pedestrians at or near the intersection and previous phase and timing data for signals on the road and on the rail line, apply current motion data received from the sensors about road vehicles and pedestrians at or near the level crossing and current phase and timing data for signals on the road and on the rail line to the machine learning model to predict imminent behaviors of the road vehicles and pedestrians, infer an imminent dangerous situation for a rail vehicle on the rail line at or near the intersection from the predicted imminent behaviors, and cause the wireless communication device to send the warning about the dangerous situation to a device of at least one of the road vehicles, pedestrians, and rail vehicle.
-
20. A method comprising
receiving data from infrastructure sensors representing positions and motions of road vehicles being driven or pedestrians walking in a ground transportation network, receiving data in basic safety messages or virtual basic safety messages and personal safety message and virtual personal safety messages about states of the road vehicles and pedestrians, the basic safety messages, virtual basic safety messages, personal safety messages, and virtual personal safety messages comprising location, heading, and speed information about the road vehicles or pedestrians, the basic safety messages and the personal safety messages being received from the road vehicles or pedestrians, the virtual basic safety messages and the virtual personal safety messages comprising location, heading, and speed information about the road vehicles and the pedestrians reconstructed from the data received from the infrastructure sensors, applying the received data from the infrastructure sensors and the data from the basic safety messages, the virtual basic safety messages, the personal safety messages, and the virtual personal safety messages to a machine learning model trained to identify dangerous driving or walking behavior of one of the road vehicles or pedestrians, and automatically reporting the dangerous driving or walking behavior to authorities.
Specification