Mobile sensing for road safety, traffic management, and road maintenance

• US 8,576,069 B2
• Filed: 10/11/2010
• Issued: 11/05/2013
• Est. Priority Date: 10/22/2009
• Status: Active Grant

• Current Assignee: Siemens Corp. (Siemens AG)
• Original Assignee: Siemens Corp. (Siemens AG)
• Inventors: Nadeem, Tamer M., Loiacono, Michael T.
• Primary Examiner(s): Swarthout, Brent
• Application Number:
  US12/901,645
• Publication Number:
  US 20110095908A1
• Time in Patent Office: 1,121 Days
• Field of Search: 340/937, 340/539.25, 340/905, 340/995.13, 340/933, 348/148, 348/149, 382/105, 701/119
• US Class Current: 340/539.25
• CPC Class Codes: B60H 3/00 Other air-treating devices
• CPC Class Codes: G08G 1/07 Controlling traffic signals
• CPC Class Codes: G08G 1/096716 where the received information does not generate an automatic action on the vehicle control
• CPC Class Codes: G08G 1/096741 where the source of the transmitted information selects which information to transmit to each vehicle
• CPC Class Codes: G08G 1/096775 where the origin of the information is a central station
• CPC Class Codes: G08G 1/123 indicating the position of vehicles, e.g. scheduled vehicles; Managing passenger vehicles circulating according to a fixed timetable, e.g. buses, trains, tramstransmission of navigation instructions to vehicles G08G1/0968
• CPC Class Codes: G08G 1/20 Monitoring the location of vehicles belonging to a group, e.g. fleet of vehicles, countable or determined number of vehicles

Abstract

Mobile monitoring systems and methods are disclosed. In accordance with one aspect of the invention, the system includes a plurality of vehicles and a base communication station that are in communication with each other. Each of the vehicles includes a camera that generates image data, a location device that generates geographic coordinates of the vehicle, a computing device that receives the image data from the camera and the geographic coordinates of the vehicle and forms a processed image signal that includes the image data, the geographic coordinates and a time stamp, and a communication device that receives the processed image signal from the computing device and wireless transmits the processed image signal to the base communication station. The base communication station receives the processed image signal. The base communication station can include an image processor to further process the processed image signal from each of the plurality of vehicles to form an output signal and a transmitter that transmits the output signal. The output signal can be used to control traffic control devices, vehicles and to provide other useful information.

Claims

1. A mobile monitoring system, comprising:

a plurality of vehicles, each vehicle comprising;

a camera that generates image data;

a location device that generates geographic coordinates of the vehicle;

a computing device that receives the image data from the camera and the geographic coordinates of the vehicle and forms a processed image signal that includes the image data, the geographic coordinates and a time stamp and is enabled to perform image recognition; and

a communication device that receives the processed image signal from the computing device and wirelessly transmits the processed image signal to a base communication station and is enabled to receive a signal from the base communication station; and

the base communication station in communication with each of the plurality of vehicles to receive processed image signals, the base communication station comprising an image processor to further process the processed image signal from each of the plurality of vehicles to determine a status of traffic flow to form an output signal and a transmitter that transmits the output signal, wherein the output signal is sent to another vehicle to provide instructions to a driver of the other vehicle and the base communication station is enabled to generate an image recognition instruction related to an object; and

wherein

the communication device receives the image recognition instruction for the computing device to execute the image recognition instruction to process an image of the object taken by the camera on the vehicle.

2. The system of claim 1, wherein each of the plurality of vehicles is selected from a group consisting of a bus, a tram, a taxi, a delivery truck, a police car, a service vehicle, an ambulance and combinations thereof.

3. The system of claim 1, wherein the output signal is sent to one of the plurality of vehicles to control the camera, the location device, the computing device or the communication device.

4. The system of claim 1, wherein the camera in at least one of the plurality of vehicles is configured to create images of a traffic control device and the processed image signal includes images of the traffic control device, and wherein the base communication station processes the processed image signal to determine an operation of the traffic control device and if the operation is determined to be defective, the output signal includes information about the operation and location of the traffic control device.

5. The system of claim 4, wherein the traffic control device is a traffic light.

6. The system of claim 4, wherein the traffic control device is a lane changing signal.

7. The system of claim 1, wherein:

the camera in one or more of the plurality of vehicles is configured to create images of nearby traffic flow and the processed image signal from each of the one or more of the plurality of vehicles includes images of nearby traffic flow;

the base communication station processes the processed image signal from the one or more of the plurality of vehicles to determine an status of the traffic flow in an area;

the base communication station configures the output signal to control a traffic control device in the area based on the status of the traffic flow in the area; and

the base communication station transmits the output signal to the traffic control device in the area.

8. The system of claim 7, wherein the traffic control device is a traffic light.

9. The system of claim 7, wherein the traffic control device is a lane changing signal.

10. The system of claim 1, wherein:

one or more of the plurality of vehicles further comprise a carbon monoxide sensor which provides an output to the computing device and the processed image signal from the one or more of the plurality of vehicles includes a level from the carbon monoxide sensor;

the base communication system processes the processed image signal from the one or more of the plurality of vehicles to determine the carbon monoxide level in an area;

the base communication system sends the output signal based to a traffic controller device based on the carbon monoxide level in the area.

11. The system of claim 1, further comprising a database of suspicious vehicles wherein the camera in one or more of the plurality of vehicles is configured to create images of nearby vehicles and the processed image signal from each of the one or more of the plurality of vehicles includes images of nearby vehicles;

the base communication station processes the processed image signal from the one or more of the plurality of vehicles to determine one or more features of the nearby vehicles;

the base communication station compares the one or more features of the nearby vehicles to the database of suspicious vehicles; and

the base communication station transmits the output signal based on the comparison of the one or more features of the nearby vehicles to the database of suspicious vehicles.

12. The system of claim 1, further comprising a fixed sensor having a camera that generates an image of a traffic flow in an area and a transmitter that sends the image of the traffic flow to the base communication station, wherein the base communication station processes the processed image signal from the plurality of vehicles and the image of the traffic flow to generate the output signal;

and the base communication station transmits the output signal based on the comparison of the one or more features of the nearby vehicles to the database of suspicious vehicles.

13. The system of claim 1, wherein the processed image signal in one or more of the plurality of vehicles includes a number of vehicle passengers, an average vehicle speed and a vehicle time table;

the base communication station processes the processed image signal from the one or more of the plurality of vehicles to configure the output signal based in part on the number of vehicle passengers, the average vehicle speed and the vehicle time table; and

the base communication station transmits the output signal to the traffic control device to control the traffic control device.

14. The system of claim 1, wherein the base communication station processes the processed image signal from one of the plurality of vehicles to determine whether the vehicle is being driven safely and configures the output signal based on whether the vehicle is being driven safely.