Vehicle behavior analysis

• US 10,318,828 B2
• Filed: 12/19/2013
• Issued: 06/11/2019
• Est. Priority Date: 12/19/2013
• Status: Active Grant

• Current Assignee: Harman International Industries Incorporated (Samsung Electronics Co. Ltd.)
• Original Assignee: Harman International Industries Incorporated (Samsung Electronics Co. Ltd.)
• Inventors: Hampiholi, Vallabha
• Primary Examiner(s): Monshi, Samira
• Application Number:
  US14/135,264
• Publication Number:
  US 20150178578A1
• Time in Patent Office: 2,000 Days
• Field of Search: None
• CPC Class Codes: G06V 20/584 of vehicle lights or traffic lights
• CPC Class Codes: G08G 1/052 with provision for determining speed or overspeed speed measuring in general G01P
• CPC Class Codes: G08G 1/091 Traffic information broadcasting broadcasting communication H04H
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection
• CPC Class Codes: G08G 1/205 Indicating the location of the monitored vehicles as destination, e.g. accidents, stolen, rental

Abstract

Embodiments are disclosed for identifying potentially erratic vehicles travelling near a vehicle including an in-vehicle computing system. In some embodiments, an in-vehicle computing system for a vehicle includes a processor, a sensor subsystem communicatively coupleable to a camera mounted on the vehicle, and an external device interface communicatively coupleable to an extra-vehicle server. The in-vehicle computing system may also include a storage device storing instructions executable by the processor to monitor neighboring vehicles within a field of view of the camera, identify a potential erratic vehicle, and transmit vehicle information to the extra-vehicle server.

Claims

1. An in-vehicle computing system for a vehicle, comprising:

a processor;

a sensor subsystem communicatively coupleable to a camera mounted on the vehicle;

an external device interface communicatively coupleable to an extra-vehicle device located externally from each of the vehicle, the sensor subsystem, and the camera; and

a storage device storing instructions executable by the processor to;

monitor, with the sensor subsystem, neighboring vehicles within a field of view of the camera;

image potential erratic behavior of an imaged vehicle via the camera;

identify, with the processor, the imaged vehicle as a potential erratic vehicle based on the imaged potential erratic behavior, wherein identifying the potential erratic vehicle includes identifying, with the processor using information from the sensor subsystem, a behavior of each of the neighboring vehicles and comparing, with the processor, the behavior of each of the neighboring vehicles to the potential erratic behavior of the potential erratic vehicle; and

automatically transmit, via the external device interface, vehicle information from the in-vehicle computing system for the vehicle to the extra-vehicle device located externally from the vehicle, the vehicle information indicating the imaged potential erratic behavior of the potential erratic vehicle.

2. The in-vehicle computing system of claim 1, wherein identifying the potential erratic vehicle includes determining one or more driving characteristics of each neighboring vehicle including speed, erratic acceleration, frequent braking, and driving patterns of each neighboring vehicle, and then automatically transmitting, without distracting a driver of the vehicle, the one or more driving characteristics to the extra-vehicle device in coordination with an identifier of the potential erratic vehicle.

3. The in-vehicle computing system of claim 1, wherein identifying the potential erratic vehicle further includes sending image data from the camera to an external device located remotely from the in-vehicle computing system, the external device running an application configured to analyze the image data and identify the potential erratic vehicle based on the image data.

4. The in-vehicle computing system of claim 1, wherein the extra-vehicle device is an extra-vehicle server, and wherein the instructions are further executable by the processor to identify a type of roadway on which the potential erratic vehicle is traversing and a type of indicator of the potential erratic vehicle, and transmit the identified type of roadway and the type of indicator to the extra-vehicle server in association with a vehicle identifier for the potential erratic vehicle, then receive an alert confirming that the potential erratic vehicle is verified as an erratic vehicle responsive to the extra-vehicle server comparing the vehicle identifier with vehicle identifiers received from one or more other observing vehicles and determining that a threshold number of observing vehicles identified the potential erratic vehicle, the threshold number of observing vehicles being based at least on the type of roadway on which the observing vehicles are traversing when observing the potential erratic vehicle.

5. The in-vehicle computing system of claim 1, wherein the extra-vehicle device is a mobile device, and wherein the instructions are further executable by the processor to receive an alert identifying an erratic vehicle identified by another neighboring vehicle.

6. The in-vehicle computing system of claim 1, wherein the camera includes a camera system comprising a rear-facing camera and at least one additional camera, and wherein the instructions are executable by the processor to identify the imaged vehicle as the potential erratic vehicle based on observing a threshold number of indicators of the imaged potential erratic behavior, wherein each of the indicators of the imaged potential erratic behavior is weighted relative to other indicators.

7. The in-vehicle computing system of claim 1, further comprising a Controller Area Network (CAN) stack communicatively connected to an electronic control unit for the camera via a CAN bus of the vehicle, the CAN stack configured to provide instructions to control operation of the camera, wherein at least the processor and the external device interface form an integrated head unit installed in an instrument panel of a cabin of the vehicle.

8. The in-vehicle computing system of claim 1, wherein the vehicle information includes, in addition to the vehicle information indicating the imaged potential erratic behavior, a vehicle identifier for the potential erratic vehicle and/or a vehicle status or condition of the potential erratic vehicle.

9. The in-vehicle computing system of claim 8, wherein the vehicle identifier includes one or more of a plate number, a make of the potential erratic vehicle, a model of the potential erratic vehicle, and a color of the potential erratic vehicle, and wherein the vehicle condition of the potential erratic vehicle includes one or more of a tire puncture, an incompletely closed door, a shifting vehicle load, and a non-functioning light.

10. The in-vehicle computing system of claim 8, wherein the vehicle status includes one or more of a location and speed of the potential erratic vehicle, wherein identifying the potential erratic vehicle further comprises identifying the potential erratic vehicle as being potentially erratic based at least on the vehicle status, and wherein transmitting the vehicle information to the extra-vehicle device comprises transmitting the vehicle status to the extra-vehicle device.

19. The in-vehicle computing system of claim 1, wherein monitoring neighboring vehicles within the field of view of the camera includes capturing image data including a number plate of each neighboring vehicle within the field of view of the camera to identify each neighboring vehicle and, for each identified neighboring vehicle, capturing a stream of image data imaging the identified neighboring vehicle over time.

20. The in-vehicle computing system of claim 1, wherein identifying the potential erratic vehicle includes determining that the image data provides evidence that the potential erratic vehicle is erratically overtaking one or more other vehicles.

11. An in-vehicle computing system for a vehicle, comprising:

a processor;

a sensor subsystem communicatively coupleable to a camera mounted on the vehicle;

an external device interface communicatively coupleable to an extra-vehicle server that is separate from the vehicle and located externally from each of the vehicle, the sensor subsystem, and the camera; and

a storage device storing instructions executable by the processor to;

for each neighboring vehicle within a field of view of the camera, control the camera, via the sensor subsystem, to capture at least one frame of image data including a license plate of the neighboring vehicle;

control the camera, via the sensor subsystem, to capture a stream of image data indicating one or more driving behaviors exhibited by each neighboring vehicle within the field of view of the camera;

compare, with the processor, the one or more driving behaviors to driving behaviors exhibited by the vehicle and/or one or more other neighboring vehicles;

identify, with the processor, a potential erratic vehicle of the neighboring vehicles based on the stream of image data and the one or more driving behaviors;

automatically transmit, via the external device interface, vehicle information corresponding to the potential erratic vehicle to the extra-vehicle server, the vehicle information including an identifier presented on the license plate of the potential erratic vehicle and the one or more driving behaviors exhibited by the potential erratic vehicle;

receive, from the extra-vehicle server via the external device interface, an alert identifying the potential erratic vehicle as a confirmed erratic vehicle responsive to the extra-vehicle server determining that a threshold number of observing vehicles identified the potential erratic vehicle based on the one or more driving behaviors of the potential erratic vehicle; and

present, via an output device, the alert identifying the potential erratic vehicle as the confirmed erratic vehicle to a driver.

12. The in-vehicle computing system of claim 11, wherein the output device comprises a display of the vehicle and/or one or more speakers of the vehicle, the in-vehicle computing system further comprising a frame grabber communicatively connected to the camera and configured to receive the stream of image data from the camera and separate the stream of image data into individual frames.

13. The in-vehicle computing system of claim 12, further comprising a video analytics module configured to analyze the individual frames from the frame grabber to determine the one or more driving behaviors, wherein the one or more driving behaviors includes frequent lane changes, and identifying the potential erratic vehicle further comprises determining that a number of times the potential erratic vehicle changed lanes exceeded a threshold above an average number of times each of the neighboring vehicles changed lanes.

21. The in-vehicle computing system of claim 13, further comprising an event generator configured to generate a signal indicating a presence of the potential erratic vehicle and/or associated details based on data received at the event generator from the video analytics module.

14. A method of identifying a potential erratic vehicle within a field of view of a camera of a vehicle, the method comprising:

receiving, at an extra-vehicle server external to the vehicle, vehicle information for a potential erratic vehicle, the vehicle information including an indication of an erratic behavior of the potential erratic vehicle as identified by at least the vehicle and a type of a roadway on which the potential erratic vehicle is traversing;

determining, with the extra-vehicle server, a number of observing vehicles from which vehicle information for the potential erratic vehicle is received; and

responsive to determining that the number of observing vehicles is above a threshold number of observing vehicles, generating and transmitting an alert to one or more vehicles in a geographical vicinity of the potential erratic vehicle confirming that the potential erratic vehicle is verified as an erratic vehicle.

15. The method of claim 14, wherein the alert from the extra-vehicle server includes a vehicle identifier and a vehicle status of the erratic vehicle, and wherein the one or more vehicles in the geographical vicinity of the potential erratic vehicle are determined to be within a threshold distance of a last known location of the verified erratic vehicle, the threshold distance being based on a determined speed of the verified erratic vehicle.

18. The method of claim 14, wherein the threshold number of observing vehicles is based on one or more of the type of the roadway that the observing vehicles are traversing and a traffic condition on the roadway.

16. A method of identifying a potential erratic vehicle within a field of view of a camera of a vehicle, the method comprising:

receiving, at an extra-vehicle server external to the vehicle, vehicle information for a potential erratic vehicle, the vehicle information including an indication of an erratic behavior exhibited by the potential erratic vehicle as identified by at least the vehicle;

determining, with the extra-vehicle server, a number of observing vehicles from which vehicle information for the potential erratic vehicle is received; and

responsive to determining that the number of observing vehicles is above a threshold number of observing vehicles, generating and transmitting an alert to one or more vehicles in a geographical vicinity of the potential erratic vehicle confirming that the potential erratic vehicle is verified as an erratic vehicle;

the method further comprising determining, with the extra-vehicle server, a number of erratic behaviors identified for the potential erratic vehicle, and wherein the alert is transmitted to the one or more vehicles responsive to determining that a threshold number of erratic behaviors is identified by the vehicle.

17. The method of claim 16, wherein the threshold number of erratic behaviors is based on one or more of a vehicle operating condition and an environmental condition.