Systems and methods for visualizing an accident involving a vehicle

• US 8,954,226 B1
• Filed: 10/18/2013
• Issued: 02/10/2015
• Est. Priority Date: 10/18/2013
• Status: Active Grant

• Current Assignee: State Farm Mutual Automobile Insurance Company (State Farm)
• Original Assignee: State Farm Mutual Automobile Insurance Company (State Farm)
• Inventors: Binion, Todd, Fields, Brian, Cielocha, Steven, Harr, Joe, Balbach, Steve J.
• Primary Examiner(s): Olszewski, John R
• Assistant Examiner(s): MELTON, TODD M
• Application Number:
  US14/057,408
• Time in Patent Office: 480 Days
• Field of Search: 701/32.2
• US Class Current: 701/33.4
• CPC Class Codes: G06Q 40/08 Insurance
• CPC Class Codes: G07C 5/008 communicating information to a remotely located station transmission systems for measured values G08C

Abstract

A method, implemented in an electronic processing system that includes a memory and one or more processors, includes receiving, at the electronic processing system, sensor data representing information collected by a first sensor (i) located on or in a first vehicle and (ii) configured to sense an environment external to the first vehicle. The method also includes storing the received sensor data in the memory, and generating, via the one or more processors and using the stored sensor data, a virtual model of an event involving at least one vehicle.

Claims

1. A method in an electronic processing system comprising a memory and one or more processors, the method comprising:

receiving, at the electronic processing system, sensor data representing information collected by a first sensor (i) located on or in a first vehicle and (ii) configured to sense an environment external to the first vehicle;

receiving, at the electronic processing system, operational data indicative of when the first vehicle is driven according to an automated control mode in which an automated driving system controls at least velocity, braking and steering of the first vehicle;

storing the received sensor data and the received operational data in the memory; and

generating, via the one or more processors and using (i) the stored sensor data and (ii) the stored operational data, a virtual model of an event involving at least one vehicle, wherein generating the virtual model includes generating a virtual model that includes an indicator of when the first vehicle is driven according to the automated control mode.

2. The method of claim 1, wherein receiving sensor data representing information collected by a first sensor includes receiving sensor data representing information collected by:

a camera device;

a radar device;

a lidar device;

or

a sonar device.

3. The method of claim 1, wherein generating a virtual model of an event involving at least one vehicle includes generating a virtual model of an accident involving at least one vehicle, the method further comprising:

determining, based on the virtual model, one or both of (i) fault for the accident and (ii) damages resulting from the accident.

4. The method of claim 1, further comprising:

causing the virtual model to be displayed to a user of the electronic processing system.

5. The method of claim 1, wherein generating a virtual model of an event involving at least one vehicle includes generating a virtual model of an accident involving at least one vehicle, the method further comprising:

causing data representing the virtual model to be sent to an electronic claims processing system.

6. The method of claim 1, wherein generating a virtual model of an event involving at least one vehicle includes generating an animated re-creation of the event that depicts at least one of:

an orientation of the first vehicle with respect to another object;

a closing speed between the first vehicle and another object;

a configuration of a driving surface;

a condition of a driving surface;

visibility conditions external to the first vehicle;

a traffic control indicator external to the first vehicle;

or

a state of a traffic control indicator external to the first vehicle.

7. The method of claim 1, wherein generating a virtual model of an event involving at least one vehicle includes generating an animated re-creation of an accident involving one or both of (i) the first vehicle and (ii) a second vehicle different than the first vehicle.

8. The method of claim 1, wherein:

the method further comprises

receiving, at the electronic processing system, additional sensor data representing information collected by a second sensor (i) located on or in a second vehicle different than the first vehicle and (ii) configured to sense an environment external to the second vehicle, and

storing the received additional sensor data in the memory; and

generating a virtual model of an event involving at least one vehicle includes generating, using (i) the stored sensor data, (ii) the stored operational data, and (iii) the stored additional sensor data, a virtual model of an event involving the first vehicle and the second vehicle.

9. The method of claim 1, wherein:

the method further comprises

receiving, at the electronic processing system, additional operational data indicative of operation of the first vehicle, and

storing the received additional operational data in the memory; and

generating, using the stored sensor data, a virtual model of an event involving at least one vehicle includes generating, using the stored sensor data and the stored additional operational data, a virtual model of an event involving at least one vehicle.

10. The method of claim 9, wherein receiving additional operational data indicative of operation of the first vehicle includes receiving operational data indicative of at least one of:

velocity of the first vehicle;

acceleration of the first vehicle;

or

diagnostics information associated with the first vehicle.

11. The method of claim 9, wherein receiving additional operational data indicative of operation of the first vehicle includes receiving operational data indicative of motion of the first vehicle with respect to six degrees of freedom.

12. The method of claim 1, wherein:

the method further comprises

receiving, at the electronic processing system, additional data representing information that the first vehicle received, via one or more wireless signals, from an external source, and

storing the received additional data in the memory; and

generating, using the stored sensor data, a virtual model of an event involving at least one vehicle includes generating, using (i) the stored sensor data, (ii) the stored operational data, and (iii) the stored additional data, a virtual model of an event involving at least one vehicle.

13. The method of claim 12, wherein receiving additional data includes at least one of:

receiving data representing information that the first vehicle received, via one or more V2V signals, from a second vehicle;

receiving data representing information that the first vehicle received, via one or more V2I signals, from an infrastructure element;

receiving data representing information that the first vehicle received, via one or more V2P signals, from a pedestrian;

or

receiving data representing information that the first vehicle received, via one or more V2X signals, from a cyclist.

14. The method of claim 1, wherein receiving sensor data representing information collected by a first sensor includes receiving sensor data at a server remote from the first vehicle via one of:

a wireless communication network;

or

a portable memory device.

15. An electronic processing system comprising:

a memory;

a data collection unit configured to

receive sensor data representing information collected by a first sensor (i) located on or in a first vehicle and (ii) configured to sense an environment external to the first vehicle,

receive operational data indicative of when the first vehicle is driven according to an automated control mode in which an automated driving system controls at least velocity, braking and steering of the first vehicle, and

store the received sensor data and the received operational data in the memory; and

a model generation unit coupled to the data collection unit and comprising one or more processors, wherein the model generation unit is configured to

generate, via the one or more processors and using (i) the stored sensor data and (ii) the stored operational data, a virtual model of an event involving at least one vehicle, wherein the virtual model includes an indicator of when the first vehicle is driven according to the automated control mode.

16. The electronic processing system of claim 15, wherein the data collection unit is configured to receive sensor data representing information collected by:

a camera device;

a radar device;

a lidar device;

or

a sonar device.

17. The electronic processing system of claim 15, wherein the model generation unit is further configured to at least one of:

cause the virtual model to be displayed to a user of the electronic processing system;

or

cause data representing the virtual model to be sent to an electronic claims processing system.

18. The electronic processing system of claim 15, wherein:

the data collection unit is further configured to

receive additional sensor data representing information collected by a second sensor (i) located on or in a second vehicle different than the first vehicle and (ii) configured to sense an environment external to the second vehicle, and

store the received additional sensor data in the memory; and

the model generation unit is configured to generate a virtual model at least by using (i) the stored sensor data, (ii) the stored operational data, and (iii) the stored additional sensor data.

19. The electronic processing system of claim 15, wherein:

the data collection unit is further configured to

receive additional operational data indicative of operation of the first vehicle, and

store the received additional operational data in the memory; and

the model generation unit is configured to generate the virtual model at least by using (i) the stored sensor data, (ii) the stored operational data, and (iii) the stored additional operational data.

20. The electronic processing system of claim 15, wherein:

the data collection unit is further configured to

receive additional data representing information that the first vehicle received, via one or more wireless signals, from an external source, and

store the received additional data in the memory; and

the model generation unit is configured to generate the virtual model at least by using (i) the stored sensor data, (ii) the stored operational data, and (iii) the stored additional data.

21. A tangible, non-transitory computer-readable storage medium storing computer-readable instructions that, when executed by one or more processors, cause the one or more processors to:

retrieve, from a memory, sensor data representing information collected by a first sensor (i) located on or in a first vehicle and (ii) configured to sense an environment external to the first vehicle;

retrieve, from a memory, operational data indicative of when the first vehicle is driven according to an automated control mode in which an automated driving system controls at least velocity, braking and steering of the first vehicle; and

generate, using (i) the retrieved sensor data and (ii) the retrieved operational data, a virtual model of an event involving at least one vehicle, wherein the virtual model includes an indicator of when the first vehicle is driven according to the automated control mode.

22. The tangible, non-transitory computer-readable storage medium of claim 21, wherein the instructions further cause the one or more processors to one or both of:

cause the virtual model to be displayed to a user of the electronic processing system;

or

cause data representing the virtual model to be sent to an electronic claims processing system.

23. The tangible, non-transitory computer-readable storage medium of claim 22, wherein:

the instructions further cause the one or more processors to retrieve, from a memory, additional sensor data representing information collected by a second sensor (i) located on or in a second vehicle different than the first vehicle and (ii) configured to sense an environment external to the second vehicle; and

the instructions cause the one or more processors to generate a virtual model at least by using (i) the retrieved sensor data, (ii) the retrieved operational data, and (iii) the retrieved additional sensor data.

24. The tangible, non-transitory computer-readable storage medium of claim 22, wherein:

the instructions further cause the one or more processors to retrieve, from a memory, additional operational data indicative of operation of the first vehicle; and

the instructions cause the one or more processors to generate the virtual model at least by using (i) the retrieved sensor data, (ii) the retrieved operational data, and (iii) the retrieved additional operational data.