Method and system for avatar replay based on mobile sensor information

• US 9,639,978 B2
• Filed: 12/04/2013
• Issued: 05/02/2017
• Est. Priority Date: 12/04/2013
• Status: Active Grant

• Current Assignee: Verizon Patent and Licensing Incorporated (Verizon Communications Inc.)
• Original Assignee: Verizon Telematics Inc. (Verizon Communications Inc.)
• Inventors: Siegel, Robert, Barfield, Jr., James
• Primary Examiner(s): Patel, Jay
• Assistant Examiner(s): MATT, MARNIE A
• Application Number:
  US14/096,201
• Publication Number:
  US 20150155007A1
• Time in Patent Office: 1,245 Days
• Field of Search: 386278
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering

Abstract

A system and method for generating and displaying a video animation or replay of a user'"'"'s drive or run using data from sensors, mapping data, manufacturer data, environmental data, and/or user data. The video replay shows an avatar representing the user or the user'"'"'s vehicle and may also show the surrounding environment through which the user traveled. The video replay may be used for entertainment, instruction, insurance, or law enforcement purposes, for example.

Claims

1. A method comprising:

receiving, by a device, sensor data generated during a drive, from one or more sensors onboard a vehicle;

receiving, by the device and in advance of the drive, mapping data corresponding to locations to be traveled during the drive by the vehicle,

the mapping data, comprising 2D or 3D images and road information, having been generated independent of the drive by the vehicle;

processing the sensor data and the mapping data, by the device, to correlate the sensor data and the mapping data using location information in the sensor data and in the mapping data;

generating, by the device, a video animation of the drive using the sensor data and mapping data,

at least a portion of the video animation being generated in advance of the drive based on the 2D or 3D images and road information received in advance of the drive,

modifying, by the device, the at least the portion of the video animation, generated in advance of the drive, to include a precise location on a road in which the vehicle traveled during the drive based on the sensor data generated during the drive by the one or more sensors onboard the vehicle; and

outputting, by the device, the video animation of the drive, including at least a modified portion of the video animation, to a display device.

2. The method of claim 1, where the one or more sensors comprise an OnBoard Diagnostic (OBD) device,

the OBD device comprising a location sensor, an accelerometer, and a gyroscope.

3. The method of claim 1, further comprising:

classifying events by comparing the sensor data to predetermined threshold values or default values.

4. The method of claim 3, where the events include at least two of:

a hard stop, a hard turn, speeding, failure to stop, or failure to signal.

5. The method of claim 3, further comprising:

using the events for underwriting in usage-based insurance (UBI) or to instruct a driver to improve driving performance.

6. The method of claim 3, further comprising:

outputting text identifying the events.

7. The method of claim 1, wherein the display device is a smartphone, tablet computer, or a vehicle display.

8. The method of claim 1, further comprising:

receiving environmental data; and

processing the environmental data to correlate the environmental data and the sensor data using timestamp information and location information in the sensor data and in the environmental data.

9. The method of claim 1, further comprising:

receiving manufacturer data and weather data,

the manufacturer data comprising model data of the vehicle, and

the weather data comprising climate data corresponding to a time that the vehicle performed the drive,

where generating the video animation comprises;

generating a visual depiction of a model of the vehicle and weather conditions encountered by the vehicle during the drive using the manufacturer data and the weather data.

16. The method of claim 1, further comprising:

receiving user information indicating a starting location for the drive and an ending location for the drive;

determining at least one route for the drive based on the user information; and

where receiving the mapping data in advance of the drive comprises;

receiving the mapping data in advance of the drive based on the at least one route.

17. The method of claim 1, where outputting the video animation includes outputting the video animation as a replay of the drive.

18. The method of claim 1, where modifying the at least the portion of the video animation includes:

modifying the at least the portion of the video animation generated in advance of the drive to include a lane of a street in which the vehicle traveled during the drive.

19. The method of claim 1, where modifying the at least the portion of the video animation includes:

modifying the at least the portion of the video animation generated in advance of the drive based on at least one of;

a force of a turn of the vehicle during the drive, or

a turning radius of the vehicle during the drive.

20. The method of claim 1, where modifying the at least the portion of the video animation includes:

modifying a depiction of an avatar for the vehicle to reflect at least one of a force of a turn of the vehicle during the drive or a turning radius of the vehicle during the drive.

10. A device comprising:

one or more processors to;

receive sensor data, generated during a drive, from one or more sensors onboard a vehicle;

receive, in advance of the drive, mapping data corresponding to locations to be traveled during the drive by the vehicle,

the mapping data, comprising 2D or 3D images and road information, having been generated independent of the drive by the vehicle;

process the sensor data and the mapping data to correlate the sensor data and the mapping data using location information in the sensor data and in the mapping data;

generate a video animation of the drive using the sensor data and mapping data,

at least a portion of the video animation being generated in advance of the drive based on the 2D or 3D images and road information received in advance of the drive,

modify the at least the portion of the video animation, generated in advance of the drive, to include a precise location on a road in which the vehicle traveled during the drive based on the sensor data generated during the drive by the one or more sensors onboard the vehicle; and

output the video animation of the drive, including at least a modified portion of the video animation, to a display device.

11. The device of claim 10, where the one or more sensors comprise an OnBoard Diagnostic (OBD) device,

the OBD device comprising a location sensor, an accelerometer, and a gyroscope.

12. The device of claim 10, where the one or more processors are further to:

classify events by comparing the sensor data to predetermined threshold values or default values.

13. The device of claim 12, where the events include at least two of:

a hard stop, a hard turn, speeding, failure to stop, or failure to signal.

14. The device of claim 12, where the events are used for underwriting in usage-based insurance (UBI) or to instruct a driver to improve driving performance.

15. A non-transitory computer-readable medium storing instructions, the instructions comprising:

one or more instructions which, when executed by a processor, cause the processor to;

receive sensor data, sensed during a drive, from one or more sensors onboard a vehicle;

receive, in advance of the drive, mapping data corresponding to locations to be traveled during the drive by the vehicle,

the mapping data, comprising 2D or 3D images and road information, having been generated independent of the drive by the vehicle;

process the sensor data and the mapping data to correlate the sensor data and the mapping data using location information in the sensor data and in the mapping data;

generate a video animation of the drive using the sensor data and mapping data,

at least a portion of the video animation being generated in advance of the drive based on the 2D or 3D images and road information received in advance of the drive,

modify the at least the portion of the video animation, generated in advance of the drive, to include a precise location on a road in which the vehicle traveled during the drive based on the sensor data sensed during the drive by the one or more sensors onboard the vehicle; and

output the video animation of the drive, including at least a modified portion of the video animation, to a display device.