Systems and methods for using image data to generate vehicle operation logs

• US 10,325,425 B1
• Filed: 03/22/2017
• Issued: 06/18/2019
• Est. Priority Date: 09/23/2015
• Status: Active Grant

• Current Assignee: State Farm Mutual Automobile Insurance Company (State Farm)
• Original Assignee: State Farm Mutual Automobile Insurance Company (State Farm)
• Inventors: Sanchez, Kenneth J., Chan, Aaron Scott
• Primary Examiner(s): Dulaney, Kathleen Y
• Application Number:
  US15/466,528
• Time in Patent Office: 818 Days
• Field of Search: 382104, 382118, 348148, 701523
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G07C 5/0808 Diagnosing performance data testing of vehicles G01M17/00; testing of electrical installation on vehicles G01R31/005
• CPC Class Codes: G07C 5/085 using electronic data carriers
• CPC Class Codes: G07C 5/0866 the electronic data carrier being a digital video recorder in combination with video camera
• CPC Class Codes: G07C 9/257 electronically G07C9/26 takes precedence

Abstract

Systems and methods for generating vehicle operation logs are provided. According to certain aspects, an electronic device may receive and analyze image data depicting an individual located within a vehicle. The electronic device may also interface with a set of sensors to retrieve or access relevant data related to the operation of the vehicle, such as time and date information, location information, and other data. The electronic device may generate a vehicle operation log that associates the individual depicted in the image data with the vehicle operating parameters.

Claims

1. A computer-implemented method in an electronic device of generating a vehicle operation log associated with operation of a vehicle, the method comprising:

recording at least one roadway on which the vehicle has operated;

receiving, at a first time subsequent to recording the at least one roadway on which the vehicle has operated, image data from at least one image sensor, wherein the at least one image sensor is located within the vehicle;

analyzing, by a computer processor, the image data to identify an operator of the vehicle;

in response to identifying the operator of the vehicle;

identifying a current time corresponding to approximately when the image data is received,

detecting that the vehicle is operating, and

retrieving, from a location module, location data indicating a location of the vehicle at the current time;

determining, from the location data, route information associated with operation of the vehicle, the route information identifying a set of roadways on which the vehicle has operated;

generating the vehicle operation log to indicate the operator of the vehicle, the current time, and the route information;

analyzing, at a second time after the first time, the route information included in the vehicle operation log to identify an efficient route;

displaying, in a user interface, a first interface including an image depicting the operator of the vehicle;

receiving, via the user interface, a next selection included in the first interface; and

responsive to receiving the next selection, displaying, in the user interface, a second interface indicating the vehicle operation log, the second interface identifying, concurrently, (i) the operator of the vehicle, (ii) the vehicle, (iii) at least a portion of the route information, and (iv) the at least one roadway recorded prior to the image data being received.

2. The computer-implemented method of claim 1, wherein receiving the image data comprises:

receiving the image data from the at least one image sensor included in the electronic device.

3. The computer-implemented method of claim 1, wherein analyzing the image data to identify the operator of the vehicle comprises:

accessing image profile data associated with the operator of the vehicle; and

comparing the image data to the image profile data to determine that the operator of the vehicle is depicted in the image data.

4. The computer-implemented method of claim 3, wherein comparing the image data to the image profile data comprises:

performing a facial recognition analysis using the image data and the image profile data; and

based on a result of the facial recognition analysis, determining that the operator of the vehicle is depicted in the image data.

5. The computer-implemented method of claim 1, wherein receiving the image data from the at least one image sensor comprises:

requesting the image data from the at least one image sensor; and

receiving, at the first time, the image data from the at least one image sensor.

6. The computer-implemented method of claim 1, wherein identifying the current time comprises:

identifying the current time and a current date;

and wherein generating the vehicle operation log comprises;

generating the vehicle operation log to indicate the operator of the vehicle, the current time, the route information, and the current date.

7. The computer-implemented method of claim 1, wherein detecting that the vehicle is operating comprises:

retrieving the location data from the location module of the electronic device; and

determining, from the location data, that the vehicle is currently in motion.

8. The computer-implemented method of claim 1, wherein detecting that the vehicle is operating comprises:

receiving, from an on-board sensor of the vehicle, an indication that the vehicle is in motion.

9. A system in an electronic device for generating a vehicle operation log associated with operation of a vehicle, comprising:

a location module configured to generate location data;

a user interface;

a memory configured to store non-transitory computer executable instructions; and

a processor configured to interface with the memory, the location module, and the user interface, wherein the processor is configured to execute the non-transitory computer executable instructions to cause the processor to;

record at least one roadway on which the vehicle has operated;

receive, at a first time subsequent to recording the at least one roadway on which the vehicle has operated, image data from at least one image sensor located within the vehicle,

analyze the image data to identify an operator of the vehicle,

in response to identifying the operator of the vehicle;

identify a current time corresponding to approximately when the image data is received,

detect that the vehicle is operating, and

retrieve, from the location module, the location data indicating a location of the vehicle at the current time,

determine, from the location data, route information associated with operation of the vehicle, the route information identifying a set of roadways on which the vehicle has operated,

generate the vehicle operation log to indicate the operator of the vehicle, the current time, and the route information,

analyze, at a second time after the first time, the route information included in the vehicle operation log to identify an efficient route,

cause the user interface to display a first interface including an image depicting the operator of the vehicle,

receive, via the user interface, a next selection included in the first interface, and

cause the user interface to display a second interface indicating the vehicle operation log, the second interface identifying, concurrently, (i) the operator of the vehicle, (ii) the vehicle, (iii) at least a portion of the route information, and (iv) the at least one roadway recorded prior to the image data being received.

10. The system of claim 9, wherein to receive the image data, the processor is configured to:

receive the image data from the at least one image sensor included in the electronic device.

11. The system of claim 9, wherein to analyze the image data to identify the operator of the vehicle, the processor is configured to:

access image profile data associated with the operator of the vehicle, and

compare the image data to the image profile data to determine that the operator of the vehicle is depicted in the image data.

12. The system of claim 11, wherein to compare the image data to the image profile data, the processor is configured to:

perform a facial recognition analysis using the image data and the image profile data, and

based on a result of the facial recognition analysis, determine that the operator of the vehicle is depicted in the image data.

13. The system of claim 9, wherein to receive the image data from the at least one image sensor, the processor is configured to:

request the image data from the at least one image sensor, and

receive, at the first time, the image data from the at least one image sensor.

14. The system of claim 9, wherein to identify the current time the processor is configured to:

identify the current time and a current date;

and wherein to generate the vehicle operation log, the processor is configured to;

generate the vehicle operation log to indicate the operator of the vehicle, the current time, the route information, and the current date.

15. The system of claim 9, wherein to detect that the vehicle is operating, the processor is configured to:

retrieve the location data from the location module, and

determine, from the location data, that the vehicle is currently in motion.

16. The system of claim 9, wherein to detect that the vehicle is operating, the processor is configured to:

receive, from an on-board sensor of the vehicle, an indication that the vehicle is in motion.