Systems and methods for using image data to generate vehicle operation logs

• US 9,646,433 B1
• Filed: 09/23/2015
• Issued: 05/09/2017
• Est. Priority Date: 09/23/2015
• Status: Active Grant

• Current Assignee: State Farm Mutual Automobile Insurance Company (State Farm)
• Original Assignee: State Farm Mutual Automobile Insurance Company (State Farm)
• Inventors: Sanchez, Kenneth Jason, Chan, Aaron Scott
• Primary Examiner(s): DULANEY, KATHLEEN YUAN
• Application Number:
  US14/862,949
• Time in Patent Office: 594 Days
• Field of Search: 382118, 382104, 348148, 701523
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G07C 5/0808 Diagnosing performance data testing of vehicles G01M17/00; testing of electrical installation on vehicles G01R31/005
• CPC Class Codes: G07C 5/085 using electronic data carriers
• CPC Class Codes: G07C 5/0866 the electronic data carrier being a digital video recorder in combination with video camera
• CPC Class Codes: G07C 9/257 electronically G07C9/26 takes precedence

Abstract

Systems and methods for generating vehicle operation logs are provided. According to certain aspects, an electronic device may receive and analyze image data depicting an individual located within a vehicle. The electronic device may also interface with a set of sensors to retrieve or access relevant data related to the operation of the vehicle, such as time and date information, location information, and other data. The electronic device may generate a vehicle operation log that associates the individual depicted in the image data with the vehicle operating parameters.

Claims

1. A computer-implemented method in an electronic device of generating a vehicle operation log associated with operation of a vehicle, the method comprising:

receiving, at a first time, first image data from at least one image sensor, wherein the at least one image sensor is located within the vehicle;

receiving, at a second time after the first time, second image data from the at least one image sensor;

analyzing, by a computer processor, the first image data and the second image data to identify an operator of the vehicle;

in response to identifying the operator of the vehicle;

identifying a current time corresponding to approximately when the second image data is received,

detecting that the vehicle is operating, and

retrieving, from a location module, location data indicating a location of the vehicle at the current time;

determining, from the location data, route information associated with operation of the vehicle, the route information identifying a set of roadways on which the vehicle has operated;

generating the vehicle operation log to indicate the operator of the vehicle, the current time, and the route information;

analyzing, at a third time after the second time, the route information included in the vehicle operation log to identify an efficient route; and

displaying, in a user interface, an interface indicating the vehicle operation log, the interface identifying, concurrently, (i) the operator of the vehicle, (ii) the vehicle, and (iii) at least a portion of the route information.

2. The computer-implemented method of claim 1, wherein receiving the first image data and the second image data comprises:

receiving the first image data and the second image data from the at least one image sensor included in the electronic device.

3. The computer-implemented method of claim 1, wherein analyzing the first image data and the second image data to identify the operator of the vehicle comprises:

accessing image profile data associated with the operator of the vehicle; and

comparing the first image data and the second image data to the image profile data to determine that the operator of the vehicle is depicted in the first image data and the second image data.

4. The computer-implemented method of claim 3, wherein comparing the first image data and the second image data to the image profile data comprises:

performing a facial recognition analysis using the first image data, the second image data, and the image profile data; and

based on a result of the facial recognition analysis, determining that the operator of the vehicle is depicted in the first image data and the second image data.

5. The computer-implemented method of claim 1, wherein identifying the current time comprises:

identifying the current time and a current date;

and wherein generating the vehicle operation log comprises;

generating the vehicle operation log to indicate the operator of the vehicle, the current time, the route information, and the current date.

6. The computer-implemented method of claim 1, wherein detecting that the vehicle is operating comprises:

retrieving the location data from the location module of the electronic device; and

determining, from the location data, that the vehicle is currently in motion.

7. The computer-implemented method of claim 1, wherein detecting that the vehicle is operating comprises:

receiving, from an on-board sensor of the vehicle, an indication that the vehicle is in motion.

8. A system in an electronic device for generating a vehicle operation log associated with operation of a vehicle, comprising:

a location module configured to generate location data;

a user interface;

a memory configured to store non-transitory computer executable instructions; and

a processor configured to interface with the memory, the location module, and the user interface, wherein the processor is configured to execute the non-transitory computer executable instructions to cause the processor to;

receive, at a first time, first image data from at least one image sensor located within the vehicle,

receive, at a second time after the first time, second image data from the at least one image sensor,

analyze the first image data and the second image data to identify an operator of the vehicle,

in response to identifying the operator of the vehicle;

identify a current time corresponding to approximately when the second image data is received,

detect that the vehicle is operating, and

retrieve, from the location module, the location data indicating a location of the vehicle at the current time,

determine, from the location data, route information associated with operation of the vehicle, the route information identifying a set of roadways on which the vehicle has operated,

generate the vehicle operation log to indicate the operator of the vehicle, the current time, and the route information,

analyze, at a third time after the second time, the route information included in the vehicle operation log to identify an efficient route, and

cause the user interface to display an interface indicating the vehicle operation log, the interface identifying, concurrently, (i) the operator of the vehicle, (ii) the vehicle, and (iii) at least a portion of the route information.

9. The system of claim 8, wherein to receive the first image data and the second image data, the processor is configured to:

receive the first image data and the second image data from the at least one image sensor included in the electronic device.

10. The system of claim 8, wherein to analyze the first image data and the second image data to identify the operator of the vehicle, the processor is configured to:

access image profile data associated with the operator of the vehicle, and

compare the first image data and the second image data to the image profile data to determine that the operator of the vehicle is depicted in the first image data and the second image data.

11. The system of claim 10, wherein to compare the first image data and the second image data to the image profile data, the processor is configured to:

perform a facial recognition analysis using the first image data, the second image data, and the image profile data, and

based on a result of the facial recognition analysis, determine that the operator of the vehicle is depicted in the first image data and the second image data.

12. The system of claim 8, wherein to identify the current time the processor is configured to:

identify the current time and a current date;

and wherein to generate the vehicle operation log, the processor is configured to;

generate the vehicle operation log to indicate the operator of the vehicle, the current time, the route information, and the current date.

13. The system of claim 8, wherein to detect that the vehicle is operating, the processor is configured to:

retrieve the location data from the location module, and

determine, from the location data, that the vehicle is currently in motion.

14. The system of claim 8, wherein to detect that the vehicle is operating, the processor is configured to:

receive, from an on-board sensor of the vehicle, an indication that the vehicle is in motion.