Real-time driver observation and scoring for driver's education

• US 10,311,750 B1
• Filed: 10/04/2016
• Issued: 06/04/2019
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: State Farm Mutual Automobile Insurance Company (State Farm)
• Original Assignee: State Farm Mutual Automobile Insurance Company (State Farm)
• Inventors: Fields, Brian M., He, Jibo, Nepomuceno, John Adrian, Roberson, Steve, Plummer, Bryan Allen, Houdek, Kurtis C., Jain, Neeraj
• Primary Examiner(s): Utama, Robert J
• Application Number:
  US15/285,001
• Time in Patent Office: 973 Days
• CPC Class Codes: A61B 5/18 for vehicle drivers or machine operators
• CPC Class Codes: B60W 2050/0064 using a remote, e.g. cordless, transmitter or receiver unit, e.g. remote keypad or mobile phone
• CPC Class Codes: B60W 2050/0075 Automatic parameter input, automatic initialising or calibrating means
• CPC Class Codes: B60W 2556/10 Historical data
• CPC Class Codes: B60W 40/09 Driving style or behaviour
• CPC Class Codes: G01C 21/3676 Overview of the route on the road map
• CPC Class Codes: G08G 1/0104 Measuring and analyzing of parameters relative to traffic conditions
• CPC Class Codes: G09B 19/14 Traffic procedures, e.g. traffic regulations
• CPC Class Codes: G09B 19/16 Control of vehicles or other craft simulators G09B9/02
• CPC Class Codes: G09B 19/167 Control of land vehicles
• CPC Class Codes: G09B 29/106 using electronic means
• CPC Class Codes: G09B 5/00 Electrically-operated educational appliances working with questions and answers G09B7/00; simulators G09B9/00; advertising or displaying in general G09F
• CPC Class Codes: G09B 5/125 the stations being mobile
• CPC Class Codes: G09B 9/02 for teaching control of vehicles or other craft
• CPC Class Codes: G09B 9/04 for teaching control of land vehicles
• CPC Class Codes: G09B 9/042 providing simulation in a real vehicle G09B9/052, G09B9/058 take precedence
• CPC Class Codes: G09B 9/052 characterised by provision for recording or measuring trainee's performance devices for psychotechnics, e.g. for vehicle drivers A61B5/16, A61B5/18

Abstract

A method includes, during a driving session in which a student driver operates a vehicle, gathering driving skill data indicative of at least one of behavior of the student driver, acceleration of the vehicle, braking of the vehicle, or steering of the vehicle, and gathering comments from a driving instructor about the driving session. The method also includes generating a driving session report corresponding to the driving session. The driving session report includes at least one score based on the driving skill data, and the comments from the driving instructor about the driving session. Still further, the method includes causing the driving session report to be displayed on a display device.

Claims

1. A method comprising:

during a driving session in which a student driver operates a vehicle while observed by a driving instructor;

gathering, by an on-board computer of the vehicle, driving skill data indicative of vehicle operation by the student driver from one or more sensors disposed within the vehicle, the one or more sensors including at least one of the following;

an accelerometer array, a geopositioning device, or an image capture device, and

gathering, by a user interface of a mobile device, comments from the driving instructor regarding vehicle operation at one or more geographic locations along a route traveled by the vehicle during the driving session, wherein the comments are each associated with one of the one or more geographic locations based upon data gathered from the one or more sensors;

calculating, by one or more processors of the mobile device or of an additional computing device communicatively connected to one or both of the on-board computer or the mobile device, at least one score based on one or more values of the driving skill data indicative of acceleration, braking, steering, gaze location, scanning frequency, lane deviation, lane centering, or time to collision;

generating, by the one or more processors, a driving session report corresponding to the driving session, including;

the at least one score based on the one or more values of the driving skill data, and

the gathered comments from the driving instructor about the driving session; and

causing the driving session report to be displayed on a display device for review.

2. The method of claim 1, further comprising:

communicating, from the on-board computer to the mobile device, the driving skill data.

3. The method of claim 2, wherein the on-board computer communicates the driving skill data to the mobile device during the driving session.

4. The method of claim 1, wherein the display device is a display of the mobile device.

5. The method of claim 1, wherein the driving session report is generated by the additional computing device.

6. The method of claim 1, further comprising:

gathering, via the user interface and following the driving session, one or more additional comments from the driving instructor regarding vehicle operation by the student driver,

wherein the driving session report further includes the one or more additional comments.

7. The method of claim 1, wherein calculating the at least one score includes:

calculating a plurality of scores corresponding to one or more of the following;

gaze location, scanning frequency, lane deviation, lane centering, time to collision, braking, acceleration, or steering of the student driver; and

combining the plurality of scores to generate a composite score representative of a performance of the student driver during the driving session,

wherein the at least one score included in the driving session report includes at least one of the plurality of scores and the composite score.

8. The method of claim 7, wherein at least one of the plurality of scores is calculated using a weighting factor adjusted for the student driver based upon previous driving sessions of the student driver.

9. The method of claim 1, wherein the comments from the driving instructor about the driving session include comment text written by the driving instructor.

10. A system comprising:

an on-board computer disposed within a vehicle, the on-board computer having one or more processors;

a mobile device having one or more processors and a user interface;

one or more sensors installed within the vehicle and communicatively connected to the on-board computer, the one or more sensors configured to generate driving skill data indicative of vehicle operation by a student driver, including at least one of the following;

an accelerometer array, a geopositioning device, or an image capture device;

a first non-transitory memory storing computer-readable instructions that, when executed by the one or more processors of the on-board computer, cause the on-board computer to gather driving skill data indicative of vehicle operation by the student driver from the one or more sensors during a driving session in which a student driver operates the vehicle while observed by a driving instructor;

one or more additional non-transitory memories storing computer-readable instructions that, when executed by the one or more processors of the mobile device or one or more processors of an additional computing device, cause the mobile device or additional computing device to;

gather, via the user interface and during the driving session, comments from the driving instructor regarding vehicle operation at one or more geographic locations along a route traveled by the vehicle during the driving session using the user interface, wherein the comments are each associated with one of the one or more geographic locations based upon data gathered from the one or more sensors;

calculate at least one score based on one or more values of the driving skill data indicative of acceleration, braking, steering, gaze location, scanning frequency, lane deviation, lane centering, or time to collision;

generate a driving session report corresponding to the driving session, including;

the at least one score based on the one or more values of the driving skill data, and

the gathered comments from the driving instructor about the driving session; and

cause the driving session report to be displayed on a display device for review.

11. The system of claim 10, wherein the one or more additional non-transitory memories include:

a second non-transitory memory of the mobile device storing instructions that, when executed by the one or more processors of the mobile device, cause the mobile device to gather the comments from the driving instructor, and

a third non-transitory memory of the additional computing device storing instructions that, when executed by the one or more processors of the additional computing device, cause the additional computing device to;

generate the driving session report, and

cause the driving session report to be displayed on the display device, wherein

the display device is a display device of the additional computing device.

12. The system of claim 10, wherein the first non-transitory memory further stores computer-readable instructions that cause the on-board computer to communicate the driving skill data to the mobile device during the driving session.

13. The system of claim 10, wherein:

generating the driving session report further includes generating a map, wherein the map includes a representation of each of the comments from the driving instructor at the geographic location corresponding to each of the comments from the driving instructor, and

causing the driving session report to be displayed on the user interface includes causing the map to be displayed on the display device.

14. The system of claim 10, wherein the computer-readable instructions stored on the first non-transitory memory further cause the one or more processors of the on-board computer to detect one or more driving events during the driving session based on the driving skill data, wherein each of the one or more driving events is associated with one of the one or more geographic locations along the route traveled by the vehicle during the driving session.

15. The system of claim 14,

wherein generating the driving session report further includes generating a map, wherein the map includes a representation of each of the one or more driving events at the geographic location corresponding to each of the one or more driving events, and

wherein causing the driving session report to be displayed on the user interface includes causing the map to be displayed on the user interface.

16. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors of a computer system, cause the computer system to:

during a driving session in which a student driver operates a vehicle while observed by a driving instructor;

gather driving skill data indicative of vehicle operation by the student driver from one or more sensors disposed within the vehicle from an on-board computer of the vehicle, the one or more sensors including at least one of the following;

an accelerometer array, a geopositioning device, or an image capture device,

generate a user interface on a mobile device, and

gather, via the user interface, comments from the driving instructor regarding vehicle operation at one or more geographic locations along a route traveled by the vehicle during the driving session, wherein the comments are each associated with one of the one or more geographic locations based upon data gathered from the one or more sensors;

calculate, via one or more processors of the mobile device or of an additional computing device communicatively connected to one or both of the on-board computer or the mobile device, at least one score based on one or more values of the driving skill data indicative of acceleration, braking, steering, gaze location, scanning frequency, lane deviation, lane centering, or time to collision;

generate, via the one or more processors of the mobile device or the additional computing device, a driving session report corresponding to the driving session, including;

the at least one score based on the one or more values of the driving skill data, and

the gathered comments from the driving instructor about the driving session; and

cause the driving session report to be displayed on a display device for review.

17. The non-transitory computer-readable medium of claim 16, further comprising instructions that cause the on-board computer to communicate the driving skill data to the mobile device during the driving session.

18. The non-transitory computer-readable medium of claim 16, wherein the driving session report is generated by the additional computing device.