Systems and methods for notifying individuals who are unfit to operate vehicles

• US 10,828,985 B1
• Filed: 01/08/2019
• Issued: 11/10/2020
• Est. Priority Date: 06/13/2016
• Status: Active Grant

• Current Assignee: State Farm Mutual Automobile Insurance Company (State Farm)
• Original Assignee: State Farm Mutual Automobile Insurance Company (State Farm)
• Inventors: Sanchez, Kenneth J., Chan, Aaron Scott
• Primary Examiner(s): Rushing, Mark S
• Application Number:
  US16/242,854
• Time in Patent Office: 672 Days
• Field of Search: 340576
• CPC Class Codes: B60K 28/066 actuating a signalling device B60K28/063 takes precedence
• CPC Class Codes: B60W 2050/146 Display means
• CPC Class Codes: B60W 2540/24 Drug level, e.g. alcohol
• CPC Class Codes: B60W 2540/26 Incapacity
• CPC Class Codes: B60W 50/14 Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G08B 21/06 indicating a condition of sleep, e.g. anti-dozing alarms

Abstract

Systems and methods for improving vehicular safety are provided. According to certain aspects, an electronic device may receive and analyze image data depicting an individual located within a vehicle. The electronic device may also access certain data related to a condition of the individual, and may accordingly determine whether the individual is fit to operate the vehicle. If the individual is unfit to operate the vehicle, the electronic device may generate and display a notification that warns of the dangers of operating the vehicle and encourages the individual to not operate the vehicle.

Claims

1. A computer-implemented method in an electronic device of improving safety of a vehicle, the method comprising:

receiving a first set of image data from a first image sensor disposed at a first location within the vehicle;

analyzing, by a computer processor, the first set of image data from the first image sensor to determine that an individual depicted in the first set of image data is not in a condition suitable to operate the vehicle;

after analyzing the first set of image data to determine that the individual is not in the condition suitable to operate the vehicle;

receiving a second set of image data from a second image sensor disposed at a second location within the vehicle different from the first location, and

analyzing the second set of image data from the second image sensor to corroborate the determination that the individual is not in the condition suitable to operate the vehicle, including determining that the second set of image data depicts that the individual has bloodshot eyes, droopy eyes and a droopy mouth;

in response to analyzing the second set of image data from the second image sensor, generating a notification including information descriptive of continued operation of the vehicle; and

causing the notification to be displayed in a user interface.

2. The computer-implemented method of claim 1, further comprising:

receiving a reading from a breathalyzer device used by the individual, the reading indicating a blood alcohol content (BAC) of the individual; and

determining, based on the BAC of the individual, that the individual is intoxicated.

3. The computer-implemented method of claim 1, wherein causing the notification to be displayed in the user interface comprises:

causing the notification to be displayed in the user interface of the electronic device.

4. The computer-implemented method of claim 1, wherein generating the notification comprises:

generating the notification further including (i) information associated with the analysis of at least one of the first set of image data from the first image sensor or the second set of image data from the second image sensor, and (ii) additional information identifying a set of risks associated with continued operation of the vehicle.

5. The computer-implemented method of claim 1, wherein analyzing the first set of image data from the first image sensor comprises:

analyzing the first set of image data from the first image sensor to determine that the individual is impaired;

and wherein generating the notification comprises;

generating the notification including an indication that the individual is impaired.

6. The computer-implemented method of claim 1, wherein analyzing the first set of image data from the first image sensor comprises:

analyzing the first set of image data from the first image sensor to determine that the individual is drowsy;

and wherein generating the notification comprises;

generating the notification including an indication that the individual is drowsy.

7. The computer-implemented method of claim 1, further comprising:

generating a vehicle log including the information associated with the analysis of at least one of the second set of image data from the second image sensor or the first set of image data from the first image sensor; and

transmitting, via a network connection, the vehicle log to a remote server.

8. A system in an electronic device for improving safety of a vehicle, comprising:

a user interface;

a memory configured to store non-transitory computer executable instructions; and

a processor configured to interface with the memory, wherein the processor is configured to execute the non-transitory computer executable instructions to cause the processor to;

receive a first set of image data from a first image sensor disposed at a first location within the vehicle,

analyze the first set of image data from the first image sensor to determine that an individual depicted in the first set of image data is not in a condition suitable to operate the vehicle,

after analyzing the first set of image data to determine that the individual is not in the condition suitable to operate the vehicle;

receive a second set of image data from a second image sensor disposed at a second location within the vehicle different from the first location, and

analyze the second set of image data from the second image sensor to corroborate the determination that the individual is not in the condition suitable to operate the vehicle, including determining that the second set of image data depicts that the individual has bloodshot eyes, droopy eyes and a droopy mouth,

in response to analyzing the second set of image data from the second image sensor, generate a notification including information descriptive of continued operation of the vehicle, and

cause the user interface to display the notification.

9. The system of claim 8, wherein the processor is further configured to:

receive a reading from a breathalyzer device used by the individual, the reading indicating a blood alcohol content (BAC) of the individual; and

determine, based on the BAC of the individual, that the individual is intoxicated.

10. The system of claim 8, wherein the processor further analyzes the first set of image data to identify the individual.

11. The system of claim 8, wherein the processor generates the notification to further include (i) information associated with the analysis of at least one of the first set of image data from the first image sensor or the second set of image data from the second image sensor, and (ii) additional information identifying a set of risks associated with continued operation of the vehicle.

12. The system of claim 8, wherein to analyze the first set of image data from the first image sensor, the processor is configured to:

analyze the first set of image data from the first image sensor to determine that the individual is impaired;

and wherein to generate the notification, the processor is configured to;

generate the notification including an indication that the individual is impaired.

13. The system of claim 8, wherein to analyze the first set of image data from the first image sensor, the processor is configured to:

analyze the first set of image data from the first image sensor to determine that the individual is drowsy;

and wherein to generate the notification, the processor is configured to;

generate the notification including an indication that the individual is drowsy.

14. The system of claim 8, wherein the processor is further configured to:

generate a vehicle log including the information associated with the analysis of at least one of the second set of image data from the second image sensor or the first set of image data from the first image sensor, and

transmit, via a network connection, the vehicle log to a remote server.

15. A non-transitory computer readable storage medium having computer-executable instructions stored therein that when executed cause an electronic device to:

receive a first set of image data from a first image sensor disposed at a first location within a vehicle,

analyze the first set of image data from the first image sensor to determine that an individual depicted in the first set of image data is not in a condition suitable to operate the vehicle,

after analyzing the first set of image data to determine that the individual is not in the condition suitable to operate the vehicle;

receive a second set of image data from a second image sensor disposed at a second location within the vehicle different from the first location, and

analyze the second set of image data from the second image sensor to corroborate the determination that the individual is not in the condition suitable to operate the vehicle, including determining that the second set of image data depicts that the individual has bloodshot eyes, droopy eyes and a droopy mouth,

in response to analyzing the second set of image data from the second image sensor, generate a notification including information descriptive of continued operation of the vehicle, and

cause a user interface to display the notification.

16. The computer readable storage medium of claim 15, wherein the computer-executable instructions when executed further cause the machine to:

receive a reading from a breathalyzer device used by the individual, the reading indicating a blood alcohol content (BAC) of the individual; and

determine, based on the BAC of the individual, that the individual is intoxicated.

17. The computer readable storage medium of claim 15, wherein the machine further analyzes the first set of image data to identify the individual.

18. The computer readable storage medium of claim 15, wherein the machine generates the notification to further include (i) information associated with the analysis of at least one of the first set of image data from the first image sensor or the second set of image data from the second image sensor, and (ii) additional information identifying a set of risks associated with continued operation of the vehicle.

19. The computer readable storage medium of claim 15, wherein to analyze the first set of image data from the first image sensor, the machine is configured to:

analyze the first set of image data from the first image sensor to determine that the individual is impaired;

and wherein to generate the notification, the machine is configured to;

generate the notification including an indication that the individual is impaired.

20. The computer readable storage medium of claim 15, wherein to analyze the first set of image data from the first image sensor, the machine is configured to:

analyze the first set of image data from the first image sensor to determine that the individual is drowsy;

and wherein to generate the notification, the machine is configured to;

generate the notification including an indication that the individual is drowsy.