Systems and methods for monitoring a vehicle operator and for monitoring an operating environment within the vehicle

• US 9,972,184 B2
• Filed: 07/24/2014
• Issued: 05/15/2018
• Est. Priority Date: 07/24/2014
• Status: Active Grant

• Current Assignee: State Farm Mutual Automobile Insurance Company (State Farm)
• Original Assignee: State Farm Mutual Automobile Insurance Company (State Farm)
• Inventors: Freeck, Jason, Ford, Alex Ewing, Sloan, Paul, Schmidt, Ryan Thomas, Angal, Mihir Dilip, Kothari, Neel
• Primary Examiner(s): Lim, Steven
• Assistant Examiner(s): LITTLEJOHN JR, MANCIL H
• Application Number:
  US14/339,652
• Publication Number:
  US 20160027276A1
• Time in Patent Office: 1,391 Days
• Field of Search: 3404261, 34042611, 34042619, 34042625, 34042632, 340575, 340576, 340439, 340435, 3404571, 701 1, 701 36, 701 51, 701 70, 455345, 4555562
• CPC Class Codes: B60R 16/037 for occupant comfort , e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel
• CPC Class Codes: G08B 21/02 Alarms for ensuring the safety of persons
• CPC Class Codes: G08B 21/06 indicating a condition of sleep, e.g. anti-dozing alarms

Abstract

The present disclosure generally relates to systems and methods for monitoring a vehicle operator and for monitoring the environment of a vehicle operator. In particularly, the present disclosure relates to systems and methods for determining a physical position of an operator within a vehicle and for determining environmental conditions surrounding the vehicle operator. The systems may include at least one of: an image sensor, an infrared sensor, an ultrasonic sensor, a microphone or a combination or sub-combination thereof. The methods may determine a position and/or an orientation of a vehicle operator'"'"'s head, arms, hands, legs, feet, etc., a combination thereof or a sub-combination thereof. The methods may generate a warning when a position of the vehicle operator is inappropriate, such as when the vehicle operator has not looked in front of the vehicle for an extended period of time when the vehicle is travelling forward, when the vehicle operator is looking at a cellular telephone, when the vehicle operator has been looking downward for an extended period of time, etc.

Claims

1. A computer implemented method for generating data representative of a position of at least a portion of a vehicle driver within an interior of a vehicle and data representative of an operating environment within the vehicle, the method comprising:

acquiring, from one or more data sources, model data, wherein the model data is representative of a model of at least a portion of the interior of the vehicle including at least a portion of a model vehicle operator;

acquiring, from two or more position sensors, vehicle driver position data, wherein a first one of the two or more position sensors is a pressure transducer located within a vehicle driver-side seat, wherein a position of the vehicle driver within the vehicle driver-side seat is inferred from shifting weight on the vehicle driver-side seat, wherein a second one of the two or more position sensors is used to generate a three-dimensional model of a vehicle driver within the interior of the vehicle, and wherein the vehicle driver position data is representative of the position of at least the portion of the vehicle driver within the interior of the vehicle;

comparing, using one or more processors, the vehicle driver position data with the model data; and

determining, using one or more processors, a difference between the vehicle driver position data and the model data based on the comparison of the vehicle driver position data with the model data to detect a vehicle driver position.

2. The method of claim 1, further comprising:

generating at least one of;

a warning to the vehicle driver that a position of at least a portion of the vehicle driver has deviated from a position of at least a portion of the model vehicle operator and an advisory to the vehicle driver how to correct a deviation of a position of at least a portion of the vehicle driver has deviated from a position of at least a portion of the model vehicle operator.

3. The method of claim 1, wherein the vehicle driver position data is acquired from at least one of:

an infrared sensor, an ultrasonic sensor, or an image sensor.

4. The method of claim 1, wherein the vehicle driver position data includes information that is representative of at least one of:

a gaze direction of the vehicle driver, an in-car gesture of the vehicle driver, a position of the vehicle driver'"'"'s head, an orientation of the vehicle driver'"'"'s head, a position of at least one of the vehicle driver'"'"'s hands, an orientation of at least one of the vehicle driver'"'"'s hands, a position of at least one of the vehicle driver'"'"'s feet or an item within at least one of the vehicle driver'"'"'s hands.

5. The method of claim 4, wherein the vehicle driver position data includes a time stamp and the information is tracked over time.

6. The method of claim 1, further comprising:

acquiring, from one or more audio sensors, audio data, wherein the audio data is representative of sound within the interior of the vehicle.

7. The method of claim 6, wherein the audio data is indicative of a volume of the sound.

8. A system for generating data representative of a position of at least a portion of a vehicle driver within an interior of a vehicle and data representative of an operating environment within the vehicle using one or more processors, the system comprising:

a model data acquisition module stored on a memory that, when executed by a processor, causes the processor to acquire model data, wherein the model data is representative of a model of at least a portion of the interior of the vehicle including at least a portion of a model vehicle operator;

a position data acquisition module stored on a memory that, when executed by a processor, causes the processor to acquire position data from at least two position sensors, wherein a first one of the at least two position sensors is a pressure transducer located within a vehicle driver-side seat, wherein a position of the vehicle driver within the vehicle driver-side seat is inferred from shifting weight on the vehicle driver-side seat, wherein a second one of the at least two position sensors is used to generate a three-dimensional model of a vehicle driver within the interior of the vehicle, and wherein the position data is representative of the position of at least the portion of the vehicle driver within the interior of the vehicle;

a comparison module stored on a memory that, when executed by a processor, causes the processor to compare the position data with the model data; and

a determination module stored on a memory that, when executed by a processor, causes the processor to determine differences between a vehicle driver position and a model vehicle operator position based on the comparison of the position data with the model data to detect a vehicle driver position associated with a vehicle accident.

9. The system of claim 8, further comprising:

a data transmission module stored on a memory that, when executed by a processor, causes the processor to transmit the position data to a remote server.

10. The system of claim 9, wherein the position data includes a time stamp and the information is tracked over time.

11. The system of claim 9, wherein the model data acquisition module and the comparison module are executed by a processor within the remote server.

12. The system of claim 8, wherein the position data includes information that is representative of at least one of:

a gaze direction of the vehicle driver, an in-car gesture of the vehicle driver, a position of the vehicle driver'"'"'s head, an orientation of the vehicle driver'"'"'s head, a position of at least one of the vehicle driver'"'"'s hands, an orientation of at least one of the vehicle driver'"'"'s hands, a position of at least one of the vehicle driver'"'"'s feet or an item within at least one of the vehicle driver'"'"'s hands.

13. The system of claim 8, further comprising:

an audio data acquisition module stored on a memory that, when executed by a processor, causes the processor to acquire audio data, wherein the audio data is representative of sound within the interior of the vehicle.

14. A non-transitory, computer-readable medium storing instructions that when executed by a process of a computer system cause the computer system to generate data representative of a position of at least a portion of a vehicle driver within an interior of a vehicle and data representative of an operating environment within the vehicle, the instructions comprising:

a model data acquisition module that, when executed by a processor, causes the processor to acquire model data, wherein the model data is representative of a model of at least a portion of the interior of the vehicle including at least a portion of a model vehicle operator;

a position data acquisition module that, when executed by a processor, causes the processor to acquire position data from at least two position sensors, wherein a first one of the at least two position sensors is a pressure transducer located within a vehicle driver-side seat, wherein a position of the vehicle driver within the vehicle driver-side seat is inferred from shifting weight on the vehicle driver-side seat, wherein a second one of the at least two position sensors is used to generate a three-dimensional model of a vehicle driver within the interior of the vehicle, and wherein the position data is representative of the position of at least the portion of the vehicle driver within the interior of the vehicle;

a comparison module that, when executed by a processor, causes the processor to compare the position data with the model data; and

a determination module that, when executed by a processor, causes the processor to determine differences between a vehicle driver position and a model vehicle operator position based on the comparison of the position data with the model data.

15. The non-transitory, computer-readable medium of claim 14, further comprising:

a data transmission module that, when executed by a processor, causes the processor to transmit the position data to a remote server.

16. The non-transitory, computer-readable medium of claim 15, wherein the position data includes a time stamp and the information is tracked over time.

17. The non-transitory, computer-readable medium of claim 15, wherein the model data acquisition module and the comparison module are executed by a processor within the remote server.

18. The non-transitory, computer-readable medium of claim 14, further comprising:

an insurance rate computation module that, when executed by a processor, causes the processor to determine an insurance rate based, at least in part, on the differences between the vehicle driver position and the model vehicle operator position.

19. The non-transitory, computer-readable medium of claim 14, wherein the audio data is representative of a volume of sound within the interior of the vehicle.

20. The non-transitory, computer-readable medium of claim 14, further comprising:

a warning/advisory generation module that, when executed by a processor, causes the processor to generate at least one of;

a warning to the vehicle driver that a position of at least a portion of the vehicle driver has deviated from a position of at least a portion of the model vehicle operator and an advisory to the vehicle driver how to correct a deviation of a position of at least a portion of the vehicle driver has deviated from a position of at least a portion of the model vehicle operator.