System for monitoring vehicle operator compliance with safe operating conditions

• US 10,524,716 B2
• Filed: 11/04/2015
• Issued: 01/07/2020
• Est. Priority Date: 11/06/2014
• Status: Active Grant

• Current Assignee: Maven Machines, Inc.
• Original Assignee: Maven Machines, Inc.
• Inventors: Geller, Avishai, Swerdlow, Samuel J.
• Primary Examiner(s): Syed, Nabil H
• Assistant Examiner(s): Eustaquio, Cal J
• Application Number:
  US14/932,730
• Publication Number:
  US 20160133117A1
• Time in Patent Office: 1,525 Days
• CPC Class Codes: A61B 5/11 Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb for measuring pulse A61B5/02 ;A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721
• CPC Class Codes: A61B 5/163 by tracking eye movement, gaze, or pupil change
• CPC Class Codes: A61B 5/18 for vehicle drivers or machine operators
• CPC Class Codes: A61B 5/6803 Head-worn items, e.g. helmets, masks, headphones or goggles
• CPC Class Codes: A61B 5/7282 Event detection, e.g. detecting unique waveforms indicative of a medical condition A61B5/4094, A61B5/4818, A61B5/349, A61B5/0823 take precedence
• CPC Class Codes: A61B 5/746 Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms alarms per se G08B
• CPC Class Codes: B60R 1/04 mounted inside vehicle B60R1/025, B60R1/08 take precedence
• CPC Class Codes: G08B 21/06 indicating a condition of sleep, e.g. anti-dozing alarms
• CPC Class Codes: G08B 21/24 Reminder alarms, e.g. anti-loss alarms

Abstract

A system for monitoring vehicle operator mirror check procedure includes a wearable electronic device configured to be worn on the head of a vehicle operator. The wearable device includes a motion sensor. A processor that receives motion data from the motion sensor, analyzes the motion data to detect a pattern of motion, and compares the detected pattern of motion to the mirror check procedure to determine whether the pattern of motion complies with the mirror check procedure. If the pattern of motion does not comply with the mirror check procedure, the system will generate an alert.

Claims

1. A system for monitoring vehicle operator mirror check procedures, comprising:

a wearable electronic device configured to be worn on a head of an operator of a vehicle, wherein the wearable electronic device comprises a motion sensor;

a processing device that is configured to receive a first set of motion data from the motion sensor corresponding to the head of the operator, wherein the first set of motion data comprises yaw, pitch, or roll of the wearable electronic device, distance travelled by the wearable electronic device in a linear or a rotational direction, linear or angular velocity of movement of the wearable electronic device, or linear angular acceleration of the wearable electronic device;

a memory device portion containing data representative of a mirror check procedure; and

a memory device portion containing programming instructions that are configured to cause the processing device to;

receive the first set of motion data transmitted from the motion sensor,

analyze the first set of motion data to detect a pattern of motion corresponding to the head of the operator,

compare the detected pattern of motion to the mirror check procedure to determine whether the pattern of motion complies with the mirror check procedure, and

if the pattern of motion does not comply with the mirror check procedure, generate an alert.

2. The system of claim 1, wherein:

the system also comprises a clock module;

the processing device is further configured to receive time data from the clock module; and

programming instructions that are configured to cause the processing device to compare the detected pattern of motion to the mirror check procedure to determine whether the pattern of motion complies with the mirror check procedure further comprise programming instructions that cause the processing device to;

determine whether the detected pattern of motion indicates a mirror check at least once per a time interval, wherein the mirror check procedure comprises a rule requiring that the operator of the vehicle check one or more mirrors of the vehicle at least once per the time interval.

3. The system of claim 1, wherein:

the system also comprises an onboard vehicle motion sensor; and

programming instructions that are configured to cause the processing device to compare the detected pattern of motion to the mirror check procedure to determine whether the pattern of motion complies with the mirror check procedure further comprise programming instructions that cause the processing device to;

determine whether the detected pattern of motion indicates a mirror check within a time interval prior to detecting, based on data from the vehicle motion sensor, a vehicle turn event, wherein the mirror check procedure comprises a rule requiring that the operator of the vehicle check one or more mirrors of the vehicle prior to causing the vehicle to turn.

4. The system of claim 1, further comprising a reference device that is attached to the vehicle and that includes:

a transmitter, and

a reference device motion sensor that is configured to collect a second set of data corresponding to motion of the vehicle.

5. The system of claim 4, wherein the programming instructions that are configured to cause the processing device to analyze the motion data to detect a pattern of motion further comprise programming instructions that cause the processing device to detect a head rotational motion of the operator by:

receiving, the second set of data corresponding to motion of the vehicle;

analyzing the first set of motion data to determine a first rotation matrix for the wearable electronic device in a world frame of reference;

analyzing the second set of data to determine a second rotation matrix for the portable electronic device in the world frame of reference;

using the first rotation matrix and the second rotational matrix to determine a rotational motion signal corresponding to the head rotational motion of the operator;

using the rotational motion signal to determine an angular displacement of the head rotational motion of the operator; and

analyzing the angular displacement to detect the head rotational motion of the operator.

6. The system of claim 5, wherein the programming instructions that are configured to cause the processing device to detect the head rotational motion of the operator of the vehicle by analyzing the angular displacement further comprise programming instructions that cause the processing device to compare a magnitude of the angular displacement to a threshold magnitude, wherein the threshold magnitude is calculated based upon direction of the rotational motion.

7. The system of claim 5, wherein the head rotational motion of the operator of the vehicle is indicative of at least one of the following:

a mirror check;

the operator of the vehicle looking outside a window of the vehicle;

the operator of the vehicle looking forward;

or

the operator of the vehicle looking downwards.

8. The system of claim 6, wherein the programming instructions that are configured to cause the processing device to compare the magnitude of the angular displacement to the threshold magnitude further comprise programming instructions that cause the processing device to perform at least one of the following:

detect a mirror check if the magnitude is above a first threshold value or below a second threshold value;

detect that the operator of the vehicle is looking outside a window of the vehicle if the magnitude is above a third threshold value or below a forth threshold value;

detect that the operator of the vehicle looking forward if the magnitude is close to a fifth threshold value;

or

detect that the operator of the vehicle looking downwards forward if the magnitude is close to a sixth threshold value in a downward direction.

9. The system of claim 1, further comprising:

a speaker disposed within a portable electronic device that is in communication with the wearable electronic device via a near-field or short-range wireless communication protocol,

wherein the speaker is configured to output an audible signal that corresponds to the alert.

10. The system of claim 1, further comprising a vibrator disposed within the wearable electronic device, wherein the vibrator is configured to receive the generated alert and output a vibrator signal that corresponds to the alert.

20. The system of claim 1, wherein the wearable electronic device further comprises a headband.

21. The system of claim 1, where in the motion sensor comprises an accelerometer and a gyroscope.

11. A method for monitoring vehicle operator mirror check procedures, comprising:

receiving, at a processing device, a first set of motion data, corresponding to a head of an operator of a vehicle, from a motion sensor of a wearable electronic device configured to be worn on the head of the operator of the vehicle, wherein the first set of motion data comprises yaw, pitch, or roll of the wearable electronic device, distance travelled by the wearable electronic device in a linear or a rotational direction, linear or angular velocity of movement of the wearable electronic device, or linear angular acceleration of the wearable electronic device;

analyzing, by the processing device, the first set of motion data to detect a pattern of motion corresponding to the head of the operator;

comparing, by the processing device, the detected pattern of motion to data representative of a mirror check procedure to determine whether the pattern of motion complies with the mirror check procedure; and

generating, by the processing device, an alert, if the pattern of motion does not comply with the mirror check procedure.

12. The method of claim 11, further comprising:

receiving, at the processing device, time data from a clock module;

the mirror check procedure comprises a rule requiring that the vehicle operator check one or more mirrors of a vehicle in which the operator is sitting at least once per a time interval; and

comparing the detected pattern of motion to the mirror check procedure to determine whether the pattern of motion complies with the mirror check procedure comprises determining whether the detected pattern of motion indicates a mirror check at least once per the time interval.

13. The method of claim 11, wherein:

the mirror check procedure comprises a rule requiring that the vehicle operator check one or more mirrors of a vehicle prior to causing the vehicle to turn; and

comparing the detected pattern of motion to the mirror check procedure to determine whether the pattern of motion complies with the mirror check procedure comprises determining whether the detected pattern of motion indicates a mirror check within a time interval prior to detecting, based on data received by the processing device from a vehicle motion sensor, a vehicle turn event.

14. The method of claim 11, wherein:

the instructions to analyze the motion data to detect a pattern of motion comprise instructions to detect a head rotational motion of the operator by;

receiving, from a reference device motion sensor, a second set of data corresponding to motion of the vehicle;

analyzing the first set of motion data to determine a first rotation matrix for the wearable electronic device in a world frame of reference;

analyzing the second set of data to determine a second rotation matrix for the portable electronic device in the world frame of reference;

using the first rotation matrix and the second rotational matrix to determine a rotational motion signal corresponding to the head rotational motion of the operator;

using the rotational motion signal to determine an angular displacement of the head rotational motion of the operator; and

analyzing the angular displacement to detect the head rotational motion of the operator.

15. The method of claim 14, wherein analyzing the angular displacement comprises comparing a magnitude of the angular displacement to a threshold magnitude, wherein the threshold magnitude is calculated based upon direction of the rotational motion.

16. The method of claim 14, wherein the head rotational motion of the operator of the vehicle is indicative of at least one of the following:

a mirror check;

the operator of the vehicle looking outside a window of the vehicle;

the operator of the vehicle looking forward;

or

the operator of the vehicle looking downwards.

17. The method of claim 15, wherein comparing a magnitude of the angular displacement to a threshold magnitude comprises at least one of the following:

detecting a mirror check if the magnitude is above a first threshold value or below a second threshold value;

detecting that the operator of the vehicle is looking outside a window of the vehicle if the magnitude is above a third threshold value or below a forth threshold value;

detecting that the operator of the vehicle looking forward if the magnitude is close to a fifth threshold value;

or

detecting that the operator of the vehicle looking downwards forward if the magnitude is close to a sixth threshold value in a downward direction.

18. The method of claim 11, further comprising:

outputting, via a speaker that is disposed within a portable electronic device that is in communication with the wearable electronic device via a near-field or short-range wireless communication protocol, an audible signal that corresponds to the alert.

19. The method of claim 11, further comprising:

receiving, at a vibrator disposed within the wearable electronic device, the generated alert; and

outputting, via the vibrator, a vibrator signal that corresponds to the alert.