Alert generation correlating between head mounted imaging data and external device

• US 9,818,283 B2
• Filed: 01/05/2015
• Issued: 11/14/2017
• Est. Priority Date: 01/06/2014
• Status: Active Grant

• Current Assignee: iOnRoad Technologies Limited (Samsung Electronics Co. Ltd.)
• Original Assignee: iOnRoad Technologies Limited (Samsung Electronics Co. Ltd.)
• Inventors: Akiva, Ohad, Atsmon, Dan, Dayan, Ram
• Primary Examiner(s): Wu, Zhen Y
• Application Number:
  US14/589,914
• Publication Number:
  US 20150194035A1
• Time in Patent Office: 1,044 Days
• Field of Search: 340575
• CPC Class Codes: A61B 5/163 by tracking eye movement, gaze, or pupil change
• CPC Class Codes: A61B 5/18 for vehicle drivers or machine operators
• CPC Class Codes: A61B 5/746 Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms alarms per se G08B
• CPC Class Codes: B60C 9/00 Reinforcements or ply arrangement of pneumatic tyres inserts having reinforcing means B60C5/08; bead structure, e.g. turnup or overlap construction, B60C15/00
• CPC Class Codes: B60K 28/066 actuating a signalling device B60K28/063 takes precedence
• CPC Class Codes: B60Q 9/00 Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00 , e.g. haptic signalling
• CPC Class Codes: B60W 2040/0872 Driver physiology
• CPC Class Codes: B60W 2050/143 Alarm means
• CPC Class Codes: B60W 2520/00 Input parameters relating to overall vehicle dynamics
• CPC Class Codes: B60W 2540/22 Psychological state; Stress level or workload
• CPC Class Codes: B60W 40/08 related to drivers or passengers
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G08B 21/06 indicating a condition of sleep, e.g. anti-dozing alarms
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

A method of alerting a vehicle'"'"'s driver. The method comprises receiving an azimuth value indicating a gazing direction of a head of the driver from a primary device placed on the driver, receiving a vehicle bearing value indicating a vehicle moving direction of the vehicle driven by the driver, calculating an angular difference between the azimuth value and the vehicle bearing value, generating an alert when the angular difference deviates from an angular threshold, and automatically presenting the alert to the driver in response to the angular difference.

Claims

1. A method of alerting a vehicle'"'"'s driver, comprising:

with a processor;

measuring head movements of the driver by a wearable mount placed on the driver;

calculating an azimuth value indicating a horizontal orientation facing direction of a head of said driver;

receiving a vehicle bearing value indicating a current vehicle moving direction of a vehicle driven by the driver;

calculating an angular difference between the azimuth value and the vehicle bearing value;

receiving a first set of image data, the first set of image data captured by a first image capture module coupled to the wearable mount and directing outwardly from the driver to capture a driver'"'"'s perspective;

receiving a second set of image data, the second set of image data captured by a second image capture module mounted on the vehicle and oriented toward the current vehicle moving direction to capture a vehicle'"'"'s perspective;

processing the first and second sets of image data to determine a comparison result, the comparison result determined according to image similarity between the first and second sets of image data;

generating an alert according to said comparison result and when the angular difference deviates from an angular threshold, said angular threshold selected from a plurality of predefined angular thresholds according to a traffic condition; and

automatically presenting the alert via an alert module to the driver.

2. The method of claim 1,

wherein said generating further comprises generating an alert when the angular difference deviates from the angular threshold and the comparison result deviates from an image similarity threshold;

and

automatically presenting the alert to the driver.

3. The method of claim 1, wherein the angular threshold is dynamically modified based on the first and second sets of image data received.

4. The method of claim 1, wherein the vehicle bearing value is generated by a geographical positioning system (GPS);

and

wherein the vehicle bearing value is transmitted by one or more of a circuit coupled to the vehicle and a mobile device to the wearable mount placed on the driver.

5. The method of claim 1, further comprising:

automatically presenting the alert to the driver in response to the angular difference while the angular difference is still present.

6. The method of claim 1, wherein said automatically presenting the alert further comprises providing a suggestion to said driver to navigate to a rest location, said rest location including at least one of a restaurant, a coffee shop, a rest stop, and a parking lot.

7. A system of alerting a driver of a vehicle, comprising:

a wearable mount comprising a processor, said wearable mount configured to be placed on a head of said driver measuring head movements of said driver and calculating an azimuth value indicating a horizontal orientation facing direction of the head of said driver;

a first image sensor coupled to said wearable mount, the first image sensor directing outwardly from said driver to capture a driver'"'"'s perspective;

a second image sensor coupled to the vehicle and oriented toward a vehicle moving direction to capture a vehicle'"'"'s perspective;

wherein said processor executes code instructions comprising;

code instructions for receiving said azimuth value from said wearable mount placed on the driver;

code instructions for receiving a vehicle bearing value indicating a current vehicle moving direction of the vehicle driven by the driver;

code instructions for calculating an angular difference between the azimuth value and the vehicle bearing value;

code instructions for receiving a first set of image data captured by said first image sensor;

code instructions for receiving a second set of image data captured by said second image sensor;

code instructions for processing the first and second sets of image data to determine a comparison result, the comparison result determined according to image similarity between said first and second sets of image data;

code instructions for generating an alert according to said comparison result and when the angular difference deviates from an angular threshold, said angular threshold selected from a plurality of predefined angular thresholds according to a traffic condition; and

code instructions for automatically presenting the alert via an alert module to the driver.

8. The system of claim 7, further comprising:

code instructions for generating an alert when the angular difference deviates from the angular threshold and the comparison result deviates from an image similarity threshold; and

code instructions for presenting the alert to the driver.

9. The system of claim 7, wherein said code instructions further comprise:

code instructions for receiving a plurality of wearable mount orientation values over a period of time;

code instructions for determining an angular velocity of the head of said driver by utilizing the plurality of wearable mount orientation values;

code instructions for generating an alert when the angular velocity deviates from an angular velocity threshold and the comparison result deviates from the angular threshold; and

code instructions for presenting the alert to the driver.

10. The system of claim 9, wherein said angular velocity threshold and said angular threshold are selected according to a traffic heaviness condition.

11. The system of claim 7, further comprising:

a mobile phone;

wherein said code instructions further comprise code instructions for presenting the alert to the mobile phone; and

the mobile phone sounds a notice as a result of the alert.

12. The system of claim 7, wherein:

said wearable mount is a pair of glasses with an electronic display, and at least one of an accelerometer and a gyro; and

wherein said code instructions further comprise code instructions for presenting the alert on the electronic display.

13. The system of claim 7, wherein:

said wearable mount is a pair of glasses with an electronic display and a GPS; and

wherein said code instructions further comprise code instructions for receiving the vehicle bearing value from the GPS.

14. The system of claim 7, wherein:

the processor is directly coupled to a vehicle'"'"'s computer system; and

said code instructions further comprising code instructions for transmitting the alert via wireless communication to said wearable mount.

15. A method of alerting a driver of a vehicle comprising:

with a processor;

receiving three-dimensional orientation information from a module on a wearable mount placed on the driver, the information indicating a horizontal orientation facing direction of a head of the driver;

determining based on the orientation information when the horizontal orientation facing direction is different from a current vehicle moving direction;

receiving a first set of image data, the first set of image data captured by a first image capture module coupled to the wearable mount and directing outwardly from said driver to capture a driver'"'"'s perspective;

receiving a second set of image data, the second set of image data captured by a second image capture module oriented toward the current vehicle moving direction to capture a vehicle'"'"'s perspective;

processing the first and second sets of image data to determine a comparison result, the comparison result determined according to image similarity between said first and second sets of image data;

generating an alert according to said comparison result and when the horizontal orientation facing direction is determined to be different from the current vehicle moving direction; and

automatically presenting the alert via an alert module to the driver.

16. The method of claim 15,

wherein generating further comprises generating an alert when the horizontal orientation facing direction is determined to be different from the current vehicle moving direction and the comparison result deviates from an image similarity threshold;

and

automatically presenting the alert to the driver.

17. The method of claim 15, wherein:

the vehicle gains driving control when the horizontal orientation facing direction is determined to be different from the current vehicle moving direction.

18. The method of claim 15, further comprising:

receiving the orientation information multiple times over a period of time;

incrementing a count each time the horizontal orientation facing direction is determined to be different from the current vehicle moving direction;

wherein generating further comprises generating an alert when the count deviates from a count threshold, the count threshold being determined by a pattern recognition algorithm accounting for the period of time; and

automatically presenting the alert to the driver.

19. The method of claim 15, further comprising:

receiving a third set of image data, the set of image data captured by the first image capture module coupled to the wearable mount;

processing the third set of image data to determine an eyes gazing direction result;

generating an alert when the horizontal orientation facing direction is determined to be different from the current vehicle moving direction and the eyes gazing direction result deviates from an eyes gazing direction threshold; and

automatically presenting the alert to the driver.