Method and system for automatic calibration of an operator monitor

• US 10,268,903 B2
• Filed: 06/11/2017
• Issued: 04/23/2019
• Est. Priority Date: 06/11/2017
• Status: Active Grant

• Current Assignee: Jungo Connectivity Ltd.
• Original Assignee: Jungo Connectivity Ltd.
• Inventors: Herbst, Ophir
• Primary Examiner(s): Holder, Anner N
• Application Number:
  US15/619,490
• Publication Number:
  US 20180357494A1
• Time in Patent Office: 681 Days
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G08B 21/06 indicating a condition of sleep, e.g. anti-dozing alarms

Abstract

Systems and methods for automatic calibration of a monitor of a driver include receiving an indication that the driver is driving a car and determining a typical orientation of the driver in a first set of images, the first set captured after receiving the indication. An orientation of the driver in a second set of images, which is captured after the first set, is compared to the typical orientation and a command is generated based on the comparison.

Claims

1. A method for automatic monitoring of an operator of an apparatus, the method comprising:

receiving a signal based on an operation parameter of the apparatus, the signal indicating that the operator is operating the apparatus;

receiving image data captured after receiving the signal, the image data comprising at least part of the operator;

determining a typical orientation of the part of the operator in the image data, to be a reference orientation;

comparing an orientation of the part of the operator in subsequent image data to the reference orientation;

generating a command based on the comparison; and

updating the reference orientation based on the orientation of the part of the operator in the subsequent image data, if the orientation of the part of the operator in the subsequent image data deviates by less than a predetermined threshold from the reference orientation; and

not updating the reference orientation if the orientation of the part of the operator in subsequent image data deviates by more than a predetermined threshold from the reference orientation.

2. The method of claim 1 wherein the operator is a driver and the apparatus is a vehicle.

3. The method of claim 2 wherein the operation parameter of the apparatus comprises one or more of:

speed, direction, acceleration and GPS information.

4. The method of claim 2 comprising receiving the signal if a value of at least one operation parameter is above a predetermined threshold.

5. The method of claim 2 comprising receiving the signal from a sensor associated with the vehicle.

6. The method of claim 1 wherein the part of the operator comprises the operator'"'"'s head.

7. The method of claim 1 wherein the typical orientation of the part of the operator comprises an average orientation of the part of the operator.

8. The method of claim 1 comprising generating the command if the orientation of the part of the operator in subsequent image data deviates by more than a predetermined threshold from the reference orientation.

9. The method of claim 2 wherein the command comprises one or a combination of:

a signal to generate an alarm, a signal to control a system associated with the vehicle and a signal to send a notification to an external control center.

10. The method of claim 1 comprising using the reference orientation to detect the orientation of the part of the operator in the subsequent image data.

11. The method of claim 1 comprising:

determining biometrics of the operator from the subsequent image data; and

generating the command based on the comparison and on the biometrics.

12. The method of claim 11 comprising using the reference orientation to determine biometrics of the operator.

13. The method of claim 1 comprising:

if the operation parameter is above a predetermined threshold then updating the reference orientation; and

not updating the reference orientation if the operation parameter is below the predetermined threshold.

14. A system for automatic monitoring of a driver, the system comprising:

a processing unit configured to

receive an indication that the driver is driving a car,

determine a typical orientation of at least part of the driver in a first set of images, the first set captured after receiving the indication,

receive a second set of images, the second set captured after the first set,

compare an orientation of the part of the driver in the second set of images to the typical orientation,

generate a command based on the comparison,

update the typical orientation based on the orientation of the part of the operator in the second set, if the orientation of the part of the operator in the second set deviates by less than a predetermined threshold from the typical orientation, and

not update the reference orientation if the orientation of the part of the operator in subsequent image data deviates by more than a predetermined threshold from the reference orientation.

15. The system of claim 14 comprising a sensor associated with the car and in communication with the processing unit, the sensor to generate the indication that the driver is driving the car.

16. The system of claim 14 comprising at least one camera in communication with the processing unit, the at least one camera to obtain the first and second sets of images.

17. The system of claim 16 wherein the camera is part of a multi-purpose mobile device.

18. The system of claim 14 wherein the processing unit is part of an already existing processor of the car.