Method and device for assisting in safe driving of a vehicle

• US 10,298,741 B2
• Filed: 07/17/2014
• Issued: 05/21/2019
• Est. Priority Date: 07/18/2013
• Status: Active Grant

• Current Assignee: Secure4Drive Communication Ltd.
• Original Assignee: Secure4Drive Communication Ltd.
• Inventors: Goren, Adi, Ulmansky, Reuven, Cohen, David
• Primary Examiner(s): Kelley, Steven S
• Application Number:
  US14/903,378
• Publication Number:
  US 20160150070A1
• Time in Patent Office: 1,769 Days
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G08B 21/06 indicating a condition of sleep, e.g. anti-dozing alarms
• CPC Class Codes: G08G 1/0112 from the vehicle, e.g. floating car data [FCD]
• CPC Class Codes: G08G 1/015 with provision for distinguishing between two or more types of vehicles, e.g. between motor-cars and cycles
• CPC Class Codes: G08G 1/0175 by photographing vehicles, e.g. when violating traffic rules
• CPC Class Codes: G08G 1/096775 where the origin of the information is a central station
• CPC Class Codes: H04M 1/724098 Interfacing with an on-board device of a vehicle for hands-free speaking in vehicles H04M1/6075
• CPC Class Codes: H04M 1/72421 with automatic activation of emergency service functions, e.g. upon sensing an alarm
• CPC Class Codes: H04M 1/72454 according to context-related or environment-related conditions
• CPC Class Codes: H04M 1/72463 to restrict the functionality of the device
• CPC Class Codes: H04W 4/029 Location-based management or tracking services
• CPC Class Codes: H04W 4/90 Services for handling of emergency or hazardous situations, e.g. earthquake and tsunami warning systems [ETWS]
• CPC Class Codes: H04W 48/04 based on user or terminal location or mobility data, e.g. moving direction, speed
• CPC Class Codes: H04W 8/18 Processing of user or subscriber data, e.g. subscribed services, user preferences or user profiles; Transfer of user or subscriber data

Abstract

A method and system are disclosed for operating a communication device to assist in safe driving of a vehicle. The method includes continuously monitoring driving conditions by analyzing data obtained from one or more sensors, positioning system, and a data network, and processing the driving conditions to determine a safety level of the vehicle corresponding thereto. The method further include automatically adjusting an operational mode of the communication device, based on the determined safety level, to automatically enable, disable and/or alter predetermined functions of the communication device in accordance with the safety level.

Claims

1. A method for operating a mobile communication device of a driver when driving a vehicle, the method comprises:

monitoring driving conditions by analyzing data obtained from one or more sensors built in said mobile communication device, wherein said sensors comprise at least a camera device of the mobile communication device;

processing data indicative of said driving conditions and determining a safety level of the vehicle corresponding to said driving conditions based on a measured distance; and

automatically adjusting an operational mode of said communication device based on said safety level, to automatically enable, disable and/or alter predetermined functions of said communication device in accordance with said safety level;

wherein said monitoring of the driving conditions comprises;

(i) operating said camera device of the mobile communication device for capturing an image showing at least one object along the vehicle'"'"'s route;

(ii) processing said image to;

recognize an element on the said object, wherein the recognized element has a predetermined physical size; and

determine an imaged size of the element in said image;

(iii) utilizing reference data to determine the predetermined physical size of said element; and

(iv) determining the measured distance from the camera to said element of the predetermined physical size based on a focal length of the camera and a ratio between said imaged size and said predetermined physical size, and

wherein said determining of said safety level comprises processing the data obtained from the one or more sensors built in said communication device to determine said driving conditions and identify a plurality of safety hazards and compute a safety score based on existence of one or more of said plurality of safety hazards, and utilize said safety score to select said safety level from a plurality of predetermined discrete levels including;

at least one safe level, at least one dangerous level, and at least one intermediate level of a predefined degree of safety; and

wherein said automatically adjusting of the operational mode includes selectively setting an operational mode of each of said predetermined functions to at least one of the following modes;

fully enabled mode, fully disabled mode, voice control mode, read-aloud notification mode;

auto-reply mode;

emergency action mode.

2. The method of claim 1, wherein said communication device comprises a display module, and wherein said automatically adjusting the operational mode of said communication device comprises:

upon determining the safety level that corresponds to the driving conditions of said vehicle, carrying out one or more of the following;

presenting imagery from at least one forward looking camera as background on said display module; and

graphically presenting one or more of the predetermined functions that are enabled at said safety level on top of said background; and

hiding one or more of the predetermined functions that are disabled at said safety level.

3. The method of claim 1, wherein said continuously monitoring of the driving conditions comprises operating said sensors built in said communication device to carry out at least one of the following:

determining a speed of the vehicle, determining a trajectory of movement of the vehicle, determining acceleration of the vehicle, determining traffic conditions along the vehicle route.

4. The method of claim 3, wherein said at least one object is another vehicle, and

wherein said processing comprising one or more of the following:

applying image recognition algorithm to identify said element in the image;

applying a tilt correction algorithm to said image to compensate over pitch and yaw misalignments, and generate a compensated image in which said element appears;

measuring the imaged size of said element in the compensated image, with respect to at least one dimension of the element; and

wherein said determining of the distance from the camera to said element based on said predetermined physical size comprises utilizing the following relation;

object distance=focal length*(object size/object size in image).

5. The method of claim 4, wherein said element includes a license plate of said another vehicle, or a pair of lights of said another vehicle.

6. The method of claim 1, comprising determining said predetermined size of the said element by carrying out the following:

processing said image to determine the imaged size of said element with respect to at least two dimensions thereof, and calculating a ratio between them; and

utilizing said ratio to classify said element to one or more associated known types, and provide said predetermined physical size based on said classification.

7. The method of claim 1, wherein the determining of the distance to the at least one object further comprises:

operating said camera of the communication device for capturing an image showing said at least one object;

processing said image to recognize said at least one object and determine a location thereof in the image; and

estimating a distance to said at least one object based on said determined location in the image, and a perspective of said image associated with a focal length of said camera by which said image is captured.

8. The method of claim 1, wherein said object is another vehicle and wherein the method further comprises determining whether said distance is below a certain minimum safe distance between said vehicle and said another vehicle by carrying out the following:

obtaining data indicative of a velocity of said another vehicle, and determining said minimum safe distance by multiplying said velocity by a certain predetermined minimal time value.

9. The method of claim 1, further comprising determining that an unsafe driving condition exists based on a change in the measured distance.

10. The method of claim 1, wherein said predetermined functions include at least one of the following interactive communication functions:

receiving and transferring incoming and outgoing phone calls respectively, receiving and transferring incoming and outgoing texting messages respectively, and browsing a data network.

11. An application installable on a mobile communication device preprogrammed for performing predetermined functions, said application is configured for assisting in safe driving of a vehicle, and for receiving input data from sensors built in said communication device including at least one camera device and comprising a data processor utility, the data processor utility comprising:

a driving condition module configured for processing said input data obtained from said sensors built in said mobile communication device to determine driving conditions of said vehicle;

a safety hazard detection module adapted for processing data indicative of said driving conditions to determine a safety level of the vehicle corresponding to said driving conditions based on a measured distance; and

wherein said driving condition module is configured to determine a distance of the vehicle to at least one object along the vehicle'"'"'s route by carrying out the following;

(i) operating the camera device for capturing an image showing the at least one object along the vehicle'"'"'s route;

(ii) processing the image to;

recognize an element on the said object, wherein the recognized element having a predetermined physical size;

determine an imaged size of the element in said image;

(iii) utilizing reference data to determine the predetermined physical size of said element; and

(iv) determining the measured distance from the camera to said element of the predetermined physical size based on a focal length of the camera and a ratio between said imaged size and said predetermined physical size, and

wherein said safety hazard detection module is configured to;

determine said safety level by processing the data obtained from the one or more sensors built in said communication device to determine said driving conditions,

identify a plurality of safety hazards in said driving conditions,

compute a safety score for said driving conditions based on existence of one or more of said plurality of safety hazards, and

utilize said safety score to selected said safety level from a plurality of predetermined discrete levels including;

at least one safe level, at least one dangerous level, and at least one intermediate level of a predefined degree of safety; and

wherein said application is configured to automatically adjust an operational mode of said communication device based on said safety level, to automatically enable, disable and/or alter predetermined functions of said communication device in accordance with said safety level;

wherein said predetermined functions include at least one of the following;

receiving and transferring incoming and outgoing phone calls respectively, receiving and transferring incoming and outgoing texting messages respectively, and browsing a data network; and

said automatically adjusting of the operational mode includes selectively setting an operational mode of each of said predetermined functions to at least one of the following modes;

fully enabled mode, fully disabled mode, voice control mode, read-aloud notification mode;

auto-reply mode;

emergency action mode.

12. The application of claim 11, comprising a data provider module adapted for downloading a computer readable code from a data network, wherein said computer readable code implementing said driving condition module, and said safety hazard detection module.

13. The application of claim 12, wherein said personal communication device is a mobile phone device and wherein said sensors include one or more of the following:

a positioning system, a camera capable of operating in forward facing mode, a camera configured to operate in rear facing mode, at least one acoustic receiver, a data provider module configured to communicate with a central station via a communication network, one or more inertial measurement modules.

14. The application of claim 11, comprising a user interface (UI) control module configured and operable for performing automatic adjustment of an operational mode of said communication device based on said safety level, by carrying out one or more of the following, upon determining the safety level that corresponds to the driving conditions of said vehicle:

presenting, on the user interface, imagery from at least one forward looking camera as background on said display module; and

graphically presenting, on a user interface, one or more predetermined functions that are enabled at said safety level on top of said background; and

hiding one or more predetermined functions that are disabled at said safety level.

15. The application of claim 11, comprising an emergency control module is configured for operating the mobile communication device in an emergency action mode, by carrying out at least one of the following:

transferring the data indicative of driving conditions to a central station, transferring image data obtained from at least one sensor, to a central station, initiating an emergency notification communication to a central station.

16. The application of claim 11, wherein said driving condition module is configured for processing said input data from the one or more sensors built in said communication device to carry out at least one of the following:

determine a speed of the vehicle, determine a trajectory of movement of the vehicle,

determine acceleration of the vehicle, determine traffic conditions along the vehicle.

17. The application of claim 11, wherein said at least one object being another vehicle, and wherein said processing of the image includes at least one of the following:

applying image recognition algorithm to identify said element in the image;

applying a tilt correction algorithm to said image to compensate over pitch and yaw misalignments, and generate a compensated image in which said element appears;

measuring the imaged size of said element in the compensated image, with respect to at least one dimension of the element; and

wherein said determining the distance from the camera to said element based on said predetermined physical size comprises utilizing the following relation;

object distance=focal length*(object size/object size in image).

18. The application of claim 11, wherein said driving condition module is configured for determining the predetermined physical size of the element by carrying out the following:

processing said image to determine the imaged size of said element with respect to at least two dimensions thereof, and calculating a ratio between them; and

utilizing said ratio to classify said element to one or more associated known types; and

providing said predetermined physical size based on said classification.

19. The application of claim 11, wherein said driving condition module is further configured to carry out the following:

operating the camera for capturing an image showing said at least one object;

processing said image to recognize said at least one object and determine a location thereof in the image; and

estimating a distance to said at least one object based on said determined location in the image, and a perspective of said image associated with a focal length of said camera by which said image is captured.

20. A telemetric system including at least one computerized server system configured and operable to communicate with the application for assisting in safe driving of a vehicle according to claim 11, being installed on at least one communication device, being members of the telemetric system, for carrying out the following:

obtain data indicative of driving conditions and/or safety hazards identified by one or more sensors integrated in the at least one communication device, wherein said data comprises at least said distance between the vehicle to at least one object along the vehicle'"'"'s route;

process the data and identify safety hazards which may affect vehicles located in the vicinity of the at least one communication device;

obtain positioning data from a positioning system of the at least one communication device and from positioning systems of one or more additional communication devices being members of the telemetric system, and

process said positioning data to identify another communication device being in the vicinity of the at least one communication device; and

communicate data indicative of the identified safety hazards to the another communication device.

21. The application of claim 11, wherein said driving condition module is further configured to determine that an unsafe driving condition exists based on a change in the measured distance.