METHOD AND DEVICE FOR ASSISTING IN SAFE DRIVING OF A VEHICLE

• US 20160150070A1
• Filed: 07/17/2014
• Published: 05/26/2016
• Est. Priority Date: 07/18/2013
• Status: Active Grant

• Current Assignee: Secure4Drive Communication Ltd.
• Original Assignee: Secure4Drive Communication Ltd.
• Inventors: Goren, Adi, ULMANSKY, Reuven, Cohen, David
• Granted Patent: US 10,298,741 B2
• Time in Patent Office: Days
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G08B 21/06 indicating a condition of sleep, e.g. anti-dozing alarms
• CPC Class Codes: G08G 1/0112 from the vehicle, e.g. floating car data [FCD]
• CPC Class Codes: G08G 1/015 with provision for distinguishing between two or more types of vehicles, e.g. between motor-cars and cycles
• CPC Class Codes: G08G 1/0175 by photographing vehicles, e.g. when violating traffic rules
• CPC Class Codes: G08G 1/096775 where the origin of the information is a central station
• CPC Class Codes: H04M 1/724098 Interfacing with an on-board device of a vehicle for hands-free speaking in vehicles H04M1/6075
• CPC Class Codes: H04M 1/72421 with automatic activation of emergency service functions, e.g. upon sensing an alarm
• CPC Class Codes: H04M 1/72454 according to context-related or environment-related conditions
• CPC Class Codes: H04M 1/72463 to restrict the functionality of the device
• CPC Class Codes: H04W 4/029 Location-based management or tracking services
• CPC Class Codes: H04W 4/90 Services for handling of emergency or hazardous situations, e.g. earthquake and tsunami warning systems [ETWS]
• CPC Class Codes: H04W 48/04 based on user or terminal location or mobility data, e.g. moving direction, speed
• CPC Class Codes: H04W 8/18 Processing of user or subscriber data, e.g. subscribed services, user preferences or user profiles; Transfer of user or subscriber data

Abstract

A method and system are disclosed for operating a communication device to assist in safe driving of a vehicle. The method includes continuously monitoring driving conditions by analyzing data obtained from one or more sensors, positioning system, and a data network, and processing the driving conditions to determine a safety level of the vehicle corresponding thereto. The method further include automatically adjusting an operational mode of the communication device, based on the determined safety level, to automatically enable, disable and/or alter predetermined functions of the communication device in accordance with the safety level.

Claims

1. A method for operating a mobile communication device of a driver when driving a vehicle, the method comprises:

continuously monitoring driving conditions by analyzing data obtained from one or more sensors built in said mobile communication device, wherein said sensors comprise k at least a camera device and an inertial sensor of the mobile communication device;

processing data indicative of said driving conditions and determining a safety level of the vehicle corresponding to said driving conditions; and

automatically adjusting an operational mode of said communication device based on said safety level, to automatically enable, disable and/or alter predetermined functions of said communication device in accordance with said safety level.

4. The method of claim 1, wherein said determining of said safety level comprises processing the data obtained from the one or more sensors built in said communication device to determine said driving conditions and identify a plurality of safety hazards and compute a safety score based on existence of one or more of said plurality of safety hazards, and utilize said safety score to select said safety level from a plurality of predetermined discrete levels including:

at least one safe level, at least one dangerous level, and at least one intermediate level of a predefined degree of safety; and

wherein said automatically adjusting of the operational mode includes selectively setting an operational mode of each of said predetermined functions to at least one of the following modes;

fully enabled mode, fully disabled mode, voice control mode, read-aloud notification mode;

auto-reply mode;

emergency action mode.

5. The method of claim 1, wherein said communication device comprises a display module, and wherein said automatically adjusting the operational mode of said communication device comprises upon determining the safety level that corresponds to the driving conditions of said vehicle carrying out one or more of the following:

presenting imagery from at least one forward looking camera as background on said display module; and

graphically presenting (e.g. by icons) one or more of the predetermined functions that are enabled at said safety level on top of said background; and

hiding one or more of the predetermined functions that are disabled at said safety level.

7. The method of claim 1, wherein said continuously monitoring of the driving conditions comprises operating said sensors built in said communication device to carry out at least one of the following:

determining a speed of the vehicle, determining a trajectory of movement of the vehicle, determining acceleration of the vehicle, determining traffic conditions along the vehicle route, determining a distance of the vehicle to at least one object along the vehicle'"'"'s route.

8. The method of claim 7, wherein said at least one object is another vehicle, determining said distance comprises:

operating said camera device of the mobile communication device for capturing an image showing said another vehicle;

processing said image to recognize an element on the another vehicle which is associated with a predetermined physical size, and to determine a measure of the imaged size of the element in said image whereby said processing comprising one or more of the following;

applying image recognition algorithm to identify said element in the image;

applying a tilt correction algorithm to said image to compensate over pitch and yaw misalignments, and generate a compensated image in which said element appears;

measuring the imaged size of said element in the compensated image, with respect to at least one dimension of the element; and

determining a distance from the camera to said element based on a focal length of the camera and a ratio between said imaged size and said predetermined physical size by utilizing the following relation;

object distance=focal length*(object size/object size in image).

9. The method of claim 8, wherein said element includes a license plate of said another vehicle, or a pair of lights of said another vehicle.

11. The method of claim 8, comprising determining said predetermined size of the said element by carrying out the following:

processing said image to determine the imaged size of said element with respect to at least two dimensions thereof, and calculating a ratio between them;

utilizing said ratio to classify said element to one or more associated known types, and provide said predetermined physical size based on said classification.

13. The method of claim 7, wherein the determining of the distance to at least one object comprises:

operating said camera of the communication device for capturing an image showing said at least one object;

processing said image to recognize said at least one object and determine a location thereof in the image; and

estimating a distance to said at least one object based on said determined location in the image, and a perspective of said image associated with a focal length of said camera by which said image is captured.

15. The method of claim 7, comprising determining whether said distance is below a certain minimum safe distance between said vehicle and another vehicle at which said camera is placed, the method comprising obtaining data indicative of a velocity of said another vehicle, and determining said minimum safe distance by multiplying said velocity by a certain predetermined minimal time value.

2. (canceled)

3. (canceled)

6. (canceled)

10. (canceled)

12. (canceled)

14. (canceled)

16-18. -18. (canceled)

19. An application installable on a mobile communication device preprogrammed for performing predetermined functions, said application is adapted for assisting in safe driving of a vehicle, and being configured for receiving input data from sensors built in said communication device including at least one camera device and an inertial sensor and comprising a data processor utility, and a user interface utility, the data processor utility comprising:

a driving condition module adapted for processing said input data obtained from said sensors built in said mobile communication device to determine driving conditions of said vehicle;

a safety hazard detection module adapted for processing data indicative of said driving conditions to determine a safety level of the vehicle corresponding to said driving conditions; and

a communication control module adapted for automatically adjusting an operational mode of said communication device based on said safety level, to automatically enable, disable and/or alter predetermined functions of said communication device in accordance with said safety level.

20. The application of claim 19, comprising a data provider module adapted for downloading a computer readable code from a data network, wherein said computer readable code implementing said driving condition module, said safety hazard detection module, and said communication control module.

22. The application of claim 20, wherein said personal communication device is configured as a mobile phone device and wherein said sensors include one or more of the following:

a positioning system, a camera capable of operating in forward facing mode, a camera capable of operating in rear facing mode, at least one acoustic receiver, a data provider module capable of communicating with a central station via a communication network, one or more inertial measurement modules.

24. The application of claim 19, wherein said safety hazard detection module is adapted to determine said safety level by processing the data obtained from the one or more sensors built in said communication device to determine said driving conditions, identify a plurality of safety hazards in said driving conditions, compute a safety score for said driving conditions based on existence of one or more of said plurality of safety hazards, and utilize said safety score to selected said safety level from a plurality of predetermined discrete levels including:

at least one safe level, at least one dangerous level, and at least one intermediate level of a predefined degree of safety; and

wherein said predetermined functions include at least one of the following;

receiving and transferring incoming and outgoing phone calls respectively, receiving and transferring incoming and outgoing texting messages respectively, and browsing a data network; and

said automatically adjusting of the operational mode includes selectively setting an operational mode of each of said predetermined functions to at least one of the following modes;

fully enabled mode, fully disabled mode, voice control mode, read-aloud notification mode;

auto-reply mode;

emergency action mode.

25. The application of claim 19, comprising a user interface (UI) control module configured and operable for performing said automatic adjustment of the operational mode by carrying out one or more of the following, upon determining the safety level that corresponds to the driving conditions of said vehicle:

presenting, on the user interface, imagery from at least one forward looking camera as background on said display module; and

graphically presenting, on the user interface, one or more of the predetermined functions that are enabled at said safety level on top of said background; and

hiding one or more of the predetermined functions that are disabled at said safety level.

26. The application of claim 19, comprising an emergency control module is configured for operating the mobile communication device in an emergency action mode, by carrying out at least one of the following:

transferring the data indicative of driving conditions to a central station, transferring image data obtained from at least one sensor, to a central station, initiating an emergency notification communication to a central station.

27. The application of claim 19, wherein said driving condition module is adapted for processing said input data from the one or more sensors built in said communication device to carry out at least one of the following:

determine a speed of the vehicle, determine a trajectory of movement of the vehicle, determine acceleration of the vehicle, determine traffic conditions along the vehicle route, determine a distance of the vehicle to at least one object along the vehicle'"'"'s route.

28. The application of claim 27, wherein said driving condition module is adapted for determining a distance of the vehicle to at least one object being another vehicle, by carrying out the following:

operating the camera for capturing an image showing said another vehicle;

processing said image to recognize an element on the another vehicle which is associated with a predetermined physical size, and to determine a measure of the imaged size of the element in said image, wherein said processing includes at least one of the following;

applying image recognition algorithm to identify said element in the image;

applying a tilt correction algorithm to said image to compensate over pitch and yaw misalignments, and generate a compensated image in which said element appears;

measuring the imaged size of said element in the compensated image, with respect to at least one dimension of the element; and

determining a distance from the camera to said element based on a focal length of the camera and a ratio between said imaged size and said predetermined physical size.

30. The application of claim 28, wherein said driving condition module is adapted for determining a distance of the vehicle to at least one object being another vehicle, by carrying out the following:

processing said image to determine the imaged size of said element with respect to at least two dimensions thereof, and calculating a ratio between them; and

utilizing said ratio to classify said element to one or more associated known types, and provide said predetermined physical size based on said classification.

31. The application of claim 27, wherein said driving condition module is capable of carrying out the following:

operating the camera for capturing an image showing said at least one object;

processing said image to recognize said at least one object and determine a location thereof in the image; and

estimating a distance to said at least one object based on said determined location in the image, and a perspective of said image associated with a focal length of said camera by which said image is captured.

21. (canceled)

23. (canceled)

29. (canceled)

32. A telemetric system including at least one computerized server system configured and operable for communicating with at least one communication device, being members of the system, for carrying out the following:

obtain data indicative of driving conditions and/or safety hazards identified by one or more sensors integrated in the at least one communication device;

process the data and identify safety hazards which may affect vehicles located in the vicinity of the at least one communication device;

obtain positioning data from a positioning system of the at least one communication device and from positioning systems of one or more additional communication devices being members of the telemetric system, and process said positioning data to identify another communication device being in the vicinity of the at least one communication device; and

communicate data indicative of the identified safety hazards to the another communication device.

33. (canceled)