Preventing driver distraction

• US 9,020,482 B2
• Filed: 03/06/2013
• Issued: 04/28/2015
• Est. Priority Date: 03/06/2013
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Jones, Brian R.
• Primary Examiner(s): Georgewill, Opiribo
• Application Number:
  US13/787,741
• Publication Number:
  US 20140256303A1
• Time in Patent Office: 783 Days
• Field of Search: 455/418, 710/241, 701/45
• US Class Current: 455/418
• CPC Class Codes: B60K 2360/122 Instrument input devices with reconfigurable control functions, e.g. reconfigurable menus
• CPC Class Codes: B60K 2360/176 Camera images
• CPC Class Codes: B60K 2360/195 Blocking or enabling display functions
• CPC Class Codes: B60K 2360/197 Blocking or enabling of input functions
• CPC Class Codes: B60K 2360/21 using cameras
• CPC Class Codes: B60K 2360/566 Mobile devices displaying vehicle information
• CPC Class Codes: B60K 2360/569 Vehicle controlling mobile device functions
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60K 35/29 Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
• CPC Class Codes: B60K 35/65 Instruments specially adapted for specific vehicle types or users, e.g. for left- or right-hand drive
• CPC Class Codes: B60K 35/654 the user being the driver
• CPC Class Codes: B60K 35/656 the user being a passenger
• CPC Class Codes: B60K 35/80 Arrangements for controlling instruments
• CPC Class Codes: B60R 2022/4883 Interlock systems
• CPC Class Codes: B60R 22/48 Control systems, alarms, or interlock systems, for the correct application of the belt or harness
• CPC Class Codes: G06V 20/593 Recognising seat occupancy
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: H04M 1/72454 according to context-related or environment-related conditions
• CPC Class Codes: H04W 4/027 : using movement velocity, acceleration information
• CPC Class Codes: H04W 4/029 : Location-based management or tracking services
• CPC Class Codes: H04W 4/40 : for vehicles, e.g. vehicle-to-pedestrians [V2P]

Abstract

In some embodiments, a processor-implemented method for disabling at least one text application on a mobile device may comprise: processing an image captured in a vehicle by a mobile device to identify a seat belt in the image; determining a slope of the seat belt relative to a horizon, wherein the horizon is determined using information pertaining to a position and an orientation of the mobile device relative to a frame of reference at a time when the image was captured; determining a speed of the mobile device; and disabling at least one text application on a mobile device based, on the slope of the seat belt and the speed of the mobile device.

Claims

1. A processor-implemented method comprising:

processing an image captured in a vehicle by a mobile device to identify a seat belt in the image;

determining a slope of the seat belt relative to a horizon, wherein the horizon is determined using information pertaining to a position and an orientation of the mobile device relative to a frame of reference at a time when the image was captured;

determining a speed of the mobile device; and

disabling at least one text application on the mobile device based, at least in part, on the slope of the seat belt and the speed of the mobile device and one or more of;

mobile device usage rules in a jurisdiction corresponding to a current location of the mobile device,

drive configuration for vehicles in the jurisdiction, or

a determination of whether a user of the mobile device is a driver of the vehicle.

2. The processor implemented method of claim 1, wherein processing the captured image to identify the seat belt further comprises detecting at least one edge in the image, wherein the at least one detected edge corresponds to one of two edges of the seat belt.

3. The processor implemented method of claim 1, wherein determining the slope of the seat belt relative to the horizon further comprises:

generating at least one of a pair of lines in the image, each line in the pair corresponding to a detected edge of the seat belt; and

determining a slope of the at least one line relative to the horizon, wherein the slope of the seat belt is determined from the slope of the at least one line.

4. The processor implemented method of claim 1, wherein disabling the at least one text application on the mobile device is based further, in part, input from one or more sensors on the mobile device.

5. The processor implemented method of claim 1, wherein a determination of whether the user of the mobile device is the driver is based, in part, on the slope of the seat belt.

6. The processor implemented method of claim 1, wherein the mobile device comprises a camera and the camera is used to capture the image in the vehicle.

7. The processor implemented method of claim 6, wherein a position and an orientation of the camera is used as a proxy for the position and orientation of the mobile device.

8. The processor implemented method of claim 1, wherein the mobile device is situated within the vehicle and the speed of the mobile device serves as a proxy for the speed of the vehicle.

9. The processor implemented method of claim 1, wherein the method is performed when the mobile device is powered on, or is woken up from a sleep state, or is unlocked.

10. The processor implemented method of claim 1, wherein the jurisdiction corresponding to the current location of the mobile device is determined based on at least one of:

information received from a location server (LCS) in a cellular network serving the mobile device, or

a Satellite Positioning System (SPS) in communication with the mobile device.

11. The processor implemented method of claim 1, wherein information pertaining to the speed of the mobile device, and the position and orientation of the mobile device at the time of image capture relative to the frame of reference is obtained, based in part, from measurements of an Inertial Measurement Unit (IMU) housed in the mobile device.

12. The processor implemented method of claim 11, wherein the IMU comprises an accelerometer.

13. The processor implemented method of claim 1, further comprising displaying an emergency number to call upon disabling the text application.

14. The processor implemented method of claim 1, wherein the method is performed on the mobile device.

15. A mobile device comprising:

a camera capable of capturing an image in a vehicle;

an Inertial Measurement Unit (IMU) coupled to the camera and capable of determining a speed of the mobile device and a position and an orientation of the camera relative to a frame of reference at a time of image capture; and

a processor coupled to the camera and the IMU, wherein the processor is configured to process the image captured by the camera to;

identify a seat belt in the image;

determine a slope of the seat belt relative to a horizon, wherein the horizon is determined using information provided by the IMU pertaining to the position and orientation of the camera relative to a frame of reference at the time when the image was captured; and

disable the execution of at least one text application on the mobile device based, at least in part, on the slope of the seat belt and the speed and one or more of;

mobile device usage rules in a jurisdiction corresponding to a current location of the mobile device,

drive configuration for vehicles in the jurisdiction, or

a determination of whether a user of the mobile device is a driver of the vehicle.

16. The mobile device of claim 15, wherein to identify the seat belt, the processor is further configured to detect at least one edge in the image, wherein the at least one detected edge corresponds to one of two edges of the seat belt.

17. The mobile device of claim 15, wherein to determine the slope of the seat belt relative to the horizon, the processor is further configured to:

generate at least one of a pair of lines in the image, each line in the pair corresponding to a detected edge of the seat belt; and

determine a slope of the at least one line relative to the horizon, wherein the slope of the seat belt is determined from the slope of the at least one line.

18. The mobile device of claim 15, further comprising one or more sensors coupled to the processor;

and

wherein the processor is configured to disable the at least one text application on the mobile device is based further, in part, on input from the one or more sensors.

19. The mobile device of claim 15, wherein the processor is configured to determine of whether the user of the mobile device is the driver is based, in part, on the slope of the seat belt.

20. The mobile device of claim 15, further comprising:

a transceiver coupled to the processor and capable of communicating with a Location Server (LCS) over a cellular network to determine the current location of the mobile device; and

wherein the processor is configured to determine the jurisdiction based, in part, on the current location of the mobile device.

21. The mobile device of claim 15, wherein the apparatus further comprises:

a Satellite Positioning System receiver coupled to the processor and capable of determining the current location of the mobile device; and

wherein the processor is configured to determine the jurisdiction based, in part, on current location of the mobile device.

22. The mobile device of claim 15, further comprising a screen coupled to processor, and

wherein the processor is configured to display an emergency number to call on the screen upon disabling the text application.

23. The mobile device of claim 15, wherein the IMU comprises an accelerometer.

24. A mobile device comprising:

an imaging means, the imaging means to capture an image in a vehicle;

an inertial measurement means coupled to the imaging means, the inertial measurement means to determine a speed of the mobile device and a position and an orientation of the imaging means relative to a frame of reference at a time of image capture; and

a processing means coupled to the imaging means and the inertial measurement means, the processing means to process the image captured by the imaging means and further comprising;

means for identifying a seat belt in the image;

means for determining a slope of the seat belt relative to a horizon, wherein the horizon is determined using information provided by the inertial measurement means pertaining to the position and orientation of the imaging means relative to a frame of reference at the time when the image was captured; and

means for disabling the execution of at least one text application on the mobile device based, at least in part, on the slope of the seat belt and the speed and one or more of;

mobile device usage rules in a jurisdiction corresponding to a current location of the mobile device,

drive configuration for vehicles in the jurisdiction, or a determination of whether a user of the mobile device is a driver of the vehicle.

25. The mobile device of claim 24, wherein means for identifying the seat belt further comprises means for detecting at least one edge in the image, wherein the at least one detected edge corresponds to one of two edges of the seat belt.

26. The mobile device of claim 24, wherein means for determining the slope of the seat belt relative to the horizon further comprises:

means for generating at least one of a pair of lines in the image, each line in the pair corresponding to a detected edge of the seat belt; and

means for determining a slope of the at least one line relative to the horizon, wherein the slope of the seat belt is determined from the slope of the at least one line.

27. The mobile device of claim 24, further comprising one or more sensing means coupled to the processing means;

and

wherein the means for disabling the at least one text application is based further, in part, on input from the one or more sensing means.

28. The mobile device of claim 24, wherein the determination of whether the user of the mobile device is the driver, is based, in part, on the slope of the seat belt.

29. The mobile device of claim 24, further comprising:

a transceiver means coupled to the processing means, the transceiver means to communicate with a Location Server (LCS) over a cellular network to determine the current location of the mobile device; and

wherein the means for disabling the at least one text application on the mobile device further comprises means for determining the jurisdiction based, in part, on the current location of the mobile device.

30. The mobile device of claim 24, wherein the apparatus further comprises:

a Satellite Positioning System receiving means coupled to the processor and capable of determining the current location of the mobile device; and

wherein the means for disabling the at least one text application on the mobile device further comprises means for determining the jurisdiction based, in part, on the current location of the mobile device.

31. The mobile device of claim 24, further comprising display means coupled to the processing means, and

wherein the display means displays an emergency number to call when the text application is disabled.

32. The mobile device of claim 24, wherein the inertial measurement means further comprises accelerometer means.

33. A non-transitory computer-readable medium comprising instructions, which when executed by a processor, perform steps in a method, the steps comprising:

processing an image captured in a vehicle by the mobile device to identify a seat belt in the image;

determining a slope of the seat belt relative to a horizon, wherein the horizon is determined using information pertaining to a position and an orientation of the mobile device relative to a frame of reference at a time when the image was captured;

determining a speed of the mobile device; and

disabling at least one text application on a mobile device based, at least in part, on the slope of the seat belt and the speed of the mobile device and one or more of;

mobile device usage rules in a jurisdiction corresponding to a current location of the mobile device,

drive configuration for vehicles in the jurisdiction, or

a determination of whether a user of the mobile device is a driver of the vehicle.

34. The computer-readable medium of claim 33, wherein processing the captured image to identify the seat belt further comprises detecting at least one edge in the image, wherein the at least one detected edge corresponds to one of two edges of the seat belt.

35. The computer-readable medium of claim 33, wherein determining the slope of the seat belt relative to the horizon further comprises:

generating at least one of a pair of lines in the image, each line in the pair corresponding to a detected edge of the seat belt; and

determining a slope of the at least one line relative to the horizon, wherein the slope of the seat belt is determined from the slope of the at least one line.

36. The computer-readable medium of claim 33, wherein disabling the at least one text application on the mobile device is based further, in part, input from one or more sensors on the mobile device.

37. The computer-readable medium of claim 33, wherein a determination of whether the user of the mobile device is the driver is based, in part, on the slope of the seat belt.

38. The computer-readable medium of claim 33, wherein the mobile device comprises a camera and the camera is used to capture the image in the vehicle.

39. The computer-readable medium of claim 38, wherein a position and an orientation of the camera is used as a proxy for the position and orientation of the mobile device.

40. The computer-readable medium of claim 33, wherein the mobile device is situated within the vehicle and the speed of the mobile device serves as a proxy for the speed of the vehicle.

41. The computer-readable medium of claim 33, wherein the method is performed when the mobile device is powered on, or is woken up from a sleep state, or is unlocked.

42. The computer-readable medium of claim 33, wherein the jurisdiction corresponding to the current location of the mobile device is determined based on at least one of:

information received from a location server (LCS) in a cellular network serving the mobile device, or

a Satellite Positioning System (SPS) in communication with the mobile device.

43. The computer-readable medium of claim 33, wherein information pertaining to the speed of the mobile device, and the position and orientation of the mobile device at the time of image capture relative to the frame of reference is obtained, based in part, from measurements of an Inertial Measurement Unit (IMU) housed in the mobile device.

44. The computer-readable medium of claim 43, wherein the IMU comprises an accelerometer.

45. The computer-readable medium of claim 33, further comprising displaying an emergency number to call upon disabling the text application.