Method and apparatus for detecting a utilization of an electronic device by a driver, for a vehicle

• US 10,395,387 B2
• Filed: 04/06/2017
• Issued: 08/27/2019
• Est. Priority Date: 04/29/2016
• Status: Expired due to Fees

• Current Assignee: Robert Bosch GmbH
• Original Assignee: Robert Bosch GmbH
• Inventors: Ewert, Marlon Ramon
• Primary Examiner(s): Couso, Jose L
• Application Number:
  US15/480,699
• Publication Number:
  US 20170316581A1
• Time in Patent Office: 873 Days
• CPC Class Codes: B60K 28/02 responsive to conditions relating to the driver
• CPC Class Codes: B60W 2050/0095 Automatic control mode change
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 40/08 related to drivers or passengers
• CPC Class Codes: G06T 2207/10004 Still image; Photographic image
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/10132 Ultrasound image
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30268 Vehicle interior
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G06V 40/107 Static hand or arm
• CPC Class Codes: G06V 40/18 Eye characteristics, e.g. of the iris

Abstract

A method includes a reading-in step in which at least one sensor signal is read in via an interface to a sensor disposed in the vehicle, the sensor signal representing at least one current parameter of the electronic device and/or of the driver in the vehicle. The method furthermore includes a comparing step in which the sensor signal is compared with at least one stored utilization signal that represents a utilization of the electronic device by the driver while driving the vehicle. The method further includes an outputting step in which a detection signal is outputted if a predetermined correlation exists between the sensor signal and the utilization signal, in order to indicate the detected utilization of the electronic device.

Claims

1. A method for detecting a utilization of an electronic device by a driver of a vehicle, the method comprising:

obtaining, by processing circuitry and from a sensor disposed in the vehicle, at least one sensor signal representing at least one current parameter of at least one of the electronic device and the driver in the vehicle;

comparing, by the processing circuitry, the sensor signal with at least one stored utilization signal that represents the utilization of the electronic device by the driver while driving the vehicle;

outputting, by the processing circuitry, a detection signal that indicates the utilization of the electronic device in response to a determination, based on the comparing, that a predetermined correlation exists between the sensor signal and the utilization signal; and

suppressing operation of the electronic device being operated by the driver to improve driving safety;

wherein the obtained signal represents at least one of a position of the driver in the vehicle, a gaze direction of the driver in the vehicle, and a hand movement of the driver in the vehicle,

wherein the position of the driver, the gaze direction of the driver and/or hand movements of the driver are captured and monitored over time to determine whether the driver is using the electronic device in the vehicle, and

wherein operation of the electronic device is suppressed by deactivating the electronic device by disconnecting radio connections, including NFC or Bluetooth connections, between vehicle electronics and the electronic device.

2. The method of claim 1, wherein the correlation is determined to exit when the sensor signal conforms to the utilization signal within a tolerance range.

3. The method of claim 1, wherein the obtaining includes reading in the sensor signal as at least one of a camera signal furnished by a vehicle camera, an ultrasonic signal furnished by an ultrasonic sensor, a laser signal, and a radar signal furnished by a radar sensor.

4. The method of claim 1, wherein the obtaining includes reading in the sensor signal as a three-dimensional laser image signal furnished by a laser scanner.

5. The method of claim 1, wherein, in the comparing, the stored utilization signal is compared as at least one of an image signal, an ultrasonic image signal, a laser image signal, and a radar signal.

6. The method of claim 1, wherein, in the comparing, the stored utilization signal is compared as a three-dimensional laser image signal.

7. The method of claim 1, wherein the obtained sensor signal is read in as a seat signal furnished by a seat sensor.

8. The method of claim 1, wherein the obtained sensor signal includes a parameter that represents a posture of the driver on a seat.

9. The method of claim 1, wherein, in the comparing, the stored utilization signal is compared as a posture image signal.

10. The method of claim 1, wherein the obtaining includes reading in the sensor signal as a coupling signal furnished by a coupling device.

11. The method of claim 1, wherein the obtaining includes reading in the sensor signal as a parameter that represents at least one of a radio-based and wired coupling connection of the electronic device to at least one component of the vehicle in the vehicle.

12. The method of claim 1, wherein in the comparing, the stored utilization signal is compared as at least one of a disconnected radio-based and wired coupling connection of the electronic device to the component of the vehicle in the vehicle.

13. The method of claim 1, wherein the obtaining includes reading-in the sensor signal as at least one of a device signal furnished by a device sensor of the electronic device and a parameter that represents at least one of a movement, an acceleration, and a rotation rate of the electronic device in the vehicle.

14. The method of claim 1, wherein the outputting is to a receiver unit external to the vehicle.

15. The method of claim 1, wherein at least one of an acoustic and optical warning signal is created in response to the detection signal in order to warn the driver.

16. The method of claim 1, wherein an automatic operating mode signal for transferring the vehicle into an automated driving mode is generated in response to the detection signal.

17. The method of claim 1, further comprising recognizing a manual operating mode signal which represents a manual driving mode of the vehicle, wherein the obtaining is performed in response to the recognition.

18. The method of claim 1, wherein a deactivation signal for deactivating the electronic device is output in response to the detection signal.

19. A non-transitory computer-readable medium on which are stored instructions that are executable by a processor and that, when executed by the processor, cause the processor to perform a method for detecting a utilization of an electronic device by a driver of a vehicle, the method comprising:

obtaining from a sensor disposed in the vehicle at least one sensor signal representing at least one current parameter of at least one of the electronic device and the driver in the vehicle;

comparing the sensor signal with at least one stored utilization signal that represents the utilization of the electronic device by the driver while driving the vehicle;

outputting a detection signal that indicates the utilization of the electronic device in response to a determination, based on the comparing, that a predetermined correlation exists between the sensor signal and the utilization signal; and

suppressing operation of the electronic device being operated by the driver to improve driving safety;

wherein the obtained signal represents at least one of a position of the driver in the vehicle, a gaze direction of the driver in the vehicle, and a hand movement of the driver in the vehicle,

wherein the position of the driver, the gaze direction of the driver and/or hand movements of the driver are captured and monitored over time to determine whether the driver is using the electronic device in the vehicle, and

wherein operation of the electronic device is suppressed by deactivating the electronic device by disconnecting radio connections, including NFC or Bluetooth connections, between vehicle electronics and the electronic device.

20. A device for detecting a utilization of an electronic device by a driver of a vehicle, the device comprising:

an interface; and

processing circuitry, wherein the processing circuitry is configured to perform the following;

obtain from a sensor disposed in the vehicle, and via the interface, at least one sensor signal representing at least one current parameter of at least one of the electronic device and the driver in the vehicle;

compare the sensor signal with at least one stored utilization signal that represents the utilization of the electronic device by the driver while driving the vehicle;

output a detection signal that indicates the utilization of the electronic device in response to a determination, based on the comparison, that a predetermined correlation exists between the sensor signal and the utilization signal; and

suppressing operation of the electronic device being operated by the driver to improve driving safety;

wherein the obtained signal represents at least one of a position of the driver in the vehicle, a gaze direction of the driver in the vehicle, and a hand movement of the driver in the vehicle,

wherein the position of the driver, the gaze direction of the driver and/or hand movements of the driver are captured and monitored over time to determine whether the driver is using the electronic device in the vehicle, and

wherein operation of the electronic device is suppressed by deactivating the electronic device by disconnecting radio connections, including NFC or Bluetooth connections, between vehicle electronics and the electronic device.