SYSTEMS, APPARATUSES AND METHODS FOR DETECTING DRIVING BEHAVIOR AND TRIGGERING ACTIONS BASED ON DETECTED DRIVING BEHAVIOR

• US 20180025636A1
• Filed: 10/02/2017
• Published: 01/25/2018
• Est. Priority Date: 05/09/2016
• Status: Active Grant

• Current Assignee: Coban Technologies Incorporated (Safe Fleet Holdings LLC)
• Original Assignee: Coban Technologies Incorporated (Safe Fleet Holdings LLC)
• Inventors: Boykin, Terry W., Nooner, Daniel P.
• Granted Patent: US 10,789,840 B2
• Time in Patent Office: Days
• CPC Class Codes: B60Q 1/2611 Indicating devices mounted on the roof of the vehicle
• CPC Class Codes: B60W 2554/804 Relative longitudinal speed
• CPC Class Codes: B60W 2555/60 Traffic rules, e.g. speed limits or right of way
• CPC Class Codes: B60W 2556/55 using telemetry
• CPC Class Codes: B60W 40/09 Driving style or behaviour
• CPC Class Codes: B60W 40/105 Speed
• CPC Class Codes: B60W 50/14 Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: G01S 19/42 Determining position
• CPC Class Codes: G06V 20/582 of traffic signs
• CPC Class Codes: G06V 20/584 of vehicle lights or traffic lights
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G07C 5/008 communicating information to a remotely located station transmission systems for measured values G08C
• CPC Class Codes: G08B 13/19613 Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion
• CPC Class Codes: G08B 13/19621 Portable camera
• CPC Class Codes: G08B 13/19641 Multiple cameras having overlapping views on a single scene
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: G08B 25/08 using communication transmission lines G08B13/19658, G08B21/0286, G08B25/016 take precedence
• CPC Class Codes: G08G 1/0112 from the vehicle, e.g. floating car data [FCD]
• CPC Class Codes: G08G 1/052 with provision for determining speed or overspeed speed measuring in general G01P
• CPC Class Codes: G08G 1/096725 where the received information generates an automatic action on the vehicle control
• CPC Class Codes: G11B 27/102 : Programmed access in sequence to addressed parts of tracks of operating record carriers access by moving the head G11B3/08, G11B5/54, G11B7/085, G11B21/022; by moving the record carrier G11B15/005, G11B17/005, by driving of both record carrier and head G11B15/1816
• CPC Class Codes: H04N 1/2112 : using still video cameras
• CPC Class Codes: H04N 21/2368 : Multiplexing of audio and video streams
• CPC Class Codes: H04N 21/2743 : Video hosting of uploaded data from client
• CPC Class Codes: H04N 21/41422 : located in transportation means, e.g. personal vehicle arrangements specially adapted for transportation systems in broadcast systems H04H20/62
• CPC Class Codes: H04N 21/4302 : Content synchronisation processes, e.g. decoder synchronisation
• CPC Class Codes: H04N 21/435 : Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/4394 : involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/8106 : involving special audio data, e.g. different tracks for different languages
• CPC Class Codes: H04N 21/84 : Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 23/634 : Warning indications
• CPC Class Codes: H04N 23/635 : Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/66 : Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 7/183 : for receiving images from a single remote source
• CPC Class Codes: H04R 1/406 : microphones
• CPC Class Codes: H04R 3/005 : for combining the signals of two or more microphones specially adapted for hearing aids H04R25/407

Abstract

Systems, apparatuses and methods for detecting the presence of certain driving behavior are disclosed. Driving behavior is detected by capturing and characterizing image data and sampling vehicle telemetry data. Real-time characterization techniques include object and shape recognition analytics to detect specifically designated content in captured image data. Actions are triggered based upon such detection.

Claims

1. A system, comprising:

a vehicle comprising;

at least one camera device configured to capture image data;

at least one sensor configured to capture vehicle telemetry data; and

a microprocessor linked to the at least one camera device and the at least one sensor, wherein the microprocessor is configured with instructions to detect the occurrence of at least one designated event.

2. The system of claim 1, wherein the at least one sensor configured to capture vehicle telemetry data comprises a GPS device configured to capture location data.

3. The system of claim 1, wherein the at least one sensor configured to capture vehicle telemetry data comprises an accelerometer.

4. The system of claim 1, wherein (i) the at least one designated event comprises aggressive driving, and (ii) the at least one sensor configured to capture vehicle telemetry data comprises an accelerometer.

5. The system of claim 1, wherein (i) the at least one designated event comprises a speed of the vehicle is outside of a speed threshold, and (ii) the at least one sensor configured to capture vehicle telemetry data comprises a speed sensor.

6. The system of claim 1, wherein the at least one designated event comprises at least one of (i) a speed of the vehicle is outside of a speed threshold, (ii) failure to stop at a traffic light, (iii) failure to stop at a stop sign, (iv) a collision, (v) a near collision, (vi) aggressive or reckless driving, and (vii) rollover of the vehicle.

7. The system of claim 1, wherein the at least one designated event comprises acceleration of the vehicle in excess of a predetermined threshold.

8. The system of claim 1,

wherein the vehicle further comprises emergency lighting mounted on the vehicle,

wherein the action triggered comprises activating the emergency lighting, and

wherein the at least one designated event comprises at least one of:

(i) a speed of the vehicle is outside of the speed threshold, (ii) an acceleration of the vehicle is in excess of a first predetermined threshold, (iii) the acceleration of the vehicle is in excess of a second predetermined threshold, and (iv) the acceleration of the vehicle is in excess of a third predetermined threshold.

9. The system of claim 1, wherein the microprocessor is further configured with instructions to perform the following:

determine a speed of the vehicle from at least one of (i) the image data captured by the at least one camera device, and (ii) the vehicle telemetry data; and

determine an applicable speed limit,

wherein the at least one designated event comprises the speed of the vehicle is outside of a speed threshold, and

wherein the occurrence of the at least one designated event is detected by comparing the determined speed of the vehicle with the determined applicable speed limit.

10. The system of claim 1, wherein the microprocessor is further configured with instructions to trigger an action if the occurrence of at least one designated event is detected.

11. The system of claim 10, wherein the triggered action comprises:

recording image data captured by the at least one camera device to internal memory; and

bookmarking the at least one designated event in metadata associated with the image data captured by the at least one camera device.

12. The system of claim 10, wherein the triggered action comprises at least one of (i) transmitting an alert to a driver of the vehicle, (ii) activating data recording by the camera device or another device, (iii) transmitting a wireless communication to a remote user, (iv) activating emergency lighting of the vehicle, (v) displaying an image of the at least one designated event, (vi) intervening into driving dynamics of the vehicle, and (vii) bookmarking the at least one designated event in metadata that is associated with the vehicle telemetry data or with the image data captured by the at least one camera device.

13. A method, comprising:

capturing image data using a camera device, wherein the camera device is mounted to a vehicle;

sampling telemetry data from at least one sensor, wherein the at least one sensor is mounted to the vehicle;

detecting the occurrence of at least one designated event from at least one of (i) the telemetry data and (ii) the image data.

14. The method of claim 13, wherein the at least one sensor comprises a GPS device configured to capture location data.

15. The method of claim 13, wherein the sampling telemetry data from at least one sensor comprises sampling telemetry data from an accelerometer.

16. The method of claim 13, wherein (i) the at least one designated event comprises aggressive driving, and (ii) the at least one sensor comprises an accelerometer.

17. The method of claim 13, wherein (i) the at least one designated event comprises a speed of the vehicle is outside of a speed threshold, and (ii) the at least one sensor comprises a speed sensor.

18. The method of claim 13, wherein the at least one designated event comprises at least one of (i) a speed of the vehicle is outside of a speed threshold, (ii) failure to stop at a traffic light, (iii) failure to stop at a stop sign, (iv) a collision, (v) a near collision, (vi) aggressive or reckless driving, and (vii) rollover of the vehicle.

19. The method of claim 13, wherein the at least one designated event comprises acceleration in excess of a predetermined threshold.

20. The method of claim 13, further comprising:

determining a speed of the vehicle from at least one of (i) the image data, and (ii) the telemetry data; and

determining an applicable speed limit,

wherein the at least one designated event comprises the speed of the vehicle is outside of a speed threshold, and

wherein the occurrence of the at least one designated event is detected also by comparing the determined speed of the vehicle with the determined applicable speed limit.

21. The method of claim 13, wherein the microprocessor is further configured with instructions to trigger an action if the occurrence of the at least one designated event is detected.

22. The method of claim 21, wherein the triggered action comprises:

recording the image data captured by the camera device to internal memory; and

bookmarking the at least one designated event in metadata associated with the image data captured by the camera device.

23. The method of claim 21, further comprising:

wherein the triggered action comprises activating emergency lighting mounted to the vehicle, and

wherein the at least one designated event comprises at least one of (i) speed of the vehicle is outside of a speed threshold, (ii) an acceleration of the vehicle exceeds a first predetermined threshold, (iii) the acceleration of the vehicle exceeds a second predetermined threshold, and (iv) the acceleration of the vehicle exceeds a third predetermined threshold.

24. The method of claim 21, wherein the triggered action comprises at least one of (i) transmitting an alert to a driver of the vehicle, (ii) activating data recording by the camera device or another device, (iii) transmitting a wireless communication to a remote user, (iv) activating emergency lighting of the vehicle, (v) displaying an image of the at least one designated event, (vi) intervening into driving dynamics of the vehicle, and (vii) bookmarking the at least one designated event in metadata that is associated with the telemetry data or with the image data captured by the camera device.

25. A method comprising:

capturing image data using a camera device, wherein the camera device is mounted to a first vehicle;

sampling telemetry data from at least one sensor, wherein the at least one sensor is mounted to the first vehicle;

determining an applicable speed limit;

determining a first speed of the first vehicle using at least one of (i) the image data captured by the camera device mounted to the first vehicle, and (ii) the telemetry data sampled from the at least one sensor mounted on the first vehicle;

calculating a relative speed of a second vehicle to the first vehicle using the image data captured by the camera device mounted to the first vehicle;

calculating a second speed of the second vehicle by adding together (i) the relative speed of the second vehicle to the first vehicle and (ii) the first speed of the first vehicle; and

comparing the second speed of the second vehicle with the applicable speed limit.

26. A system comprising:

a first vehicle comprising;

at least one camera device configured to capture image data;

at least one sensor configured to capture vehicle telemetry data; and

a microprocessor linked to the at least one camera device and the at least one sensor, wherein the microprocessor is configured with instructions to;

determine an applicable speed limit;

determine a first speed of the first vehicle using at least one of (i) image data captured by the camera device, and (ii) vehicle telemetry data captured by the at least one sensor,

calculate a relative speed of a second vehicle to the first vehicle using the image data captured by the camera device;

calculate a second speed of the second vehicle by adding together (i) the relative speed of the second vehicle to the first vehicle and (ii) the first speed of the first vehicle; and

compare the second speed of the second vehicle with the applicable speed limit.