Vehicle event playback apparatus and methods

• US 9,728,228 B2
• Filed: 08/10/2012
• Issued: 08/08/2017
• Est. Priority Date: 08/10/2012
• Status: Active Grant

• Current Assignee: SmartDrive Systems, Inc. (Solera Holdings Incorporated)
• Original Assignee: SmartDrive Systems, Inc. (Solera Holdings Incorporated)
• Inventors: Palmer, Jason, Sljivar, Steven
• Primary Examiner(s): Chow, Doon
• Assistant Examiner(s): NICHOLAS, WENDY K
• Application Number:
  US13/571,416
• Publication Number:
  US 20140046550A1
• Time in Patent Office: 1,824 Days
• Field of Search: 715771, 715716, 715719, 715772, 7155001, 701 48, 701 334, 701301, 701 45, 701 314, 701 35, 340903, 340436, 340435, 3404255, 340 96, 340937, 340905, 340 36, 340576, 340439, 34042628, 180271, 180287, 348148, 348 E7085
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection
• CPC Class Codes: G09B 29/007 using computer methods
• CPC Class Codes: G09B 29/10 Map spot or coordinate position indicators; Map reading aids optical projection apparatus per se G03B
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/41422 located in transportation means, e.g. personal vehicle arrangements specially adapted for transportation systems in broadcast systems H04H20/62
• CPC Class Codes: H04N 21/4325 by playing back content from the storage medium reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79

Abstract

Vehicle event data playback systems have been devised and invented to provide authorized users means for advanced visual review. Detailed circumstances relating to vehicle operation are visually presented in these unique playback systems. In particular, a group of cooperating visual display devices operate in conjunction with each other to effect a detailed visual presentation of a vehicle'"'"'s operational states. An interested party is afforded a high level of access to many data types in highly graphical and intuitive arrangements. Further, data replay access is enhanced by slow motion, fast forward, loop repeat, among others which have never before been associated with these data types nor with the compound visual presentations first taught in the accompanying disclosure.

Claims

1. A vehicle event data playback apparatus comprising:

a logic processor configured to facilitate display of information stored electronically in a vehicle event record that corresponds to a vehicle event, the information stored in the vehicle event record being received from a vehicle event recorder mounted in a vehicle, the information stored in the vehicle event record received responsive to detection of the vehicle event by the vehicle event recorder, the vehicle event comprising a vehicle operation anomaly detected during operation of the vehicle by a vehicle operator, the vehicle event record including visual information and vehicle operation information for a period of time that includes the vehicle event, wherein the vehicle event is associated with excess fuel consumption;

a graphical display device configured to display vehicle event record information via a graphical user interface system; and

the graphical user interface system,

a view of said graphical user interface system comprising;

a plurality of control objects, the plurality of control objects comprising two or more of an engine load control object, a power take-off control object, a traction control object, an electronic stability control object, or an excess fuel consumption control object, the plurality of control objects corresponding to data values of the vehicle event record and configured such that a visual appearance of the plurality of control objects changes based on changes in the data values in said vehicle event record over time during the vehicle event, wherein the plurality of control objects further includes one or more video player control objects and a notations field object configured to receive notations from a reviewer through entry and/or selection of information from the reviewer, wherein the notations include a first notation that is associated with an indicator related to a severity of an infraction by the vehicle operator during the vehicle event, and wherein the logic processor is further configured to associate the first notation with a corresponding point in time such that the first notation is displayed at the corresponding point in time during subsequent playback using the vehicle event data playback apparatus, wherein the excess fuel consumption control object reflects instant feedback that has been provided to the vehicle operator in response to the vehicle event;

a line graph representation of the data values in the vehicle event record over time that corresponds to the plurality of control objects; and

a video player configured to display video data of the vehicle event record that is synchronized in time with the plurality of control objects and the line graph representation, wherein the video player is further configured to display information that reflects a response by the vehicle operator to the instant feedback.

2. The vehicle event data playback apparatus of claim 1, wherein the notations further include a second notation, wherein the logic processor is further configured to associate the second notation with a corresponding period of time that includes time prior to the corresponding point in time and that further includes time subsequent to the corresponding point in time, and wherein the second notation is displayed throughout the corresponding period of time during subsequent playback.

3. The vehicle event data playback apparatus of claim 1, wherein the graphical user interface system is configured such that the view of the graphical user interface system further comprises a timeline control object, said timeline control object having a start time, an end time, and a discrete number of time instants therebetween.

4. The vehicle event data playback apparatus of claim 3, wherein the logic processor is configured such that the timeline control object is coupled to the plurality of control objects of the graphical user interface to effect time synchronization between coupled control objects.

5. The vehicle event data playback apparatus of claim 4, wherein the graphical user interface system is configured such that the plurality of control objects provide visual expressions of data related to vehicle operation.

6. The vehicle event data playback apparatus of claim 4, wherein the graphical user interface system is configured such that the plurality of control objects include four or more of a g-force control object;

an engine speed control object;

a vehicle speed control object;

a throttle position control object;

the engine load control object;

the power take-off control object;

a malfunction indicator light control object;

a brake system control object;

an anti-lock brake system control object;

the traction control object;

the electronic stability control object;

the excess fuel consumption control object;

a notation control object;

or an environment state control object.

7. The vehicle event data playback apparatus of claim 3, wherein at least one of the video player control objects is arranged for playing data files comprising an image series via the video player.

8. The vehicle event data playback apparatus of claim 3, wherein the graphical user interface system further comprises at least two of the video player control objects, wherein video images presented via the individual video player control objects are synchronized in time such that images simultaneously displayed have a frame capture time instant which is substantially the same.

9. The vehicle event data playback apparatus of claim 1, wherein the graphical user interface system is configured such that the one or more video player control objects include a first virtual video player and a second virtual video player, the first virtual video player characterized as a streetview video player and configured to play one or more streetview image series derived from sources other than the vehicle event recorder, the one or more streetview image series including images captured at a time independent and different from an event period during which the vehicle event occurred, the images captured from a plurality of discrete street locations, the second virtual video player characterized as a mapview video player and configured to play one or more map image series including images characterized as map images, wherein the video player is configured to display video data of the vehicle event record that is synchronized in time with the first virtual video player and the second virtual video player.

10. The vehicle event data playback apparatus of claim 9, wherein the one or more streetview image series is comprised of images made from locations that substantially correspond to locations recorded by the vehicle event recorder in the event record.

11. The vehicle event data playback apparatus of claim 10, wherein the graphical user interface system is configured such that the one or more streetview image series further includes icons and augmentations determined based on data captured in the vehicle event record.

12. The vehicle event data playback apparatus of claim 11, wherein the graphical user interface system is configured such that said icons or augmentations are characterized as those from the group including:

those which indicate a location of the vehicle event;

those which indicate a direction of travel;

those which indicate a street name; and

those which identify landmarks.

13. The vehicle event data playback apparatus of claim 9, wherein the graphical user interface system is configured such that said map images include locations which substantially correspond to locations recorded in the vehicle event record.

14. The vehicle event data playback apparatus of claim 13, wherein the graphical user interface system is configured such that said map images further include augmentations which depend upon data captured with the vehicle event recorder.

15. The vehicle event data playback apparatus of claim 14, wherein the graphical user interface system is configured such that said augmentation is characterized as a vehicle position indicator.

16. The vehicle event data playback apparatus of claim 14, wherein the graphical user interface system is configured such that said augmentation is characterized as an infraction indicator.

17. The vehicle event data playback apparatus of claim 9, wherein the graphical user interface system is configured such that the one or more video player control objects further includes a third virtual video player, the third virtual video player characterized as a bird'"'"'s eye view player.

18. The vehicle event data playback apparatus of claim 2, wherein the corresponding period of time of the second notation includes a start time of the corresponding period of time and an end time of the corresponding period of time, wherein the start time is received from the reviewer through entry and/or selection of information, and wherein the end time is received from the reviewer through entry and/or selection of information.