METHODS, APPARATUS, AND SYSTEMS FOR ACQUIRING AND ANALYZING VEHICLE DATA AND GENERATING AN ELECTRONIC REPRESENTATION OF VEHICLE OPERATIONS

• US 20140347396A1
• Filed: 12/16/2013
• Published: 11/27/2014
• Est. Priority Date: 04/03/2009
• Status: Abandoned Application

• Current Assignee: Certusview Technologies LLC (Dycom Industries Incorporated)
• Original Assignee: Certusview Technologies LLC (Dycom Industries Incorporated)
• Inventors: Nielsen, Steven E., Chambers, Curtis, Farr, Jeffrey
• Application Number:
  US14/107,550
• Publication Number:
  US 20140347396A1
• Time in Patent Office: Days
• US Class Current: 345/634
• CPC Class Codes: B60R 2300/302 combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
• CPC Class Codes: B60R 2300/304 using merged images, e.g. merging camera image with stored images
• CPC Class Codes: B60R 2300/50 characterised by the display information being shared, e.g. external display, data transfer to other traffic participants or centralised traffic controller
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G07C 5/008 communicating information to a remotely located station transmission systems for measured values G08C
• CPC Class Codes: G07C 5/085 using electronic data carriers

Abstract

Geo-referenced and/or time-referenced electronic drawings may be generated based on electronic vehicle information to facilitate documentation of a vehicle-related event. A symbols library, a collection of geo-referenced images, and any data acquired from one or more vehicles may be stored in memory for use in connection with generation of such drawings, and a drawing tool graphical user interface (GUI) may be provided for electronically processing vehicle data and geo-referenced images. Processed geo-referenced images may be saved as event-specific images, which may be integrated into, for example, an electronic vehicle accident report for accurately depicting a vehicle accident.

Claims

1. An apparatus to document operation of a first vehicle in a geographic area, the apparatus comprising:

a communication interface;

a memory to store processor-executable instructions; and

a processing unit communicatively coupled to the communication interface and the memory, wherein upon execution of the processor-executable instructions by the processing unit, the processing unit;

controls the communication interface to electronically receive source data representing at least one input image of the geographic area in which at least a portion of the operation of the first vehicle occurs;

acquires vehicle-based information relating to the first vehicle at a time during or proximate the operation of the first vehicle in the geographic area;

renders, based at least in part on the vehicle-based information, a marked-up image including a first representation of at least the portion of the operation overlaid on the at least one input image; and

further controls the communication interface and/or the memory to electronically transmit and/or electronically store information relating to the marked-up digital image so as to document the operation of the first vehicle with respect to the geographic area.

2. The apparatus of claim 1, wherein the processing unit acquires a media file comprising audio information and/or video information and/or image information generated during or proximate the operation of the first vehicle.

3. The apparatus of claim 2, wherein the media file is captured using a media capture device mounted in the first vehicle, and wherein the media capture device is a digital camera, an infra-red camera, or an audio recorder.

4. The apparatus of claim 2, wherein the processing unit acquires the media file from a vehicle control system associated with the first vehicle.

5. The apparatus of claim 1, wherein the input image is geo-referenced.

6. The apparatus of claim 1, further comprising a display device;

wherein the processing unit controls the display device to display the marked-up digital image.

7. The apparatus of claim 6, further comprising at least one user input device, wherein the processing unit further:

categorizes the at least one input image, and/or the first representation of at least a portion of the operation, into a plurality of display layers of the marked-up digital image;

controls the display device and/or the at least one user input device so as to provide for independent enabling or disabling for display of at least some display layers of the plurality of display layers; and

controls the display device so as to display only enabled display layers of the plurality of display layers.

8. The apparatus of claim 7, wherein the processing unit categorizes the at least one input image as a reference layer;

and categorizes the first representation of at least a portion of the operation as a symbols layer.

9. The apparatus of claim 7, wherein the processing unit further controls the display device and/or the at least one user input device to provide for alternate enabling and disabling for display of at least one display layer of the at least some display layers so as to facilitate a comparative viewing of the at least some display layers.

10. The apparatus of claim 7, wherein the processing unit further:

controls the display device so as to display a layer directory or layer legend pane respectively indicating all of the plurality of display layers; and

controls the display device and/or the at least one user input device to allowing for selection of at least one display layer of the plurality of display layers indicated in the layer directory or layer legend pane so as to enable or disable for display the selected at least one display layer.

11. The apparatus of claim 7, wherein:

at least one display layer of the plurality of display layers includes a plurality of sub-layers;

the processing unit categorizes at least some of the at least one input image, and/or at least some of the representation of at least a portion of the operation, into the plurality of sub-layers;

the processing unit controls the display device and/or the at least one user input device so as to provide for independent enabling or disabling for display of each sub-layer of the plurality of sub-layers of the at least one display layer; and

the processing unit controls the display device so as to display only enabled sub-layers of the plurality of sub-layers.

12. The apparatus of claim 6, further comprising a user input device, wherein the processing unit acquires user input from the user input device to add to the marked-up digital image a second representation of at least a portion of the operation.

13. The apparatus of claim 1, wherein the processing unit:

selects a vehicle symbol corresponding to the first vehicle from a plurality of vehicle symbols in a symbol library; and

wherein the first representation comprises the selected vehicle symbol.

14. The apparatus of claim 13, wherein the processing unit:

selects the vehicle symbol based on a vehicle identification number of the first vehicle.

15. The apparatus of claim 1, wherein the processing unit:

generates a series of images, including the marked-up digital image, wherein the series of images comprises representations of the operation at different sequential times.

16. The apparatus of claim 1, wherein the vehicle-based information relates to an environmental condition in an area proximate to the first vehicle at a time during or proximate the operation.

17. The apparatus of claim 16, wherein the environmental condition comprises at least one of:

a temperature in an area of the first vehicle;

a humidity in an area of the first vehicle; and

a level of light in an area of the first vehicle.

18. The apparatus of claim 1, wherein the vehicle-based information comprises at least one of:

at least one position of the first vehicle during or proximate the operation;

at least one timestamp indicating at least one time during or proximate the operation;

an inclination of the first vehicle;

a direction of the first vehicle;

a speed of the first vehicle;

an acceleration of the first vehicle;

an airbag deployment status;

a throttle position or degree;

a brake position or degree.

19. An method for documenting operation of a first vehicle in a geographic area, the method comprising:

A) electronically receiving source data representing at least one input image of the geographic area in which at least a portion of the operation of the first vehicle occurs;

B) acquiring vehicle-based information relating to the first vehicle at a time during or proximate the operation of the first vehicle in the geographic area;

C) electronically rendering, based at least in part on the vehicle-based information, a marked-up image including a first representation of at least the portion of the operation overlaid on the at least one input image; and

D) electronically transmitting and/or electronically storing information relating to the marked-up digital image so as to document the operation of the first vehicle with respect to the geographic area.

20. An apparatus for documenting operation of a first vehicle in a first geographic area, the apparatus comprising:

a communication interface;

a memory to store processor-executable instructions; and

a processing unit communicatively coupled to the communication interface and the memory, wherein upon execution of the processor-executable instructions by the processing unit, the processing unit;

controls the communication interface to electronically receive source data representing at least two input images of the first geographic area;

acquires vehicle-based information relating to the first vehicle at a time during or proximate the operation of the first vehicle in the first geographic area;

renders, based at least in part on the vehicle-based information, a slideshow or a movie presentation, wherein the slideshow or movie presentation comprises at least two marked-up digital images, comprising;

(i) a first marked-up digital image comprising a first representation of at least a first portion of the operation of the first vehicle overlaid on at least one of the at least two input images; and

(ii) a second marked-up digital image comprising a second representation of at least a second portion of the operation of the first vehicle that is different from the first portion of the operation and is overlaid on another of the at least two input images; and

further controls the communication interface and/or the memory to electronically transmit and/or electronically store the slideshow or movie presentation so as to document the operation of the first vehicle with respect to the first geographic area.