Data processing apparatus

• US 10,399,438 B2
• Filed: 10/19/2015
• Issued: 09/03/2019
• Est. Priority Date: 11/28/2014
• Status: Active Grant

• Current Assignee: Fujitsu Ten Limited (DENSO Corporation)
• Original Assignee: Fujitsu Ten Limited (DENSO Corporation)
• Inventors: Shiraishi, Haruki, Maeda, Munenori, Ono, Kohei, Tanabe, Toshio, Li, Lin
• Primary Examiner(s): Holder, Anner N
• Application Number:
  US14/886,950
• Publication Number:
  US 20160155004A1
• Time in Patent Office: 1,415 Days
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G07C 5/008 communicating information to a remotely located station transmission systems for measured values G08C
• CPC Class Codes: G07C 5/0866 the electronic data carrier being a digital video recorder in combination with video camera
• CPC Class Codes: G08G 1/0112 from the vehicle, e.g. floating car data [FCD]
• CPC Class Codes: G08G 1/0133 for classifying traffic situation
• CPC Class Codes: G08G 1/20 Monitoring the location of vehicles belonging to a group, e.g. fleet of vehicles, countable or determined number of vehicles
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera

Abstract

A data processing apparatus processes moving image data that shows a vicinity of a vehicle and that is recorded while the vehicle is running. The data processing apparatus includes a controller configured to: acquire behavioral information on a specific behavior of the vehicle during an image capturing period of the moving image data; acquire object information on an object in the vicinity of the vehicle during the image capturing period of the moving image data; and determine a cause of the specific behavior of the vehicle based on the behavioral information and the object information.

Claims

1. A data processing apparatus for processing moving image data previously captured by a drive recorder of a vehicle and that shows a vicinity of the vehicle and that was recorded while the vehicle was running, the data processing apparatus comprising:

a controller configured to;

acquire behavioral information of the vehicle that occurred while the vehicle was running during an image capturing period of the moving image data by the drive recorder;

determine whether the acquired behavioral information indicates that a specific behavior of the vehicle occurred while the vehicle was running and, when the specific behavior is determined to have occurred, record the acquired behavioral information and the moving image data acquired during the image capturing period in which the specific behavior occurred;

acquire object information on an object in the vicinity of the vehicle during the image capturing period of the moving image data, the object information including a vehicle relative state of each of one or more recognized objects, the vehicle relative state being a position of the recognized object relative to the vehicle;

determine (1) a cause of the specific behavior of the vehicle that occurred while the vehicle was running while the drive recorder was capturing the moving image data based on the behavioral information and the object information relating to the moving image data, and (2) a cause object in the vicinity of the vehicle, the cause object having been determined to be the cause of the specific behavior of the vehicle; and

reproduce the moving image data, while highlighting the cause object in a reproduced image, wherein

the controller determines the cause of the specific behavior of the vehicle, based on a position of the object in the vicinity of the vehicle at a time at which the specific behavior of the vehicle occurred.

2. The data processing apparatus according to claim 1, wherein

the controller determines, as the cause object, an object located ahead of the vehicle in a travelling direction of the vehicle at the time at which the specific behavior of the vehicle occurred.

3. The data processing apparatus according to claim 1, wherein

the controller highlights the cause object in the reproduced image at the time at which the specific behavior of the vehicle occurred during reproduction of the moving image data.

4. The data processing apparatus according to claim 1, wherein

the controller highlights the cause object in the reproduced image starting at a time that is prior to the time at which the specific behavior of the vehicle occurred during the reproduction of the moving image data.

5. The data processing apparatus according to claim 1, wherein:

the controller derives a degree of risk related to the cause object, and

the controller uses a mode of highlighting that varies depending on the degree of risk.

6. The data processing apparatus according to claim 1, wherein

the controller determines a state of a driver of the vehicle, the state of the driver having been determined to be the cause of the specific behavior of the vehicle.

7. The data processing apparatus according to claim 6, wherein

the controller determines, based on the position of the object in the vicinity of the vehicle at the time at which the specific behavior of the vehicle occurred, that the cause of the specific behavior of the vehicle is distraction of the driver.

8. The data processing apparatus according to claim 7, further comprising:

a display that displays in a list the moving image data relating to the specific behavior of which the cause has been determined to be the distraction of the driver.

9. The data processing apparatus according to claim 7, wherein

the moving image data is associated with the driver of the vehicle for which the moving image data has been recorded, and

the controller counts, for each different driver of the vehicle, a number of the moving image data relating to the specific behavior of which the cause has been determined to be the distraction of the driver.

10. The data processing apparatus according to claim 1, wherein

the specific behavior is sudden braking of the vehicle.

11. A data processing method for processing moving image data previously captured by a drive recorder of a vehicle and that shows a vicinity of the vehicle and that was recorded while the vehicle was running, the data processing method comprising the steps of:

(a) acquiring, with a controller, behavioral information of the vehicle that occurred while the vehicle was running during an image capturing period of the moving image data by the drive recorder;

(b) determining, with the controller, whether the acquired behavioral information indicates that a specific behavior of the vehicle occurred while the vehicle was running and, when the specific behavior is determined to have occurred, recording the acquired behavioral information and the moving image data acquired during the image capturing period in which the specific behavior occurred;

(c) acquiring, with the controller, object information on an object in the vicinity of the vehicle during the image capturing period of the moving image data, the object information including a vehicle relative state of each of one or more recognized objects, the vehicle relative state being a position of the recognized object relative to the vehicle;

(d) determining, with the controller, (1) a cause of the specific behavior of the vehicle that occurred while the vehicle was running while the drive recorder was capturing the moving image data based on the behavioral information and the object information relating to the moving image data, and (2) a cause object in the vicinity of the vehicle, the cause object having been determined to be the cause of the specific behavior of the vehicle; and

(e) reproducing, with the controller, the moving image data, while highlighting the cause object in a reproduced image, wherein

the cause of the specific behavior of the vehicle is determined based on a position of the object in the vicinity of the vehicle at a time at which the specific behavior of the vehicle occurred.

12. The data processing method according to claim 11, wherein

the step (d) determines a state of a driver of the vehicle, the state of the driver having been determined to be the cause of the specific behavior of the vehicle.

13. A non-transitory computer-readable recording medium that stores a program to be executed by a computer included in a data processing apparatus configured to process moving image data previously captured by a drive recorder of a vehicle and that shows a vicinity of the vehicle and that was recorded while the vehicle was running, the program causing the computer to execute the steps of:

(a) acquiring behavioral information of the vehicle that occurred while the vehicle was running during an image capturing period of the moving image data by the drive recorder;

(b) determining whether the acquired behavioral information indicates that a specific behavior of the vehicle occurred while the vehicle was running and, when the specific behavior is determined to have occurred, recording the acquired behavioral information and the moving image data acquired during the image capturing period in which the specific behavior occurred;

(c) acquiring object information on an object in the vicinity of the vehicle during the image capturing period of the moving image data, the object information including a vehicle relative state of each of one or more recognized objects, the vehicle relative state being a position of the recognized object relative to the vehicle;

(d) determining (1) a cause of the specific behavior of the vehicle that occurred while the vehicle was running while the drive recorder was capturing the moving image data based on the behavioral information and the object information relating to the moving image data, and (2) a cause object in the vicinity of the vehicle, the cause object having been determined to be the cause of the specific behavior of the vehicle; and

(e) reproducing the moving image data, while highlighting the cause object in a reproduced image, wherein

the cause of the specific behavior of the vehicle is determined based on a position of the object in the vicinity of the vehicle at a time at which the specific behavior of the vehicle occurred.

14. The recording medium according to claim 13, wherein

the step (d) determines a state of a driver of the vehicle, the state of the driver having been determined to be the cause of the specific behavior of the vehicle.