DRIVING SUPPORT DEVICE, DRIVING SUPPORT METHOD, AND DRIVING SUPPORT PROGRAM

• US 20100245575A1
• Filed: 02/05/2010
• Published: 09/30/2010
• Est. Priority Date: 03/27/2009
• Status: Active Grant

• Current Assignee: Aisin AW Company Limited (Aisin Corp.)
• Original Assignee: Aisin AW Company Limited (Aisin Corp.)
• Inventors: MORI, Toshihiro, Ooshita, Yuuichi
• Granted Patent: US 8,675,070 B2
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: B60R 2300/60 characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective
• CPC Class Codes: G06T 2207/20092 Interactive image processing based on input by user
• CPC Class Codes: G06T 7/80 Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road

Abstract

In a driving support device and method, images of a vicinity of a vehicle are captured and recorded. Movement information relating to movement of the vehicle is acquired and a movement status of the vehicle based on the acquired movement information is determined. Based on (i) the determined movement status and (ii) a parameter associated with the determined movement status, the recorded image data is composited to create a composite image of an area including a position of the vehicle. The composite image is displayed on a display unit. The parameter is calibrated based on (a) a position of a reference marker included in the composite image created according to the movement status and (b) a predicted position of the reference marker superimposed and displayed on the composite image according to the movement status.

Claims

1. A driving support device, comprising:

an imaging unit for capturing images of a vicinity of a vehicle;

a recording unit for recording image data of the images captured by the imaging unit;

a movement status determining unit for acquiring movement information relating to movement of the vehicle and determining a movement status of the vehicle based on the acquired movement information;

a composite image creating unit for, based on (i) the movement status determined by the movement status determining unit and (ii) a parameter associated with the movement status, compositing the image data recorded in the recording unit and creating a composite image of an area including a position of the vehicle;

a displaying unit for displaying the composite image created by the composite image creating unit; and

a calibrating unit for calibrating the parameter based on (a) a position of a reference marker included in the composite image that the composite image creating unit created according to the movement status and (b) a predicted position of the reference marker superimposed and displayed on the composite image according to the movement status.

2. The driving support device according to claim 1, wherein the movement status includes a turn made by the vehicle;

the parameter associated with the movement status includes a turn parameter being used by the composite image creating unit for creating the composite image; and

the calibrating unit is configured for calibrating the turn parameter based on (a) the position of the reference marker included in the composite image that the composite image creating unit created according to the turn and (b) the predicted position of the reference marker superimposed and displayed on the composite image according to the turn.

3. The driving support device according to claim 2, wherein

the movement status includes a straight movement made by the vehicle;

and

the parameter associated with the movement status includes a distance parameter being used by the composite image creating unit for creating the composite image; and

the calibrating unit is configured for calibrating the distance parameter based on (a) the position of the reference marker included in the composite image that the composite image creating unit created according to the straight movement and (b) the predicted position of the reference marker superimposed and displayed on the composite image according to the straight movement.

4. The driving support device according to claim 1, wherein the movement status includes a straight movement made by the vehicle;

and

the parameter associated with the movement status includes a distance parameter being used by the composite image creating unit for creating the composite image; and

the calibrating unit is configured for calibrating the distance parameter based on (a) the position of the reference marker included in the composite image that the composite image creating unit created according to the straight movement and (b) the predicted position of the reference marker superimposed and displayed on the composite image according to the straight movement.

5. The driving support device according to claim 1, further comprising an overhead image creating unit for, using an overhead parameter, performing an overhead conversion on the image data of the vicinity of the vehicle captured by the imaging unit to create an overhead image of the area including the position of the vehicle, wherein

the calibrating unit is configured for calibrating the overhead parameter based on (a) the position of the reference marker included in the overhead image that the overhead image creating unit created and (b) the predicted position of the reference marker superimposed and displayed on the overhead image according to the overhead conversion.

6. The driving support device according to claim 3, further comprising an overhead image creating unit for, using an overhead parameter, performing an overhead conversion on the image data of the vicinity of the vehicle captured by the imaging unit to create an overhead image of the area including the position of the vehicle, wherein

the calibrating unit is configured for calibrating the overhead parameter based on (a) the position of the reference marker included in the overhead image that the overhead image creating unit created and (b) the predicted position of the reference marker superimposed and displayed on the overhead image according to the overhead conversion.

7. The driving support device according to claim 6, wherein

the calibrating unit is configured for calibrating the distance parameter after the overhead parameter.

8. The driving support device according to claim 7, wherein

the calibrating unit is configured for calibrating the turn parameter after the distance parameter.

9. The driving support device according to claim 3, wherein

the calibrating unit is configured for calibrating the turn parameter after the distance parameter.

10. A driving support method, comprising the steps of:

capturing, by an imaging unit, images of a vicinity of a vehicle;

recording, in a recording unit, image data of the captured images;

acquiring movement information relating to movement of the vehicle and determining a movement status of the vehicle based on the acquired movement information;

based on (i) the determined movement status and (ii) a parameter associated with the determined movement status, compositing the image data recorded in the recording unit and creating a composite image of an area including a position of the vehicle;

displaying, on a display unit, the composite image; and

calibrating the parameter based on (a) a position of a reference marker included in the composite image created according to the movement status and (b) a predicted position of the reference marker superimposed and displayed on the composite image according to the movement status.

11. The driving support method according to claim 10, wherein

the movement status includes a turn made by the vehicle;

the parameter associated with the movement status includes a turn parameter being used for creating the composite image; and

the calibrating step comprises calibrating the turn parameter based on (a) the position of the reference marker included in the composite image created according to the turn and (b) the predicted position of the reference marker superimposed and displayed on the composite image according to the turn.

12. The driving support method according to claim 11, wherein

the movement status includes a straight movement made by the vehicle;

and

the parameter associated with the movement status includes a distance parameter being used for creating the composite image; and

the calibrating step comprises calibrating the distance parameter based on (a) the position of the reference marker included in the composite image created according to the straight movement and (b) the predicted position of the reference marker superimposed and displayed on the composite image according to the straight movement.

13. The driving support method according to claim 12, further comprising the step of

using an overhead parameter, performing an overhead conversion on the image data of the vicinity of the vehicle captured by the imaging unit to create an overhead image of the area including the position of the vehicle,

wherein

the calibrating step comprises calibrating the overhead parameter is calibrated based on (a) the position of the reference marker included in the overhead image and (ii) the predicted position of the reference marker superimposed and displayed on the overhead image according to an overhead conversion.

14. The driving support method according to claim 13, wherein after the overhead parameter was calibrated, the distance parameter is calibrated.

15. The driving support method according to claim 14, wherein

after the distance parameter was calibrated, the turn parameter is calibrated.

16. A computer-readable medium containing thereon a driving support program that, when executed by a processor, causes the processor to perform the driving support method according to claim 10.

17. A computer-readable medium containing thereon a driving support program that, when executed by a processor, causes the processor to perform the driving support method according to claim 11.

18. A computer-readable medium containing thereon a driving support program that, when executed by a processor, causes the processor to perform the driving support method according to claim 12.

19. A computer-readable medium containing thereon a driving support program that, when executed by a processor, causes the processor to perform the driving support method according to claim 13.

20. A computer^-readable medium containing thereon a driving support program that, when executed by a processor, causes the processor to perform the driving support method according to claim 15.