Driving Assistance System And Connected Vehicles

• US 20100171828A1
• Filed: 08/19/2008
• Published: 07/08/2010
• Est. Priority Date: 09/03/2007
• Status: Abandoned Application

• Current Assignee: Sanyo Electric Company Limited (Panasonic Holdings Corporation)
• Original Assignee: Sanyo Electric Company Limited (Panasonic Holdings Corporation)
• Inventors: Ishii, Yoheii
• Application Number:
  US12/676,285
• Publication Number:
  US 20100171828A1
• Time in Patent Office: Days
• US Class Current: 348/135
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 2300/607 from a bird's eye viewpoint
• CPC Class Codes: B60R 2300/806 for aiding parking
• CPC Class Codes: B60R 2300/8086 for vehicle path indication
• CPC Class Codes: B62D 13/06 for backing a normally drawn trailer
• CPC Class Codes: B62D 15/0275 by overlaying a vehicle path based on present steering angle over an image without processing that image
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 2207/30264 Parking
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

A tractor and a trailer are connected together and a camera is installed on the trailer side of the connected vehicles. The camera captures images behind the trailer. A driving assistance system projects the captured images on bird'"'"'s-eye view coordinates parallel with a road surface to convert the images into bird'"'"'s-eye view images and obtains on the bird'"'"'s-eye view coordinates an optical flow of a moving image composed of the captured images. The connection angle between the tractor and the trailer is estimated based on the optical flow and on movement information on the tractor, and further, a predicted movement trajectory of the trailer is obtained from both the connection angle and the movement information on the tractor. The predicted movement trajectory is overlaid on the bird'"'"'s-eye view images and the resulting image is outputted to a display device.

Claims

1. A driving assistance system for an articulated vehicle including a first vehicle coupled to a second vehicle, the driving assistance system including a camera on the second vehicle to obtain images behind the second vehicle, the driving assistance system acquiring a plurality of chronologically ordered shot images from the camera and outputting a display image generated from the shot images to a display device, the driving assistance system comprising:

a motion detecting portion which derives an optical flow of a moving image formed by the plurality of shot images;

a coupling angle estimating portion which estimates a coupling angle of the first and second vehicles based on the optical flow and on movement information of the first vehicle fed to the coupling angle estimating portion; and

a movement course estimating portion which derives a predicted movement course of the second vehicle based on the coupling angle and on the movement information of the first vehicle, the display image being generated by superimposing a sign based on the predicted movement course on an image based on the shot images.

2. The driving assistance system according to claim 1, further comprising:

a coordinate transforming portion which transforms the plurality of shot images to a plurality of bird'"'"'s-eye view images by projecting the shot images onto a predetermined bird'"'"'s-eye view coordinate system,

the optical flow derived by the motion detecting portion being an optical flow on the bird'"'"'s-eye view coordinate system.

3. The driving assistance system according to claim 2, wherein the movement information of the first vehicle includes information representing a movement direction and a movement speed of the first vehicle, and

the coupling angle estimating portion derives a vector representing the movement direction and a movement amount of the first vehicle on the bird'"'"'s-eye view coordinate system based on the movement information of the first vehicle, and estimates the coupling angle based on the vector and on the optical flow.

4. The driving assistance system according to claim 1, further comprising:

an indicating portion which, provides an indication according to a result of comparison of the estimated coupling angle with a predetermined threshold angle.

10. An articulated vehicle comprising a first vehicle coupled to a second vehicle, the articulated vehicle comprising the driving assistance system of claim 1.

11. An articulated vehicle comprising a first vehicle coupled to a second vehicle, the articulated vehicle comprising the driving assistance system of claim 2.

12. An articulated vehicle comprising a first vehicle coupled to a second vehicle, the articulated vehicle comprising the driving assistance system of claim 3.

13. An articulated vehicle comprising a first vehicle coupled to a second vehicle, the articulated vehicle comprising the driving assistance system of claim 4.

5. A driving assistance system, for an articulated vehicle including a first vehicle coupled to a second vehicle, the driving assistance system including a camera on the second vehicle to obtain images behind the second vehicle, the driving assistance system acquiring a plurality of chronologically ordered shot images from the camera and outputting a display image generated from the shot images to a display device, the driving assistance system comprising:

a motion detecting portion which derives an optical flow of a moving image formed by the plurality of shot images; and

a movement direction estimating portion which estimates a movement direction of the second vehicle based on the optical flow, wherein

a result of estimation by the movement direction estimating portion being reflected in the display image.

6. The driving assistance system according to claim 5, further comprising:

a coordinate transforming portion transforming the plurality of shot images to a plurality of bird'"'"'s-eye view images by projecting the shot images onto a predetermined bird'"'"'s-eye view coordinate system,

the optical flow derived by the motion detecting portion being an optical flow on the bird'"'"'s-eye view coordinate system.

7. The driving assistance system according to claim 6, further comprising:

a coupling angle estimating portion estimating a coupling angle of the first and second vehicles based on the optical flow and on movement information of the first vehicle fed to the coupling angle estimating portion, a result of estimation of the coupling angle being reflected in the display image.

8. The driving assistance system according to claim 7, wherein the movement information of the first vehicle includes information representing a movement direction and a movement speed of the first vehicle, and

the coupling angle estimating portion derives a vector representing the movement direction and a movement amount of the first vehicle on the bird'"'"'s-eye view coordinate system based on the movement information of the first vehicle, and estimates the coupling angle based on the vector and on the optical flow.

9. The driving assistance system according to claim 7, further comprising:

an indicating portion which provides an indication according to a result of comparison of the estimated coupling angle with a predetermined threshold angle.

14. An articulated vehicle comprising a first vehicle coupled to a second vehicle, the articulated vehicle comprising the driving assistance system of claim 5.

15. An articulated vehicle comprising a first vehicle coupled to a second vehicle, the articulated vehicle comprising the driving assistance system of claim 6.

16. An articulated vehicle comprising a first vehicle coupled to a second vehicle, the articulated vehicle comprising the driving assistance system of claim 7.

17. An articulated vehicle comprising a first vehicle coupled to a second vehicle, the articulated vehicle comprising the driving assistance system of claim 8.

18. An articulated vehicle comprising a first vehicle coupled to a second vehicle, the articulated vehicle comprising the driving assistance system of claim 9.