Rendering device

• US 20020002427A1
• Filed: 05/23/2001
• Published: 01/03/2002
• Est. Priority Date: 05/24/2000
• Status: Active Grant

• Current Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Original Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Inventors: Yoshida, Takashi, Iisaka, Atsushi, Ishida, Akira
• Granted Patent: US 6,539,288 B2
• Time in Patent Office: Days
• US Class Current: 701/1
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/30 characterised by the type of image processing
• CPC Class Codes: B60R 2300/302 combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
• CPC Class Codes: B60R 2300/304 using merged images, e.g. merging camera image with stored images
• CPC Class Codes: B60R 2300/404 triggering from stand-by mode to operation mode
• CPC Class Codes: B60R 2300/70 characterised by an event-triggered choice to display a specific image among a selection of captured images
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

In a rendering device Urnd1, a processor 1 receives surrounding images S1 to S8 from image capture devices 5 to 12 placed in a vehicle, and based thereon, generates a vehicle overlaid image. The processor 1 also receives a rudder angle θ from a rudder angle sensor 13 placed in the vehicle. Then, based on the received rudder angle θ, the processor 1 calculates a 3D predictive trajectory of the vehicle, and on the vehicle overlaid image, renders thus calculated 3D predictive trajectories that a display image is generated. Therefore, the display image generated by the rendering device Urnd1 is driver-friendly.

Claims

1. A rendering device for generating a display image for drive assistance, said device comprising:

a first generation part for generating a surrounding image corresponding to an area surrounding the vehicle; and

a reception part for receiving a current rudder angle from a rudder angle sensor placed in said vehicle;

a calculation part for calculating, based on the rudder angle received by said reception part, a three-dimensional predictive trajectory of said vehicle; and

a second generation part for generating the display image showing the three-dimensional predictive trajectory calculated in said calculation part rendered on the surrounding image generated by said first generation part.

2. The rendering device according to claim 1, wherein said calculation part calculates said three-dimensional predictive trajectory with reference to a wheel position of said vehicle.

3. The rendering device according to claim 1, wherein said calculation part calculates said three-dimensional predictive trajectory with reference to a point on a surface of said vehicle farthest from a longitudinal median plane of the vehicle.

4. The rendering device according to claim 1, wherein when said vehicle is moving backward, said calculation part calculates the three-dimensional predictive trajectory extending toward the back of the vehicle.

5. The rendering device according to claim 1, wherein when said vehicle is moving forward, said calculation part calculates the three-dimensional predictive trajectory extending toward the front of the vehicle.

6. The rendering device according to claim 1, wherein said calculation part calculates, by referring to the rudder angle received from said rudder angle sensor, the three-dimensional predictive trajectory with reference to a corner on the opposite side to the rudder angle and on the rear side of the vehicle with respect to a heading direction.

7. The rendering device according to claim 1, wherein

a gear sensor is provided in said vehicle for detecting a current gear thereof, and

said device further includes a determination part for determining whether said vehicle is moving forward or backward based on the gear provided by said gear sensor, and

said calculation part

calculates, when said determination part determines that said vehicle is moving forward, the three-dimensional predictive trajectory extending in a forward direction, and

calculates, when said determination part determines that said vehicle is moving backward, the three-dimensional predictive trajectory extending in a backward direction.

8. A rendering device for generating a display image for drive assistance, said device comprising:

a first generation part for generating a surrounding image corresponding to an area surrounding the vehicle;

a calculation part for calculating a trail of said vehicle; and

a second generation part for generating the display image showing the trail calculated in said calculation part rendered on the surrounding image received by said first generation part.

9. The rendering device according to claim 8, further comprising:

a first reception part for receiving a current rudder angle of said vehicle from a rudder angle sensor placed in the vehicle; and

a second reception part for receiving a wheel speed of each wheel of said vehicle from a wheel speed sensor placed in the vehicle, and

said calculation part calculates the trail of said vehicle based on the rudder angle received by said first reception part and the wheel speeds received by said second reception part.

10. A rendering method for generating a display image for drive assistance, said method comprising:

a first generation step of generating a surrounding image corresponding to an area surrounding the vehicle; and

a reception step of receiving a current rudder angle from a rudder angle sensor placed in said vehicle;

a calculation step of calculating a three-dimensional predictive trajectory of said vehicle based on the rudder angle received in said reception step; and

a second generation step of generating the display image showing the three-dimensional predictive trajectory calculated in said calculation step rendered on the surrounding image received in said first generation step.

11. A rendering method for generating a display image for drive assistance, said method comprising:

a first generation step of receiving a surrounding image corresponding to an area surrounding the vehicle; and

a calculation step of calculating a trail of said vehicle; and

a second generation step of generating the display image showing the trail calculated in said calculation step rendered on the surrounding image received in said first reception step.

12. A recording medium on which a program for generating a display image for drive assistance is recorded, said program comprising:

a first generation step of generating a surrounding image corresponding to an area surrounding the vehicle; and

a reception step of receiving a current rudder angle from a rudder angle sensor placed in said vehicle;

a calculation step of calculating, based on the rudder angle received in said reception step, a three-dimensional predictive trajectory indicating of said vehicle; and

a second generation step of generating the display image showing the three-dimensional predictive trajectory calculated in said calculation step rendered on the surrounding image received in said first reception step.

13. A recording medium on which a program for generating a display image for drive assistance is recorded, said program comprising:

a first generation step of generating a surrounding image corresponding to an area surrounding the vehicle; and

a calculation step calculating a trail of said vehicle; and

a second generation step of generating the display image showing the trail calculated in said calculation step rendered on the surrounding image received in said first reception step.

14. A program for generating a display image for drive assistance is recorded, comprising:

a first generation step of generating a surrounding image corresponding to an area surrounding the vehicle; and

a reception step of receiving a current rudder angle from a rudder angle sensor placed in said vehicle;

a calculation step of calculating, based on the rudder angle received in said reception step, a three-dimensional predictive trajectory of said vehicle; and

a second generation step of generating the display image showing the three-dimensional predictive trajectory calculated in said calculation step rendered on the surrounding image received in said first reception step.

15. A program for generating a display image for drive assistance is recorded, comprising:

a first generation step of generating a surrounding image corresponding an area surrounding the vehicle; and

a calculation step of calculating a trail of said vehicle; and

a second generation step of generating the display image showing the trail calculated in said calculation step rendered on the surrounding image received in said first reception step.