Driving-operation assist and recording medium

• US 8,077,202 B2
• Filed: 08/28/2007
• Issued: 12/13/2011
• Est. Priority Date: 10/08/1998
• Status: Expired due to Fees

• Current Assignee: Panasonic Intellectual Property Corporation of America (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Inventors: Okamoto, Shusaku, Ishii, Hirofumi, Nakagawa, Masamichi, Nobori, Kunio, Morimura, Atsushi
• Primary Examiner(s): VO, TUNG T
• Application Number:
  US11/846,048
• Publication Number:
  US 20070299572A1
• Time in Patent Office: 1,568 Days
• Field of Search: 348118-148, 348150-179, 382104-243, 701/41, 701/301, 340/461, 340/901, 340/937, 359/896
• US Class Current: 348/148
• CPC Class Codes: B60R 1/28 with an adjustable field of view
• CPC Class Codes: B60R 2300/102 using 360 degree surveillance camera system
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/302 combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/305 merging camera image with lines or icons
• CPC Class Codes: B60R 2300/307 virtually distinguishing relevant parts of a scene from the background of the scene
• CPC Class Codes: B60R 2300/607 from a bird's eye viewpoint
• CPC Class Codes: B60R 2300/806 for aiding parking
• CPC Class Codes: B60R 2300/8086 for vehicle path indication
• CPC Class Codes: B62D 15/02 Steering position indicators ; Steering position determination; Steering aids
• CPC Class Codes: B62D 15/027 Parking aids, e.g. instruction means
• CPC Class Codes: B62D 15/028 Guided parking by providing commands to the driver, e.g. acoustically or optically
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A vehicle-operation assist includes a circumferential-state imager for imaging a circumferential state of a vehicle with a camera and generating a circumferential-state image; a synthetic-image generator for generating a synthetic image by superimposing on the circumferential-state image, an assumed-movement pattern of the vehicle performing a predetermined series of driving operations; and a display for displaying the synthetic image. The circumferential-state imager has at least one camera and a camera parameter table for storing characteristics of the camera and generating the circumferential-state image on the basis of the camera characteristics.

Claims

1. A vehicle-operation assist for a vehicle mounted with a camera, comprising:

an operation-start detecting unit operable to detect that an actual driving operation corresponding to a predetermined driving operation is started automatically or through an input from a driver;

a circumferential-state imaging unit operable to generate a circumferential-state image using an output image from the camera;

a synthetic-image generating unit operable to generate a synthetic image by using the circumferential-state image, said synthetic image including an assumed-movement pattern showing movement of the vehicle in case of performing the predetermined driving operation, said assumed-movement pattern including (i) a trace between a start position of the vehicle and an end position of the vehicle, and (ii) a synthetic image of the vehicle at the end position in case of performing the predetermined driving operation; and

a display unit operable to display the synthetic image,

wherein the synthetic-image generating unit generates a synthetic image of which a positional relationship between the assumed-movement pattern and the circumferential-state image is fixed while an actual driving operation corresponding to the predetermined driving operation is performed by following said trace between said start position and said end position.

2. The vehicle-operation assist according to claim 1, further comprising

a positional-information sorting unit which stores positional information of a whole or a part of the assumed-movement pattern with regard to the basis of a whole or a part of the circumferential-state image on the synthetic image when the actual driving operation is started,

wherein the synthetic-image generating unit fixes the positional relation in accordance with the positional information.

3. The vehicle-operation assist according to claim 1, further comprising

a movement-position computing unit operable to compute movement positions of the vehicle since the actual driving operation was started, in accordance with signals relating to the actual driving operation, and

wherein the synthetic-image generating unit fixes the positional relation in accordance with the movement positions.

4. The vehicle-operation assist according to claim 1, further comprising

a driving control unit operable to control the vehicle automatically in accordance with an assumed-movement data when the actual driving operation corresponding to the predetermined driving operation is started,

wherein said assumed-movement data includes time-series data showing a relation between a movement distance and a steering angle of the steering wheel of the vehicle, and the assumed-movement pattern included in the synthetic image.

5. A vehicle-operation assist for a vehicle mounted with a camera, comprising:

an operation-start detecting unit operable to detect that an actual driving operation corresponding to a predetermined driving operation is started, automatically or through an input from a driver;

a circumferential-state imaging unit operable to generate a circumferential-state image using an output image from the camera, wherein the circumferential-state imaging unit changes a way of generating the circumferential-state image when the actual driving operation is started;

a synthetic-image generating unit operable to generate a synthetic image by using the circumferential-state image, said synthetic image including an assumed-movement pattern showing movement of the vehicle in case of performing the predetermined driving operation, said assumed-movement pattern including (i) a trace between a start position of the vehicle and an end position of the vehicle, and (ii) a synthetic image of the vehicle at the end position in case of performing the predetermined driving operation; and

a display unit operable to display the synthetic image,

wherein the synthetic-image generating unit generates a synthetic image of which a positional relationship between the assumed-movement pattern and the circumferential-state image is fixed while an actual driving operation corresponding to the predetermined driving operation is performed by following said trace between said start position and said end position.

6. The vehicle-operation assist according to claim 5, wherein

the circumferential-state imaging unit generates a virtual viewpoint image in which the vehicle and its surroundings are viewed from a virtual viewpoint, fixes a predetermined viewpoint to the vehicle before the actual driving operation corresponding to the predetermined driving operation is started, and changes the predetermined viewpoint to a point fixed to three-dimensional space after the actual driving operation corresponding to the predetermined driving operation is started.

7. The vehicle-operation assist according to claim 6, wherein

the point fixed to the three-dimensional space is a point just above the end position of the predetermined driving operation when the actual driving operation is started.