Parking assist method and parking assist apparatus

• US 20070057816A1
• Filed: 09/06/2006
• Published: 03/15/2007
• Est. Priority Date: 09/12/2005
• Status: Abandoned Application

• Current Assignee: Aisin AW Company Limited (Aisin Corp.)
• Original Assignee: Aisin AW Company Limited (Aisin Corp.)
• Inventors: Sugiura, Hiroaki, Kubota, Tomoki, Mori, Toshihiro, Sakakibara, Seiji
• Application Number:
  US11/515,733
• Publication Number:
  US 20070057816A1
• Time in Patent Office: Days
• US Class Current: 340/932.200
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 30/06 Automatic manoeuvring for parking
• CPC Class Codes: B60W 50/14 Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: B62D 15/027 Parking aids, e.g. instruction means
• CPC Class Codes: B62D 15/0275 by overlaying a vehicle path based on present steering angle over an image without processing that image

Abstract

A navigation apparatus includes a controller, an image data input unit adapted to acquire image data from a camera installed in a vehicle, and an image memory for storing the image data. The navigation apparatus also includes an image processing unit converting data extracted from the acquired image data to data simulating a virtual viewpoint. The image processing unit stores the converted data in the image memory in associated with position data indicating the position at which the image was taken by the camera. Using a plurality of sets of converted data, the image processing unit generates bird'"'"'s eye view data representing a bird'"'"'s-eye image of an area nearby the current vehicle position. When the controller determines that parking operation is stopped, the image processing unit displays the bird'"'"'s eye view image together with a mark indicating the current vehicle position.

Claims

1. A method of assisting a vehicle parking operation, comprising:

acquiring image data from a camera unit installed in the vehicle;

storing the acquired image data in image storage means;

generating bird'"'"'s eye view data representing an image of a nearby area around a current vehicle position in the form of a bird'"'"'s-eye view based on the image data stored in the image data storage means when the vehicle parking operation is stopped; and

displaying the bird'"'"'s eye view with a vehicle mark indicating the current vehicle position superimposed on the bird'"'"'s eye view, on the display screen.

2. A parking assist apparatus for installation in a vehicle, comprising:

vehicle status determination means for determining whether a vehicle parking operation is stopped, based on vehicle information input to the vehicle status determination means;

image data acquisition means for acquiring image data from a camera unit installed in the vehicle;

first image processing means for generating converted data by image processing of the acquired image data;

image data storage means for storing the converted data;

second image processing means for generating bird'"'"'s eye view data representing an image of a nearby area around a current vehicle position in the form of a bird'"'"'s-eye view, based on the converted data stored in the image data storage means; and

image output means for, when the determination made by the vehicle status determination means is that the vehicle parking operation is stopped, displaying the bird'"'"'s eye view, with a vehicle mark indicating the current vehicle position superimposed on the bird'"'"'s eye view, on a display screen.

5. The parking assist apparatus according to claim 2, wherein the image output means outputs the bird'"'"'s eye view data such that an area on a front side thereof, as viewed forward in the direction of vehicle movement, is displayed in an area at the top of the display screen.

6. The parking assist apparatus according to claim 2, wherein the vehicle status determination means determines, when the direction in which the vehicle is moving is changed from a direction toward a target parking space, that the vehicle parking operation is stopped.

8. The parking assist apparatus according to claim 2, wherein the vehicle status determination means determines, when the vehicle has not moved for a time longer than a predetermined period, that the vehicle parking operation is stopped.

10. The parking assist apparatus according to claim 2, wherein the second image processing means combines sets converted data, the sets derived from respective images taken by the camera unit, such that the converted data sets are arranged in a side-by-side series extending across the display screen in a direction corresponding to the direction of movement of the vehicle.

12. The parking assist apparatus according to claim 2, wherein the second image processing means generates bird'"'"'s eye view data representing an image of an area completely surrounding the vehicle, using a plurality of sets of converted data derived from respective images taken by the camera unit.

14. The parking assist apparatus according to claim 2, wherein the first image processing means extracts a predetermined area from the acquired image data and converts the extracted data so as to represent an image of a road surface area corresponding to the extracted area, as viewed from a virtual viewpoint set as a point vertically above the road surface area.

16. The parking assist apparatus according to claim 2, wherein the second image processing means generates the bird'"'"'s eye view data using (1) current-position image data acquired at the current vehicle position and (2) the stored converted data.

18. The parking assist apparatus according to claim 2, wherein:

the image data storage means attaches, to the converted data or the acquired image data, direction data or rudder angle data indicating the direction or the rudder angle as of the time of generating the converted data or acquiring the image data; and

the image processing means rotates the converted data or the acquired image data in accordance with the attached direction data or rudder angle data and the direction or the rudder angle of the vehicle as of when the parking operation is stopped.

20. The parking assist apparatus according to claim 2, wherein the first image processing means extracts a middle area, as viewed in the direction of movement of the vehicle, from the acquired image data.

22. The parking assist apparatus according to claim 2, wherein the image data acquisition means acquires the image data from the camera unit and stores the acquired image data in the image data storage means each time the vehicle reaches one of plural positions predetermined for capture of image data.

3. A parking assist apparatus for installation in a vehicle, comprising:

vehicle status determination means for determining whether a vehicle parking operation is stopped, based on vehicle information input to the vehicle status determination means;

image data acquisition means for acquiring image data from a camera unit installed in the vehicle;

image data storage means for storing the acquired image data;

first image processing means for generating converted data by image processing of the acquired image data;

second image processing means for generating bird'"'"'s eye view data representing an image of a nearby area around a current vehicle position in the form of a bird'"'"'s-eye view, based on the converted data; and

image output means for, when the determination made by the vehicle status determination means is that the vehicle parking operation is stopped, displaying the bird'"'"'s eye view, with a vehicle mark indicating the current vehicle position superimposed on the bird'"'"'s eye view, on a display screen.

4. The parking assist apparatus according to claim 3, wherein the image output means outputs the bird'"'"'s eye view data such that an area on a front side thereof, as viewed forward in the direction of vehicle movement, is displayed in an area at the top of the display screen.

7. The parking assist apparatus according to claim 3, wherein the vehicle status determination means determines, when the direction in which the vehicle is moving is changed from a direction toward a target parking space, that the vehicle parking operation is stopped.

9. The parking assist apparatus according to claim 3, wherein the vehicle status determination means determines, when the vehicle has not moved for a time longer than a predetermined period, that the vehicle parking operation is stopped.

11. The parking assist apparatus according to claim 3, wherein the second image processing means combines sets converted data, the sets derived from respective images taken by the camera unit, such that the converted data sets are arranged in a side-by-side series extending across the display screen in a direction corresponding to the direction of movement of the vehicle.

13. The parking assist apparatus according to claim 3, wherein the second image processing means generates bird'"'"'s eye view data representing an image of an area completely surrounding the vehicle, using a plurality of sets of converted data derived from respective images taken by the camera unit.

15. The parking assist apparatus according to claim 3, wherein the first image processing means extracts a predetermined area from the acquired image data and converts the extracted data so as to represent an image of a road surface area corresponding to the extracted area, as viewed from a virtual viewpoint set as a point vertically above the road surface area.

17. The parking assist apparatus according to claim 3, wherein the second image processing means generates the bird'"'"'s eye view data using (1) current-position image data acquired at the current vehicle position and (2) the stored converted data.

19. The parking assist apparatus according to claim 3, wherein

the image data storage means attaches, to the converted data or the acquired image data, direction data or rudder angle data indicating the direction or the rudder angle as of the time of generating the converted data or acquiring the image data;

and

the image processing means rotates the converted data or the acquired image data in accordance with the attached direction data or rudder angle data and the direction or the rudder angle of the vehicle as of when the parking operation is stopped.

21. The parking assist apparatus according to claim 3, wherein the first image processing means extracts a middle area, as viewed in the direction of movement of the vehicle, from the acquired image data.

23. The parking assist apparatus according to claim 3, wherein the image data acquisition means acquires the image data from the camera unit and stores the acquired image data in the image data storage means each time the vehicle reaches one of plural positions predetermined for capture of image data.

24. A parking assist apparatus installed in a vehicle, comprising:

vehicle status determination means for determining whether a vehicle parking operation is stopped, based on vehicle information input to the vehicle status determination means;

image data acquisition means for acquiring image data from a camera unit installed in the vehicle;

first image processing means for generating converted data by image processing of the acquired image data;

image data storage means for storing the converted data;

composite data generation means for generating composite data including data representing an image of a rear end portion of the vehicle and an image of a nearby area behind the vehicle, based on current-position image data acquired at the current vehicle position and the converted data which is stored in the image data storage means and which represents an image of an area in a current blind spot of the camera unit;

second image processing means for generating, using the converted data stored in the image data storage means, bird'"'"'s eye view data which represents a bird'"'"'s-eye view image of an area completely surrounding the vehicle at the present position and which includes a smaller percentage of the current-position image data than is included in the composite data; and

moving body detection means for detecting a moving body in an area nearby the current vehicle position;

image output means for outputting, responsive to a determination that the vehicle parking operation is stopped, a bird'"'"'s eye view image including an image of the whole vehicle based on the bird'"'"'s eye view data and a vehicle mark indicating the current vehicle position superimposed on the bird'"'"'s eye view image, for display on a display screen; and

image switching means for switching image data, when the image based on the bird'"'"'s eye view data and the vehicle mark are displayed on the display screen, responsive to detection of a moving body, to output the composite data to the display screen.