Parking assistance system

• US 6,483,429 B1
• Filed: 10/20/2000
• Issued: 11/19/2002
• Est. Priority Date: 10/21/1999
• Status: Expired due to Term

• Current Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Original Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Inventors: Iisaka, Atsushi, Yasui, Nobuhiko
• Primary Examiner(s): SWARTHOUT, BRENT
• Application Number:
  US09/692,540
• Time in Patent Office: 760 Days
• Field of Search: 340/903, 340/435, 340/932.2, 340/937, 340/958, 340/436, 348/118, 348/148, 348/149, 382/106, 356/1
• US Class Current: 340/435
• CPC Class Codes: B60Q 9/005 using a video camera
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 2300/30 characterised by the type of image processing
• CPC Class Codes: B60R 2300/302 combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
• CPC Class Codes: B60R 2300/305 merging camera image with lines or icons
• CPC Class Codes: B60R 2300/307 virtually distinguishing relevant parts of a scene from the background of the scene
• CPC Class Codes: B60R 2300/404 triggering from stand-by mode to operation mode
• CPC Class Codes: B60R 2300/607 from a bird's eye viewpoint
• CPC Class Codes: B60R 2300/806 for aiding parking
• CPC Class Codes: B60R 2300/8093 for obstacle warning
• CPC Class Codes: B60T 2201/10 Automatic or semi-automatic parking aid systems
• CPC Class Codes: G01S 5/16 using electromagnetic waves other than radio waves
• CPC Class Codes: G06V 20/586 of parking space

Abstract

A parking assistance system is mounted in a vehicle, and has an image pick-up with a single camera, an image processing device, a display, a steering angle sensor, a wheel speed sensor, and a pulse counter. An A/D converter subjects two analog images picked up by the image pick-up at different locations to A/D conversion, and sends the results to frame memories. A CPU uses the digital image data and the transition data of the vehicle to calculate object data and a distance from the vehicle to the 3D object. An image thus obtained is then converted into a view from the above. The view from the above is stored in a frame memory, and outputted to the display under the control of a controller for display.

Claims

1. A parking assistance system for assisting a driver of a vehicle to park by picking up an image around the vehicle, and advising the driver of what 3D object is located therearound, said parking assistance system comprising:

an image pick-up having a single camera, said image pick-up being operable to pick up, during a transition of the vehicle, a first image and a second image around the vehicle at a first location and time and a second location and time, respectively;

an object specification part being operable to detect and specify the 3D object found in each of the first image and the second image;

a vehicle position calculation part being operable to calculate transition data of the vehicle from the first location to the second location;

an object distance calculation part being operable to calculate a distance from the vehicle to the 3D object by using a position of the 3D object in each of the first image and the second image, and the transition data of the vehicle; and

an image creation part being operable to create a third image for display to the driver based on the first image and the second image picked up by said image pick-up and data calculated by said object distance calculation part.

2. The parking assistance system according to claim 1, wherein said object distance calculation part

detects an edge of the 3D object from each of the first image and the second image; and

calculates the distance from the vehicle to the edge of the 3D object by using coordinate data of any edge identical in the first image and the second image and the transition data of the vehicle.

3. The parking assistance system according to claim 2, wherein said object distance calculation part further

estimates a position of the edge identical in the first image and the second image by using the transition data of the vehicle, and

detects the identical edge by positionally subjecting the estimated edge to image analysis.

4. The parking assistance system according to claim 1, wherein said image creation part

converts one of the first image and the second image picked up by said image pick-up into a view from above, and

creates the third image by adding the data calculated by said object distance calculation part onto the view from above.

5. The parking assistance system according to claim 4, wherein said image creation part perceivably emphasizes, out of the data calculated by said object distance calculation part, a part of the object in a vicinity of the vehicle.

6. The parking assistance system according to claim 4, wherein said image creation part generates the third image by converting the data calculated by said object distance calculation part into a 3D object model, and by adding the 3D object model onto the view from above.

7. The parking assistance system according to claim 4, wherein said image creating part additionally adds a model of the vehicle onto the third image.

8. The parking assistance system according to claim 1, wherein said object specification part further

creates a fourth image by projecting the first image onto the second location for transformation, and

detects and specifies the 3D object by taking a difference between the fourth image and the second image.

9. The parking assistance system according to claim 1, wherein said object specification part

creates a fourth image by projecting the second image onto the first location for transformation, and

detects and specifies the 3D object by taking a difference between the fourth image and the first image.

10. The parking assistance system according to claim 1, wherein the transition data of the vehicle includes a linear transit distance and a vehicle angle of the vehicle, and

said vehicle position calculation part calculates the linear transit distance and the vehicle angle based on data obtained from a steering angle sensor and wheel speed sensor via a pulse counter equipped in the vehicle.

11. The parking assistance system according to claim 1, wherein said image pick-up is mounted in the vehicle so as to face a rearward direction.

12. The parking assistance system according to claim 1, further comprising a display operable to display the third image to the driver.

13. The parking assistance system according to claim 1, further comprising a speaker being operable to generate a sound when the distance from the vehicle to the 3D object calculated by said object distance calculation part is shorter than a predetermined distance.

14. The parking assistance system according to claim 1, further comprising a light emitter being operable to generate light when the distance from the vehicle to the 3D object calculated by said object distance calculation part is shorter than a predetermined distance.

15. The parking assistance system according to claim 1, wherein said image pick-up starts picking up an image in response to a manual operation of the driver of the vehicle.

16. The parking assistance system according to claim 1, wherein said image pick-up starts picking up an image when the vehicle decelerates to a speed slower than a predetermined speed.

17. The parking assistance system according to claim 1, wherein said image pick-up starts picking up an image when the vehicle goes in reverse.