Vehicle Image Processing Method

• US 20110169957A1
• Filed: 01/14/2010
• Published: 07/14/2011
• Est. Priority Date: 01/14/2010
• Status: Abandoned Application

• Current Assignee: Ford Global Technologies, LLC (Ford Motor Company)
• Original Assignee: Ford Global Technologies, LLC (Ford Motor Company)
• Inventors: Bartz, Daniel James
• Application Number:
  US12/687,321
• Publication Number:
  US 20110169957A1
• Time in Patent Office: Days
• US Class Current: 348/149
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 1/31 providing stereoscopic vision
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/607 from a bird's eye viewpoint
• CPC Class Codes: G06T 1/0007 Image acquisition
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30261 Obstacle
• CPC Class Codes: G06T 7/269 using gradient-based methods

Abstract

A method for processing an image of the exterior of a vehicle includes transmitting successive camera images from a camera to a processor. Optical flow vectors from the multiple camera images are estimated. The optical flow vectors are compared and objects located on the ground are separated from objects located above the ground. Vehicle motion is estimated. Data from the successive camera images is processed to create an estimated three-dimensional (3D) bird'"'"'s eye view image, and the bird'"'"'s eye view image is displayed.

Claims

1. A method for processing an image of the exterior of a vehicle comprising:

transmitting successive camera images from a camera to a processor;

estimating optical flow vectors from the multiple camera images;

comparing the optical flow vectors and separating objects located on the ground from objects located above the ground;

estimating vehicle motion;

processing data from the successive camera images to create an estimated three-dimensional (3D) bird'"'"'s eye view image; and

displaying the bird'"'"'s eye view image.

2. The method according to claim 1, wherein the step of transmitting multiple camera images from a camera to a processor includes transmitting images of the environment adjacent to the exterior of the vehicle.

3. The method according to claim 1, wherein the step of transmitting multiple camera images from a camera to a processor includes transmitting images from a video camera.

4. The method according to claim 1, further including measuring vehicle motion.

5. The method according to claim 4, wherein vehicle motion is measured with one of an ultrasound sensors, radar, light detection and ranging (LIDAR) devices, and GPS devices.

6. The method according to claim 1, wherein the bird'"'"'s eye view image is displayed within the vehicle.

7. The method according to claim 6, wherein the bird'"'"'s eye view image is displayed in a vehicle instrument panel.

8. The method according to claim 6, wherein the bird'"'"'s eye view image is displayed within the vehicle as a 3D image.

9. The method according to claim 6, wherein the bird'"'"'s eye view image is displayed within the vehicle as a 2D image.

10. The method according to claim 1, further including determining a width and a distance from the vehicle of an identified object in the camera images.

11. The method according to claim 10, further including calculating the height of the identified object.

12. The method according to claim 1, further including transmitting successive camera images from more than one camera to a processor, and fusing image data from each of the cameras into a composite image.

13. A method for processing an image of the exterior of a vehicle comprising:

transmitting successive camera images from a camera to a processor;

estimating optical flow vectors from the multiple camera images;

comparing the optical flow vectors and separating objects located on the ground from objects located above the ground;

measuring vehicle motion with one of an ultrasound sensors, radar, light detection and ranging (LIDAR) devices, and GPS devices;

processing data from the successive camera images to create an estimated three-dimensional (3D) bird'"'"'s eye view image; and

displaying a 3D bird'"'"'s eye view image.

14. The method according to claim 13, wherein the step of transmitting multiple camera images from a camera to a processor includes transmitting images of the environment adjacent to the exterior of the vehicle.

15. The method according to claim 13, wherein the step of transmitting multiple camera images from a camera to a processor includes transmitting images from a video camera.

16. The method according to claim 13, wherein the bird'"'"'s eye view image is displayed within the vehicle.

17. The method according to claim 16, wherein the bird'"'"'s eye view image is displayed within the vehicle as one of a 3D image and a 2D image.

18. The method according to claim 13, further including determining a width and a distance from the vehicle of an identified object in the camera images.

19. The method according to claim 18, further including calculating the height of the identified object.

20. The method according to claim 13, further including transmitting successive camera images from more than one camera to a processor, and fusing image data from each of the cameras into a composite image.