System and method for displaying a 3D vehicle surrounding with adjustable point of view including a distance sensor

• US 8,044,781 B2
• Filed: 11/10/2008
• Issued: 10/25/2011
• Est. Priority Date: 11/10/2008
• Status: Active Grant

• Current Assignee: Volkswagen AG
• Original Assignee: Volkswagen AG
• Inventors: Camhi, Jamie, Laubinger, Lorenz
• Primary Examiner(s): Hofsass; Jeffery
• Application Number:
  US12/268,299
• Publication Number:
  US 20100117812A1
• Time in Patent Office: 1,079 Days
• Field of Search: 340/435, 340/436, 340/903, 701/1, 701/207.3, 701/301
• US Class Current: 340/435
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 1/28 with an adjustable field of view
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/806 for aiding parking
• CPC Class Codes: G08G 1/165 for passive traffic, e.g. including static obstacles, trees
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: G08G 1/168 Driving aids for parking, e.g. acoustic or visual feedback on parking space

Abstract

A system and method relates to displaying a vehicle surrounding with an adjustable point of view, including at least one sensor device on the vehicle, a processor, and a display. The sensor device is configured to measure distances to objects of the vehicle surrounding. In addition, the processor is configured to generate a three-dimensional environment map based on the measured distances of the sensor device. Further, the display is configured to display the three-dimensional environment map having an adjustable point of view based on a particular driving situation.

Claims

1. A system for displaying a vehicle surrounding with an adjustable point of view, comprising:

at least one sensor device on the vehicle, the at least one sensor device configured to measure distances to objects of the vehicle surrounding;

a processor configured to generate a three-dimensional environment map based on the measured distances of the at least one sensor device; and

a display configured to display the three-dimensional environment map having an adjustable point of view based on a particular driving situation.

2. The system according to claim 1, wherein the adjustable point of view includes a point of view other than that of the at least one sensor device.

3. The system according to claim 2, wherein the adjustable point of view includes a point of view most beneficial to the particular driving situation.

4. The system according to claim 3, wherein the point of view most beneficial to the particular driving situation includes a point of view, during a parallel parking situation, from at least one of a side and a rear of the vehicle.

5. The system according to claim 1, wherein the processor is configured to continuously update the three-dimensional environment map.

6. The system according to claim 1, wherein the at least one sensor device includes at least one of:

(a) a time-of-flight, (b) lidar, (c) radar, (d) ultrasound, and (e) stereo sensor device.

7. The system according to claim 1, wherein the processor is configured to highlight the objects in the three-dimensional environment map based on the measured distances to the objects.

8. The system according to claim 1, wherein the processor is configured to highlight the objects in the three-dimensional environment map based on the particular driving situation.

9. The system according to claim 1, wherein the display is configured to display an indication of the measured distances to the objects on the three-dimensional environment map.

10. The system according to claim 1, wherein the at least one sensor device includes a plurality of sensor devices with at least partially overlapping fields of view.

11. The system according to claim 10, wherein the plurality of sensor devices includes a sensor device mounted on a rear of the vehicle and a sensor device mounted on each side of the vehicle.

12. The system according to claim 1, wherein the processor is configured to perform sensor fusion, object recognition, and scene rendering.

13. The system according to claim 12, wherein the processor is configured to perform noise filtering and contrast enhancement.

14. The system according to claim 1, wherein the processor is configured to include a three-dimensional model of the vehicle in the three-dimensional environment map.

15. A method for displaying a vehicle surrounding with an adjustable point of view, comprising:

measuring distances, by at least one sensor device on the vehicle, to objects of the vehicle surrounding;

generating, by a processor, a three-dimensional environment map based on the measured distances of the at least one sensor device; and

displaying, by a display, the three-dimensional environment map having an adjustable point of view based on a particular driving situation.

16. The method according to claim 15, wherein displaying the three-dimensional environment map includes displaying from a point of view other than that of the at least one sensor device.

17. The method according to claim 15, wherein displaying the three-dimensional environment map includes displaying from a point of view most beneficial to the particular driving situation.

18. The method according to claim 17, wherein displaying from the point of view most beneficial to the particular driving situation includes displaying from a point of view, during a parallel parking situation, from at least one of a side and a rear of the vehicle.

19. The method according to claim 15, further comprising continuously updating, by the processor, the three-dimensional environment map.

20. The method according to claim 15, further comprising highlighting, by the processor, the objects in the three-dimensional environment map based on the measured distances to the objects.

21. The method according to claim 15, further comprising highlighting, by the processor, the objects in the three-dimensional environment map based on the particular driving situation.

22. The method according to claim 15, further comprising displaying, by the display, an indication of the measured distances to the objects on the three-dimensional environment map.

23. The method according to claim 15, further comprising measuring distances by a plurality of sensor devices with at least partially overlapping fields of view.

24. The method according to claim 23, further comprising measuring distances by the plurality of sensor devices including one sensor device mounted on a rear of the vehicle, and one sensor device mounted on each side of the vehicle.

25. The method according to claim 15, wherein the generating includes:

combining, by the processor, the measured distances of the at least one sensor device;

recognizing the objects in a data set; and

rendering the three-dimensional environment map.

26. The method according to claim 25, wherein the generating includes:

filtering noise; and

enhancing contrast.

27. The method according to claim 15, further comprising including, by the processor, a three-dimensional model of the vehicle in the three-dimensional environment map.