Head-up display system and method for carrying out the location-correct display of an object situated outside a vehicle with regard to the position of the driver

• US 7,605,773 B2
• Filed: 05/04/2002
• Issued: 10/20/2009
• Est. Priority Date: 06/30/2001
• Status: Expired due to Fees

• Current Assignee: Robert Bosch GmbH
• Original Assignee: Robert Bosch GmbH
• Inventors: Janssen, Holger
• Primary Examiner(s): Dharia; Prabodh M
• Application Number:
  US10/481,912
• Publication Number:
  US 20040178894A1
• Time in Patent Office: 2,726 Days
• Field of Search: 345/156, 345/633, 345/7, 345/8, 345/173, 345/619, 340/435, 340/557, 340/425.5, 340/461, 340/988, 340/436, 340/903, 340/973, 340/980, 340/572.1, 340/936, 340/433, 701/96, 701/301, 701/120, 701/200, 701/207, 348/148, 342/70, 455/456.1, 359/13, 359/630, 359/708
• US Class Current: 345/7
• CPC Class Codes: B60K 2360/149 Instrument input by detecting viewing direction not otherwise provided for
• CPC Class Codes: B60K 2360/334 Projection means
• CPC Class Codes: B60K 2360/785 on or in relation to the windshield or windows
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/60 Instruments characterised by their location or relative disposition in or on vehicles arrangements of lighting devices on dashboards B60Q3/10
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 2300/107 using stereoscopic cameras
• CPC Class Codes: B60R 2300/205 using a head-up display
• CPC Class Codes: G01C 21/365 Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G08G 1/16 Anti-collision systems road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes

Abstract

A head-up display system for representing an object of a space external to the vehicle, having a device for recording a position of a passenger of the vehicle and a device for the correct-location representation of the object with respect to the position of the driver. The head-up display system may be applied to navigation systems and to automatic cruise control systems.

Claims

1. A head-up display system for representing an object in a space external to a vehicle, comprising:

a position system for recording a position of at least one of the passengers of the vehicle;

a projection unit for projecting a correct-location representation of the object, the correct-location representation including a marking configured to surround and be spaced apart from the actual object as seen by the at least one of the passengers of the vehicle, and for fading in a symbol into a direct viewing range of a driver of the vehicle in a location different than that of the projection of the correct-location representation, the symbol representing the object;

a sensing arrangement to sense the object in the space external to the vehicle; and

a computing unit for receiving sensed object data from the sensing arrangement and recognizing a pattern in the sensed object data to generate the symbol representing the object as a function of the sensed object data and symbol data stored in a databank,

wherein the computing unit can recognize patterns associated with traffic signs, pedestrians and vehicles to generate corresponding symbols.

2. The head-up display system of claim 1, wherein the sensing arrangement includes at least one of a video camera, a radar sensor, a lidar sensor, a range imager, a time-off flight sensor, a night vision sensor, and an infrared sensor.

3. The head-up display system of claim 1, wherein the sensing arrangement generates a multi-dimensional image of a region of the space exterior to the vehicle.

4. The head-up display system of claim 3, wherein the sensing arrangement includes stereo sensors.

5. The head-up display system of claim 1, wherein the position system records at least one of a head position and a position of the eyes of at least one of the driver and a front-seat passenger.

6. The head-up display system of claim 1, wherein the position system includes a sensor device having at least one of a video camera, a radar sensor, a lidar sensor, a range imager, a time-off flight sensor, a night vision sensor, and an infrared sensor for generating a multi-dimensional image of the passenger compartment of the vehicle.

7. The head-up display system of claim 1, further comprising:

a calculating unit for computing image data for the correct-location representation of the object based upon data supplied by the position system.

8. The head-up display system of claim 7, further comprising:

a highlighting device for highlighting the object in the correct-location representation.

9. The head-up display system of claim 8, wherein the object is at least one of a pedestrian, a cyclist, a traffic participant, a traffic sign, a traffic light, a priority highway, a pedestrian crosswalk, and a roadway marking.

10. The head-up display system of claim 1, further comprising:

additional vehicle sensors for generating at least one of a warning sign, a recommendation and danger information with regard to the object shown.

11. The head-up display system of claim 1, wherein the projection unit projects the correct-location representation of a warning as a function of a driving situation.

12. The head-up display system of claim 11, wherein the driving situation involves the vehicle leaving a roadway.

13. The head-up display system of claim 11, wherein the projection unit projects the correct-location representation of an assistance function as a function of the driving situation.

14. The head-up display system of claim 11, wherein the driving situation involves the vehicle making one of a lane change and a change to a turn-off lane.

15. The head-up display system of claim 1, wherein the projection unit projects the correct-location representation of an evasive maneuver around the object.

16. The head-up display system of claim 15, further comprising:

a computing and algorithm unit for determining the evasive maneuver.

17. The head-up display system of claim 1, wherein the projection unit fades in at least one of information and a warning if the head of at least one of the driver and the front-seat passenger is in an unfavorable position.

18. The head-up display system of claim 1, wherein the unfavorable position is unfavorable with respect to an air bag.

19. The head-up display system of claim 1, further comprising:

an automatic cruise control system, wherein the displayed object is selectable as a reference object for the automatic cruise control system.

20. The head-up display system of claim 1, further comprising:

a computer for determining a representation of the object by accessing data.

21. The head-up display system of claim 20, wherein the data is stored in a navigation databank of a navigation system.

22. The head-up display system of claim 1, wherein the data includes video data.

23. The head-up display system of claim 22, wherein the video data is transmitted by at least one of a television transmission, a DVD playback device, and an information service.

24. The head-up display system of claim 20, wherein the representation occurs when the vehicle travels below a maximum vehicle speed.

25. The head-up display system of claim 1, wherein the position system is configured to record at least one front-seat passenger position.

26. The head-up display system of claim 11, wherein the projection unit is configured to project the correct-location representation of the object with respect to the position of a front-seat passenger.

27. A navigation system comprising:

a head-up display system for representing an object in a space external to the vehicle, the head-up system including;

a position system for determining a vehicle position, and for recording a position of at least one of the passengers of the vehicle;

a projection unit for projecting a correct-location representation of the object, the correct-location representation including a marking configured to surround and be spaced apart from the actual object as seen by the at least one of the passengers of the vehicle, and for fading in a symbol into a direct viewing range of a driver of the vehicle in a location different than that of the projection of the correct-location representation, the symbol representing the object;

a sensing arrangement to sense the object in the space external to the vehicle; and

a computing unit for receiving sensed object data from the sensing arrangement and recognizing a pattern in the sensed object data to generate the symbol representing the object as a function of the sensed object data and symbol data stored in a databank,

wherein the computing unit can recognize patterns associated with traffic signs, pedestrians and vehicles to generate corresponding symbols.

28. An automatic cruise control system, comprising:

a distance recorder for recording a distance from an object traveling ahead;

a head-up display system for representing an object in a space external to the vehicle, wherein the object traveling ahead is used as reference point for use in automatic cruise control, and the object traveling ahead is represented in a correct-location manner by the head-up display system, the head-up display system including;

a position system for recording a position of at least one of the passengers of the vehicle;

a projection unit for projecting a correct-location representation of the object, the correct-location representation including a marking configured to surround and be spaced apart from the actual object as seen by the at least one of the passengers of the vehicle, and for fading in a symbol into a direct viewing range of a driver of the vehicle in a location different than that of the projection of the correct-location representation, the symbol representing the object;

a sensing arrangement to sense the object in the space external to the vehicle; and

a computing unit for receiving sensed object data from the sensing arrangement and recognizing a pattern in the sensed object data to generate the symbol representing the object as a function of the recorded object data and symbol data stored in a databank,

wherein the computing unit can recognize patterns associated with traffic signs, pedestrians and vehicles to generate corresponding symbols.

29. The automatic cruise control system of claim 28, wherein the object represented in a correct-location manner is selected as a reference object.

30. A method for providing a correct-location head-up representation of an object in a space external to a vehicle on a windshield, the method comprising:

recording a position of at least one of a driver and a front-seat passenger;

determining image data for the correct-location representation of the object with respect to the position; and

providing as a head-up projection the correct-location representation of the image data, the correct-location representation including a marking configured to surround and be spaced apart from the actual object as seen by the at least one of the driver and the front-seat passenger, and fading in a symbol into a direct viewing range of the driver of the vehicle in a location different than that of the projection of the correct-location representation, the symbol representing the object;

sensing the object in the space external to the vehicle; and

recognizing a pattern in sensed object data to generate the symbol representing the object as a function of the sensed object data and symbol data stored in a databank,

wherein the recognizing includes recognizing patterns associated with traffic signs, pedestrians and vehicles to generate corresponding symbols.

31. The method of claim 30, wherein a position of the eyes of at least one of the driver and the front-seat passenger is recorded.

32. The method of claim 30, wherein at least one sensor in the space external to the vehicle is used to determine the image data.

33. The method of claim 30, further comprising:

providing the sensed object data to an evaluation unit; and

providing at least one of information, a warning and a correct-location marking in a head-up projection based on a determination by the evaluation unit.

34. The method of claim 30, further comprising:

accessing at least one of a databank and a data file for providing the correct-location representation of the object.

35. The method of claim 34, wherein the databank includes a navigation databank.

36. The method of claim 34, wherein the data includes video data.

37. The method of claim 36, further comprising:

transmitting the video data by at least one of a television transmission, a DVD playback device, and an information service.

38. A computer program product on one of a computer-readable medium and a data file transmittable via a computer network, the computer program product being executable on an electronic system, comprising:

programming arrangement for performing a process for providing a correct-location head-up representation of an object in a space external to a vehicle on a windshield, the process including;

recording a position of at least one of a driver and a front-seat passenger;

determining image data for the correct-location representation of the object with respect to the position; and

providing as a head-up projection the correct-location representation of the image data, the correct-location representation including a marking configured to surround and be spaced apart from the actual object as seen by the at least one of the driver and the front-seat passenger, and fading in a symbol into a direct viewing range of the driver of the vehicle in a location different than that of the projection of the correct-location representation, the symbol representing the object;

sensing the object in the space external to the vehicle using a sensing arrangement of the vehicle, wherein the sensing arrangement includes at least one of;

a video camera, a radar sensor, a lidar sensor, a range imager, a time-off flight sensor, a night vision sensor, or an infrared sensor; and

recognizing a pattern in sensed object data to generate the symbol representing the object as a function of the sensed object data and symbol data stored in a databank,

wherein the recognizing includes recognizing patterns associated with traffic signs, pedestrians and vehicles to generate corresponding symbols.

39. The computer program product of claim 38, wherein the electronic system includes one of a head-up display system, a navigation system, and a system for automatic cruise control.