Stereo night vision system for vehicles

• US 20060098093A1
• Filed: 09/08/2003
• Published: 05/11/2006
• Est. Priority Date: 09/12/2002
• Status: Abandoned Application

• Current Assignee: Daimler Chrysler Company LLC (Stellantis NV)
• Original Assignee: Daimler Chrysler Company LLC (Stellantis NV)
• Inventors: Hahn, Stefan, Straub, Bernhard, Kreuzer, Markus
• Application Number:
  US10/527,722
• Publication Number:
  US 20060098093A1
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: H04N 13/111 Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/254 in combination with electromagnetic radiation sources for illuminating objects
• CPC Class Codes: H04N 13/30 Image reproducers optical systems for producing stereoscopic or other three-dimensional effects G02B30/00
• CPC Class Codes: H04N 13/302 for viewing without the aid of special glasses, i.e. using autostereoscopic displays
• CPC Class Codes: H04N 13/305 using lenticular lenses, e.g. arrangements of cylindrical lenses
• CPC Class Codes: H04N 13/307 using fly-eye lenses, e.g. arrangements of circular lenses
• CPC Class Codes: H04N 13/31 using parallax barriers
• CPC Class Codes: H04N 13/32 using arrays of controllable light sources; using moving apertures or moving light sources
• CPC Class Codes: H04N 13/324 Colour aspects
• CPC Class Codes: H04N 13/332 Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
• CPC Class Codes: H04N 13/334 using spectral multiplexing
• CPC Class Codes: H04N 13/337 using polarisation multiplexing
• CPC Class Codes: H04N 13/341 using temporal multiplexing
• CPC Class Codes: H04N 13/346 using prisms or semi-transparent mirrors
• CPC Class Codes: H04N 13/356 having separate monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/361 Reproducing mixed stereoscopic images; Reproducing mixed monoscopic and stereoscopic images, e.g. a stereoscopic image overlay window on a monoscopic image background
• CPC Class Codes: H04N 13/363 using image projection screens volumetric display H04N13/388
• CPC Class Codes: H04N 13/373 for tracking forward-backward translational head movements, i.e. longitudinal movements
• CPC Class Codes: H04N 13/376 for tracking left-right translational head movements, i.e. lateral movements
• CPC Class Codes: H04N 13/38 : for tracking vertical translational head movements
• CPC Class Codes: H04N 13/383 : for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
• CPC Class Codes: H04N 13/388 : Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume
• CPC Class Codes: H04N 13/39 : the picture elements emitting light at places where a pair of light beams intersect in a transparent material
• CPC Class Codes: H04N 13/393 : the volume being generated by a moving, e.g. vibrating or rotating, surface
• CPC Class Codes: H04N 13/395 : with depth sampling, i.e. the volume being constructed from a stack or sequence of 2D image planes
• CPC Class Codes: H04N 13/398 : Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 2013/0081 : Depth or disparity estimation from stereoscopic image signals

Abstract

The invention relates to a night vision system for vehicles. According to the invention, the road in front of the vehicle is stereoscopically recorded via two night vision-capable cameras, e.g. infrared or low-light-level cameras that are mounted in the front of the vehicle at a distance from one another. Corresponding stereoscopic image display devices permit the driver to observe the road in front of the vehicle in three-dimensions. Objects located in front of the vehicle can be detected in critical areas by means of additional image evaluating devices and can be differently accentuated or marked in the image representation. The night vision system can be designed to also permit a two-dimensional display of images or data alternatively or in conjunction with 3D representation. In an enhanced embodiment, head movements and/or the line of sight of the driver are/is detected and used for a corresponding tracking of the image display.

Claims

1. A night vision system for vehicles, having at least two night vision capable cameras that are fitted on the vehicle at a spacing from one another in such a way that a stereoscopic recording is made of the driving path situated in front of the vehicle, and having means which condition the image signals of the night vision capable cameras and reproduce them optically for the driver, wherein means are present that generate for the driver a stereoscopic reproduction of the image signals.

2. The night vision system as claimed in claim 1, wherein the means for generating a stereoscopic reproduction project image components from various night vision capable cameras in different spatial directions.

3. The night vision system as claimed in claim 1, wherein the means for generating a stereoscopic reproduction has elements that project image components in different spatial directions by means of optical diffraction (for example diffractive optical elements, gratings, holographic elements).

4. The night vision system as claimed in claim 1, wherein the means for generating a stereoscopic reproduction have elements that project image components in different spatial directions by means of optical refraction (for example arrays of longitudinal prisms, microlens arrangements, cylindrical lens arrays or field lenses).

5. The night vision system as claimed in claim 1, wherein the means for generating a stereoscopic reproduction have elements that project image components in different spatial directions by means of reflection (for example retroreflectors, partially reflecting elements).

6. The night vision system as claimed in claim 1, wherein the means for generating a stereoscopic reproduction have elements that separate image components optically by means of exclusion (for example barrier grid, color mask) or covering (for example polarization filter).

7. The night vision system as claimed in claim 1, wherein the means for generating a stereoscopic reproduction have elements that separate image components optically as a function of time.

8. The night vision system as claimed in claim 1, wherein the means for generating a stereoscopic reproduction have elements that illuminate image reproduction displays (for example LCD displays) in a structured fashion (parallax illumination).

9. The night vision system as claimed in claim 1, wherein the means for generating a stereoscopic reproduction have scanning laser systems and electrooptic modulators.

10. The night vision system as claimed in claim 1, wherein the means for generating a stereoscopic reproduction have at least two projectors that emit image components in an angularly selective fashion.

11. The night vision system as claimed in claim 1, wherein the means for generating a stereoscopic reproduction have elements (for example lasers, edge-emitting LEDs) that project image components directly onto the driver'"'"'s retina.

12. The night vision system as claimed in claim 1, wherein means are present which detect the head and/or eye position or direction of view of the driver and drive the means for generating a stereoscopic reproduction as a function of the detected head and/or eye position or direction of view.

13. The night vision system as claimed in claim 12, wherein the head and/or eye position or direction of view of the driver is detected via cameras, ultrasound or infrared detectors fitted in the interior of the vehicle.

14. The night vision system as claimed in claim 12, wherein the means for generating a stereoscopic reproduction are driven in such a way that a movement parallax results.

15. The night vision system as claimed in claim 1, wherein the means for generating a stereoscopic reproduction have elements that are worn by the driver (for example polarization or color filter spectacles, mini displays, etc.).

16. The night vision system as claimed in claim 1, wherein the means for generating a stereoscopic reproduction have swinging or rotating displays.

17. The night vision system as claimed in claim 1, wherein the means for generating a stereoscopic reproduction have volumetric displays in which individual spatial points are excited to emit light by means of laser radiation, for example.

18. The night vision system as claimed in claim 1, wherein the conditioning of the image signals of the night vision capable cameras includes the detection and optical accentuation of objects in the driving direction.

19. The night vision system as claimed in claim 18, wherein the optical accentuation of the objects is performed by marking (for example coloring, contrasting, flashing).

20. The night vision system as claimed in claim 18, wherein the optical accentuation of the objects is performed by varying the apparent position (for example distance) in the stereoscopic reproduction.

21. The night vision system as claimed in claim 1, wherein in addition to the three-dimensional reproduction image components are also reproduced in a two-dimensional display.

22. The night vision system as claimed in claim 21, wherein the driving control parameters (speed, rotational speed etc) and/or navigation information (for example GPS) are reproduced as image components in a two-dimensional display.