Method and Warning Device for Graphically Processing an Image of a Camera

• US 20080224837A1
• Filed: 01/13/2005
• Published: 09/18/2008
• Est. Priority Date: 02/23/2004
• Status: Abandoned Application

• Current Assignee: Valeo Schalter und Sensoren GmbH (Valeo SE)
• Original Assignee: Valeo Schalter und Sensoren GmbH (Valeo SE)
• Inventors: Hedderich, Markus, Meyer, Thorsten, Benz, Juergen
• Application Number:
  US10/589,566
• Publication Number:
  US 20080224837A1
• Time in Patent Office: Days
• US Class Current: 340/435
• CPC Class Codes: B60Q 9/005 using a video camera
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G08G 1/163 involving continuous checking

Abstract

The invention relates to a method for graphically processing an image of the surroundings of a motor vehicle, the image being been provided by a camera device. It is known fact that said images are processed in such a way that the danger potential for the motor vehicle posed by an obstacle in the surroundings is visualized optically by or highlighted for the driver. According to the invention, the image provided by the camera device is processed taking into account the position of the obstacle in the image in order to highlight said danger potential in an even clearer manner for the driver. To this end, the actual position of the obstacle in the surroundings of the motor vehicle is initially determined. The position of the obstacle in the image corresponding to the actual position of the obstacle in the surroundings is subsequently determined.

Claims

1-17. -17. (canceled)

18. A method for graphically processing an image, provided by a camera device, of surroundings of a vehicle or in a direction of travel of the vehicle for presentation to an observer or to a driver of the vehicle, the method comprising the steps of:

a) detecting an obstacle in the surroundings of the vehicle;

b) determining a position of the obstacle relative to a position of the vehicle;

c) determining a position of the obstacle relative to the surroundings;

d) determining a position of the obstacle in the image provided by the camera device; and

e) processing the image thereby taking into consideration the determined position of the obstacle in the image.

19. The method of claim 18, wherein a graphical object illustrating an expected future course of travel of the vehicle is faded into the image of the camera device and the position of the obstacle in the surroundings is determined using the known distance between the obstacle and the vehicle or the camera device, wherein the position of the obstacle in the image or of a side of the obstacle facing or closest to the camera device, represents the determined actual distance between the obstacle and the camera device.

20. The method of claim 18, wherein the expected future course of travel is determined using information concerning a steering angle of the vehicle and a fictitious camera position is illustrated in a lower portion of the image.

21. The method of claim 19, wherein the graphical object which is faded into the image of the camera device to illustrate the course of travel comprises a symbol indicating an end of travel motion, the symbol being a limiting line, limiting means symbolically presented on the course of travel, a barrier, a gate, or a fence disposed approximately at a level of the determined position of the obstacle in the image.

22. The method of claim 19, wherein the graphical object illustrating the course of travel is imaged only to approximately a level of the determined position of the obstacle in the image, but not for larger distances from the vehicle or the camera device.

23. The method of claim 19, wherein for large separations from the vehicle beyond an approximate location of the determined position of the obstacle in the image, the graphical object in the form of the course of travel is only schematically indicated or is indicated using broken lines.

24. The method of claim 18, wherein, as viewed by the camera device, at least one region of the surroundings of the vehicle is determined in which the obstacle is located and at least one graphical object is faded into the image of the camera device to optically emphasize a correlation between the obstacle and the at least one region and/or a position of the obstacle within this region.

25. The method of claim 24, wherein a bar or a bar which extends in a vertical direction from a lower edge of the image is faded into the image as the graphical object to indicate the position of the obstacle relative to the position of the vehicle or the camera device, wherein a horizontal position of the bar in the image represents the region of the surrounding and/or a height or length of the bar in a vertical direction represents the determined distance between the obstacle and the vehicle.

26. The method of claim 25, wherein an outline of the bar is adjusted to the representation of the determined course of travel and is illustrated in a correspondingly bent and/or distorted fashion.

27. The method of claim 18, wherein a graphical object is faded into the image at the position of the obstacle in the image or at a position of a side of the obstacle facing or closest to the camera device, wherein the obstacle is at least partially covered.

28. The method of claim 27, wherein the outline of the graphical object has a basic geometric form, is rectangular, oval, triangular or has a form of a determined outline of the obstacle.

29. The method of claim 19, wherein the graphical object is semi-transparent or represented only as an outline.

30. The method of claim 19, wherein the graphical object is represented as a colored surface, wherein a color can optionally be varied in accordance with the determined distance between the obstacle and the vehicle or the camera device.

31. The method of claim 18, wherein the image of the camera device is manipulated, brightened, or colored in a region of the determined position of the obstacle, wherein the manipulation depends on a magnitude of the determined distance between the obstacle and the vehicle, varies in time and/or flashes.

32. A computer program comprising a program code for a vehicle warning device, wherein the program code is designed to perform the method of claim 18.

33. A data carrier having the computer program of claim 32.

34. A warning device for a vehicle, comprising:

a camera device for generating images of surroundings of the vehicle or in a direction of vehicle travel;

an image processing device for processing the images produced by the camera device;

a display means for displaying the processed image to a viewer or to a driver of the vehicle;

an obstacle detection/distance measuring device for detecting an obstacle in the surroundings of the vehicle and for determining a real position of the obstacle;

a transformation device for transforming the real position of the obstacle in the surroundings into a corresponding position of the obstacle in the image of the camera device; and

means, within said image processing device, for processing the image of the camera device, thereby taking into consideration the determined position of the obstacle in the image.

35. The warning device of claim 34, wherein the image processing device is designed to process the image of the camera device while taking into consideration vehicle parameters or a vehicle steering angle.