Method for identification of a projected symbol on a street in a vehicle, apparatus and vehicle

• US 9,536,157 B2
• Filed: 03/05/2015
• Issued: 01/03/2017
• Est. Priority Date: 03/05/2014
• Status: Active Grant

• Current Assignee: Conti Temic Microelectronic GmbH (Continental AG)
• Original Assignee: Conti Temic Microelectronic GmbH (Continental AG)
• Inventors: Zobel, Matthias
• Primary Examiner(s): Le, Vu
• Assistant Examiner(s): BEG, SAMAH A
• Application Number:
  US14/639,215
• Publication Number:
  US 20150254515A1
• Time in Patent Office: 670 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06V 10/145 Illumination specially adapted for pattern recognition, e.g. using gratings
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G06V 20/582 of traffic signs
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road

Abstract

A method and a camera-based driver assistance system in a subject vehicle uses image processing to automatically recognize dynamic intangible symbols that are projected as light onto the road by another vehicle, and responds in an appropriate manner based on the recognized symbols. For example, advice is given to the driver or signals are transmitted to vehicle devices in order to bring about an appropriate vehicle response, such as an emergency braking action or a distance alert.

Claims

1. A method for a subject vehicle driving on a road, the method comprising steps of:

with a camera of the subject vehicle, capturing an image of a part of the road that has thereon an intangible symbol that is projected as light onto the part of the road by a road user other than the subject vehicle;

with a computing unit of the subject vehicle, detecting, in the image, the intangible symbol on the part of the road;

with the computing unit, identifying the intangible symbol detected in the image; and

with the computing unit, generating a signal based on the identified intangible symbol in order to bring about a measure in the subject vehicle in response to and dependent on the identified intangible symbol.

2. The method according to claim 1, wherein the step of identifying the intangible symbol comprises identifying a color of the intangible symbol.

3. The method according to claim 1, wherein the intangible symbol is selected from the group consisting of a distance line extending transversely to a direction of travel of the subject vehicle, a stop sign, a speed limit symbol, a traffic light symbol and any combination thereof.

4. The method according to claim 1, wherein the identifying of the intangible symbol is performed by an automatic image processing program being executed by the computing unit in the subject vehicle.

5. The method according to claim 4, further including a step of transmitting the signal to a device of the subject vehicle, and with the device performing the measure, wherein the measure is selected from the group consisting of a distance alert, a braking action of the subject vehicle, an acceleration of the subject vehicle, a warning given to a driver of the subject vehicle, an intervention in a longitudinal control of the subject vehicle, an intervention in a lateral control of the subject vehicle, an intervention in a longitudinal control and a lateral control of the subject vehicle, an intervention in vehicle dynamics of the subject vehicle, a transmission of telemetric information from the subject vehicle, and any combination thereof.

6. The method according to claim 1, further including a step of performing a situation recognition by the computing unit in the subject vehicle.

7. The method according to claim 6, wherein the situation recognition comprises receiving input data from another system or component of the subject vehicle and comparing the input data to stored situation criteria to determine a current operating situation of the subject vehicle, and further comprising determining said measure in response to and dependent on both the signal and the current operating situation.

8. The method according to claim 1, further including a step of associating the identified intangible symbol to the signal to be generated using associations stored in the subject vehicle.

9. The method according to claim 1, further including a step of using the signal in a driver assistance system of the subject vehicle to perform the measure which comprises producing a warning or intervening in driving dynamics of the subject vehicle.

10. The method according to claim 1, wherein the step of identifying the intangible symbol comprises identifying a variation in intensity of the intangible symbol.

11. The method according to claim 1, wherein the intangible symbol moves along the road together with the other road user moving along the road, and the step of capturing an image comprises capturing a succession of images moving to further parts of the road to which the intangible symbol has moved.

12. A device for a subject vehicle driving on a road, the device including:

a camera configured and arranged to capture images of a part of the road, and

a processor arrangement,

wherein the camera is further configured and arranged to transmit the images captured by the camera to the processor arrangement,

wherein the processor arrangement is configured and arranged to identify, in at least one of the images, an intangible symbol that is projected as light onto said part of the road by a road user other than the subject vehicle, and

wherein the processor arrangement is further configured and arranged to generate a signal in order to bring about a measure in the subject vehicle in response to and dependent on the identified intangible symbol.

13. A subject vehicle including:

the device according to claim 12, and

a driver assistance system,

wherein the device is further configured and arranged to transmit the signal generated by the processor arrangement to the driver assistance system, and

wherein the driver assistance system is configured and arranged to perform the measure based on the signal generated by the processor arrangement, which measure is selected from the group consisting of a distance alert, a braking action of the subject vehicle, an acceleration of the subject vehicle, a warning given to a driver of the subject vehicle, an intervention in a longitudinal control of the subject vehicle, an intervention in a lateral control of the subject vehicle, an intervention in a longitudinal control and a lateral control of the subject vehicle, an intervention in vehicle dynamics of the subject vehicle, a transmission of telemetric information from the subject vehicle, and any combination thereof.

14. The subject vehicle according to claim 13, further including a light projector and a control unit connected to the light projector, wherein the control unit and the light projector are configured and arranged to project light onto the road to form a light symbol on the road.