Method and device for determining a valid lane marking

• US 9,626,571 B2
• Filed: 02/04/2010
• Issued: 04/18/2017
• Est. Priority Date: 02/04/2009
• Status: Active Grant

• Current Assignee: CARIAD SE (Volkswagen AG)
• Original Assignee: Hella KGaA Hueck & Company
• Inventors: Spangenberg, Robert
• Primary Examiner(s): Kelley, Christopher S
• Assistant Examiner(s): Retallick, Kaitlin A
• Application Number:
  US13/146,569
• Publication Number:
  US 20120033074A1
• Time in Patent Office: 2,630 Days
• Field of Search: None
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 2540/18 Steering angle
• CPC Class Codes: B60W 2554/00 Input parameters relating to objects
• CPC Class Codes: B60W 2720/10 Longitudinal speed
• CPC Class Codes: B60W 30/08 Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences
• CPC Class Codes: B60W 40/04 Traffic conditions
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road

Abstract

A method and a device for determining a valid lane marking using a vehicle camera system. A series of pictures are taken of an area in front of the vehicle. At least a first lane marking and a second lane marking different from the first lane marking are detected in corresponding image data. A vehicle driving ahead of the vehicle is detected in at least two successively taken pictures and its position relative to the first lane marking as well as its position relative to the second lane marking is determined. Dependent on the positions of the vehicle driving ahead determined with the aid of the pictures, one of the detected lane markings is selected as the valid lane marking.

Claims

1. A method for determining a valid lane marking with the aid of a camera system of a vehicle, in particular a road vehicle,

in which with the aid of a camera of the camera system (16) several pictures (30, 54, 66) with images of an area in front of the vehicle (12) are successively taken as a picture series, and image data corresponding to the respective picture (30, 54, 66) are generated,

and in which the image data of at least a part of the pictures (30, 54, 66) of the picture series are processed,

wherein at least a first lane marking (38, 40) and a second lane marking (56, 58) different from the first lane marking are detected in at least one picture of the picture series, the second lane marking having been temporarily applied to divert traffic from a lane delimited by the first lane marking,

a vehicle (34) driving ahead of the vehicle (12) is detected in at least two successively taken pictures (30, 54, 66) of the picture series,

for each of the at least two pictures, the position (P1 to P4;

P1 to P4*) of the vehicle driving ahead (34) relative to the first lane marking (38, 40) and the position (P1 to P4;

P1 to P4*) of the vehicle driving ahead (34) relative to the second lane marking (56, 58) is determined,

and wherein, dependent on the positions (P1 to P4;

P1 to P4*) of the vehicle driving ahead (34) determined with the aid of the pictures, one of the detected lane markings (38, 40;

56, 58) is selected as the valid lane marking.

2. The method according to claim 1, characterized in that based on at least two, preferably at least three of the pictures successively taken as a picture series, a course of movement (52, 64) of the vehicle driving ahead (34) is determined, and in that based on the determined course of movement (52, 64) of the vehicle driving ahead (34) and the courses of the at least two detected lane markings (38, 40;

56, 58) one of the lane markings (38, 40;

56, 58) is selected as the valid lane marking.

3. The method according to one of the preceding claims, characterized in that from the at least two lane markings (38, 40;

56, 58) the lane marking (38, 40;

56, 58) is selected as the valid lane marking (38, 40) that, for both determined positions, has a lateral offset transverse to the traffic direction of the lane (14) that is within a preset range for both positions (P1 to P4;

P1 to P4*), or to which the determined positions (P1 to P4;

P1 to P4*) have smaller lateral distances.

4. The method according to claim 1, characterized in that a crossing of at least one of the detected lane markings (38, 40;

56, 58) is detected and is taken into account in the determination of the valid lane marking (38, 40;

56, 58).

5. The method according to claim 1, characterized in that a first degree of correspondence between the course of the first determined lane marking (38, 40) and the course of movement (52, 64) of the vehicle driving ahead (34) and a second degree of correspondence between the course of the second determined lane marking (56, 58) and the course of movement (52, 64) of the vehicle driving ahead (34) is determined, and in that the lane marking (38, 40;

56, 58) that has a higher degree of correspondence is selected as the valid lane marking.

6. The method according to claim 5, characterized in that the lane marking (38, 40;

56, 58) with the highest degree of correspondence is selected as the valid lane marking (38, 40;

56, 58) only when the degree of correspondence has a minimum degree of correspondence and/or when the difference between the first degree and the second degree exceeds a preset minimum difference.

7. The method according to claim 1, characterized in that a lane departure warning system is provided with the course of the lane marking (38, 40;

56, 58) determined as the valid lane marking or with an information on the lane marking (38, 40;

56, 58) selected as the valid lane marking, and in that the lane departure warning system processes the course of the valid lane marking (38, 40;

56, 58) as the lane marking (38, 40;

56, 58) to be followed.

8. The method according to claim 1, characterized in that in addition the position of the own vehicle (12) relative to the first lane marking (38, 40) and relative to the second lane marking (56, 58) is determined, preferably repeatedly, and in that the determined position is taken into account in the selection of the valid lane marking (38, 40;

56, 58).

9. The method according to claim 8, characterized in that the position of the own vehicle (12) relative to the first lane marking (38, 40) and relative to the second lane marking (56, 58) is determined several times, and the course of movement of the own vehicle (12) is taken into account in the selection of the valid lane marking (38, 40;

56, 58).

10. The method according to claim 9, characterized in that the course of movement (52, 64) of the own vehicle (12) is determined with the aid of the steering angle and the speed of the own vehicle (12).

11. A device for determining a valid lane marking with the aid of a camera system (16) of a vehicle (12), in particular a road vehicle,

with a camera system (16) having a camera (17) for successively taking several pictures (30, 54, 66) with images of an area in front of the vehicle (12) as a picture series and generating image data corresponding to the respective picture (30, 54, 66),

with a processing unit (22) for processing the image data of at least a part of the pictures (30, 54, 66) of the picture series, wherein the processing unit (22) detects in at least one picture (30, 54, 66) of the picture series at least two different lane markings (38, 40;

56, 58),

the processing unit (22) detects a vehicle (34) driving ahead of the vehicle (12) in at least two pictures (30, 54, 66) of the picture series and each time determines the position (P1 to P4;

P1 to P4*) of the vehicle driving ahead (34) relative to the detected first lane marking (38, 48;

56, 58) and the position of the vehicle relative to the second lane marking for each of the at least two pictures, and

wherein the processing unit (22), dependent on the determined positions (P1 to P4;

P1 to P4*) of the vehicle driving ahead (34) relative to both lane markings (38, 40;

56, 58), selects one of these detected lane markings (38, 40;

56, 58) as the valid lane marking (56, 58), the selected marking having been temporarily applied to divert traffic from a lane delimited by the first lane marking.