Vehicle lane keeping techniques

• US 9,120,486 B1
• Filed: 04/22/2014
• Issued: 09/01/2015
• Est. Priority Date: 04/22/2014
• Status: Active Grant

• Current Assignee: FCA US LLC (Stellantis NV)
• Original Assignee: FCA US LLC (Stellantis NV)
• Inventors: Mallinger, Philip
• Primary Examiner(s): LANG, MICHAEL DEAN
• Application Number:
  US14/258,727
• Time in Patent Office: 497 Days
• US Class Current: 1/1
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 30/12 Lane keeping
• CPC Class Codes: B60W 30/18154 Approaching an intersection
• CPC Class Codes: B60W 30/18163 Lane change; Overtaking manoeuvres

Abstract

A computer-implemented method includes receiving, at a controller of a vehicle, the controller having one or more processors, image data of a road in front of and along which the vehicle is traveling, the road having a plurality of lane lines defining at least one lane. The method includes detecting a pair of the lane lines using the image data. The method includes determining that one of the pair of lane lines is an invalid lane line for defining a lane in which the vehicle is traveling. The method includes generating a virtual lane line based on previous image data in response to determining the invalid lane line, the virtual lane line being configured to replace the invalid lane line. The method also includes controlling lane keeping of the vehicle using the virtual lane line and the other lane line of the pair of lane lines.

Claims

1. A computer-implemented method, comprising:

receiving, at a controller of a vehicle, the controller having one or more processors, image data of a road in front of and along which the vehicle is traveling, the road having a plurality of lane lines defining at least one lane;

detecting, at the controller, a first pair of the lane lines using the image data;

using the image data, detecting, at the controller;

(i) a break in one of the first pair of lane lines, and

(ii) after detecting the broken lane line, detecting a second pair of lane lines using the image data, the second pair of lane lines including the unbroken lane line from the first pair of lane lines and another different lane line;

determining, at the controller, that one of the second pair of lane lines is an invalid lane line for defining a lane in which the vehicle is traveling;

generating, at the controller, a virtual lane line based on previous image data in response to determining the invalid lane line, the virtual lane line being configured to replace the invalid lane line in the second pair of lane lines; and

controlling, by the controller, lane keeping of the vehicle using the virtual lane line and the other lane line of the pair of lane lines.

2. The computer-implemented method of claim 1, further comprising:

receiving, at the controller, subsequent image data of the road, the subsequent image data being captured after the image data;

detecting, at the controller, a subsequent pair of the lane lines using the subsequent image data, the subsequent pair of lane lines corresponding to the first pair of lane lines;

determining, at the controller, that both of the subsequent pair of lane lines are valid lane lines for defining the lane in which the vehicle is traveling; and

controlling, by the controller, lane keeping of the vehicle using the subsequent pair of lane lines.

3. The computer-implemented method of claim 2, wherein controlling lane keeping of the vehicle further includes adjusting, by the controller, operation of a steering assist system of the vehicle to keep the vehicle traveling between two specific lane lines.

4. The computer-implemented method of claim 2, wherein determining validity of a specific pair of lane lines further includes:

determining, at the controller, a degree of parallelism between the specific pair of lane lines; and

determining, at the controller, that one of the specific pair of lane lines is invalid when the degree of parallelism is less than a predetermined threshold.

5. The computer-implemented method of claim 4, wherein the degree of parallelism is based on a similarity of curvatures of each of the specific pair of lane lines.

6. The computer-implemented method of claim 5, wherein the degree of parallelism is based on a similarity of angles between a center of the lane and each of the specific pair of lane lines.

7. The computer-implemented method of claim 2, wherein determining of a specific pair of lane lines further includes:

determining, at the controller, that one of the specific pair of lane lines is valid lane line for defining the lane in which the vehicle is traveling; and

comparing, at the controller, the other lane line of the specific pair of lane lines to the valid lane line to determine a validity of the other lane line.

8. The computer-implemented method of claim 7, wherein determining the validity of the other lane line includes comparing at least one of:

(i) a curvature of the valid lane line and the other lane line; and

(ii) an angle between the valid lane line and the other lane line.

9. The computer-implemented method of claim 2, wherein determining a validity of a specific lane line further includes:

determining, at the controller, an angle or a curvature of the specific lane line for the previous image data;

determining, at the controller, an angle or a curvature of the specific lane line for the image data; and

determining, at the controller, that the specific lane line is invalid when a change in the angles or the curvatures is greater than a predetermined threshold.

10. The computer-implemented method of claim 1, further comprising utilizing, at the controller, global positioning satellite (GPS) data to augment the detection of the pair of lane lines and the selective determination of the invalid lane line.

11. The computer-implemented method of claim 1, wherein the road is a highway or expressway and the invalid lane line is an outer lane line of (i) an entrance/on-ramp or (ii) an exit/off-ramp.

12. The computer-implemented method of claim 1, wherein the invalid lane line is an outer lane of a (i) turn lane or (ii) an intersection.

13. The computer-implemented method of claim 1, wherein the break of the broken lane line corresponds to one of (i) an on-ramp of a highway or expressway, (ii) an off-ramp of a highway or expressway, (iii) a turn lane, and (iv) an intersection.