CLEAR PATH DETECTION USING SEGMENTATION-BASED METHOD

• US 20100098297A1
• Filed: 10/19/2009
• Published: 04/22/2010
• Est. Priority Date: 04/24/2008
• Status: Active Grant

• Current Assignee: GM Global Technology Operations LLC (General Motors Company)
• Original Assignee: GM Global Technology Operations Incorporated (Motors Liquidation Co. GUC Trust)
• Inventors: Zhang, Wende
• Granted Patent: US 8,670,592 B2
• Time in Patent Office: Days
• US Class Current: 382/104
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 30/09 Taking automatic action to avoid collision, e.g. braking and steering
• CPC Class Codes: G06V 10/56 relating to colour
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: G08G 1/165 for passive traffic, e.g. including static obstacles, trees
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection

Abstract

A method for detecting a clear path of travel for a vehicle by segmenting an image generated by a camera device located upon the vehicle includes monitoring the image, analyzing the image with a plurality of analysis methods to segment a region of the image that cannot represent the clear path of travel from a region of the image that can represent the clear path of travel, defining the clear path of travel based upon the analyzing, and utilizing the clear path of travel to navigate the vehicle.

Claims

1. Method for detecting a clear path of travel for a vehicle by segmenting an image generated by a camera device located upon the vehicle, the method comprising:

monitoring the image;

analyzing the image with a plurality of analysis methods to segment a region of the image that cannot represent the clear path of travel from a region of the image that can represent the clear path of travel;

defining the clear path of travel based upon the analyzing; and

utilizing the clear path of travel to navigate the vehicle.

2. The method of claim 1, wherein analyzing the image comprises utilizing:

a motion analysis between a plurality of sequential images to identify a region of the image that cannot be the clear path;

a texture analysis of the image to identify a region of the image that cannot be the clear path;

a color analysis of the image to identify a region of the image that cannot be the clear path; and

a geometric analysis of the image to identify a region of the image that cannot be the clear path.

3. The method of claim 2, wherein the motion analysis identifying the region of the image that cannot be a clear path comprises utilizing image subtraction to identify a region of the image that is not stationary.

4. The method of claim 2, wherein the texture analysis identifying the region of the image that cannot be a clear path comprises utilizing a texture rich method to identify features in the image.

5. The method of claim 2, wherein the texture analysis identifying the region of the image that cannot be a clear path comprises utilizing a textureless method to identify properties of different regions in the image.

6. The method of claim 2, wherein the color analysis identifying the region of the image that cannot be a clear path comprises identifying a region in the image that includes a color that cannot be a road surface.

7. The method of claim 2, wherein the geometric analysis identifying the region of the image that cannot be a clear path comprises identifying a region in the image with a shape not supporting transit of the vehicle therethrough.

8. The method of claim 2, wherein the geometric analysis identifying the region of the image that cannot be a clear path comprises identifying a region in the image indicating a surface height difference not supporting transit of the vehicle thereacross.

9. The method of claim 1, wherein analyzing the image comprises:

utilizing an analysis method selected from the group consisting of

a motion analysis between a plurality of sequential images to identify a region of the image that cannot be the clear path,

a texture analysis of the image to identify a region of the image that cannot be the clear path,

a color analysis of the image to identify a region of the image that cannot be the clear path, and

a geometric analysis of the image to identify a region of the image that cannot be the clear path; and

utilizing an additional analysis method selected from the group consisting of

the motion analysis,

the texture analysis,

the color analysis,

the geometric analysis,

a radar analysis of an operating environment of the vehicle to identify a region of the image that cannot be the clear path,

a LIDAR analysis of an operating environment of the vehicle to identify a region of the image that cannot be the clear path,

a vehicle to vehicle communication describing an operating environment of the vehicle to identify a region of the image that cannot be the clear path, and

a vehicle to infrastructure communication describing an operating environment of the vehicle to identify a region of the image that cannot be the clear path.

10. The method of claim 1, wherein analyzing the image comprises:

utilizing an analysis method selected from the group consisting of

histogram thresholding segmentation,

ostu-segmentation,

region growth segmentation,

watershed method segmentation,

K-mean clustering segmentation,

ISODATA segmentation,

graph based segmentation in grid-graph space, and

graph based segmentation in feature space.

11. The method of claim 1, wherein analyzing the image comprises selecting the plurality of analysis methods based upon factors affecting the accuracy of each respective analysis method.

12. Method for detecting a clear path of travel for a vehicle by segmenting an image generated by a camera device located upon the vehicle, the method comprising:

monitoring the image;

pre-processing the image, comprising analyzing the image with a plurality of analysis methods to segment a region of the image that cannot represent the clear path of travel from a region of the image that can represent the clear path of travel;

analyzing the image through clear path detection analysis based upon the pre-processing to determine a clear path of travel within the image; and

utilizing the clear path of travel to navigate the vehicle.

13. The method of claim 12, wherein analyzing the image through clear path detection analysis comprises utilizing a patch-based analysis.

14. The method of claim 13, further comprising utilizing a patch configuration arranging patches to the image based upon the pre-processing.

15. The method of claim 12, wherein analyzing the image through clear path detection analysis comprises utilizing a pixel-based analysis.

16. The method of claim 12, wherein analyzing the image through clear path detection analysis comprises utilizing an example-based analysis.