Machine vision based obstacle avoidance system

• US 9,224,054 B2
• Filed: 02/11/2014
• Issued: 12/29/2015
• Est. Priority Date: 08/28/2009
• Status: Expired due to Fees

• Current Assignee: Indian Institute of Science
• Original Assignee: Indian Institute of Science
• Inventors: Ghose, Debasish, Kompella, Varun Raj
• Primary Examiner(s): Ustaris, Joseph
• Assistant Examiner(s): MCINNISH, KEVIN K
• Application Number:
  US14/177,493
• Publication Number:
  US 20140219507A1
• Time in Patent Office: 686 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G05D 1/0246 using a video camera in combination with image processing means
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30261 Obstacle
• CPC Class Codes: G06T 7/12 Edge-based segmentation
• CPC Class Codes: G06T 7/174 involving the use of two or more images
• CPC Class Codes: G06V 10/25 Determination of region of interest [ROI] or a volume of interest [VOI]
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads

Abstract

Machine vision based obstacle avoidance system is provided. The system utilizes a CCD camera to capture an image. A normalized image and dynamic masking is used in object detection.

Claims

1. A method to detect an obstacle in a field of view, comprising:

performing a dynamic mask (DMA) operation to detect an obstacle that includes generating a dynamic mask and comparing a dynamic mask width with a predetermined value;

alternating between performing the DMA operation to performing a histogram intensity switching (HIS) operation in response to the dynamic mask width being greater than the predetermined value;

performing the HIS operation for a predetermined number of iterations;

performing the HIS operation and the DMA operation for one additional iteration each following the performance of the HIS operation for the predetermined number of iterations;

and performing an obstacle avoidance maneuver in response to the dynamic mask width being greater than the predetermined value.

2. The method of claim 1, further comprising:

painting a ground surface a first intensity value; and

painting the obstacle a second intensity value.

3. The method of claim 2, further comprising in response to the first intensity value of the ground surface changing to the second intensity value, shifting a maximum intensity value of a histogram, generated by a mask, to a zero intensity value.

4. The method of claim 3, wherein the HIS operation includes providing an indication of an obstacle collision in response to the histogram shifting from the maximum intensity value to the zero intensity value.

5. The method of claim 2, wherein the obstacle includes a first number of pixels that are less than a second number of pixels occupied by the ground surface.

6. The method of claim 5, wherein the first intensity value of the ground surface corresponds to peak intensities of an intensity histogram using a mask.

7. The method of claim 2, wherein the first intensity value includes a maximum intensity value and the second intensity value includes a zero intensity value.

8. The method of claim 7, wherein the maximum intensity value is white and the zero intensity value is black.

9. The method of claim 1, wherein the dynamic mask width being greater than the predetermined value corresponds to an amount of colored pixels in relation to an amount of pixels representing the ground surface.

10. A mobile platform comprising:

a base structure;

a drive mechanism coupled to the base structure; and

a computing device comprising a memory and at least one processor, the at least one processor configured to;

perform a dynamic mask (DMA) operation to detect an obstacle that includes generating a dynamic mask and comparing a dynamic mask width with a predetermined value,

alternate between performing the DMA operation to performing a histogram intensity switching (HIS) operation in response to the dynamic mask width being greater than the predetermined value,

perform the HIS operation for a predetermined number of iterations,

perform the HIS operation and the DMA operation for one additional iteration each following the performance of the HIS operation for the predetermined number of iterations, and

control the drive mechanism to perform an obstacle avoidance maneuver in response to the dynamic mask width being greater than the predetermined value.

11. The mobile platform of claim 10, wherein the at least one processor is further configured to:

paint a ground surface a first intensity value; and

paint the obstacle a second intensity value.

12. The mobile platform of claim 11, wherein the at least one processor is further configured to in response to the first intensity value of the ground surface changing to the second intensity value, shift a maximum intensity value of a histogram, generated by a mask, to a zero intensity value.

13. The mobile platform of claim 12, wherein the HIS operation includes providing an indication of an obstacle collision in response to the histogram shifting from the maximum intensity value to the zero intensity value.

14. The mobile platform of claim 11, wherein the obstacle includes a first number of pixels that are less than a second number of pixels occupied by the ground surface.

15. The mobile platform of claim 14, wherein the first intensity value of the ground surface corresponds to peak intensities of an intensity histogram using a mask.

16. The mobile platform of claim 11, wherein the first intensity value includes a maximum intensity value and the second intensity value includes a zero intensity value.

17. The mobile platform of claim 16, wherein the maximum intensity value is white and the zero intensity value is black.

18. The mobile platform of claim 10, wherein the dynamic mask width being greater than the predetermined value corresponds to an amount of colored pixels in relation to an amount of pixels representing the ground surface.

19. The mobile platform of claim 18, wherein the amount of colored pixels is greater than the amount of pixels representing the ground surface.

20. A non-transitory computer-readable medium storing executable instructions that, in response to being executed, cause a computer to perform operations comprising:

performing a dynamic mask (DMA) operation to detect an obstacle that includes generating a dynamic mask and comparing a dynamic mask width with a predetermined value;

alternating between performing the DMA operation to performing a histogram intensity switching (HIS) operation in response to the dynamic mask width being greater than the predetermined value;

performing the HIS operation for a predetermined number of iterations;

performing the HIS operation and the DMA operation for one additional iteration each following the performance of the HIS operation for the predetermined number of iterations; and

performing an obstacle avoidance maneuver in response to the dynamic mask width being greater than the predetermined value.