Method for front matching stereo vision
First Claim
Patent Images
1. A method for feature-front based stereo matching image processing utilizing a computer-based device, the method comprising:
- providing at least one left image having at least one scanline and at least one right image having at least one scanline of an object or scene, wherein each scanline has at least one extremal pixel;
optionally converting the left image and right image to grey scale images;
optionally smoothing the left and right image;
finding the extremal pixels along each scanline in each image by calculating at each pixel the product of the along-the-scanline backward and forward differences of the image intensity field,whereby a pixel is an extremal pixel when the product is less than zero or when the product is zero and either the backward or forward difference is non-zero andwherein two consecutive image intensity extrema are connected by a straight line to form an ascending or descending feature front, for the left image and for the right image, having a strength equal to the absolute difference between the feature front end intensity values,utilizing the scanlines from the left image and right image simultaneously and sorting the feature fronts in decreasing order of strengths greater than a value of zero into a list; and
calculating for each front in the sorted list, in order of strongest to weakest feature front regardless of scanline, the matching front on the other scanline within a search window satisfying the match criterion, wherein the feature front for which a match is sought is the current feature front.
1 Assignment
0 Petitions
Accused Products
Abstract
The present invention provides a method, system, and apparatus for solving the stereo vision matching problem. The invention implements a method for solving image correspondence problems so that each front region between consecutive extremal pixels in one image is matched to a corresponding front region between consecutive extremal pixels in another image.
7 Citations
31 Claims
-
1. A method for feature-front based stereo matching image processing utilizing a computer-based device, the method comprising:
-
providing at least one left image having at least one scanline and at least one right image having at least one scanline of an object or scene, wherein each scanline has at least one extremal pixel; optionally converting the left image and right image to grey scale images; optionally smoothing the left and right image; finding the extremal pixels along each scanline in each image by calculating at each pixel the product of the along-the-scanline backward and forward differences of the image intensity field, whereby a pixel is an extremal pixel when the product is less than zero or when the product is zero and either the backward or forward difference is non-zero and wherein two consecutive image intensity extrema are connected by a straight line to form an ascending or descending feature front, for the left image and for the right image, having a strength equal to the absolute difference between the feature front end intensity values, utilizing the scanlines from the left image and right image simultaneously and sorting the feature fronts in decreasing order of strengths greater than a value of zero into a list; and calculating for each front in the sorted list, in order of strongest to weakest feature front regardless of scanline, the matching front on the other scanline within a search window satisfying the match criterion, wherein the feature front for which a match is sought is the current feature front. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16)
-
-
17. An apparatus for feature-front based stereo matching image processing utilizing a computer-based device, comprising:
-
means for providing at least one left image having at least one scanline and at least one right image having at least one scanline of an object or scene, wherein each scanline has at least one extremal pixel; means for optionally converting the left image and right image to grey scale images; means for optionally smoothing the left and right image; means for finding the extremal pixels along each scanline in each image by calculating at each pixel the product of the along-the-scanline backward and forward differences of the image intensity field, whereby a pixel is an extremal pixel when the product is less than zero or when the product is zero and either the backward or forward difference is non-zero and wherein two consecutive image intensity extrema are connected by a straight line to form an ascending or descending feature front, for the left image and for the right image, having a strength equal to the absolute difference between the feature front end intensity values; means for utilizing the scanlines from the left image and right image simultaneously and sorting the feature fronts in decreasing order of strengths greater than a value of zero into a list; and means for calculating for each front in the sorted list, in order of strongest to weakest feature front regardless of scanline, the matching front on the other scanline within a search window satisfying the match criterion, wherein the feature front for which a match is sought is the current feature front. - View Dependent Claims (18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31)
-
Specification