Method and device for parallel processing of images

• US 9,020,297 B2
• Filed: 12/15/2011
• Issued: 04/28/2015
• Est. Priority Date: 12/17/2010
• Status: Active Grant

• Current Assignee: Ivisys Sweden AB
• Original Assignee: Ivisys APS
• Inventors: Chehaiber, Moatasem
• Primary Examiner(s): Patel, Jayesh A
• Assistant Examiner(s): TRAN, MAI H
• Application Number:
  US13/990,284
• Publication Number:
  US 20130251265A1
• Time in Patent Office: 1,230 Days
• Field of Search: None
• US Class Current: 382/279
• CPC Class Codes: G06T 2207/20016 Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform
• CPC Class Codes: G06T 2207/20224 Image subtraction
• CPC Class Codes: G06T 5/20 using local operators
• CPC Class Codes: G06T 5/70 Denoising; Smoothing
• CPC Class Codes: G06V 10/462 Salient features, e.g. scale invariant feature transforms [SIFT]
• CPC Class Codes: G06V 10/94 Hardware or software architectures specially adapted for image or video understanding

Abstract

The present invention relates to the parallel calculation of convoluted data. In particular, the invention relates to Gaussian pyramid construction and parallel processing of image data, such as parallel calculation of repeatedly convoluted data for use in a SIFT algorithm. This is achieved by providing a method for obtaining a plurality of difference images from an original image defined by a plurality of pixels, said method comprising: Providing a plurality of blurring convolution functions, each of said blurring functions providing increasing degree of blurring of an original image upon convolution of said original image; establishing a plurality of difference convolution functions, Dif, by calculating the difference between two of said blurring convolution functions, each of said two blurring convolution functions providing different degrees of blurring of an original image upon convolution of said original image; and calculating a plurality of difference images from said original image, by convolving each of said difference convolution functions, Dif, with said original image to obtain difference images.

Claims

1. A method configured for parallel computation for obtaining a first plurality of difference images and a number, n, of subsequent plurality of difference images, said method comprising:

a. Obtaining a first plurality of difference images from an original image defined by a plurality of pixels, the first plurality of difference images obtained by;

i. Providing a plurality of blurring convolution functions, each of said blurring functions providing increasing degree of blurring of said original image upon convolution of said original image;

ii. Establishing a plurality of difference convolution functions, Dif, by calculating a difference between any two of said blurring convolution functions, each of said two blurring convolution functions providing different degrees of blurring of said original image upon convolution of said original image; and

iii. Calculating a plurality of difference images from said original image, by convolving each of said difference convolution functions, Dif, with said original image to obtain difference images,

b. Obtaining a first down sampling anti-aliasing convolution function, DAcon(l), by convolving said plurality of blurring functions with a down sampling function and an anti-aliasing function;

c. When n is larger than 1, obtaining additional down sampling anti-aliasing convolution function(s), DAcon(t), by convolving the previous down sampling antialiasing convolution function, DAcon(t-l), with said plurality of blurring functions, a down sampling function and an anti-aliasing function, beginning this step c with t =2, and repeating this step while increasing t with unitary increments until t reaches n;

d. Convolving all of the down sampling anti-aliasing convolution functions, DAcon, with said original image to obtain an image(x) for each down sampling antialiasing convolution function DAcon(x);

e. Obtaining the n subsequent pluralities of difference images, obtaining each plurality(x) from each image(x),

wherein said blurring convolution functions are Gaussian.

2. The method according to claim 1, for use in a method of identifying scale invariant features in said original image.

3. The method according to claim 1, wherein said plurality of difference blurring convolution functions are established once and repeatedly used for subsequent calculation of said difference images.

4. The method according to claim 1, wherein said difference convolution function, Dif, is approximated by a polynomial.

5. The method according to claim 2, wherein the method of identifying scale invariant features in said original image, wherein the identified image features are stable across different scales in an image defined by a plurality of pixels, wherein multiple filtering steps and re-sampling steps may be performed in parallel, the method comprising:

a. Obtaining said multiple difference images;

b. Locating pixel amplitude extrema in said multiple difference images;

c. Producing a pixel gradient vector for each pixel in each difference image;

d. Associating vector orientations with respective actual maximal and minimal amplitude pixels associated with each difference image.

10. A computer program product comprising program code means stored on a non-transitory computer readable medium for performing the method of claim 1 when said program product is run on a computer.

6. An image processing device configured for parallel computation for obtaining a plurality of difference images from an original image defined by a plurality of pixels, said device comprising means for receiving data in respect of said first image, means for transmitting or storing said difference images, and

a processor circuit, configured to:

a. Obtain said a first plurality of difference images from said original, the first plurality of difference images obtained by;

i. Provide a plurality of blurring convolution functions, each of said blurring functions providing increasing degree of blurring of said original image upon convolution of said original image;

ii. Establish a plurality of difference convolution functions, Dif, by calculating a difference between any two of said blurring convolution functions, each of said two blurring convolution functions providing different degrees of blurring of said original image upon convolution of said original image; and

iii. Calculate a plurality of difference images from said original image, by convolving each of said difference convolution functions, Dif, with said original image to obtain difference images;

b. Obtain a first down sampling anti-aliasing convolution function, DAcon(l), by convolving said plurality of blurring functions with a down sampling function and an anti-aliasing function;

c. When n is larger than 1, obtaining additional down sampling anti-aliasing convolution function(s), DAcon(t), by convolving the previous down sampling antialiasing convolution function, DAcon(t-l), with said plurality of blurring functions, a down sampling function and an anti-aliasing function, beginning this step c with t =2, and repeating this step while increasing t with unitary increments until t reaches n;

d. Convolve all of the down sampling anti-aliasing convolution functions, DAcon, with said original image to obtain an image(x) for each down sampling antialiasing convolution function DAcon(x);

e. Obtain the n subsequent pluralities of difference images, obtaining each plurality(x) from each image(x), wherein said blurring convolution functions are Gaussian.

7. The image processing device according to claim 6, wherein said processor circuit comprises a chip, such as a CPU.

8. The image processing device according to claim 6, said image processing device comprising multiple chips, each chip configured to calculate at least one difference image.

9. The image processing device according to claim 6, wherein said image processing device comprises a bilinear interpolator, said bilinear interpolator comprising a multiply and accumulate unit (MAC), a delay line adder and a control logic block.