IMAGE FEATURE IDENTIFICATION AND MOTION COMPENSATION APPARATUS, SYSTEMS, AND METHODS

• US 20080226192A1
• Filed: 06/06/2007
• Published: 09/18/2008
• Est. Priority Date: 03/14/2007
• Status: Active Grant

• Current Assignee: Aptina Imaging Corporation (ON Semiconductor Corporation)
• Original Assignee: Micron Technology, Inc.
• Inventors: Lin, Sheng, Li, Dong, Silverstein, Amnon
• Granted Patent: US 7,542,614 B2
• Time in Patent Office: Days
• US Class Current: 382/276
• CPC Class Codes: H04N 23/73 by influencing the exposure time

Abstract

Apparatus, systems, and methods disclosed herein may estimate the magnitude of relative motion between a scene and an image capture device used to capture the scene. Some embodiments may utilize discrete cosine transform and/or Sobel gradient techniques to identify one or more blocks of pixels in an originating calibration image frame. Matching blocks of pixels may be located in a successive calibration image frame. Motion vectors originating at one calibration frame and terminating at the other calibration frame may be calculated. The magnitude of relative motion derived thereby may be used to adjust image capture parameters associated with the image capture device, including exposure settings.

Claims

1. An apparatus, comprising:

a discrete cosine transform (DCT) coder to perform a DCT operation on a set of luminance values associated with a block of pixels selected from an image to obtain a DCT coefficient matrix; and

a feature extraction module operatively coupled to the DCT coder to perform operations on a plurality of DCT coefficients selected from low-frequency bands of the DCT coefficient matrix to derive a value of an image feature strength metric associated with the block of pixels.

2. The apparatus of claim 1, wherein the DCT operation comprises at least one of a Type I DCT operation, a Type II DCT operation, a Type III DCT operation, or a Type IV DCT operation.

3. The apparatus of claim 1, wherein the block of pixels comprises an eight-pixel by eight-pixel block.

4. The apparatus of claim 1, further comprising:

feature combination logic operatively coupled to the DCT coder to calculate a mathematical function of at least one of a horizontal component of the image feature strength metric, a vertical component of the image feature strength metric, or a diagonal component of the image feature strength metric.

5. The apparatus of claim 4, further comprising:

horizontal feature logic operatively coupled to the feature combination logic to perform a mathematical operation on DCT coefficients from a DCT coefficient sub-matrix located in a horizontal band of the DCT coefficient matrix adjacent a lowest-frequency sub-matrix of the DCT coefficient matrix to obtain the horizontal component of the image feature strength metric.

6. The apparatus of claim 4, further comprising:

vertical feature logic operatively coupled to the feature combination logic to perform a mathematical operation on DCT coefficients from a DCT coefficient sub-matrix located in a vertical band of the DCT coefficient matrix adjacent a lowest-frequency sub-matrix of the DCT coefficient matrix to obtain the vertical component of the image feature strength metric.

7. The apparatus of claim 4, further comprising:

diagonal feature logic operatively coupled to the feature combination logic to perform a mathematical operation on DCT coefficients from a DCT coefficient sub-matrix located in a diagonal band of the DCT coefficient matrix adjacent a lowest-frequency sub-matrix of the DCT coefficient matrix to obtain the diagonal component of the image feature strength metric.

8. The apparatus of claim 5, claim 6, or claim 7, wherein the mathematical operation comprises a sum.

9. A system, comprising:

an image sensor array (ISA) to detect luminance incident to a set of ISA elements and to transform the luminance to create a set of luminance values associated with a pixel representation of an image;

a discrete cosine transform (DCT) coder coupled to the ISA to perform a DCT operation on a subset of the set of luminance values to obtain a DCT coefficient matrix, wherein the subset is associated with a block of pixels selected from the image;

a feature extraction module coupled to the DCT coder to perform operations on a plurality of DCT coefficients selected from low-frequency bands of the DCT coefficient matrix to derive a value of an image feature strength metric associated with the block of pixels; and

target matching logic coupled to the feature extraction module to correlate an image feature as selected from at least one of a first image or a database to an instance of the image feature as searched for in a target image.

10. The system of claim 9, incorporated into a digital camera.

11. The system of claim 9, incorporated into a digital imaging software product.

12. The system of claim 9, incorporated into a vehicle system.

13. The system of claim 12, wherein the vehicle system comprises at least one of a navigation system or a collision avoidance system.

14. The system of claim 9, further comprising:

motion priority logic coupled to the target matching logic to estimate a magnitude of relative motion between a scene and the ISA, the relative motion occurring during a period of time between capturing a first image of the scene and capturing a second image of the scene.

15. The system of claim 14, further comprising:

motion vector logic coupled to the motion priority logic to calculate a magnitude of a motion vector associated with a first image feature block of pixels selected from the first image of the scene, the magnitude calculated as a relative distance between a location of the first image feature block of pixels and a location of a second image feature block of pixels as found in the second image of the scene, the relative distance divided by the period of time.

16. A method, comprising:

performing a discrete cosine transform (DCT) operation on a set of luminance values associated with a block of pixels selected from an image to obtain a DCT coefficient matrix; and

performing a mathematical calculation on a plurality of DCT coefficients selected from low-frequency bands of the DCT coefficient matrix to derive a value of an image feature strength metric associated with the block of pixels.

17. The method of claim 16, further comprising:

calculating a mathematical function of at least one of a horizontal image feature strength component of the DCT coefficient matrix, a vertical image feature strength component of the DCT coefficient matrix, or a diagonal image feature strength component of the DCT coefficient matrix to obtain the value of the image feature strength metric associated with the block of pixels.

18. The method of claim 17, wherein the mathematical function comprises a sum of at least two of the horizontal image feature strength component, the vertical image feature strength component, and the diagonal image feature strength component.

19. The method of claim 17, further comprising:

summing DCT coefficients from a DCT coefficient sub-matrix located in a horizontal band of the DCT coefficient matrix adjacent a lowest-frequency sub-matrix of the DCT coefficient matrix to obtain the horizontal image feature strength component.

20. The method of claim 17, further comprising:

summing DCT coefficients from a DCT coefficient sub-matrix located in a vertical band of the DCT coefficient matrix adjacent a lowest-frequency sub-matrix of the DCT coefficient matrix to obtain the vertical image feature strength component.

21. The method of claim 17, further comprising:

summing DCT coefficients from a DCT coefficient sub-matrix located in a diagonal band of the DCT coefficient matrix adjacent a lowest-frequency sub-matrix of the DCT coefficient matrix to obtain the diagonal image feature strength component.