Methods, systems and apparatuses for motion detection using auto-focus statistics

• US 8,233,094 B2
• Filed: 05/24/2007
• Issued: 07/31/2012
• Est. Priority Date: 05/24/2007
• Status: Active Grant

• Current Assignee: Aptina Imaging Corporation (ON Semiconductor Corporation)
• Original Assignee: Aptina Imaging Corporation (ON Semiconductor Corporation)
• Inventors: Subbotin, Igor, Mokhnatyuk, Alexander
• Primary Examiner(s): Dastouri, Mehrdad
• Assistant Examiner(s): RAHAMAN, MOHAMMED S
• Application Number:
  US11/802,728
• Publication Number:
  US 20080291333A1
• Time in Patent Office: 1,895 Days
• Field of Search: 348700-701
• US Class Current: 348/700
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations
• CPC Class Codes: H04N 23/6811 based on the image signal

Abstract

Methods, systems and apparatuses for the detection of motion using statistics data already available within an imager, such as sharpness scores or brightness values. The method includes obtaining at least two sets of statistics data for respective image frames which include corresponding windows; initializing a motion counter; determining, for each window, a relative difference value for the particular window; comparing the relative difference value to a first threshold. If the relative difference value is greater than the first threshold, the method increments the motion counter; and determines if there is motion by comparing the value of the motion counter to a second threshold. The motion detection may further take into account the relative importance of certain areas of the image frame.

Claims

1. A method for detecting motion using a system-on-a-chip imager comprising:

obtaining motion sensitive statistics data for at least first and second image frames, wherein each image frame comprises a plurality of corresponding windows and wherein the motion sensitive statistics data includes a sharpness score for each of the corresponding windows in each image frame;

for each window, determining a relative difference value using the sharpness scores from the first and second image frames;

determining a number of times the relative difference value is greater than a first threshold; and

determining if there is motion by comparing the number of times the relative difference value is greater than the first threshold to a second threshold, wherein the first threshold represents an amount of change in sharpness scores for a single window between image frames, wherein the second threshold represents a number of windows for which the relative difference value is greater than the first threshold, wherein the relative difference value for each window is computed as an absolute value of a difference between sharpness scores associated with that window from the first and second image frames divided by a maximum of sharpness scores associated with that window from the first and second image frames, and wherein the sharpness score for each of the corresponding windows comprises a number representing a difference between intensity values of adjacent areas in that corresponding window.

2. The method of claim 1, wherein the motion sensitive statistics data further comprises brightness values for each of the corresponding windows in each image frame.

3. A method for detecting motion using a system-on-a-chip imager comprising:

obtaining motion sensitive statistics data for at least first and second image frames, wherein each image frame comprises a plurality of corresponding windows and wherein the motion sensitive statistics data includes a sharpness score for each of the corresponding windows in each image frame;

for each window, determining a relative difference value for a particular window using the sharpness scores from the first and second image frames;

determining a motion score, wherein the motion score is a summation, for each window for which the relative difference value is greater than a first threshold, of a motion variable multiplied by a weight factor corresponding to each window; and

determining if there is motion by comparing the value of the motion score to a second threshold, wherein the first threshold represents an amount of change in sharpness scores for a single window between image frames, wherein the second threshold represents a maximum value of the motion score, wherein the relative difference value for each window is computed as an absolute value of a difference between sharpness scores associated with that window from the first and second image frames divided by a maximum of sharpness scores associated with that window from the first and second image frames, and wherein the sharpness score for each of the corresponding windows comprises a number representing a difference between intensity values of adjacent areas in that corresponding window.

4. The method of claim 3, wherein the weight factors are based on the relative importance of the particular window to which it corresponds.

5. The method of claim 3, wherein the weight factor for a window near the center of the image frame is higher than the weight factor for a window near a periphery of the image frame.

6. The method of claim 3, wherein the motion sensitive statistics data further comprises brightness values for the each of the corresponding windows in each image frame.

7. An imaging device comprising:

a pixel array, the pixel array outputting a plurality of pixel values; and

an image processing unit coupled to the pixel array, the imaging processing unit being operable to detect motion in a scene represented by the plurality of pixel values, wherein motion is detected using changes in a sharpness score and a brightness value in different image frames, wherein each image frame comprises a plurality of windows, and wherein the sharpness score and the brightness value are determined for each window of each image frame, wherein the image processing unit is further operable to;

for each window, determine a relative difference value for a particular window using the sharpness score and the brightness value from first and second image frames;

determine a number of times the relative difference value is greater than a first threshold; and

determine if there is motion by comparing the number of times the relative difference value is greater than the first threshold to a second threshold, wherein the first threshold represents an amount of change in sharpness scores for a single window between image frames, wherein the second threshold represents a number of windows for which the relative difference value is greater than the first threshold, wherein the relative difference value for each window is computed as an absolute value of a difference between sharpness scores associated with that window from the first and second image frames divided by a maximum of sharpness scores associated with that window from the first and second image frames, and wherein the sharpness score for each of the corresponding windows comprises a number representing a difference between the pixel values of adjacent pixels in the pixel array associated with that corresponding window.

8. The imaging device of claim 7, wherein the image processing unit further comprises a statistics engine and wherein the sharpness score and the brightness value are computed by the statistics engine.

9. The imaging device of claim 7, wherein motion is detected using a combination of the sharpness score and the brightness value.

10. An imaging system comprising:

a lens;

a pixel array for capturing image frames received through the lens; and

an image processing circuit which is operable to detect motion in the captured image frames, wherein the motion detection comprises;

obtaining motion sensitive statistics data for at least first and second image frames, wherein each image frame comprises a plurality of corresponding windows and wherein the motion sensitive statistics data includes a sharpness score for each of the corresponding windows in each image frame;

for each window, determining a relative difference value for a particular window using the sharpness scores from the first and second image frames;

determining a number of times the relative difference value is greater than a first threshold; and

determining if there is motion by comparing the number of times the relative difference value is greater than the first threshold to a second threshold, wherein the first threshold represents an amount of change in sharpness scores for a single window between image frames, wherein the second threshold represents a number of windows for which the relative difference value is greater than the first threshold, wherein the relative difference value for each window is computed as an absolute value of a difference between sharpness scores associated with that window from the first and second image frames divided by a maximum of sharpness scores associated with that window from the first and second image frames, and wherein the sharpness score for each of the corresponding windows comprises a number representing a difference between intensity values of adjacent areas in that corresponding window.

11. The imaging system of claim 10, wherein an additional portion of the motion sensitive statistics data comprises information from a statistics engine located in the image processing unit.

12. An imaging system comprising:

a lens;

a pixel array for capturing image frames received through the lens; and

an image processing circuit which is operable to detect motion in the captured image frames, wherein the motion detection comprises;

obtaining motion sensitive statistics data for at least first and second image frames, wherein each image frame comprises a plurality of corresponding windows and wherein the motion sensitive statistics data includes a sharpness score for each of the corresponding windows in each image frame;

for each window, determining a relative difference value for a particular window using the sharpness scores from the first and second image frames;

determining a motion score, wherein the motion score is a summation, for each window for which the relative difference value is greater than a first threshold, of a motion variable multiplied by a weight factor corresponding to each window; and

determining if there is motion by comparing the value of the motion score to a second threshold, wherein the first threshold represents an amount of change in sharpness scores for a single window between image frames, wherein the second threshold represents a maximum value of the motion score, wherein the relative difference value for each window is computed as an absolute value of a difference between sharpness scores associated with that window from the first and second image frames divided by a maximum of sharpness scores associated with that window from the first and second image frames, and wherein the sharpness score for each of the corresponding windows comprises a number representing a difference between intensity values of adjacent areas in that corresponding window.

13. The imaging system of claim 12, wherein the weight factor for a window near the center of the image frame is higher than the weight factor for a window near a periphery of the image frame.

14. The imaging system of claim 12, wherein an additional portion of the motion sensitive statistics data comprises information from a statistics engine located in the image processing unit.