Method of video encoding using windows and system thereof

• US 7,408,989 B2
• Filed: 01/16/2003
• Issued: 08/05/2008
• Est. Priority Date: 01/16/2003
• Status: Active Grant

• Current Assignee: VIXS Systems Incorporated (Pixelworks Incorporated)
• Original Assignee: VIX5 Systems Incorporated
• Inventors: Rault, Patrick, Zeng, Zhihua
• Primary Examiner(s): AN, SHAWN S
• Application Number:
  US10/345,847
• Publication Number:
  US 20040141556A1
• Time in Patent Office: 2,028 Days
• Field of Search: 375/240.16, 375/240.12, 375/240.15, 375/240.14, 348/699, 348/700, 382/236, 382/238, 382/232, 382/239
• US Class Current: 375/240.16
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51

Abstract

A first search window within a reference frame of video data is identified along with a first correlation threshold value for the first window. The first correlation threshold value is a value to which correlation factors between a pixel set being encoded and pixels sets of the first search window are compared. For example, if a correlation factor between a specific pixel set of the first search window and a pixel set being encoded meets the first threshold value, a successful match between the two pixel sets has been found, and a corresponding motion vector can be assigned to the pixel set being encoded. If none of the pixel sets within the first window meet the first threshold value, a second search window within the first frame is selected along with a second correlation threshold value. The correlation factors for pixel sets in the second window are compared to the second correlation threshold value.

Claims

1. A method of processing a video signal, the method comprising:

selecting a first search window of a first frame of video data, the first search window having a first window size;

determining a first correlation factor between a first set of pixels within the first search window with respect to a second set of pixels in a second frame of video data;

comparing the first correlation factor to a first threshold value;

selecting a second search window of the first frame, the second search window having a second window size, the second window size greater than the first window size;

determining a second correlation factor between a third set of pixels within the second search window with respect to the second set of pixels;

comparing the second correlation factor to a second threshold value, the second threshold value being different than the first threshold value;

selecting a third search window of the first frame, the third search window having a third window size, the third window size greater than the second window size;

determining a third correlation factor between a fourth set of pixels within the third search window with respect to the second set of pixels; and

comparing the third correlation factor to a third threshold having a third correlation threshold value, the third correlation threshold value being different than the second correlation threshold value and different than the first correlation threshold value.

2. The method of claim 1, wherein selecting the second search window comprises the first set of pixels being within the second search window.

3. The method of claim 1, further comprising determining a motion vector based on at least one of the pixels within at least one of the third set of pixels and fourth set of pixels.

4. The method of claim 1, further comprising:

saving the first correlation factor; and

comparing the first correlation factor to the second threshold value.

5. The method of claim 4, wherein comparing the first correlation factor to the second threshold value occurs before comparing the second correlation factor to the second threshold value.

6. The method of claim 1, wherein determining the first correlation factor comprises determining the first correlation factor based on a first correlation technique and determining the second correlation factor comprises determining the second correlation factor based on a second correlation technique different than the first correlation technique.

7. The method of claim 1, wherein determining the first correlation factor comprises determining the first correlation factor based on a first correlation technique, determining the second correlation factor comprises determining the second correlation factor based on the first correlation technique.

8. The method of claim 1 further comprising:

when the fourth set of pixels has a best correlation factor of sets of pixels in the third search window, identifying the fourth set of pixels as a set of pixels with the best correlation factor in the third window.

9. A method of determining a motion vector for a pixel set being encoded comprising:

selecting a first search window of a first frame of video data, the first search window having a first window size;

determining if any pixel set associated with the first search window meets a first correlation requirement with respect to the pixel set being encoded;

determining a motion vector for the pixel set being encoded when any pixel set associated the first search window meets the first correlation requirement; and

when no pixel set associated the first search window meets the first correlation requirement;

selecting a second search window of the first frame of video data, the second search window having a second window size larger than the first window size;

determining if any pixel set associated with the first search window meets a second correlation requirement with respect to the pixel set being encoded, the second correlation requirement being different than the first correlation requirement; and

determining a motion vector for the pixel set being encoded when any pixel set associated the second search window meets the second correlation requirement.

10. The method of claim 9, wherein the second correlation requirement is less stringent than the first correlation requirement.

11. A method comprising:

selecting a first search window having a first window size for a first frame of video data;

determining a first correlation factor between a first set of pixels within the first search window with respect to a second set of pixels in a second frame of video data;

in response to determining that the first correlation factor does not meet a first threshold;

selecting a second search window having a second window size greater than the first window size for the first frame; and

determining a second correlation factor between a third set of pixels within the second search window with respect to the second set of pixels.

12. The method of claim 11, further comprising:

determining a motion vector for the second set of pixels based on the third set of pixels in response to determining that the second correlation factor meets a second threshold.

13. The method of claim 11, further comprising:

in response to determining that the second correlation factor does not meet a second threshold;

selecting a third search window having a third window size greater than the second window size for the first frame; and

determining a third correlation factor between a fourth set of pixels within the second search window with respect to the second set of pixels.

14. The method of claim 13, further comprising:

determining a motion vector for the second set of pixels based on the fourth set of pixels in response to determining that the third correlation factor meets a second threshold.

15. The method of claim 11, wherein determining the first correlation factor comprises determining the first correlation factor based on a first correlation technique wherein determining the second correlation factor comprises determining the second correlation factor based on a second correlation technique different than the first correlation technique.

16. A system comprising:

a video data processing element;

a memory coupled to the video data processing element, the memory comprising;

a video data storage region to store a first frame of video data and a second frame of video data; and

a program storage region to store program instructions, the program instructions to manipulate the video data processing element to;

select a first search window having a first window size for the first frame;

determine a first correlation factor between a first set of pixels within the first search window with respect to a second set of pixels in the second frame; and

in response to determining that the first correlation factor does not meet a first threshold;

select a second search window having a second window size greater than the first window size for the first frame; and

determine a second correlation factor between a third set of pixels within the second search window with respect to the second set of pixels.

17. The system of claim 16, wherein the program instructions are to manipulate the video data processing element to:

determine a motion vector for the second set of pixels based on the third set of pixels in response to determining that the second correlation factor meets a second threshold.

18. The system of claim 16, wherein the program instructions are to manipulate the video data processing element to:

in response to determining that the second correlation factor does not meet a second threshold;

select a third search window having a third window size greater than the second window size for the first frame; and

determine a third correlation factor between a fourth set of pixels within the second search window with respect to the second set of pixels.

19. The system of claim 18, wherein the program instructions are to manipulate the video data processing element to:

determine a motion vector for the second set of pixels based on the fourth set of pixels in response to determining that the third correlation factor meets a second threshold.

20. The system of claim 16, wherein:

the program instructions to manipulate the video data processing element to determine the first correlation factor comprise program instruction to manipulate the video data processing element to determine the first correlation factor based on a first correlation technique; and

the program instructions to manipulate the video data processing element to determine the second correlation factor comprise program instruction to manipulate the video data processing element to determine the second correlation factor based on a second correlation technique different than the first correlation technique.