UNIFIED FRACTIONAL SEARCH AND MOTION COMPENSATION ARCHITECTURE ACROSS MULTIPLE VIDEO STANDARDS

• US 20130301742A1
• Filed: 03/28/2013
• Published: 11/14/2013
• Est. Priority Date: 05/14/2012
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Huang, Ling Feng, Mohan, Sumit, Cheung, Stephen
• Granted Patent: US 9,277,222 B2
• Time in Patent Office: Days
• US Class Current: 375/240.29
• CPC Class Codes: H04N 19/43 Hardware specially adapted for motion estimation or compensation
• CPC Class Codes: H04N 19/433 characterised by techniques for memory access
• CPC Class Codes: H04N 19/439 using cascaded computational arrangements for performing a single operation, e.g. filtering
• CPC Class Codes: H04N 19/523 with sub-pixel accuracy
• CPC Class Codes: H04N 19/59 involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
• CPC Class Codes: H04N 19/80 Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation H04N19/635, H04N19/86 take precedence

Abstract

Methods and systems for performing at least one of video encoding and video decoding are disclosed. In one implementation, the system includes a controller configured to determine a video standard associated with a portion of the video data, each portion of the video data associated with one of a plurality of video standards. The controller is further configured to provide a set of the filter parameters which are associated with a video standard to be used for at least one of the video encoding and decoding and at least one filter configured to filter at least one reference pixel received from the reference pixel memory based, at least in part, on the provided set of filter parameters.

Claims

1. A system for processing video data, the system comprising:

a controller configured to;

determine a video standard associated with a portion of the video data, each portion of the video data associated with one of a plurality of video standards;

provide a set of filter parameters for the portion of the video data based on the determined video standard; and

at least one filter configured to filter at least one reference pixel included in the portion of the video data based, at least in part, on the provided set of filter parameters.

2. The system of claim 1, wherein processing the video data comprises at least one of encoding the video data and decoding the video data.

3. The system of claim 2, wherein the controller is configured to determine the video standard based, at least in part, on video standard identification information contained in a fractional search engine (FSE) software register.

4. The system of claim 1, further comprising a filter parameter engine configured to obtain the at least one set of the filter parameters, wherein the controller is configured to activate the filter parameter engine to provide the retrieved filter parameters to the at least one filter.

5. The system of claim 4, wherein the filter parameter engine includes a filter parameter memory storing a plurality of sets of filter parameters each associated with at least one of the plurality of video standards.

6. The system of claim 4, wherein the controller includes a filter parameter memory and the filter parameter engine, the filter parameter memory storing a plurality of sets of filter parameters each associated with at least one of the plurality of video standards.

7. The system of claim 4, further comprising:

a reference pixel memory storing the reference pixels; and

a reference pixel fetcher configured to;

fetch at least one reference pixel from the reference pixel memory; and

provide the fetched pixel to the at least one filter.

8. The system of claim 7, wherein the controller is configured to control the reference fetcher and the filter parameter engine such that the reference pixel fetching and filter parameter providing are substantially simultaneously performed.

9. The system of claim 1, wherein the at least one filter comprises:

a first filter configured to filter the at least one reference pixel based on at least one of the provided filter parameters; and

a second filter configured to filter the output of the first filter based on at least one of the provided filter parameters.

10. The system of claim 9, wherein filtering the at least one reference pixel comprises:

horizontally filtering, via the first filter, the at least one reference pixel; and

vertically filtering, via the second filter, the output of the first filter.

11. The system of claim 10, wherein the video standard comprises one of VP6, VP8, HEVC, H.264 Chroma and MPEG4-SP.

12. The system of claim 9, wherein filtering the at least one reference pixel comprises:

vertically filtering, via the first filter, the at least one reference pixel; and

horizontally filtering, via the second filter, the output of the first filter.

13. The system of claim 12, wherein the video standard comprises VC1.

14. The system of claim 9, further comprising:

a half pixel buffer configured to buffer the output of the second filter; and

a third filter configured to filter the output of the half pixel buffer.

15. The system of claim 14, wherein filtering the at least one reference pixel comprises:

horizontally and vertically filtering, via the first filter, the at least one reference pixel;

vertically filtering, via the second filter, the output of the first filter and wherein the third filter is configured to bilinear filter the output of the half pixel buffer.

16. The system of claim 15, wherein the video standard comprises one of H.264 Luma and MPEG-ASP.

17. The system of claim 14, wherein at least one of the first filter and the second comprises:

a first half filter configured to filter a plurality of first reference pixels based on a first set of filter coefficients received from the filter parameter memory, wherein the number of the first reference pixels are the same as the number of the first filter coefficients; and

a second half filter configured to filter a plurality of second reference pixels based on a second set of filter coefficients received from the filter parameter memory, wherein the number of the second reference pixels are the same as the number of the second filter coefficients.

18. The system of claim 17, further comprising:

a first adder configured to add the outputs of the first and second half filters;

a second adder configured to;

obtain a plurality of rounding parameters from the filter parameter memory; and

sum the output of the first adder and the rounding parameters;

a shifter configured to;

obtain a plurality of shift parameters from the filter parameter memory; and

shift the output of the second adder based on the shift parameters; and

a clipper configured to clip the output of the shifter to a specified range.

19. The system of claim 17, wherein at least one of the first and second half filters comprises:

a logic gate configured to perform a logic operation on a first reference pixel based, at least in part, on a first filter coefficient;

a shift adder configured to perform a shift-adding function on a second reference pixel based, at least in part, on a second filter coefficient;

a first adder configured to add the outputs of the logic gate and the shift adder;

a first multiplier configured to multiply a third reference pixel and a third filter coefficient;

a second adder configured to add the outputs of the first adder and the first multiplier; and

a second multiplier configured to multiply a fourth reference pixel and a fourth filter coefficient; and

a third adder configured to add the outputs of the second adder and the second multiplier.

20. The system of claim 1, further comprising a filter parameter memory storing a table including the plurality of sets of filter parameters assigned to each of the plurality of video standards, respectively.

21. The system of claim 20, wherein the filter parameter memory is configured to add thereon additional sets of filter parameters associated with additional video standards, respectively.

22. The system of claim 1, wherein the plurality of video standards comprise H.264, MPEG4-SP, MPEG4-ASP, VC1, VP6, VP8, and HEVC.

23. The system of claim 1, wherein the filter parameters comprise at least one of filter coefficients, rounding, and shift parameters.

24. The system of claim 23, wherein the filter parameters of a first video standard of the plurality of video standards are different from those of other video standards of the plurality of video standards.

25. A method of processing video data, the method comprising:

detecting a video standard associated with a portion of the video data, each portion of the video data associated with one of a plurality of video standards;

providing a set of filter parameters for the portion of the video data based on the detected video standard; and

filtering at least one reference pixel of the portion of the video data based, at least in part, on the provided set of filter parameters.

26. The method of claim 25, wherein processing the video data comprises at least one of encoding the video data and decoding the video data.

27. The method of claim 25, wherein the video standard is determined based on video standard identification information.

28. The method of claim 25, further comprising fetching at least one reference pixel from the stored reference pixels, wherein the fetching and providing are substantially simultaneously performed.

29. The method of claim 25, wherein the filtering comprises:

first filtering the at least one reference pixel based on at least one of the provided filter parameters; and

second filtering the first filtered pixel based on at least one of the provided filter parameters.

30. The method of claim 25, further comprising:

horizontally filtering the at least one reference pixel; and

subsequently vertically filtering the first filtered pixel,

wherein the video standard comprises one of VP6, VP8, HEVC, H.264 Chroma, and MPEG4-SP.

31. The method of claim 25, further comprising:

vertically filtering the at least one reference pixel; and

subsequently horizontally filtering the first filtered pixel,

wherein the video standard comprises VC1.

32. The method of claim 25, further comprising:

buffering the second filtered pixel; and

third filtering the buffered pixel based on at least one of the provided filter parameters.

33. The method of claim 32, further comprising:

horizontally filtering the at least one reference pixel;

first vertical filtering the horizontally filtered at least one reference pixel;

second vertical filtering the first vertical filtered at least one reference pixel; and

bilinear filtering the second vertical filtered at least one reference pixel,

wherein the video standard comprises one of H.264 Luma and MPEG-ASP.

34. The method of claim 25, further comprising:

storing reference pixels included in the video data; and

storing a plurality of sets of filter parameters associated with a plurality of video standards, respectively.

35. The method of claim 25, further comprising:

receiving additional sets of filter parameters associated with additional video standards; and

storing the received additional sets of filter parameters.

36. The method of claim 25, wherein the video standards comprise H.264, MPEG4-SP, MPEG4-ASP, VC1, VP6, VP8, and HEVC.

37. The method of claim 25, wherein the filter parameters comprise at least one of:

filter coefficients, rounding and shift parameters, and wherein the filter parameters of one video standard of the plurality of video standards are different from those of other video standards of the plurality of video standards.

38. A non-transitory computer readable medium storing a processor-readable code, the processor-readable code for programming one or more processors to perform a method of processing video data, the method comprising:

detecting a video standard associated with a portion of the video data, each portion of the video data associated with one of a plurality of video standards;

providing a set of filter parameters for the portion of the video data based on the detected video standard; and

filtering at least one reference pixel of the portion of the video data based, at least in part, on the provided set of filter parameters.

39. The medium of claim 38, wherein the video standard is determined based on video standard identification information.

40. The medium of claim 38, wherein the method further comprises:

receiving additional sets of filter parameters associated with additional video standards; and

storing the received additional sets of filter parameters.

41. The medium of claim 38, wherein the filter parameters comprise at least one of:

filter coefficients, rounding and shift parameters, and wherein the filter parameters of one video standard of the plurality of video standards are different from those of other video standards of the plurality of video standards.

42. A system for processing video data, the system comprising:

means for detecting a video standard associated with a portion of the video data, each portion of the video data associated with one of a plurality of video standards;

means for providing a set of filter parameters for the portion of the video data based on the detected video standard; and

means for filtering at least one reference pixel of the portion of the video data based, at least in part, on the provided set of filter parameters.