VIDEO CODING WITH MOTION VECTORS DETERMINED BY DECODER

• US 20080205505A1
• Filed: 02/22/2007
• Published: 08/28/2008
• Est. Priority Date: 02/22/2007
• Status: Abandoned Application

• Current Assignee: Intellectual Ventures Holding 35 LLC (Intellectual Ventures LLC)
• Original Assignee: Intellectual Ventures Holding 35 LLC (Intellectual Ventures LLC)
• Inventors: Monro, Donald Martin
• Application Number:
  US11/678,004
• Publication Number:
  US 20080205505A1
• Time in Patent Office: Days
• US Class Current: 375/240
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation
• CPC Class Codes: H04N 19/513 Processing of motion vectors
• CPC Class Codes: H04N 19/517 by encoding

Abstract

A method, system, and apparatus for video coding in regards to motion data, particularly with vectors determined by a decoder are disclosed. A method of video decoding where part of a reference image frame is compared with a portion of the image frame to be compensated and the comparison allows for determination of a motion vector. An encoder which provides to a decoder in the form of a data bitstream, a portion of an image frame, allowing the decoder to determine a motion. A decoder which be determining motion vectors produces at least some of an image frame. A system for video coding having both an encoder and a decoder.

Claims

1. A method of decoding, comprising:

receiving at least part of a reference image frame;

receiving at least a portion of another image frame; and

determining a motion vector through comparing the portion of the another image frame and the part of the reference image frame.

2. The method of claim 1, wherein the determining step a motion vector further comprises:

determining the motion vector in response to additional information associated with the portion.

3. The method of claim 1, wherein the determining step further comprises:

determining the motion vector in response to previously determined ones of the motion vectors.

4. The method of claim 1, wherein the comparing step comprises:

separately combining the portion with the part to produce a plurality of combined portions; and

filtering the plurality of combined portions to produce a plurality of filtered values.

5. The method of claim 4, wherein filtering the plurality of combined portions comprises applying at least one of an edge filter, a variance filter, or a higher order statistical filter to the plurality of combined portions.

6. The method of claim 5, wherein the edge filter comprises a Sobel filter.

7. The method of claim 4, further comprising:

determining a region of the reference image frame associated with a respective one of the filtered values having a lowest variance.

8. The method of claim 7, further comprising:

determining a displacement value between the portion and the region associated with the filtered value having the lowest variance.

9. The method of claim 1, wherein the determining step comprises determining the motion vector'"'"'s confidence value.

10. The method of claim 1, wherein said another image frame comprises a Displaced Frame Difference (DFD) frame.

55. The method of claim 1, wherein comparing the portion and the part further comprises:

filtering the portion to produce a filtered portion value.

56. The method of claim 1, wherein comparing the portion and the part further comprises:

filtering the part to produce region values.

57. The method of claim 55, wherein comparing the portion and the part further comprises:

filtering the part of the reference image frame to produce filtered region values.

58. The method of claim 57, wherein comparing the portion and the part further comprises:

separately combining the filtered portion value with the filtered region values to produce a plurality of combined values.

11. (canceled)

12. An apparatus, comprising:

a decoder adapted to receive an image frame portion and to determine a motion vector by comparing the image frame portion and a plurality of reference frame portions.

13. The apparatus of claim 12, wherein the decoder is further adapted to determine the motion vector in response to additional information received from an encoder.

14. The apparatus of claim 12, wherein the decoder is further adapted to compare the image frame portion and the plurality of reference frame portions by:

adding the image frame portion to the plurality of reference frame portions to generate a plurality of combined frame portions; and

filtering the plurality of combined frame portions.

15. The apparatus of claim 14, wherein the filtering of the plurality of combined frame portions comprises applying at least one of an edge filter, a variance filter, or a higher order statistical filter to the plurality of combined frame portions.

16. The apparatus of claim 14, wherein the edge filter comprises a Sobel filter.

17. The apparatus of claim 12, wherein the decoder is further adapted to determine the motion vector in response to previously determined ones of the motion vectors.

18. The apparatus of claim 12, wherein the image frame comprises a DFD frame.

60. The apparatus of claim 12, wherein the decoder is further adapted to compare the image frame portion and the plurality of reference frame portions by filtering the image frame portion to a produce a filtered portion value.

61. The apparatus of claim 12, wherein the decoder is further adapted to compare the image frame portion and the plurality of reference frame portions by filtering regions of the reference frame to produce filtered region values.

62. The apparatus of claim 60, wherein the decoder is further adapted to compare the image frame portion and the plurality of reference frame portions by filtering regions of the reference frame to produce filtered region values.

63. The apparatus of claim 62, wherein the decoder is further adapted to compare the image frame portion and the plurality of reference frame portions by separately combining the filtered portion value with the filtered region values to produce a plurality of combined values.

64. The apparatus of claim 63, wherein the decoder is further adapted to compare the image frame portion and the plurality of reference frame portions by filtering the plurality of combined values.

19. (canceled)

20. An apparatus, comprising:

an encoder adapted to;

produce a bitstream including at least a portion of an image frame; and

provide information to a decoder, wherein the decoder is configured to predict a motion vector using the portion of the image frame.

21. The apparatus of claim 20, wherein the encoder is further adapted to provide information to a decoder, wherein the decoder is configured to predict the motion vector in response to other motion vectors.

22. The apparatus of claim 20, wherein the image frame comprises a DFD frame.

23. A method, comprising:

transmitting information from an encoder to a decoder, the information comprising codes indicative of a portion of an image frame, the information causing the decoder to estimate a motion vector using the portion of the image frame.

24. The method of claim 23, the information further causing the decoder to estimate the motion vector in response to other motion vectors.

25. The method of claim 23, wherein the image frame comprises a DFD frame.

26. The method of claim 23, wherein the information includes codes indicative of other motion vectors.

27. A system, comprising:

an encoder adapted to provide a bitstream including codes indicative of a portion of an image frame; and

a decoder communicatively coupled to the encoder, the decoder adapted to decode the bitstream and to determine estimate a motion vector using the portion of the image frame.

28. The system of claim 27, wherein the decoder is coupled to the encoder via at least one of a wireless interconnect, a local area network, and an Internet.

29. The system of claim 27, wherein the decoder is adapted to determine the motion vector by comparing the portion of the image frame and portions of a reference frame.

30. The system of claim 27, wherein the image frame comprises a DFD frame.

31. The system of claim 27, wherein the decoder is further adapted to determine the motion vector in response to additional information associated with the portion of the image frame received from the encoder.

32. A tangible computer readable storage medium having computer program code recorded thereon that when executed by a processor produces desired results, the computer readable storage medium comprising:

computer program code that enables the processor to receive at least part of a reference image frame at the decoder;

computer program code that enables the processor to receive a portion of another image frame at the decoder; and

computer program code that enables the processor to determine estimating a motion vector through comparing the portion of another image frame and the part of the reference image frame.

33. The tangible computer readable storage medium of claim 32, wherein said computer program code further comprising:

computer program code that enables the processor to determine estimating the motion vector in response to additional information associated with the portion.

34. The tangible computer readable storage medium of claim 32, wherein said computer program code for estimating the motion vector further comprising:

computer program code that enables the processor to determine estimating the motion vector through previously determined ones of the motion vectors.

35. The tangible computer readable storage medium of claim 32, wherein said computer program code for comparing the portion and the pad further comprising:

computer program code that enables the processor to separately combine the portion with one or more of the parts to produce a plurality of combined portions; and

computer program code that enables the processor to filter the plurality of combined portions to produce a plurality of filtered values.

36. The tangible computer readable storage medium of claim 35, wherein said computer program code for filtering the combined portions further comprising:

computer program code that enables the processor to apply applying at least one of an edge filter, a variance filter, and a higher order statistical filter to the plurality of combined portions.

37. The tangible computer readable storage medium of claim 36, wherein the edge filter comprises a Sobel filter.

38. The tangible computer readable storage medium of claim 35, wherein said computer program code further comprising:

computer program code that enables the processor to determine a region of the reference image frame associated with a respective one of the filtered values having a lowest variance.

39. The tangible computer readable storage medium of claim 38, wherein said computer program code further comprising:

computer program code that enables the processor to determine a displacement value between the portion and the region associated with the filtered value having the lowest variance.

40. The tangible computer readable storage medium of claim 32, wherein said computer program code for determining the motion vector further comprising:

computer program code that enables the processor to determine the motion vector'"'"'s confidence value.

42. The tangible computer readable storage medium of claim 32, wherein said another image frame comprises a DFD frame.

65. The tangible computer readable storage medium of claim 32, wherein said computer program code for comparing the portion and the part farther comprises:

computer program code that enables the processor to filter the portion to produce a filtered portion value.

66. The tangible computer readable storage medium of claim 32, wherein said computer program code for comparing the portion and the part comprises:

computer program code that enables the processor to filter the part to produce filtered region values.

67. The tangible computer readable storage medium of claim 65, wherein said computer program code for comparing the portion and the part further comprises:

computer program code that enables the processor to filter the part to produce filtered region values.

68. The tangible computer readable storage medium of claim 67, wherein said computer program code for comparing the portion and the part further comprises:

computer program code that enables the processor to separately combine the filtered portion value with the filtered region values to produce a plurality of combined values.

69. The tangible computer readable storage medium of claim 68, wherein said computer program code for comparing the portion and the part further comprises:

computer program code that enables the processor to filter the plurality of combined values.

41. (canceled)

43. A tangible computer readable storage medium having computer program code recorded thereon that when executed by a processor produces desired results, the computer readable storage medium comprising:

computer program code that enables the processor to transmit information from an encoder to a video decoder, the information including codes indicative of a portion of an image frame, the information causing the decoder to determine a motion vector using the portion of the image frame.

44. The tangible computer readable storage medium of claim 43, the information further causing the decoder to estimate determine the motion vector in response to other motion vectors.

45. The tangible computer readable storage medium of claim 43, wherein the image frame comprises a DFD frame.

46. The tangible computer readable storage medium of claim 43, wherein the information includes codes indicative of other motion vectors.

47. A system, comprising a decoder configured to produce at least some portions of an image frame by determining motion vectors.

48. The system of claim 47, wherein the decoder is configured to determine motion vectors though information received from an encoder.

49. The system of claim 48, wherein the information is provided to the decoder in a bitstream that also conveys motion vectors.

50. The system of claim 49, wherein the decoder is further configured to use the motion vectors conveyed in the bitstream to produce at least other portions of the image frame.

51. The system of claim 48, wherein the information causes the decoder to motion vectors.

52. The system of claim 48, wherein the information also causes the decoder to produce other portions of the image frame through at least one of previously determined motion vectors and previously conveyed motion vectors.

53. The system of claim 47, wherein the decoder is configured to determine motion vectors by applying statistical filters.

54. The system of claim 47, wherein the decoder is configured to determine motion vectors by comparing portions of an error image frame and portions of a reference image frame.

59. The method of claim 53, wherein comparing the portion and the part further comprises:

filtering the plurality of combined values.