Data coding and decoding with replicated matching pursuits

• US 7,813,573 B2
• Filed: 09/08/2005
• Issued: 10/12/2010
• Est. Priority Date: 09/08/2005
• Status: Active Grant

• Current Assignee: Rateze Remote Mgmt. L.L.C. (Intellectual Ventures LLC)
• Original Assignee: Pan Pacific Plasma LLC (Intellectual Ventures LLC)
• Inventors: Monro, Donald M.
• Primary Examiner(s): Ge; Yuzhen
• Application Number:
  US11/222,667
• Publication Number:
  US 20070053434A1
• Time in Patent Office: 1,860 Days
• Field of Search: None
• US Class Current: 382/240
• CPC Class Codes: H04N 19/126 Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers
• CPC Class Codes: H04N 19/13 Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/615 using motion compensated temporal filtering [MCTF]
• CPC Class Codes: H04N 19/63 using sub-band based transform, e.g. wavelets
• CPC Class Codes: H04N 19/97 Matching pursuit coding

Abstract

Embodiments related to coding data using a motion compensated transform, and replicated matching pursuits are disclosed. In some embodiments, a motion compensated transform is applied to an original image sequence to produce a transformed image sequence, and a replicated matching pursuits process is performed on the motion compensated transformed image sequence to code it.

Claims

1. A method, performed by a computing system having a memory and a processor, for coding data, the method comprising:

applying a motion compensated transform to an original image sequence;

creating motion vectors and temporal planes during the motion compensated transform; and

performing, by the computing system, a replicated matching pursuit process on the motion compensated transformed image sequence at least in part by,

identifying a parent atom at a first location within a first temporal plane of the created temporal planes, the parent atom having an associated first basis function; and

for each of a plurality of second temporal planes of the created temporal planes,

identifying a second location of a potential child atom within the second temporal plane, wherein the second location within the second temporal plane is substantially identical in position to the first location within the first temporal plane;

determining, based at least in part on the first basis function and the identified second location, an amplitude; and

upon determining that the determined amplitude exceeds a first threshold, storing the potential child atom as a child atom of the second temporal plane.

2. The method of claim 1, wherein the motion compensated transform is three dimensional.

3. The method of claim 1, wherein the motion compensated transformed image sequence comprises a group of temporal planes.

4. The method of claim 3, wherein the group of temporal planes comprises 16 planes.

5. The method of claim 4, wherein the motion compensated transform comprises performing 1 or more spatial scales, and 1 or more scales of 2 or more temporal wavelet transforms.

6. The method of claim 1, wherein the replicated matching pursuit process is applied to the temporal planes to create matching pursuits coded data.

7. The method of claim 6, further comprising:

coding the motion vectors;

coding the matching pursuits coded data; and

transmitting the coded motion vectors and the coded matching pursuits coded data.

8. The method of claim 7, wherein the coding the motion vectors comprises variable length coding.

9. The method of claim 7, wherein the coding the matching pursuits coded data comprises precision limited quantization coding.

10. The method of claim 7, wherein the coding the matching pursuits coded data comprises merge coding.

11. The method of claim 7, wherein coding the matching pursuits coded data comprises run length coding.

12. The method of claim 7, further comprising:

receiving the coded motion vectors and coded matching pursuits data;

decoding the received data; and

reconstructing a current reconstruction image sequence utilizing the decoded data.

13. The method of claim 1, wherein the data comprises multidimensional data.

14. A method, performed by a computing system, of transforming data, comprising:

parsing received data wherein the received data was coded

by applying a motion compensated transform to an original image, creating motion vectors and temporal planes during the motion compensated transform, and performing, by the computing system, a replicated matching pursuit process on the motion compensated transformed image sequence including,

identifying a first atom at a first location within a first temporal plane using a matching pursuit process on the first temporal plane of the created temporal planes, the first atom having an associated first basis function, and

for each of a plurality of second temporal planes of the created temporal planes,

identifying a second location of a potential child atom within the second temporal plane, wherein the second location within the second temporal plane is substantially identical in position to the first location within the first temporal plane,

determining, based at least in part on the first basis function and the identified second location, an amplitude, and

upon determining that the determined amplitude exceeds a first threshold, storing the potential child atom as a child atom of the second temporal plane;

creating motion compensation data from the parsed data;

building parent and similar atoms, and residual data from the parsed data;

building wavelet transform coefficients;

producing motion residual image utilizing an inverse wavelet transform; and

merging the motion compensation data and the motion residual image to form a current reconstruction image.

15. A tangible computer-readable storage medium having computer-executable instructions stored thereon, the instructions comprising:

instructions to apply a three-dimensional motion compensated transform to an image sequence, wherein the motion compensated transform comprises creating motion vectors and temporal planes; and

instructions to perform a replicated matching pursuit process on the transformed image sequence including,

determining a parent atom in a first temporal plane of the created temporal planes, wherein the parent atom is at a first location within the first temporal plane of the created temporal planes and has an associated first basis function, and

for each of a plurality of second temporal planes of the created temporal planes,

determining a second location of a potential child atom within the second temporal plane, wherein the second location within the second temporal plane is substantially identical in position to the first location within the first temporal plane,

determining, based at least in part on the first basis function and the identified second location, an amplitude, and

upon determining that the determined amplitude exceeds a first threshold, storing the potential child atom as a child atom of the second temporal plane.

16. The tangible computer-readable storage medium of claim 15, wherein the instructions to perform the replicated matching pursuit process include instructions for applying the replicated matching pursuit process to the temporal planes to create matching pursuits coded data.

17. The tangible computer-readable storage medium of claim 16, further comprising:

instructions to code the motion vectors;

instructions to code the matching pursuits coded data; and

instructions to transmit the coded motion vectors and the coded matching pursuits data.

18. The tangible computer-readable storage medium of claim 17, further comprising:

instructions for receiving the coded motion vectors and coded matching pursuits data;

instructions for decoding the received data; and

instructions for reconstructing a current reconstruction image sequence utilizing the decoded data.

19. The tangible computer-readable storage medium of claim 15, wherein the data comprises multidimensional data.

20. A system for transforming data, comprising:

means for processing program instructions communicably coupled to a means for storing in a memory;

means for applying a three-dimensional motion compensated transform to an image sequence and creating motion vectors and temporal planes during the motion compensated transform; and

means for performing a replicated matching pursuit process on the transformed image sequence including,

determining a parent atom in a first temporal plane of the created temporal planes, wherein the parent atom is at a first location within the first temporal plane of the created temporal planes and has an associated first basis function, and

for each of a plurality of second temporal planes of the created temporal planes,

determining a second location of a potential child atom within the second temporal plane, wherein the second location within the second temporal plane is substantially identical in position to the first location within the first temporal plane,

determining, based at least in part on the first basis function and the identified second location, an amplitude, and

upon determining that the determined amplitude exceeds a first threshold, storing the potential child atom as a child atom of the second temporal plane.

21. The system of claim 20, wherein the motion compensated transformed image sequence comprises a group of temporal planes.

22. The system of claim 21, wherein the group of temporal planes comprises 16 planes.

23. The system of claim 22, wherein the motion compensated transform comprises performing 1 or more spatial scales, and 1 or more scales of 2 or more temporal wavelet transforms.

24. The system of claim 20, wherein the matching pursuit process is applied to the temporal planes to create matching pursuits coded data.

25. The system of claim 24, further comprising:

means for coding the motion vectors;

means for coding the matching pursuits coded data; and

means for transmitting the coded motion vectors and the coded matching pursuits coded data.