Video coding with embedded motion
First Claim
1. A method, comprising:
- receiving image data comprising a sequence of one or more frames, wherein the one or more image frames include a first image frame and a second image frame;
identifying a first basis function that represents at least, in part, a first portion of the first image frame;
identifying a second portion of the second image frame that is represented at least by the first basis function;
determining a displacement between the first portion of the first image frame and the second portion of the second image frame; and
associating motion data with the first basis function, wherein the motion data indicates the displacement;
wherein the first portion includes two or more pixels of the first image frame,wherein the second portion includes two or more pixels of the second image frame, andwherein the first basis function is selected from a dictionary of basis functions.
2 Assignments
0 Petitions
Accused Products
Abstract
A method, system, and apparatus for video coding and decoding with embedded motion information are disclosed. Image data is associated with basis functions and motion data. A method of identifying one or more basis functions which are representative of image data and associating the basis function with the motion data. A method or receiving information indicative of a basis function and of motion data and determining a motion vector based on the motion data. A system where portions of an image representative of basis functions are further associated with motion data at an encoder and then communicated to a decoder. A decoder produces at least portions of a predicted image using basis functions parameters and motion data.
76 Citations
65 Claims
-
1. A method, comprising:
-
receiving image data comprising a sequence of one or more frames, wherein the one or more image frames include a first image frame and a second image frame; identifying a first basis function that represents at least, in part, a first portion of the first image frame; identifying a second portion of the second image frame that is represented at least by the first basis function; determining a displacement between the first portion of the first image frame and the second portion of the second image frame; and associating motion data with the first basis function, wherein the motion data indicates the displacement; wherein the first portion includes two or more pixels of the first image frame, wherein the second portion includes two or more pixels of the second image frame, and wherein the first basis function is selected from a dictionary of basis functions. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. An apparatus, comprising:
-
an encoder adapted to; receive image data comprising a sequence of one or more image frames, wherein the one or more image frames include a first image frame and a second image frame; identify a first atom that represents at least, in part, a first portion of the first image frame; identify a second portion of the second image frame that is represented at least by the first atom; determine a displacement between the first portion of the first image frame and the second portion of the second image frame; associate motion data with the first atom, wherein the motion data indicates the displacement; and generate a transmission bitstream using the first atom and the motion data, wherein the first portion includes two or more pixels of the image data, wherein the second portion includes two or more pixels of the second image frame, and wherein the first atom is selected by the encoder from a dictionary of atoms. - View Dependent Claims (13, 14, 15, 16, 17)
-
-
18. An apparatus, comprising:
-
a decoder adapted to; receive a bitstream, the bitstream representing a first image frame and a second image frame in a sequence of image frames, the bitstream including coded motion data associated with a first coded atom; extract the first coded atom from the bitstream, the first coded atom representing a first portion of the first image frame; extract the coded motion data from the bitstream, wherein the coded motion data indicates a displacement between the first portion of the first image frame and a second portion of the second image frame, wherein the first coded atom represents the second portion of the second image frame; and generate the first image frame and the second image frame based on the first coded atom and the displacement, wherein the first coded atom represents two or more pixels of the first image frame, and wherein the first coded atom is included in a dictionary of atoms. - View Dependent Claims (19, 20, 21, 22)
-
-
23. An apparatus, comprising:
-
an encoding device adapted to; receive image data comprising a sequence of one or more image frames, wherein the one or more image frames include a first image frame and a second image frame; identify a first basis function at represents at least, in part, a first portion of the first image frame; identify a second portion of the second image frame that is represented at least by the first basis function; determine a displacement between the first of the first portion of the image frame and the second portion of the second image frame; associate motion data with the first basis function, wherein the motion data indicates the displacement; and generate a transmission bitstream from the first basis function and the motion data, wherein the first portion includes two or more pixels of the image data, wherein the second portion includes two or more pixels of the second image frame, and wherein the first basis function is selected by the encoding device, from a dictionary of basis functions. - View Dependent Claims (24, 25, 26, 27)
-
-
28. A method, comprising:
-
receiving coded information representing a first image frame and a second image frame in a sequence of image frames, the coded information including coded motion data associated with a first basis function; extracting the first basis function from the coded information, the first basis function representing a first portion of the first image frame; extracting the motion data from the coded Information, wherein the motion data indicates a displacement between the first portion of the first image frame and a second portion of the second image frame, wherein the first basis function represents the second portion of the second image frame; and generating the first image frame and the second image frame based on the first basis function and the displacement, wherein the first basis function represents two or more pixels of the first image frame, and wherein the first basis function is included in a dictionary of basis functions. - View Dependent Claims (29, 30, 31, 32, 33)
-
-
34. An apparatus, comprising:
-
a decoder adapted to; receive digital data, the digital data representing a first image frame and a predicted image frame in a sequence of image frames, the digital data including motion data associated with a first basis function; extract the first basis function from the digital data, the first basis function representing a first portion of the first image frame; extract the motion data from the digital data, wherein the motion data indicates a displacement between the first portion of the first image frame and a second portion of the predicted image frame, wherein the first basis function represents the second portion of the predicted image frame; and generate the first image frame and the predicted image frame based on the first basis function and the displacement, wherein the first basis function represents two or more pixels of the first image frame, and wherein the first basis function is included in a dictionary. - View Dependent Claims (35, 36, 37)
-
-
38. A method, comprising:
-
receiving image data comprising a sequence of one or more image frames, wherein the one or more image frames include a first image frame and a second image frame; identifying a first basis function that represents at least, in part, a first portion of the first image frame; identifying a second portion of the second image frame that is represented at least by the first basis function; determining a displacement between the first portion of the first basis function and the second portion of the second image frame; associating motion data with the first basis function, wherein the motion data indicates the displacement; and transmitting information including one or more codes indicative of the first basis function and one or more codes indicative of the motion data associated with the first basis function, wherein the first portion includes two or more pixels of the first image frame, wherein the second portion includes two or more pixels of the second image frame, and wherein the first basis function is selected from a dictionary of basis functions. - View Dependent Claims (39, 40, 41, 42)
-
-
43. A system, comprising:
-
an encoder adapter to; receive video image data comprising a sequence of one or more video image frames, wherein the one or more video image frames include a first image frame and a second image frame; identify a first basis function that represents at least, in part, a first portion of the first image frame; identify a second portion of the second image frame that is represented at least by the first basis function; determine a displacement between the first portion of the first image frame and the second portion of the second image frame; associate a motion vector with the first basis function, wherein the motion vector indicates the displacement; and transmit a bitstream using the first basis function and the motion vector to a decoder communicatively coupled to the encoder and adapted to receive the bitstream, wherein the first portion includes two or more pixels of the first image frame, wherein the second portion includes two or more pixels of the second image frame, and wherein the first basis function is selected from a dictionary of basis functions. - View Dependent Claims (44, 45, 46, 47)
-
-
48. A tangible non-transitory computer readable storage medium having computer program code recorded thereon that when executed by a processor produces desired results, the computer readable storage medium comprising:
-
computer program code that enables the processor to; identify a first basis function that represents at least, in part, a first portion of the first image frame; identify a second portion of the second image frame that is represented at least by the first basis function; determine a displacement between the first portion of the first image frame and the second portion of the second image frame; and associate motion data with the first basis function, wherein the motion data indicates the displacement; wherein the first portion includes two or more pixels of the first image frame, wherein the second portion includes two or more pixels of the second image frame, and wherein the first basis function is selected from a dictionary of basis functions. - View Dependent Claims (49, 50, 51, 52, 53, 54, 55, 56)
-
-
57. A tangible non-transitory computer readable storage medium having computer program code recorded thereon that when executed by a processor produces desired resuIts, the computer readable storage medium comprising:
-
computer program code that enables the processor to; receive a bitstream, the bitstream representing a first image frame and a second image frame in a sequence of image frames, the bitstream including motion data associated with a first basis function; extract the first basis function from the bitstream, the first basis function representing a first portion of the first image frame; extract the motion data from the bitstream, wherein the motion data indicates a displacement between the first portion of the first image frame and a second portion of the second image frame, wherein the first basis function represents the second portion of the second image frame; and generate the first image frame and the second image frame based on the first basis function and the displacement, wherein the first basis function represents two or more pixels of the first image frame, and wherein the first basis function is included in a dictionary of basis functions. - View Dependent Claims (58, 59, 60, 61)
-
-
62. A tangible non-transitory computer readable storage medium having computer program code recorded thereon that when executed by a processor produces desired results, the computer readable storage medium comprising:
-
computer program code that enables the processor to; receive image data comprising a sequence of one or more image frames, wherein the one or more image frames include a first image frame and a second image frame; identify a first basis function that represents at least, in part, a first portion of the first made frame; identify a second portion of the second image frame that is represented at least by the first basis function; determine a displacement between the first portion of the first basis function and the second portion of the second image frame; associate motion data with the first basis function, wherein the motion data indicates the displacement; and transmit information including one or more codes indicative of the first basis function and one or more codes indicative of motion data associated with the first basis function, wherein the first portion includes two or more pixels of the first image frame, wherein the second portion includes two or more pixels of the second image frame, and wherein the first basis function is selected from a dictionary of basis functions. - View Dependent Claims (63, 64, 65)
-
Specification