System and method of streaming 3-D wireframe animations

• US 9,454,828 B2
• Filed: 06/12/2015
• Issued: 09/27/2016
• Est. Priority Date: 08/20/2002
• Status: Expired due to Term

• Current Assignee: AT&T Intellectual Property II LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property II LP (AT&T, Inc.)
• Inventors: Ostermann, Joern, Varakliotis, Sokratis
• Primary Examiner(s): Tseng, Charles
• Application Number:
  US14/737,691
• Publication Number:
  US 20150287218A1
• Time in Patent Office: 473 Days
• US Class Current: 1/1
• CPC Class Codes: G06T 13/20 3D [Three Dimensional] animation
• CPC Class Codes: G06T 9/001 Model-based coding, e.g. wire frame
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 19/154 Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion use of rate-distortion criteria H04N19/147
• CPC Class Codes: H04N 19/36 Scalability techniques involving formatting the layers as a function of picture distortion after decoding, e.g. signal-to-noise [SNR] scalability
• CPC Class Codes: H04N 19/67 involving unequal error protection [UEP], i.e. providing protection according to the importance of the data
• CPC Class Codes: H04N 19/895 in combination with error concealment

Abstract

Optimal resilience to errors in packetized streaming 3-D wireframe animation is achieved by partitioning the stream into layers and applying unequal error correction coding to each layer independently to maintain the same overall bitrate. The unequal error protection scheme for each of the layers combined with error concealment at the receiver achieves graceful degradation of streamed animation at higher packet loss rates than approaches that do not account for subjective parameters such as visual smoothness.

Claims

1. A method comprising:

processing, via a processor, parameters n, FR, Sp, and F of video data via a channel bitrate algorithm, wherein the parameters are located in a block-of-packets structure for each layer of a plurality of layers of video data, n is a number of lines in the block-of-packets structure, Sp is a number of columns in the block-of-packets structure, FR is a sequence frame rate, and F is a number of data frames in the block-of-packets structure for a respective layer of the plurality of layers, wherein the channel bitrate algorithm produces a bitrate value for each layer in the plurality of layers based on a product of n, FR, and Sp to yield a result, the result being divided by F, to yield bitrate values; and

applying, via the processor, unequal error protection to a layer of the plurality of layers according to the bitrate values produced by the channel bitrate algorithm.

2. The method of claim 1, wherein the layer of the plurality of layers comprises one of a node and a group of nodes within a wireframe mesh.

3. The method of claim 1, further comprising encoding a particular layer in the plurality of layers to be resilient to packet errors.

4. The method of claim 1, wherein a number of nodes within a portion of the plurality of layers is associated with an output bit rate of the portion.

5. The method of claim 1, further comprising producing a three-dimensional packetized streaming signal representative of a scene comprising animation associated with the plurality of layers of video data.

6. The method of claim 1, further comprising partitioning the plurality of layers according to a visual importance of each respective layer in the plurality of layers.

7. The method of claim 1, wherein the unequal error protection comprises optimizing a distribution of a bit budget allocation amongst the plurality of layers.

8. A system comprising:

a processor; and

a computer-readable storage medium having instructions stored which, when executed by the processor, cause the processor to perform operations comprising;

processing parameters n, FR, Sp, and F of video data via a channel bitrate algorithm, wherein the parameters are located in a block-of-packets structure for each layer of a plurality of layers of video data, n is a number of lines in the block-of-packets structure, Sp is a number of columns in the block-of-packets structure, FR is a sequence frame rate, and F is a number of data frames in the block-of-packets structure for a respective layer of the plurality of layers, wherein the channel bitrate algorithm produces a bitrate value for each layer in the plurality of layers based on a product of n, FR, and Sp to yield a result, the result being divided by F, to yield bitrate values; and

applying unequal error protection to a layer of the plurality of layers according to the bitrate values produced by the channel bitrate algorithm.

9. The system of claim 8, wherein the layer of the plurality of layers comprises one of a node and a group of nodes within a wireframe mesh.

10. The system of claim 8, the computer-readable storage medium having additional instructions stored which, when executed by the processor, result in operations comprising encoding a particular layer in the plurality of layers to be resilient to packet errors.

11. The system of claim 8, wherein a number of nodes within a portion of the plurality of layers is associated with an output bit rate of the portion.

12. The system of claim 8, the computer-readable storage medium having additional instructions stored which, when executed by the processor, result in operations comprising producing a three-dimensional packetized streaming signal representative of a scene comprising animation associated with the plurality of layers of video data.

13. The system of claim 8, the computer-readable storage medium having additional instructions stored which, when executed by the processor, result in operations comprising partitioning the plurality of layers according to a visual importance of each respective layer in the plurality of layers.

14. The system of claim 8, wherein the unequal error protection comprises optimizing a distribution of a bit budget allocation amongst the plurality of layers.

15. A computer-readable storage device having instructions stored which, when executed by a computing device, cause the computing device to perform operations comprising:

processing parameters n, FR, Sp, and F of video data via a channel bitrate algorithm, wherein the parameters are located in a block-of-packets structure for each layer of a plurality of layers of video data, n is a number of lines in the block-of-packets structure, Sp is a number of columns in the block-of-packets structure, FR is a sequence frame rate, and F is a number of data frames in the block-of-packets structure for a respective layer of the plurality of layers, wherein the channel bitrate algorithm produces a bitrate value for each layer in the plurality of layers based on a product of n, FR, and Sp to yield a result, the result being divided by F, to yield bitrate values; and

applying unequal error protection to a layer of the plurality of layers according to the bitrate values produced by the channel bitrate algorithm.

16. The computer-readable storage device of claim 15, wherein the layer of the plurality of layers comprises one of a node and a group of nodes within a wireframe mesh.

17. The computer-readable storage device of claim 15, having additional instructions stored which, when executed by the computing device, result in operations comprising encoding a particular layer in the plurality of layers to be resilient to packet errors.

18. The computer-readable storage device of claim 15, wherein a number of nodes within a portion of the plurality of layers is associated with an output bit rate of the portion.

19. The computer-readable storage device of claim 15, having additional instructions stored which, when executed by the computing device, result in operations comprising producing a three-dimensional packetized streaming signal representative of a scene comprising animation associated with the plurality of layers of video data.

20. The computer-readable storage device of claim 15, having additional instructions stored which, when executed by the computing device, result in operations comprising partitioning the plurality of layers according to a visual importance of each respective layer in the plurality of layers.