System and method of streaming 3-D wireframe animations

• US 10,262,439 B2
• Filed: 03/09/2018
• Issued: 04/16/2019
• Est. Priority Date: 08/20/2002
• Status: Expired due to Fees

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Ostermann, Joern, Varakliotis, Sokratis
• Primary Examiner(s): Tseng, Charles
• Application Number:
  US15/916,547
• Publication Number:
  US 20180197312A1
• Time in Patent Office: 403 Days
• CPC Class Codes: G06T 13/20 3D [Three Dimensional] animation
• CPC Class Codes: G06T 9/001 Model-based coding, e.g. wire frame
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 19/154 Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion use of rate-distortion criteria H04N19/147
• CPC Class Codes: H04N 19/36 Scalability techniques involving formatting the layers as a function of picture distortion after decoding, e.g. signal-to-noise [SNR] scalability
• CPC Class Codes: H04N 19/67 involving unequal error protection [UEP], i.e. providing protection according to the importance of the data
• CPC Class Codes: H04N 19/895 in combination with error concealment

Abstract

Optimal resilience to errors in packetized streaming 3-D wireframe animation is achieved by partitioning the stream into layers and applying unequal error correction coding to each layer independently to maintain the same overall bitrate. The unequal error protection scheme for each of the layers combined with error concealment at the receiver achieves graceful degradation of streamed animation at higher packet loss rates than approaches that do not account for subjective parameters such as visual smoothness.

Claims

1. A method comprising:

partitioning, via a processor, a three-dimensional wireframe mesh corresponding to a video scene according to (1) a natural object within the three-dimensional wireframe mesh and (2) a motion of the natural object, to yield a first partition comprising the natural object and a second partition;

organizing the first partition and the second partition into respective layers based on a first visual smoothness value for the first partition and a second visual smoothness value associated with the second partition; and

generating one or more bitstreams including the respective layers for transmission.

2. The method of claim 1, wherein the second partition comprises a second natural object having a second motion.

3. The method of claim 2, further comprising:

computing the first visual smoothness value for the first partition; and

computing the second visual smoothness value for the second partition.

4. The method of claim 1, further comprising:

applying unequal error protection to the respective layers, wherein the unequal error protection applied to each layer of the respective layers is based on a respective bitrate value for each layer of the respective layers.

5. The method of claim 1, wherein each layer of the respective layers comprises one of a node and a group of nodes within the three-dimensional wireframe mesh.

6. The method of claim 1, further comprising encoding a particular layer in the respective layers to be resilient to packet errors.

7. The method of claim 1, wherein a number of nodes within a portion of the respective layers is associated with an output bit rate of the portion.

8. A system comprising:

a processor; and

a computer-readable storage medium storing instructions which, when executed by the processor, cause the processor to perform operations comprising;

partitioning a three-dimensional wireframe mesh corresponding to a video scene according to (1) a natural object within the three-dimensional wireframe mesh and (2) a motion of the natural object, to yield a first partition comprising the natural object and a second partition;

organizing the first partition and the second partition into respective layers based on a first visual smoothness value for the first partition and a second visual smoothness value associated with the second partition; and

generating one or more bitstreams including the respective layers for transmission.

9. The system of claim 8, wherein the second partition comprises a second natural object having a second motion.

10. The system of claim 9, wherein the computer-readable storage medium stores additional instructions which, when executed by the processor, cause the processor to perform operations further comprising:

computing the first visual smoothness value for the first partition; and

computing the second visual smoothness value for the second partition.

11. The system of claim 8, wherein the computer-readable storage medium stores additional instructions which, when executed by the processor, cause the processor to perform operations further comprising:

applying unequal error protection to the respective layers, wherein the unequal error protection applied to each layer of the respective layers is based on a respective bitrate value for each layer of the respective layers.

12. The system of claim 8, wherein each layer of the respective layers comprises one of a node and a group of nodes within the three-dimensional wireframe mesh.

13. The system of claim 8, wherein the computer-readable storage medium stores additional instructions which, when executed by the processor, cause the processor to perform operations further comprising:

encoding a particular layer in the respective layers to be resilient to packet errors.

14. The system of claim 8, wherein a number of nodes within a portion of the respective layers is associated with an output bit rate of the portion.

15. A computer-readable storage device storing instructions which, when executed by a processor, cause the processor to perform operations comprising:

partitioning a three-dimensional wireframe mesh corresponding to a video scene according to (1) a natural object within the three-dimensional wireframe mesh and (2) a motion of the natural object, to yield a first partition comprising the natural object and a second partition;

organizing the first partition and the second partition into respective layers based on a first visual smoothness value for the first partition and a second visual smoothness value associated with the second partition; and

generating one or more bitstreams including the respective layers for transmission.

16. The computer-readable storage device of claim 15, further comprising producing a three-dimensional packetized streaming signal representative of a scene comprising animation associated with the respective layers.

17. The computer-readable storage device of claim 15, further comprising partitioning the respective layers according to a visual importance of each layer of the respective layers.

18. The computer-readable storage device of claim 15, wherein a number of nodes within a portion of the respective layers is associated with an output bit rate of the portion.

19. The computer-readable storage device of claim 15, wherein the computer-readable storage device stores additional instructions which, when executed by the processor, cause the processor to perform operations comprising:

applying unequal error protection to the respective layers, wherein the unequal error protection applied to each layer of the respective layers is based on a respective bitrate value for each layer of the respective layers.

20. The computer-readable storage device of claim 19, wherein the unequal error protection comprises optimizing a distribution of a bit budget allocation amongst the respective layers.