Dynamic streaming plural lattice video coding representations of video

• US 9,467,696 B2
• Filed: 10/02/2012
• Issued: 10/11/2016
• Est. Priority Date: 06/18/2009
• Status: Expired due to Fees

• Current Assignee: Tech 5 SAS
• Original Assignee: Tech 5
• Inventors: Rodriguez, Arturo A., Shepherd, Gregory, Cook, Benjamin M.
• Primary Examiner(s): Beck, Leron
• Application Number:
  US13/633,672
• Publication Number:
  US 20130028314A1
• Time in Patent Office: 1,470 Days
• Field of Search: 37524001-24029, 33324001-24029
• US Class Current: 1/1
• CPC Class Codes: H04N 19/102 characterised by the element, parameter or selection affected or controlled by the adaptive coding
• CPC Class Codes: H04N 19/119 Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
• CPC Class Codes: H04N 19/167 Position within a video image, e.g. region of interest [ROI]
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/177 the unit being a group of pictures [GOP]
• CPC Class Codes: H04N 19/63 using sub-band based transform, e.g. wavelets
• CPC Class Codes: H04N 21/631 Multimode Transmission, e.g. transmitting basic layers and enhancement layers of the content over different transmission paths or transmitting with different error corrections, different keys or with different transmission protocols

Abstract

A first sequence of pictures may be partitioned into plural representations, each of the plural representations may be encoded independently of each other with a common time base, a first portion of the plural encoded representations may be provided based on a first network condition, the first portion having a first bit-rate, and a second portion of the plural encoded representations may be provided having a second bit-rate different than the first bit-rate, wherein a switch from providing the first portion to providing the second portion is responsive to a second network condition different than the first network condition.

Claims

1. A method, comprising:

encoding plural representations having a respective sequence of latticed pictures, wherein a first sequence of pictures has plural contiguous, non-overlapping segments, each of the plural segments having a single corresponding segment in each of the plural representations;

decoding the latticed pictures of a first segment of the plural encoded representations;

forming pictures by de-latticing the decoded latticed-pictures of the first segment; and

displaying the de-latticed pictures of the first segment picture at a resolution corresponding to a picture resolution of 1/p, where p equals the number of plural segments.

2. The method of claim 1, further comprising providing a first portion of the plural encoded representations based on a first network condition.

3. The method of claim 1, further comprising providing a second portion of the plural encoded representations based on a second network condition.

4. The method of claim 3 wherein the second network condition comprises a change in network bandwidth.

5. The method of claim 3, wherein the second network condition comprises a change in network device resources.

6. The method of claim 1, further comprising providing the latticed pictures of the first segment of the plural encoded representations to a server.

7. The method of claim 1, further comprising providing the latticed pictures of the first segment of the plural encoded representations to a network storage device.

8. The method of claim 1, further comprising providing the latticed pictures of the first segment of the plural encoded representations over an Internet connection to a receiver.

9. The method of claim 8, wherein the providing the latticed pictures is based on discarding one or more of the plural encoded representations without manifesting an interruption in a presentation of the latticed pictures to a viewer associated with the receiver.

10. The method of claim 8, wherein the providing the latticed pictures is based on aggregating one or more of the plural encoded representations without manifesting an interruption in a presentation of the latticed pictures to a viewer associated with the receiver.

11. The method of claim 8, wherein the providing of the latticed pictures is further responsive to a signal from the receiver.

12. The method of claim 1, wherein the providing of the latticed pictures is implemented at a location different from a random access point (RAP).

13. A method, comprising:

transmitting from a network device a first portion of plural encoded representations having a respective sequence of latticed pictures based on a first network condition, the plural encoded representations corresponding to a plural representations derived from a first sequence of pictures, the first sequence of pictures having plural contiguous, non-overlapping segments, each of the plural segments having a single corresponding segment in each of the plural representations, wherein transmitting at the network device a second portion of the encoded plural representations having a respective sequence of latticed pictures based on a second network condition; and

switching from transmitting the first portion to transmitting the second portion responsive to the second network condition being different than the first network condition, wherein pictures may be formed by de-latticing the decoded latticed-pictures for display at a resolution corresponding to a picture resolution of 1/p, where p equals the number of plural segments.

14. The method of claim 13, wherein either the first or second network conditions comprise a change in network bandwidth, a change in available resources of the network device, or a combination of both.

15. The method of claim 13, wherein the transmitting the respective sequence of latticed pictures comprises transmitting over an Internet connection.

16. The method of claim 13, wherein the second portion differs from the first portion in the number of encoded plural representations.

17. The method of claim 13, further comprising monitoring by the network device one or more parameters, and responsive to a change in status of the one or more parameters, signaling to a server to switch from transmitting the first portion to the second portion.

18. The method of claim 17, wherein the one or more parameters comprises buffer fullness, data arrival, current bandwidth, or decoding ability, or a combination of two or more.

19. The method of claim 13, wherein the first sequence of pictures has a first spatial resolution and a first temporal resolution, and each of the plural representations represents a distinct set of pixels of the first sequence of pictures.

20. A system, comprising:

a first network device, comprising;

a memory comprising logic; and

a processor configured to execute the logic to cause the processor to;

encode plural representations having a respective sequence of latticed pictures, wherein a first sequence of pictures has plural contiguous, non-overlapping segments, each of the plural segments having a single corresponding segment in each of the plural representations;

decode the latticed pictures of a first segment of the plural encoded representations;

form pictures by de-latticing the decoded latticed-pictures of the first segment; and

display the de-latticed pictures of the first segment picture at a resolution corresponding to a picture resolution of 1/p, where p equals the number of plural segments.