Dynamic streaming with latticed representations of video

• US 8,279,926 B2
• Filed: 06/18/2010
• Issued: 10/02/2012
• Est. Priority Date: 06/18/2009
• Status: Expired due to Fees

• Current Assignee: Tech 5 SAS
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Rodriguez, Arturo A., Shepherd, Gregory, Cook, Benjamin M.
• Primary Examiner(s): Czekaj, David
• Assistant Examiner(s): Beck, Leron
• Application Number:
  US12/819,157
• Publication Number:
  US 20100322302A1
• Time in Patent Office: 837 Days
• Field of Search: 37524001-24029
• US Class Current: 375/240.1
• CPC Class Codes: H04N 19/102 characterised by the element, parameter or selection affected or controlled by the adaptive coding
• CPC Class Codes: H04N 19/119 Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
• CPC Class Codes: H04N 19/167 Position within a video image, e.g. region of interest [ROI]
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/177 the unit being a group of pictures [GOP]
• CPC Class Codes: H04N 19/63 using sub-band based transform, e.g. wavelets
• CPC Class Codes: H04N 21/631 Multimode Transmission, e.g. transmitting basic layers and enhancement layers of the content over different transmission paths or transmitting with different error corrections, different keys or with different transmission protocols

Abstract

In one embodiment, a method that partitions a first sequence of pictures into plural representations, encodes each of the plural representations independently of each other with a common time base, provides a first portion of the plural encoded representations based on a first network condition, the first portion having a first bit-rate, and provides a second portion of the plural encoded representations having a second bit-rate different than the first bit-rate, wherein a switch from providing the first portion to providing the second portion is responsive to a second network condition different than the first network condition.

Claims

1. A method, comprising:

partitioning a first sequence of pictures into plural representations, the first sequence of pictures having plural contiguous, non-overlapping segments, each of the plural segments having a single corresponding segment in each of the plural representations, the first sequence of pictures having a first spatial resolution and a first temporal resolution, each of the plural representations having a respective sequence of latticed pictures representing a distinct set of pixels of the first sequence of pictures, the plural representations collectively comprising the first spatial resolution and the first temporal resolution;

encoding each of the plural representations independently of each other with a common time base, each encoded representation having a respective bit-rate, the plural encoded representations having an aggregate bit-rate;

providing a first portion of the plural encoded representations based on a first network condition, the first portion having a first bit-rate; and

providing a second portion of the plural encoded representations having a second bit-rate different than the first bit-rate, wherein a switch from providing the first portion to providing the second portion is responsive to a second network condition different than the first network condition;

receiving the encoded representations at a communications and decoding the latticed pictures of a first segment;

forming pictures by de-latticing the decoded latticed-pictures of the first segment; and

providing the de-latticed pictures of the first segment for display at a partial picture resolution of the corresponding pictures of the video signal, the partial resolution corresponding to a picture resolution of 1/p, where p equals the number of arranged plural segments.

2. The method of claim 1, wherein either the first or second network conditions comprise a change in network bandwidth.

3. The method of claim 1, wherein either the first or second network conditions comprise a change in network device resources.

4. The method of claim 1, wherein the providing of the first and second portion comprises providing to a server.

5. The method of claim 1, wherein the providing of the first and second portion comprises providing to a network storage device.

6. The method of claim 1, wherein the providing of the first and second portion comprises providing over an Internet connection to a receiver.

7. The method of claim 6, wherein the receiver comprises a personal computer.

8. The method of claim 6, wherein the providing of the second portion is based on discarding one or more of the plural encoded representations without manifesting an interruption in a presentation of the first sequence of pictures to a viewer associated with the receiver.

9. The method of claim 6, wherein the providing of the second portion is based on aggregating one or more of the plural encoded representations without manifesting an interruption in a presentation of the first sequence of pictures to a viewer associated with the receiver.

10. The method of claim 6, wherein the providing of the second portion is further responsive to a signal from the receiver.

11. The method of claim 1, wherein the providing of the second portion is implemented at a location different from a groups of pictures (GOP) boundary or random access point (RAP).

12. A method, comprising:

receiving at a network device a first portion of plural encoded representations based on a first network condition, the first portion having a first bit-rate, the plural encoded representations independently decodable and having a common time base, each encoded representation having a respective bit-rate, the plural encoded representations having an aggregate bit-rate, the plural encoded representations corresponding to a plural representations derived from a first sequence of pictures, the first sequence of pictures having plural contiguous, non-overlapping segments, each of the plural segments having a single corresponding segment in each of the plural representations, the first sequence of pictures having a first spatial resolution and a first temporal resolution, each of the plural representations having a respective sequence of latticed pictures representing a distinct set of pixels of the first sequence of pictures, the plural representations collectively comprising the first spatial resolution and the first temporal resolution; and

receiving at the network device a second portion of the encoded plural representations having a second bit-rate different than the first bit-rate, wherein a switch from receiving the first portion to receiving the second portion is responsive to a second network condition different than the first network condition receiving the encoded representations at and decoding the latticed pictures of a first segment;

forming pictures by de-latticing the decoded latticed-pictures of the first segment; and

providing the de-latticed pictures of the first segment for display at a partial picture resolution of the corresponding pictures of the video signal, the partial resolution corresponding to a picture resolution of 1/p, where p equals the number of arranged plural segments.

13. The method of claim 12, wherein either the first or second network conditions comprise a change in network bandwidth, a change in available resources of the network device, or a combination of both.

14. The method of claim 12, wherein the receiving of the first and second portion comprises receiving from a server over an Internet connection.

15. The method of claim 12, wherein the second portion differs from the first portion in the number of encoded plural representations, further comprising decoding and presenting for output the first portion followed by decoding and presenting for output the second portion without manifesting an interruption of the presentation to a viewer associated with the receiver.

16. The method of claim 12, further comprising monitoring by the network device one or more parameters, and responsive to a change in status of the one or more parameters, signaling to a server to switch from providing the first portion to the second portion.

17. The method of claim 16, wherein the one or more parameters comprises buffer fullness, data arrival, current bandwidth, or decoding ability, or a combination of two or more.

18. A system, comprising:

a first network device, comprising;

a memory comprising logic; and

a processor configured to execute the logic to cause the processor to;

partition a first sequence of pictures into plural representations, the first sequence of pictures having plural contiguous, non-overlapping segments, each of the plural segments having a single corresponding segment in each of the plural representations, the first sequence of pictures having a first spatial resolution and a first temporal resolution, each of the plural representations representing a distinct set of pixels of the first sequence of pictures, the plural representations collectively comprising the first spatial resolution and the first temporal resolution;

encode each of the plural representations independently of each other with a common time base, each encoded representation having a respective sequence of latticed pictures having a respective bit-rate, the plural encoded representations having an aggregate bit-rate;

provide a first portion of the plural encoded representations based on a first network condition, the first portion having a first bit-rate; and

provide a second portion of the plural encoded representations having a second bit-rate different than the first bit-rate, wherein a switch from providing the first portion to providing the second portion is responsive to a second network condition different than the first network condition decode the latticed pictures of a first segment;

form pictures by de-latticing the decoded latticed-pictures of the first segment; and

provide the de-latticed pictures of the first segment for display at a partial picture resolution of the corresponding pictures of the video signal, the partial resolution corresponding to a picture resolution of 1/p, where p equals the number of arranged plural segments.

19. The system of claim 18, wherein the processor further executes the logic to provide the second portion based on either:

discarding one or more of the plural encoded representations without manifesting an interruption in a presentation of the first sequence of pictures to a viewer associated with the receiver;

or

aggregating one or more of the plural encoded representations without manifesting an interruption in the presentation of the first sequence of pictures to the viewer.

20. The system of claim 18, further comprising a second network device, wherein the second network device comprises a stream buffer, a memory with logic, and a processor configured to execute the logic to:

monitoring one or more parameters, wherein the one or more parameters comprises buffer fullness, data arrival, current bandwidth, or decoding ability, or a combination of two or more; and

responsive to a change in status of the one or more parameters, signal to the first network device to switch from providing the first portion to the second portion.