TECHNIQUES FOR ADAPTIVE VIDEO STREAMING

• US 20160073106A1
• Filed: 05/04/2015
• Published: 03/10/2016
• Est. Priority Date: 09/08/2014
• Status: Active Application

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Su, Yeping, Wu, Hsi-Jung, Zhang, Ke, Chung, Chris Y., Zhou, Xiaosong
• Application Number:
  US14/703,366
• Publication Number:
  US 20160073106A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: H04N 19/10 using adaptive coding
• CPC Class Codes: H04N 21/234363 by altering the spatial resolution, e.g. for clients with a lower screen resolution
• CPC Class Codes: H04N 21/23439 for generating different versions
• CPC Class Codes: H04N 21/23805 Controlling the feeding rate to the network, e.g. by controlling the video pump
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/8543 using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML] information retrieval of semistructured data, the underlying structure being taken into account, e.g. mark-up language structure data G06F16/80

Abstract

In a video coding system, a common video sequence is coded multiple times to yield respective instances of coded video data. Each instance may be coded according to a set coding parameters derived from a target bit rate of a respective tier of service. Each tier may be coded according to a constraint that limits a maximum coding rate of the tier to be less than a target bit rate of another predetermined tier of service. Having been coded according to the constraint facilitates dynamic switching among tiers by a requesting client device processing resources or communication bandwidth changes. Improved coding systems to switch among different coding streams may increase quality of video streamed while minimizing transmission and storage size of such content.

Claims

1. A method, comprising:

coding a common video sequence multiple times to yield respective instances of coded video data, each instance having video data coded according to a set of coding parameters derived from a target bit rate of a respective tier of service,

wherein for a given tier, coding is constrained to limit a maximum coding rate of the tier to be less than a target bit rate of another predetermined tier of service.

2. The method of claim 1, wherein the instances of coded video each include a plurality of chunks of coded video data.

3. The method of claim 1, wherein the instances of coded video each include a plurality of chunks of coded video data having chunk boundaries that are temporally aligned with boundaries of chunks from other instances.

4. The method of claim 3, wherein a first frame of at least one chunk is a frame that is decodable without reference to any preceding frame in coding order and all other coded frames of the respective chunk that follow the first frame in coding order have prediction references that go no earlier than the first frame.

5. The method of claim 1, further comprising storing the instances of coded video at a distribution server in association with a manifest file containing data describing the tiers.

6. The method of claim 1, further comprising, for at least one coding instance:

identifying portion(s) of the respective instance having a coding rate that exceeds the target bit rate of the instance,

coding portions of the video sequence corresponding to the identified portion(s) into a plurality of sub-tiers, each sub-tier having coding parameters that induce a respective coding rate for the identified portion(s), and

storing the coded instance and the coded sub-tiers in storage at a distribution server.

7. The method of claim 1, wherein each coded tier has a different resolution but a substantially similar aspect ratio as each other.

8. The method of claim 1, wherein at least one coded tier has a pixel aspect ratio derived from a display aspect ratio and a storage aspect ratio.

9. The method of claim 1, wherein the coding comprises:

for a first tier, estimating characteristics of the video sequence, selecting coding parameters based on the estimated characteristics and the target bit rate of the first tier and coding the video sequence according to the selected coding parameters of the first tier, and

for at least one other tier, selecting coding parameters based on the estimated characteristics and the target bit rate of the other tier, and coding the video sequence according to the selected coding parameters of the other tier.

10. The method of claim 1, wherein the coding comprises, for at least one tier:

estimating characteristics of the video sequence,

selecting coding parameters based on the estimated characteristics and a target bit rate of the respective tier,

coding the video sequence according to the selected coding parameters,

estimating a coding quality obtained from the coding, and

if the estimated coding quality is below a predetermined threshold, revising the coding parameters and repeating the coding using the revised coding parameters.

11. A distribution server, comprising:

a computer readable storage device having stored thereon a file representing a media item, the file including;

multiple coding instances of the media item, each instance having coded video data representing the media item having been coded according to a set of coding parameters derived from a target bit rate of a respective tier of service, wherein for a given tier, coding is constrained to limit a maximum coding rate of the tier to be less than a target bit rate of another predetermined tier of service, and

a manifest file containing data describing the tiers.

12. The server of claim 11, further comprising a communication system to provide data of a respective tier upon request.

13. The server of claim 11, wherein the coding instances each include a plurality of chunks of coded video data.

14. The server of claim 11, wherein the coding instances each include a plurality of chunks of coded video data having chunk boundaries that are temporally aligned with boundaries of chunks from other instances.

15. The server of claim 11, wherein a first frame of at least one chunk is a frame that is decodable without reference to any preceding frame in coding order.

16. The server of claim 11, wherein the file further comprises, for at least one instance:

a plurality of coded sub-tiers of the instance, corresponding to a portion of the respective instance having a coding rate that exceeds the target bit rate of the instance, each sub-tier coded according to coding parameters that induce a respective coding rate for the identified portion.

17. The server of claim 11, wherein each coded tier has a different resolution but a substantially similar aspect ratio as each other.

19. The server of claim 17, wherein the instances of coded video data each include a plurality of chunks of coded video data.

20. The server of claim 17, wherein the instances of coded video data each include a plurality of chunks of coded video data having chunk boundaries that are temporally aligned with boundaries of chunks from other instances.

21. The server of claim 17, wherein a first frame of at least one chunk is a frame that is decodable without reference to any preceding frame in coding order.

22. The server of claim 17, wherein the video coder further:

identifies a portion of the respective instance having a coding rate that exceeds the target bit rate of the instance, and

codes portions of the video sequence corresponding to the identified portion(s) into a plurality of sub-tiers, each sub-tier having coding parameters that induce a respective coding rate for the identified portion.

23. The server of claim 17, wherein each coded tier has a different resolution but a substantially similar aspect ratio as each other.

18. A coding server, comprising:

a video coder to code a common video sequence multiple times to yield respective instances of coded video data, each instance having video data coded according to a set of coding parameters derived from a target bit rate of a respective tier of service, wherein for a given tier, coding is constrained to limit a maximum coding rate of the tier to be less than a target bit rate of another predetermined tier of service, and

a storage device to store the instances of coded video data.

24. A computer readable storage device having stored thereon program instructions that, when executed, cause a programming device to perform a method comprising:

coding a common video sequence multiple times to yield respective instances of coded video data, each instance having video data coded according to a set of coding parameters derived from a target bit rate of a respective tier of service, wherein for a given tier, coding is constrained to limit a maximum coding rate of the tier to be less than a target bit rate of another predetermined tier of service.

25. The device of claim 24, wherein the program instructions further cause the executing device to:

identify a portion of a coding instance having a coding rate that exceeds the target bit rate of the instance, and

code portions of the video sequence corresponding to the identified portion(s) into a plurality of sub-tiers, each sub-tier having coding parameters that induce a respective coding rate for the identified portion.

26. The device of claim 24, wherein the program instructions further cause the executing device to store the instances of coded video at a distribution server in association with a manifest file containing data describing the tiers.

27. A method, comprising:

estimating characteristics of a video sequence to be coded,

coding a common video sequence multiple times to yield respective instances of coded video data, each associated with a respective tier of service, comprising for each instance;

selecting coding parameters for the respective instance based on the estimated characteristics and a target bit rate of the respective tier, wherein a maximum coding rate of at least one tier is less than a target bit rate of another predetermined tier of service and a maximum coding rate at a startup portion of a coded instance is less than a maximum coding rate of an intermediate portion of the coded instance;

coding the video sequence according to the selected coding parameters, and storing the instances of coded data at a media delivery server.

28. The method of claim 27, wherein a target bit rate of a coded instance is determined based on an estimated buffering condition of a player that is to decode the coded instance.

29. The method of claim 27, wherein select frames of the video sequence are coded as sync frames in all the coded instances.

30. The method of claim 27, wherein the coded instances are stored in individually accessible segments, each of which begins with a coded sync frame.