Method and apparatus for determining a multimedia representation for a multimedia asset delivered to a client device

• US 9,769,281 B2
• Filed: 12/19/2011
• Issued: 09/19/2017
• Est. Priority Date: 12/19/2011
• Status: Active Grant

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Inventors: Braskich, Anthony J., Emeott, Stephen P., Smith, Alfonso Martinez
• Primary Examiner(s): Christensen, Scott B
• Assistant Examiner(s): RICHARDSON, THOMAS W
• Application Number:
  US13/329,702
• Publication Number:
  US 20130159455A1
• Time in Patent Office: 2,101 Days
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 67/303 Terminal profiles
• CPC Class Codes: H04L 67/565 Conversion or adaptation of application format or content adding application control or application functional data H04L67/561

Abstract

A method (1000) and apparatus (110) determine a multimedia representation for a multimedia asset. The method includes receiving (1020) a multimedia asset request for a multimedia asset at a multimedia representation broker (110). The multimedia asset request is received from a specific client device (120). The multimedia asset request includes client device information about the specific client device (120). The method determines (1030), at the multimedia representation broker (110), a multimedia representation for use in providing the multimedia asset to the specific client device (120) based on the client device information and based on media representations appropriate for a client device context of the specific client device (120). The method outputs (1040) multimedia representation information corresponding to the multimedia asset for the specific client device (120) based on the determined multimedia representation.

Claims

1. A method comprising:

receiving, by a system including a processor, a plurality of client reports from a plurality of client devices, each of the plurality of client reports comprising playback information describing playback of a multimedia representation from a plurality of multimedia representations of a multimedia asset;

determining and storing, by the system based on the plurality of client reports, a plurality of playback metrics, each of the plurality of playback metrics associated with a different combination of a client type and a multimedia representation from the plurality of multimedia representations, and each of the plurality of playback metrics being a probability of successful playback of the associated multimedia representation on a client device of the associated client type, wherein the probability is calculated based on a number of client reports from the plurality of client reports that indicate successful playback of the associated multimedia representation on the associated client type and a number of client reports from the plurality of client reports that indicate failed playback of the associated multimedia representation on the associated client type;

receiving, by the system from a requesting client device, a multimedia asset request for the multimedia asset, wherein the multimedia asset request includes client device information about the requesting client device;

determining, by the system, a client type of the requesting client device based on the client device information;

selecting, by the system from the plurality of multimedia representations, a multimedia representation for the requesting client device based on the playback metric associated with the determined client type and the selected multimedia representation being the highest among the playback metrics associated with the determined client type; and

outputting, by the system to the requesting client device, multimedia representation information corresponding to the selected multimedia representation.

2. The method of claim 1:

wherein the multimedia asset has a unique identifier; and

wherein each of the plurality of multimedia representations is in a different multimedia format.

3. The method of claim 1, wherein the multimedia representation information comprises a streaming multimedia asset universal resource locator.

4. The method of claim 1, further comprising:

obtaining a manifest of the multimedia asset from an origin server associated with the multimedia asset; and

pruning the manifest of the multimedia asset to generate a pruned multimedia asset manifest comprising multimedia representations from the plurality of multimedia representations that are compatible with the requesting client device;

wherein the outputting comprises delivering multimedia representation data corresponding to the pruned multimedia asset manifest to the requesting client device.

5. The method of claim 1, wherein the client device information includes client device context information.

6. The method of claim 1, wherein the client device information includes a measure of recent failed playback attempts at the requesting client device.

7. The method of claim 1, wherein the selected multimedia representation is selected based on encoding needed for playback of the selected multimedia representation on the requesting client device.

8. A system, comprising:

a processor; and

a memory communicatively coupled to the processor, the memory having stored therein computer-executable instructions which when executed by the processor cause the processor to perform operations comprising;

receiving a plurality of client reports from a plurality of client devices, each of the plurality of client reports comprising playback information describing playback of a multimedia representation from a plurality of multimedia representations of a multimedia asset;

determining and storing, based on the plurality of client reports, a plurality of playback metrics, each of the plurality of playback metrics associated with a different combination of a client type and a multimedia representation from the plurality of multimedia representations, and each of the plurality of playback metrics being a probability of successful playback of the associated multimedia representation on a client device of the associated client type, wherein the probability is calculated based on a number of client reports from the plurality of client reports that indicate successful playback of the associated multimedia representation on the associated client type and a number of client reports from the plurality of client reports that indicate failed playback of the associated multimedia representation on the associated client type;

receiving a multimedia asset request for the multimedia asset from a requesting client device, wherein the multimedia asset request includes client device information about the requesting client device;

determining a client type of the requesting client device based on the client device information;

selecting, from the plurality of multimedia representations, a multimedia representation for the requesting client device based on the playback metric associated with the determined client type and the selected multimedia representation being the highest among the playback metrics associated with the determined client type; and

outputting, to the requesting client device, multimedia representation information corresponding to the selected multimedia representation.

9. The system of claim 8, wherein the multimedia asset has a unique identifier and wherein each of the plurality of multimedia representations is in a different multimedia format.

10. The system of claim 8, wherein the multimedia representation information comprises a streaming multimedia asset universal resource locator.

11. The system of claim 8, wherein the computer-executable instructions when executed by the processor further cause the processor to perform operations comprising:

obtaining a manifest of the multimedia asset from an origin server associated with the multimedia asset; and

pruning the manifest of the multimedia asset to generate a pruned multimedia asset manifest comprising multimedia representations from the plurality of multimedia representations that are compatible with the requesting client device;

wherein the outputting comprises delivering multimedia representation data corresponding to the pruned multimedia asset manifest to the requesting client device.

12. The system of claim 8, wherein the client device information includes client device context information.

13. The system of claim 8, wherein the client device information includes a measure of recent failed playback attempts at the requesting client device.

14. A non-transitory computer-readable medium having instructions stored thereon that, in response to execution, cause a system including a processor to perform operations comprising:

receiving a plurality of client reports from a plurality of client devices, each of the plurality of client reports comprising playback information describing playback of a multimedia representation from a plurality of multimedia representations of a multimedia asset;

determining and storing, based on the plurality of client reports, a plurality of playback metrics, each of the plurality of playback metrics associated with a different combination of a client type and a multimedia representation from the plurality of multimedia representations, and each of the plurality of playback metrics being a probability of successful playback of the associated multimedia representation on a client device of the associated client type, wherein the probability is calculated based on a number of client reports from the plurality of client reports that indicate successful playback of the associated multimedia representation on the associated client type and a number of client reports from the plurality of client reports that indicate failed playback of the associated multimedia representation on the associated client type;

receiving a multimedia asset request for the multimedia asset from a requesting client device, wherein the multimedia asset request includes client device information about the requesting client device;

determining a client type of the requesting client device based on the client device information;

selecting, from the plurality of multimedia representations, a multimedia representation for the requesting client device based on the playback metric associated with the determined client type and the selected multimedia representation being the highest among the playback metrics associated with the determined client type; and

outputting, by the system to the requesting client device, multimedia representation information corresponding to the selected multimedia representation.

15. The computer-readable medium of claim 14, wherein the multimedia asset has a unique identifier and wherein each of the plurality of multimedia representations is in a different multimedia format.

16. The computer-readable medium of claim 14, wherein the multimedia representation information comprises a streaming multimedia asset universal resource locator.

17. The computer-readable medium of claim 14, wherein the instructions further cause the system to perform operations comprising:

obtaining a manifest of the multimedia asset from an origin server associated with the multimedia asset; and

pruning the manifest of the multimedia asset to generate a pruned multimedia asset manifest comprising multimedia representations from the plurality of multimedia representations that are compatible with the requesting client device;

wherein the outputting comprises delivering multimedia representation data corresponding to the pruned multimedia asset manifest to the requesting client device.

18. The computer-readable medium of claim 14, wherein the client device information includes client device context information.

19. The computer-readable medium of claim 14, wherein the client device information includes a measure of recent failed playback attempts at the requesting client device.