MULTIPLE STREAM CONTENT PRESENTATION

• US 20170134450A1
• Filed: 01/20/2017
• Published: 05/11/2017
• Est. Priority Date: 11/11/2013
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Heinz, II, Gerard Joseph, Mamtani, Vinod Murli, Taraki, Quais
• Granted Patent: US 10,097,596 B2
• Time in Patent Office: Days
• CPC Class Codes: G06T 11/40 Filling a planar surface by adding surface attributes, e.g. colour or texture
• CPC Class Codes: H04L 65/1083 In-session procedures
• CPC Class Codes: H04L 65/1089 by adding media; by removing media
• CPC Class Codes: H04L 65/4015 where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04L 67/1021 based on client or server locations
• CPC Class Codes: H04L 67/1027 Persistence of sessions during load balancing
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04L 67/141 Setup of application sessions admission control or resource allocation in data switching networks H04L47/70
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/2343 involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements video transcoding H04N19/40; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 21/2747 Remote storage of video programs received via the downstream path, e.g. from the server
• CPC Class Codes: H04N 5/76 Television signal recording
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus

Abstract

A client may, for example, initiate presentation of the content item in a hybrid stream mode in which both a client stream and a content provider stream are combined to form a resulting hybrid stream for presentation. The client may then, at some point during presentation of the content item, detect that the content provider stream has become unavailable. In response to such a determination, the client may continue to present the content item in a client stream mode, in which the client stream is used for presentation of the content item without use of the content provider stream.

Claims

1. A system comprising:

one or more processors

one or more memories to store a set of instructions, which if executed by the one or more processors, causes the one or more processors to perform operations comprising;

generating a client stream including information corresponding to client stream features associated with a presentation of content item;

receiving, from a content provider, a content provider stream including information corresponding to content provider stream features associated with the presentation of the content item;

displaying at least one content provider stream feature;

determining that the content provider stream is at least temporarily unavailable; and

displaying at least one client stream feature.

2. The system of claim 1, wherein the at least one content provider stream feature is displayed in a first image, and wherein the at least one client stream feature is displayed in a second image.

3. The system of claim 2, wherein the first image includes at least one other client stream feature, and wherein the second image includes at least one other content provider stream feature.

4. The system of claim 2, wherein, for an object in the first image, the client stream includes a lower intricacy version of the object and the content provider stream includes a higher intricacy version of the object.

5. The system of claim 1, wherein the client stream is generated based at least in part on a client version of the content item executed at a client compute node, and wherein the content provider stream is generated based at least in part on a content provider version of the content item executed by the content provider.

6. The system of claim 1, wherein state information associated with the content item is exchanged between a client compute node and the content provider, wherein the content provider stream is generated based at least in part on state information received from the client compute node, and wherein the client stream is generated based at least in part on state information received from the content provider.

7. The system of claim 1, wherein determining that that the content provider stream is at least temporarily unavailable comprises detecting a disconnection between the content provider and a client.

8. The system of claim 1, wherein determining that that the content provider stream is at least temporarily unavailable comprises detecting that a connection between the content provider and a client has dropped below a threshold level of quality.

9. A method comprising:

generating a client stream including information corresponding to client stream features associated with a presentation of content item;

receiving, from a content provider, a content provider stream including information corresponding to content provider stream features associated with the presentation of the content item;

displaying at least one content provider stream feature;

determining that the content provider stream is at least temporarily unavailable; and

displaying at least one client stream feature.

10. The method of claim 9, wherein the at least one content provider stream feature is displayed in a first image, and wherein the at least one client stream feature is displayed in a second image.

11. The method of claim 10, wherein the first image includes at least one other client stream feature, and wherein the second image includes at least one other content provider stream feature.

12. The computer-implemented method of claim 10, wherein, for an object in the first image, the client stream includes a lower intricacy version of the object and the content provider stream includes a higher intricacy version of the object.

13. The method of claim 9, wherein the client stream is generated based at least in part on a client version of the content item executed at a client compute node, and wherein the content provider stream is generated based at least in part on a content provider version of the content item executed by the content provider.

14. The method of claim 9, wherein state information associated with the content item is exchanged between a client compute node and the content provider, wherein the content provider stream is generated based at least in part on state information received from the client compute node, and wherein the client stream is generated based at least in part on state information received from the content provider.

15. The method of claim 9, wherein determining that that the content provider stream is at least temporarily unavailable comprises detecting that a connection between the content provider and a client has dropped below a threshold level of quality.

16. A non-transitory computer-readable medium having stored thereon a set of instructions, which if performed by one or more processors, causes the one or more processors to perform operations comprising:

receiving, from a client, a request for transmission of a content provider stream associated with a presentation of content item;

receiving, from the client, state information indicating a state associated with one or more features included in a client stream generated by the client in association with the presentation of the content item;

generating the content provider stream based at least in part on the state information received from the client;

transmitting, to the client, the content provider stream; and

transmitting, to the client, state information indicating a state associated with one or more features of the content provider stream.

17. The non-transitory computer-readable storage medium of claim 16, wherein the operations further comprise:

determining that there are insufficient available content provider resources to perform one or more tasks having a higher priority than the generating and the transmitting of the content provider stream; and

deciding to at least temporarily stop the generating and the transmitting of the content provider stream.

18. The non-transitory computer-readable storage medium of claim 16, wherein the operations further comprise:

detecting at least one of a disconnection from the client or a reduction in a quality of a connection to the client below a threshold level of quality; and

responsively stopping, at least temporarily, the transmitting of the content provider stream to the client.

19. The non-transitory computer-readable storage medium of claim 16, wherein at least one feature of a first client stream image is combined with at least one feature of a first content provider stream image to form at least a portion of a first display image.

20. The non-transitory computer-readable storage medium of claim 16, wherein the client stream is generated based at least in part on the state information transmitted to the client indicating the state associated with one or more features of the content provider stream.