Adaptive scene complexity based on service quality

• US 10,601,885 B2
• Filed: 03/20/2017
• Issued: 03/24/2020
• Est. Priority Date: 11/11/2013
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Heinz, II, Gerard Joseph, Thompson, Jonathan Paul, Efremov, Venelin Nikolaev
• Primary Examiner(s): Nano, Sargon N
• Application Number:
  US15/463,606
• Publication Number:
  US 20170195390A1
• Time in Patent Office: 1,100 Days
• CPC Class Codes: A63F 13/355 Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
• CPC Class Codes: H04L 47/24 Traffic characterised by specific attributes, e.g. priority or QoS
• CPC Class Codes: H04L 47/2416 Real-time traffic
• CPC Class Codes: H04L 47/38 by adapting coding or compression rate
• CPC Class Codes: H04L 65/61 for supporting one-way streaming services, e.g. Internet radio
• CPC Class Codes: H04L 65/613 for the control of the source by the destination control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 67/565 Conversion or adaptation of application format or content adding application control or application functional data H04L67/561
• CPC Class Codes: H04N 21/2402 Monitoring of the downstream path of the transmission network, e.g. bandwidth available traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876
• CPC Class Codes: H04N 21/2662 Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
• CPC Class Codes: H04N 21/4402 involving reformatting operations of video signals for household redistribution, storage or real-time display details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764
• CPC Class Codes: H04N 21/4781 Games
• CPC Class Codes: H04N 21/64792 Controlling the complexity of the content stream, e.g. by dropping packets intermediate media network packet handling H04L65/765; proxy provisioning conversion or adaptation for reducing the amount or size of exchanged application data H04L67/5651; negotiation of resources in wireless networks H04W28/16
• CPC Class Codes: H04N 21/8146 involving graphical data, e.g. 3D object, 2D graphics
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video

Abstract

Content, such as a video game, may be delivered by a content provider to a destination using, for example, streaming content delivery techniques. The transmission of the content may be monitored in order to determine transmission conditions such as a quality of the network connection from the content provider to the destination. The determined transmission conditions may then be used to determine adjustments to a complexity of various scenes associated with the content. For example, in some cases, when transmission conditions are unfavorable, scenes may be adjusted by reducing a complexity of the scenes.

Claims

1. A system comprising:

one or more processors

one or more memories to store a set of instructions, which if executed by the one or more processors, causes the one or more processors to perform operations comprising;

identifying data included in a video game corresponding to a scene, wherein the video game includes interest information and intricacy information, the interest information identifying a respective level of interest for each of a plurality of objects in the scene the interest information identifying a respective level of interest for each of a plurality of objects in the scene based at least in part on a likelihood of user interaction therewith, the intricacy information identifying a respective level of intricacy for each of the plurality of objects in the scene;

adjusting, based at least in part on a change in bandwidth of at least one network, the data to result in a reduction to scene complexity associated with the scene, wherein the reduction to the scene complexity comprises removing a first object of the plurality of objects from the scene based at least in part on a first level of interest for the first object identified in the interest information and a first level of intricacy for the first object identified in the intricacy information;

rendering an image based on the data that is adjusted; and

transmitting, over the at least one network, the image to a destination.

2. The system of claim 1, wherein the reduction to the scene complexity further comprises reducing an intricacy of a second object of the plurality of objects.

3. The system of claim 1, wherein the operations further comprise receiving information that comprises data indicative of a quality of network service.

4. A method comprising:

identifying data included in a video game corresponding to a scene, wherein the video game includes interest information and intricacy information, the interest information identifying a respective level of interest for each of a plurality of objects in the scene the interest information identifying a respective level of interest for each of a plurality of objects in the scene, the intricacy information identifying a respective level of intricacy for each of the plurality of objects in the scene;

adjusting, based at least in part on a change in bandwidth of at least one network, the data to result in a reduction to scene complexity associated with the scene, wherein the reduction to the scene complexity comprises removing a first object of the plurality of objects from the scene based at least in part on a first level of interest for the first object identified in the interest information and a first level of intricacy for the first object identified in the intricacy information;

rendering an image based on the data that is adjusted; and

transmitting, over the at least one network, the image to a destination.

5. The method of claim 4, wherein the reduction to the scene complexity further comprises reducing an intricacy of a second object of the plurality of objects.

6. The method of claim 4, further comprising receiving information that comprises data indicative of a quality of network service.

7. The method of claim 4, wherein the respective level of interest for each of the plurality of objects in the scene is based at least in part on a likelihood of user interaction therewith.

8. A non-transitory computer-readable medium having stored thereon a set of instructions, which if performed by one or more processors, causes the one or more processors to perform operations comprising:

identifying data included in a video game corresponding to a scene, wherein the video game includes interest information and intricacy information, the interest information identifying a respective level of interest for each of a plurality of objects in the scene the interest information identifying a respective level of interest for each of a plurality of objects in the scene, the intricacy information identifying a respective level of intricacy for each of the plurality of objects in the scene;

adjusting, based at least in part on a change in bandwidth of at least one network, the data to result in a reduction to scene complexity associated with the scene, wherein the reduction to the scene complexity comprises removing a first object of the plurality of objects from the scene based at least in part on a first level of interest for the first object identified in the interest information and a first level of intricacy for the first object identified in the intricacy information;

rendering an image based on the data that is adjusted; and

transmitting, over the at least one network, the image to a destination.

9. The non-transitory computer-readable medium of claim 8, wherein the reduction to the scene complexity further comprises reducing an intricacy of a second object of the plurality of objects.

10. The non-transitory computer-readable medium of claim 8, wherein the operations further comprise receiving information that comprises data indicative of a quality of network service.

11. The non-transitory computer-readable medium of claim 8, wherein the respective level of interest for each of the plurality of objects in the scene is based at least in part on a likelihood of user interaction therewith.