Service for generating graphics object data

• US 10,315,110 B2
• Filed: 02/13/2017
• Issued: 06/11/2019
• Est. Priority Date: 11/11/2013
• Status: Expired due to Fees

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Heinz, II, Gerard Joseph, Efremov, Venelin Nikolaev, Thompson, Jonathan Paul
• Primary Examiner(s): Galka, Lawrence S
• Application Number:
  US15/430,704
• Publication Number:
  US 20170151496A1
• Time in Patent Office: 848 Days
• CPC Class Codes: A63F 13/355 Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
• CPC Class Codes: A63F 2300/538 for performing operations on behalf of the game client, e.g. rendering
• CPC Class Codes: D06B 1/00 Applying liquids, gases or vapours onto textile materials to effect treatment, e.g. washing, dyeing, bleaching, sizing or impregnating mercerising D06B7/00; solvent-treatment D06B9/00; treatment of selected parts of textile materials D06B11/00; with aid of vibration D06B13/00
• CPC Class Codes: G06F 15/00 Digital computers in general details G06F1/00 – G06F13/00; Data processing equipment in general
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 5/70 Denoising; Smoothing
• CPC Class Codes: G09G 2340/02 Handling of images in compressed format, e.g. JPEG, MPEG
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 2350/00 Solving problems of bandwidth in display systems
• CPC Class Codes: G09G 2370/022 Centralised management of display operation, e.g. in a server instead of locally

Abstract

When a scene is generated, a content item may identify graphics object service requests associated with the scene. Each scene may have any number of associated graphics object service requests that may be sent to any number of different graphics object services. The graphics object services may be accessible over a network such as the Internet. By requesting object data from graphics object services, a content item may, for example, reduce at least part of the computational burden on a graphics processing unit of a client device.

Claims

1. A method comprising:

calculating, by a client device, an amount of incoming data that is receivable by the client device within a time period;

allocating, by the client device, a first portion of the amount of incoming data to a first request for a first service external to the client device to render a first object associated with a scene of a video game;

determining, by the client device, a first encoding bitrate for the first object based at least in part on the first portion of the amount of incoming data;

transmitting, to the first service, the first request to render the first object and an indication of the first encoding bitrate;

allocating, by the client device, a second portion of the amount of incoming data to a second request for a second service external to the client device to render a second object also associated with the scene of the video game;

determining, by the client device, a second encoding bitrate for the second object based at least in part on the second portion of the amount of incoming data;

transmitting, to the second service, the second request to render the second object and an indication of the second encoding bitrate;

receiving, by the client device, the first object from the first service and the second object from the second service; and

displaying, on the client device, an image associated with the scene, the image including the first object and the second object.

2. The method of claim 1, further comprising combining, by the client device, a first portion of the image with a second portion of the image, wherein the first portion includes the first object and the second portion includes the second object.

3. The method of claim 2, wherein combining the first portion of the image with the second portion of the image is performed in accordance with a representation that includes multiple layers, wherein a first layer corresponds to the first portion of the image, and wherein a second layer corresponds to the second portion of the image.

4. The method of claim 2, wherein combining the first portion of the image with the second portion of the image comprises inserting the first portion into a first identified area of the image and inserting the second portion into a second identified area of the image.

5. The method of claim 2, wherein a third portion of the image is rendered by the client device.

6. The method of claim 2, further comprising:

generating a blurring effect at an area along a border of the first portion of the image and the second portion of the image.

7. The method of claim 2, wherein the video game comprises instructions for requesting rendering of the first object.

8. A system comprising:

one or more processors

one or more memories to store a set of instructions, which if executed by the one or more processors, causes the one or more processors to perform operations comprising;

calculating, by a client device, an amount of incoming data that is receivable by the client device within a time period;

allocating, by the client device, a first portion of the amount of incoming data to a first request for a first service external to the client device to render a first object associated with a scene of a video game;

determining, by the client device, a first encoding bitrate for the first object based at least in part on the first portion of the amount of incoming data;

transmitting, to the first service, the first request to render the first object and an indication of the first encoding bitrate;

allocating, by the client device, a second portion of the amount of incoming data to a second request for a second service external to the client device to render a second object also associated with the scene of the video game;

determining, by the client device, a second encoding bitrate for the second object based at least in part on the second portion of the amount of incoming data;

transmitting, to the second service, the second request to render the second object and an indication of the second encoding bitrate;

receiving, by the client device, the first object from the first service and the second object from the second service; and

displaying, on the client device, an image associated with the scene, the image including the first object and the second object.

9. The system of claim 8, further comprising combining, by the client device, a first portion of the image with a second portion of the image, wherein the first portion includes the first object and the second portion includes the second object.

10. The system of claim 9, wherein combining the first portion of the image with the second portion of the image is performed in accordance with a representation that includes multiple layers, wherein a first layer corresponds to the first portion of the image, and wherein a second layer corresponds to the second portion of the image.

11. The system of claim 9, wherein combining the first portion of the image with the second portion of the image comprises inserting the first portion into a first identified area of the image and inserting the second portion into a second identified area of the image.

12. The system of claim 9, wherein a third portion of the image is rendered by the client device.

13. The system of claim 9, wherein the operations further comprise:

generating a blurring effect at an area along a border of the first portion of the image and the second portion of the image.

14. The system of claim 9, wherein the video game comprises instructions for requesting rendering of the first object.

15. A non-transitory computer-readable medium having stored thereon a set of instructions, which if performed by one or more processors, causes the one or more processors to perform operations comprising:

calculating, by a client device, an amount of incoming data that is receivable by the client device within a time period;

allocating, by the client device, a first portion of the amount of incoming data to a first request for a first service external to the client device to render a first object associated with a scene of a video game;

determining, by the client device, a first encoding bitrate for the first object based at least in part on the first portion of the amount of incoming data;

transmitting, to the first service, the first request to render the first object and an indication of the first encoding bitrate;

allocating, by the client device, a second portion of the amount of incoming data to a second request for a second service external to the client device to render a second object also associated with the scene of the video game;

determining, by the client device, a second encoding bitrate for the second object based at least in part on the second portion of the amount of incoming data;

transmitting, to the second service, the second request to render the second object and an indication of the second encoding bitrate;

receiving, by the client device, the first object from the first service and the second object from the second service; and

displaying, on the client device, an image associated with the scene, the image including the first object and the second object.

16. The non-transitory computer-readable medium of claim 15, further comprising combining, by the client device, a first portion of the image with a second portion of the image, wherein the first portion includes the first object and the second portion includes the second object.

17. The non-transitory computer-readable medium of claim 16, wherein combining the first portion of the image with the second portion of the image is performed in accordance with a representation that includes multiple layers, wherein a first layer corresponds to the first portion of the image, and wherein a second layer corresponds to the second portion of the image.

18. The non-transitory computer-readable medium of claim 16, wherein combining the first portion of the image with the second portion of the image comprises inserting the first portion into a first identified area of the image and inserting the second portion into a second identified area of the image.

19. The non-transitory computer-readable medium of claim 16, wherein a third portion of the image is rendered by the client device.

20. The non-transitory computer-readable medium of claim 16, wherein the video game comprises instructions for requesting rendering of the first object.