STREAMING GAME SERVER VIDEO RECORDER

• US 20150131969A1
• Filed: 11/11/2013
• Published: 05/14/2015
• Est. Priority Date: 11/11/2013
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Taraki, Quais, Vahlsing, Matthew, Mamtani, Vinod Murli, Morris, James Jonathan, Heinz, Gerard Joseph II
• Granted Patent: US 9,374,552 B2
• Time in Patent Office: Days
• US Class Current: 386/248
• CPC Class Codes: G06T 11/40 Filling a planar surface by adding surface attributes, e.g. colour or texture
• CPC Class Codes: H04L 65/1083 In-session procedures
• CPC Class Codes: H04L 65/1089 by adding media; by removing media
• CPC Class Codes: H04L 65/4015 where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04L 67/1021 based on client or server locations
• CPC Class Codes: H04L 67/1027 Persistence of sessions during load balancing
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04L 67/141 Setup of application sessions admission control or resource allocation in data switching networks H04L47/70
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/2343 involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements video transcoding H04N19/40; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 21/2747 Remote storage of video programs received via the downstream path, e.g. from the server
• CPC Class Codes: H04N 5/76 Television signal recording
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus

Abstract

A content provider may operate computing nodes configured to provide graphics rendering services to a client running a game or other application. A graphics frame may be rendered and encoded in a format compatible with a client'"'"'s display device. A second version of the frame may be encoded in a format having selected storage characteristics and compatible with a plurality of display types. The frame may be added to the end of a video stored by the content provider. Frames may be deleted from the video to prevent the video from exceeding a maximum length.

Claims

1. A system for recording video content, the system comprising:

one or more storage devices; and

one or more computing nodes communicatively coupled to the one or more storage devices, the one or more computing nodes configured to operate a service for rendering graphics on behalf of a first client remote to the one or more computing nodes, the one or more computing nodes further configured at least to;

run an application, the application including video content;

render a first frame on behalf of the first client;

encode the first frame of the video content in a first format compatible with a first display type, the first display type corresponding to a display of the first client;

transmit the first frame to the first client;

store a second frame of the video content in a sequence of frames stored on the one or more storage devices, the second frame corresponding to a time of the first frame, the second frame encoded in a second format compatible with a plurality of display types, the plurality of display types comprising the first display type;

determine that a threshold length of the sequence of frames has been exceeded, the determining based at least in part on a count of frames in the sequence of frames stored on the one or more storage devices; and

remove an earliest frame from the sequence of frames stored on the one or more storage devices upon determining that the threshold has been exceeded, the earliest frame corresponding to a time prior to the first frame.

2. The system of claim 1, the one or more computing nodes further configured at least to:

receive information indicative of at least one of an identity of a user of the first client, a client process, a session, a timestamp, an annotation, or a publisher; and

store, on the one or more storage devices, an association between the sequence of frames and the information.

3. The system of claim 1, the one or more computing nodes further configured at least to:

receive information indicative of at least one of a timestamp, an annotation, or an event that occurred in a process executing on the first client; and

store, on the one or more storage devices, an association between at least one frame of the sequence of frames and the information indicative of the event.

4. The system of claim 1, the one or more computing nodes further configured at least to:

render the second frame of the video content from a viewpoint different from a viewpoint of the first frame, wherein the viewpoint comprises at least one of distance, position, or orientation.

5. A method of recording video formed by a rendering service operating on one or more computing nodes remote to a first client, the method comprising:

rendering, by the rendering service, a first frame of video content for an application, the first frame encoded in a first format compatible with a first display type corresponding to a display of the first client;

transmitting the first frame to the first client;

storing a second frame of the video content in a sequence of frames stored on one or more storage devices of the one or more computing nodes, the second frame corresponding to a time of the first frame, the second frame encoded in a second format compatible with one or more display types, the one or more display types comprising the first display type; and

deleting at least one frame from the sequence of frames stored on the one or more storage devices.

6. The method of claim 5, further comprising:

storing an association between the sequence of frames and information indicative of at least one of an identity of a user of the first client, a client process, a session, a timestamp, an annotation, or a publisher.

7. The method of claim 5, further comprising:

storing an association between at least one frame of the sequence of frames and information indicative of at least one of state information or metadata for the application.

8. The method of claim 5, further comprising:

transmitting a copy of the second frame to a second client.

9. The method of claim 8, wherein a display of the second client is compatible with an additional display type other than the first display type.

10. The method of claim 5, further comprising:

rendering the second frame of the video content from at least one of a different distance, position, or orientation than the first frame.

11. The method of claim 5, further comprising:

rendering, by the rendering service, a graphical element; and

forming a third frame by overlaying or juxtaposing the graphical element with the first frame.

12. The method of claim 5, further comprising:

forming an index based at least in part on metadata associated with a frame of the sequence of frames.

13. The method of claim 5, further comprising:

rendering the second frame based at least in part on state information maintained by the one or more computing nodes, the state information corresponding to the application.

14. The method of claim 5, wherein the one or more storage devices comprises a memory of at least one of the one or more computing nodes.

15. The method of claim 5, further comprising recording an association between a timestamp and the second frame.

16. A non-transitory computer-readable storage medium having stored thereon instructions that, upon execution by one or more computing devices, cause the one or more computing devices at least to:

render, by a rendering service operating on one or more computing nodes, a first frame of video content, the first frame encoded in a first format compatible with a first display type corresponding to a display of a first client remote to the one or more computing nodes;

send the first frame to the first client;

store a second frame of the video content in a first sequence of frames stored on one or more storage devices of the one or more computing nodes, the second frame corresponding to a time of the first frame, the second frame encoded in a second format compatible with the first display type and a second display type; and

delete an earliest frame from the first sequence of frames stored on the one or more storage devices.

17. The non-transitory computer-readable medium of claim 16, comprising further instructions that, upon execution by the one or more computing devices, cause the one or more computing devices to at least:

store metadata corresponding to the first sequence of frames on the one or more storage devices.

18. The non-transitory computer-readable medium of claim 16, comprising further instructions that, upon execution by the one or more computing devices, cause the one or more computing devices to at least:

transmit a copy of the second frame to a second client.

19. The non-transitory computer-readable medium of claim 16, comprising further instructions that, upon execution by the one or more computing devices, cause the one or computing devices to at least:

store a second sequence of frames on the one or more storage devices upon receiving a request indicative of storing the second sequence of frames, the second sequence of frames comprising one or more frames of the first sequence of frames.

20. The non-transitory computer-readable medium of claim 19, wherein the request is sent by the first client in response to an in-game event.

21. The non-transitory computer-readable medium of claim 16, comprising further instructions that, upon execution by the one or more computing devices, cause the one or more computing devices to at least:

receive, from the first client, information indicative of the second format.

22. The non-transitory computer-readable medium of claim 16, comprising further instructions that, upon execution by the one or more computing devices, cause the one or more computing devices to at least:

transmit the second frame to one or more additional clients.