Management of streaming video data

• US 10,421,011 B2
• Filed: 06/06/2018
• Issued: 09/24/2019
• Est. Priority Date: 03/16/2016
• Status: Active Grant

• Current Assignee: Skillz Platform, Inc. (Skillz Inc.)
• Original Assignee: Skillz Inc.
• Inventors: Paradise, Andrew
• Primary Examiner(s): Torimiro, Adetokunbo O
• Application Number:
  US16/001,259
• Publication Number:
  US 20180280796A1
• Time in Patent Office: 475 Days
• Field of Search: 463 1, 463 20, 463 22, 463 25, 463 31, 463 39, 463 42
• CPC Class Codes: A63F 13/332 using wireless networks, e.g. cellular phone networks
• CPC Class Codes: A63F 13/335 using Internet
• CPC Class Codes: A63F 13/35 Details of game servers
• CPC Class Codes: A63F 13/355 Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
• CPC Class Codes: A63F 13/497 Partially or entirely replaying previous game actions
• CPC Class Codes: A63F 13/5255 according to dedicated instructions from a player, e.g. using a secondary joystick to rotate the camera around a player's character
• CPC Class Codes: A63F 13/53 involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game
• CPC Class Codes: A63F 13/86 Watching games played by other players
• CPC Class Codes: A63F 2300/406 Transmission via wireless network, e.g. pager or GSM
• CPC Class Codes: A63F 2300/407 Data transfer via internet
• CPC Class Codes: A63F 2300/51 Server architecture

Abstract

User action data characterizing action by a player in a game environment executing at a user client is received at a server. The game environment is created by the user client separate from the server. Data characterizing a selected viewing position is received. The selected viewing position is different than a player viewing position. The selected viewing position characterizes a viewing location within the game environment. A recreated game environment is generated from the user action data at the server. A video stream of the recreated game environment is generated. The video stream includes video from a perspective of the selected viewing position. The video stream is transmitted to a viewing client. Related apparatus, systems, articles, and techniques are also described.

Claims

1. A method comprising:

receiving, at a first data processor, user action data characterizing action by a player in a game environment executing at a client, the game environment created by the client separate from the first data processor, the client rendering the game environment from a first spatial position within the game environment;

receiving, at the first data processor, data characterizing a selected viewing position including a second spatial position within the game environment, the second spatial position different than the first spatial position,

determining, from the user action data, a recreated game environment; and

rendering the recreated game environment, the rendering including past action by the player from a perspective of the selected viewing position.

2. The method of claim 1, wherein the user action data includes data characterizing user interface actions by the player with the game environment.

3. The method of claim 1, wherein determining the recreated game environment includes executing a game engine using game state data and the user activity data.

4. The method of claim 3, wherein the at least one data processor includes the game engine that receives the selected viewing position and the user action data and renders the recreated game environment from the perspective of the selected viewing position.

5. The method of claim 1, wherein the user activity data is retrieved from a database and the user activity data is associated with a historical game play.

6. The method of claim 1, wherein the user activity data is received from the client or a game hosting server, the user activity data from an ongoing executing game environment.

7. The method of claim 1, further comprising:

generating a video stream of the recreated game environment, the video stream including video replay of past action by the player from a perspective of the selected viewing position; and

transmitting the video stream to a viewing client;

wherein generating the video stream includes capturing a rendered recreated game environment.

8. The method of claim 7, further comprising:

receiving an audio stream; and

combining the audio stream with the video stream prior to transmission of the video stream.

9. The method of claim 1, further comprising:

generating statistics on the player using user action data; and

transmitting statistics to a viewing client.

10. The method of claim 1, further comprising:

updating the recreated game environment using the user action data to visualize the past action of the player over time.

11. The method of claim 1, wherein the selected viewing position is dynamic over time and the perspective of the video replay of past action by the player varies over time based on changes in the selected viewing position.

12. The method of claim 1, further comprising:

simultaneously displaying the generated video stream and a live video stream of gameplay by the player within a user interface of a commentator client.

13. The method of claim 1, wherein the rendering is performed by the first data processor or by a server remote from the first data processor.

14. A system comprising:

a first data processor and memory storing instructions, which when executed by the first data processor, cause the first data processor to perform operations comprising;

receiving, at the first data processor, user action data characterizing action by a player in a game environment executing at a client, the game environment created by the client separate from the first data processor, the client rendering the game environment from a first spatial position within the game environment;

receiving, at the first data processor, data characterizing a selected viewing position including a second spatial position within the game environment, the second spatial position different than the first spatial position,

determining, from the user action data, a recreated game environment; and

causing rendering of the recreated game environment, the rendering including past action by the player from a perspective of the selected viewing position.

15. The system of claim 14, wherein the rendering is performed by the first data processor or by a server remote from the first data processor.

16. The system of claim 14, wherein determining the recreated game environment includes executing a game engine using game state data and the user activity data.

17. The system of claim 16, wherein the at least one data processor includes the game engine that receives the selected viewing position and the user action data and renders the recreated game environment from the perspective of the selected viewing position.

18. The system of claim 14, the operations further comprising:

generating a video stream of the recreated game environment, the video stream including video replay of past action by the player from a perspective of the selected viewing position; and

transmitting the video stream to a viewing client;

wherein generating the video stream includes capturing a rendered recreated game environment.

19. The system of claim 18, the operations further comprising:

receiving an audio stream;

combining the audio stream with the video stream prior to transmission of the video stream;

generating statistics on the player using user action data;

transmitting statistics to a viewing client;

simultaneously displaying the generated video stream and a live video stream of gameplay by the player within a user interface of a commentator client.

20. A non-transitory computer program product storing executable instructions, which, when executed by at least one data processor forming part of at least one computing system, implements operations comprising:

receiving, at the first data processor, user action data characterizing action by a player in a game environment executing at a client, the game environment created by the client separate from the first data processor, the client rendering the game environment from a first spatial position within the game environment;

receiving, at the first data processor, data characterizing a selected viewing position including a second spatial position within the game environment, the second spatial position different than the first spatial position,

determining, from the user action data, a recreated game environment; and

causing rendering of the recreated game environment, the rendering including past action by the player from a perspective of the selected viewing position.