Systems and methods of serving game video

• US 8,147,339 B1
• Filed: 12/15/2008
• Issued: 04/03/2012
• Est. Priority Date: 12/15/2007
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: Gaikai Incorporated (Sony Group Corp.)
• Inventors: Perry, David
• Primary Examiner(s): Richards, N Drew
• Assistant Examiner(s): Singal, Ankush
• Application Number:
  US12/334,819
• Time in Patent Office: 1,205 Days
• Field of Search: 463 31- 33
• US Class Current: 463/42
• CPC Class Codes: A63F 13/335 using Internet
• CPC Class Codes: A63F 13/355 Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
• CPC Class Codes: A63F 2300/5533 using program state or machine event data, e.g. server keeps track of the state of multiple players on in a multiple player game

Abstract

A multiplayer game is supported by a backend game server and a plurality of clients configured to communicate over a computing network such as the internet. Images for display on the clients are at least partially rendered by the backend game server and then delivered in an at least partially rendered form to the clients. At the clients the delivered images may be further rendered and are displayed to a player of the game. The displayed images optionally include images of real-world objects.

Claims

1. A system comprising:

a state machine configured to maintain a state of a multi-player game, the state being responsive to inputs received from a plurality of clients;

a first image generator configured to receive the state from the state machine and to at least partially render a first image based on the state and a point of view of a first player;

a second image generator configured to receive the state from the state machine and to at least partially render a second image based on the state and a point of view of a second player; and

a network interface configured to deliver the first image to a first of the clients and the second image to a second of the clients, over a computing network.

2. The system of claim 1, further comprising an image compressor configured to compress the first image and the second image prior to delivery over the computing network.

3. The system of claim 1, further comprising the first of the clients and the second of the clients.

4. The system of claim 1, wherein the first image is fully rendered.

5. The system of claim 1, wherein the first image is only partially rendered.

6. The system of claim 1, wherein the first image is configured for a further texture to be added by the first client.

7. The system of claim 1, wherein the first image generator is assigned to generate at least partially rendered images for the first client and the second image generator is assigned to generate at least partially rendered images for the second client.

8. The system of claim 1, wherein the first image generator is assigned to generate at least partially rendered images of a first region or instance within the multi-player game, and the second image generator is assigned to generate at least partially rendered images of a second region or instance within the multi-player game.

9. The system of claim 1, wherein the first image generator is configured to generate an image of a first size and the second image generator is configured to generate an image of a second size.

10. The system of claim 1, wherein the first client is a renderless client.

11. The system of claim 1, wherein the first image generator comprises a local state memory configured to store part of the state of the multi-player game.

12. The system of claim 1, wherein the first image generator is configured to generate at least partially rendered images for a plurality of clients in parallel.

13. The system of claim 1, wherein the at least partially rendering does not include an application of textures to all points that are visible.

14. The system of claim 1, wherein the computing network comprises the internet.

15. The system of claim 1, wherein the first image generator is configured to at least partially render the first image based on a virtual 3D environment including avatars of multiple players.

16. A system comprising:

a network interface configured to receive an image via a computing network and to deliver player commands and a point of view of an avatar of a player to a game server via the computing network, the image including an image of a video game rendered by a game server based on a game state of the video game and the point of view of an avatar of a player;

a player interface configured to receive the player commands from the player; and

a display configured to display the image to the player.

17. The system of claim 16, further including a state memory configured to store a state of the video game and a processor configured to process the player commands based on the state of the video game.

18. The system of claim 16, further including a decompressor configured to decompress the received image.

19. The system of claim 16, further including a renderer configured to further render the received image to generate a fully rendered image.

20. The system of claim 16, further including a renderer configured to further render the received image by adding a texture to the received image, to generate a fully rendered image.

21. The system of claim 16, wherein the network interface is addressable using a MAC or internet protocol address.

22. A method comprising:

receiving a command from a first player via a first client and a computing network;

updating a game state based on the command received from the first player;

receiving a first point of view of the first player via the computing network;

communicating at least part of the game state to a first image generator;

rendering a first image based on the game state and the first point of view using the first image generator; and

delivering the first image to the first player via the first client and the computing network.

23. The method of claim 22, further comprising:

receiving a command from a second player via the computing network;

updating the game state based on the command received from the second player;

receiving a second point of view of the second player via the computing network;

communicating at least part of the game state to a second image generator;

rendering a second image based on the game state and the second point of view using the second image generator; and

delivering the second image to the second player via the computing network.

24. The method of claim 22, wherein the first image is delivered to the first client as a partially rendered image and further rendered by the first client.

25. The method of claim 22, wherein the first image is delivered to the first client using TCP/IP protocols.

26. The method of claim 22, wherein updating the game state comprises updating a global game state and wherein communicating the at least part of the game state to the first image generator comprises communicating only a local game state subset of the global game state.

27. The method of claim 22, wherein rendering the first image does not include an application of textures to all points that are visible.

28. The method of claim 22, wherein rendering the first image comprises rendering only a partial rendering and delivering the first image to the first player comprises delivering only the partial rendering.

29. The method of claim 22, wherein rendering the first image is based on a virtual 3D environment including avatars of multiple players.

30. A method comprising:

receiving a command from a player via a player interface;

sending the received command to a game server via a computing network;

receiving a compressed image from the game server via the computing network, the compressed image including an image of a video game rendered based on a game state of the video game and a point of view of an avatar of the player, the game state being based on the sent command;

decompressing the compressed image; and

displaying the decompressed image to the player.

31. The method of claim 30, wherein the compressed image is a partially rendered image, and further including further rendering the partially rendered image.

32. The method of claim 30, wherein the compressed image is received via the internet.