Program mode switching

• US 9,498,714 B2
• Filed: 09/13/2011
• Issued: 11/22/2016
• Est. Priority Date: 12/15/2007
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment America LLC (Sony Group Corp.)
• Inventors: Pereira, Rui Filipe Andrade, Perry, David, Gault, Andrew Buchanan
• Primary Examiner(s): McClellan, James S
• Assistant Examiner(s): Weatherford, Syvila
• Application Number:
  US13/231,850
• Publication Number:
  US 20120004040A1
• Time in Patent Office: 1,897 Days
• Field of Search: 463/40, 463/31, 709/231, 345/522
• US Class Current: 1/1
• CPC Class Codes: A63F 13/30 Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
• CPC Class Codes: A63F 13/34 using peer-to-peer connections
• CPC Class Codes: A63F 13/355 Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
• CPC Class Codes: A63F 13/358 Adapting the game course according to the network or server load, e.g. for reducing latency due to different connection speeds between clients
• CPC Class Codes: A63F 13/70 Game security or game management aspects
• CPC Class Codes: A63F 13/77 involving data related to game devices or game servers, e.g. configuration data, software version or amount of memory
• CPC Class Codes: A63F 2300/402 Communication between platforms, i.e. physical link to protocol
• CPC Class Codes: A63F 2300/534 for network load management, e.g. bandwidth optimization, latency reduction
• CPC Class Codes: A63F 2300/538 for performing operations on behalf of the game client, e.g. rendering
• CPC Class Codes: A63F 2300/552 for downloading to client devices, e.g. using OS version, hardware or software profile of the client device
• CPC Class Codes: A63F 2300/554 by saving game or status data
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 15/005 General purpose rendering architectures
• CPC Class Codes: G09G 5/363 Graphics controllers

Abstract

A computing system is configured to execute a computer program on a server and to provide a video stream of the program output to a geographically remote client over a communication network. The computing system is further configured to provide executable content of the computer program to the client over the communication network in parallel with the video stream. When a sufficient amount of the executable content has been provided to the client execution of the computer program is transitioned from the server to the client. The transition optionally includes communicating a state of the computer program from the server to the client. The executable content can be provided to the client in an order that is determined based on the state of the computer program. Those parts of the executable content deemed most likely to be necessary to support game play on the client are given priority.

Claims

1. A method of providing a computer game, the method comprising:

receiving a command for processing by the computer game at a video server system, the command received from a remote client directing execution of the computer game;

executing game logic of the computer game on the video server system in accordance with the command received from the remote client, execution of the game logic resulting in generation of a video game environment based on a game state and on the command received from the remote client;

operating a graphics processing unit at the video server system to render the video game environment to video data;

processing the video data through an encoding pipeline at the video server system to encode the video data into a data format compatible with a codec present at the remote client;

providing the encoded video data from the video server system to the remote client over a communication network; and

providing executable game logic of the computer game to the remote client in addition to the encoded video data;

executing the executable game logic of the computer game on the remote client to generate video of the computer game at the remote client based on the game state and on commands for processing by the computer game as provided at the remote client; and

in conjunction with executing the executable game logic of the computer game on the remote client, stopping provision of the encoded video data from the video server system to the remote client over the communication network.

2. The method of claim 1, wherein a rate, in bytes/second, at which the executable game logic is provided is dependent on a bandwidth of the communication network.

3. The method of claim 1, wherein a rate, in bytes/second, at which the executable game logic is provided is dependent on a bandwidth required to provide the encoded video data at a minimum level of quality.

4. The method of claim 1, wherein a data packet sent from the video server system to the remote client includes both the encoded video data and data of the executable game logic.

5. The method of claim 4, wherein the data of the executable game logic is background downloaded from the video server system to the remote client during provision of the encoded video data from the video server system to the remote client.

6. The method of claim 1, wherein stopping provision of the encoded video data from the video server system to the remote client over the communication network is part of transitioning from a streaming mode in which the encoded video data is provided to the remote client from the video server system to a client mode in which the executable game logic is used to generate video of the computer game on the remote client.

7. The method of claim 6, wherein the transitioning includes reassigning a game session to operate between a game server and the remote client rather than or in addition to between the game server and the video server system.

8. The method of claim 6, further comprising:

after transitioning to the client mode, transferring game state data from the remote client to the video server system during execution of the executable game logic in the client mode or after completing a session of the execution of the executable game logic in the client mode.

9. The method of claim 1, further comprising:

receiving a game command at the video server system from the remote client;

forwarding the received game command to a game server; and

receiving a game state from the game server, the game state having been updated using the received game command.

10. The method of claim 9, further comprising:

using the received game command to update a game state on the remote client.

11. The method of claim 1, further comprising:

determining a rate at which the executable game logic can be downloaded to the remote client while maintaining a minimum level of quality for display of a video stream corresponding to the encoded video data on the remote client.

12. The method of claim 11, wherein the rate at which the executable game logic can be downloaded to the remote client is dependent on a rate at which the encoded video data is provided to the remote client.

13. The method of claim 11, wherein the rate at which the executable game logic can be downloaded to the remote client changes over time.

14. The method of claim 11, wherein the executable game logic is provided to the remote client at a rate less than or equal to the determined rate.

15. The method of claim 1, wherein the executable game logic and the encoded video data are provided to the remote client in parallel.

16. The method of claim 1, further comprising:

modifying an order in which parts of the executable game logic are provided to the remote client, wherein the modifying is based on the game state.

17. The method of claim 16, wherein modifying the order is dependent on a probability of reaching a second game state from a first game state.

18. The method of claim 1, further comprising:

providing the game state to the remote client from the video server system or from a game server.

19. The method of claim 1, further comprising:

transferring a game session such that the game state is sent from a game server to the remote client rather than or in addition to from the game server to the video server system.

20. The method of claim 19, wherein the game session is transferred automatically.

21. The method of claim 1, further comprising:

transferring the game session such that a game server assigns commands received from the remote client to the game session that was previously established between the video server system and the game server.

22. The method of claim 21, wherein transferring the game session includes sending instructions to the game server configured to cause the game server to change network addresses associated with the game session.

23. The method of claim 1, further comprising:

starting execution of the executable game logic on the remote client to produce game video based on the game state.

24. The method of claim 23, further comprising:

continuing to execute the executable game logic on the remote client while further parts of the executable game logic are downloaded to the remote client.

25. The method of claim 23, wherein the executable game logic provided to the remote client includes all available executable game logic for the computer game.

26. A method of providing a computer game, the method comprising:

executing game logic of the computer game on a video server system or a first client, execution of the game logic resulting in generation of a video game environment based on a game state;

operating a graphics processing unit at the video server system of the first client to render the video game environment to video data;

processing the video data through an encoding pipeline at the video server system to encode the video data into a data format compatible with a codec present at a remote second client;

providing the encoded video data from the video server system or the first client to the remote second client over a communication network; and

providing executable game logic to the remote second client from the first client in parallel with the encoded video data, the executable game logic configured to execute on the remote second client to generate game video at the remote second client based on the game state,

wherein executing game logic of the computer game on the video server system or the first client is done in accordance with command data received from the remote second client;

executing the executable game logic on the remote second client to generate game video at the remote second client based on the game state; and

in conjunction with executing the executable game logic on the remote second client, stopping provision of the encoded video data from the video server system or the first client to the remote second client over the communication network and stopping execution of game logic of the computer game on the video server system or the first client.

27. The method of claim 26, further comprising:

determining a proximity of the first client to the remote second client.

28. The method of claim 26, further comprising:

testing or monitoring a communication channel between the first client and the remote second client.

29. The method of claim 26, further comprising:

using a download manager on a server separate from both the first client and the remote second client to manage the communication of the executable game logic to the remote second client from the first client.

30. The method of claim 26, wherein the game logic is executed on the first client before executing the executable game logic on the remote second client to generate game video at the remote second client based on the game state.

31. The method of claim 26, wherein the executable game logic is provided to the remote second client from a plurality of clients including the first client on a peer-to-peer basis.

32. The method of claim 26, wherein data of the executable game logic is background downloaded from the video server system to the remote second client during provision of the encoded video data to the remote second client.

33. A method of providing a computer game, comprising:

executing game logic of the computer game on a video server system or a first client, execution of the game logic resulting in generation of a video game environment based on a game state;

operating a graphics processing unit at the video server system of the first client to render the video game environment to video data;

processing the video data through an encoding pipeline at the video server system to encode the video data into a data format compatible with a codec present at a remote second client;

providing the encoded video data from the video server system or the first client to a remote second client over a communication network;

providing executable game logic to the remote second client from the first client in parallel with the encoded video data, the executable game logic configured to execute on the remote second client to generate game video at the remote second client based on the game state;

transitioning from a streaming mode in which the encoded video data is provided to the remote second client to a client mode in which the executable game logic is used to generate video of the computer game on the remote second client; and

after transitioning to the client mode, transferring game state data from the remote second client to the video server system during execution of the executable game logic in the client mode or after completing a session of the execution of the executable game logic in the client mode; and

after transitioning to the client mode, stopping provision of the encoded video data from the video server system or the first client to the remote second client over the communication network.