Dual-mode program execution

• US 8,840,476 B2
• Filed: 09/13/2011
• Issued: 09/23/2014
• Est. Priority Date: 12/15/2008
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment America LLC (Sony Group Corp.)
• Inventors: Perry, David, Gault, Andrew Buchanan, Pereira, Rui Filipe Andrade
• Primary Examiner(s): LIM, SENG HENG
• Application Number:
  US13/231,790
• Publication Number:
  US 20120005316A1
• Time in Patent Office: 1,106 Days
• Field of Search: None
• US Class Current: 463/42
• CPC Class Codes: H04L 65/4025 where none of the additional parallel sessions is real time or time sensitive, e.g. downloading a file in a parallel FTP session, initiating an email or combinational services
• CPC Class Codes: H04L 65/61 for supporting one-way streaming services, e.g. Internet radio
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04L 67/142 Managing session states for stateless protocols; Signalling session states; State transitions; Keeping-state mechanisms
• CPC Class Codes: H04L 67/34 involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416

Abstract

A computing system is configured to execute a computer program on a server and to provide a video stream of the program output to a geographically remote client over a communication network. The computing system is further configured to provide executable content of the computer program to the client over the communication network in parallel with the video stream. When a sufficient amount of the executable content has been provided to the client execution of the computer program is transitioned from the server to the client. The transition optionally includes communicating a state of the computer program from the server to the client. The executable content can be provided to the client in an order that is determined based on the state of the computer program. Those parts of the executable content deemed most likely to be necessary to support game play on the client are given priority.

Claims

1. A game system comprising:

a video source configured to provide a streaming video to a first client geographically remote from the video source, the streaming video being generated at the video source and being based on a state of a video game; and

a download manager configured to download executable content of the video game from a code source to the first client via a network while the streaming video is being provided to the first client from the video source;

wherein the video source is configured to generate a first streaming video based on a point of view of a first user and a second streaming video based on a point of view of a second user, and to provide the first and second streaming videos to the first client and a second client respectively;

transition logic configured to transition the generation of the first streaming video from the video source to the first client without interrupting a game session of the video game, the transition logic configured to determine when an executable subset of the executable content has been provided to the first client, the transition logic further configured to initiate execution of the executable subset on the first client;

wherein the state of the video game is dependent on commands received from the first and second clients both prior to and following the transition.

2. The system of claim 1, wherein the video source is configured to produce the streaming video using a graphic processing unit.

3. The system of claim 2, wherein the graphics processing unit is configured to generate two or more video streams in parallel, and the video source is configured to communicate these video streams to different clients.

4. The system of claim 1, wherein the first or second streaming video is rendered at the video source from a three dimensional game environment.

5. The system of claim 1, wherein the state of the video game is provided to the first client while the streaming video is being provided to the first client.

6. The system of claim 1, wherein the download manager is configured to give greater priority to providing the first streaming video to the first client relative to providing the executable content to the first client.

7. The system of claim 1, wherein the download manager is configured to provide the executable content at a bit rate that is dependent on a bandwidth of a communication channel between the code source and the first client and is also dependent on an amount of data in the first streaming video.

8. The system of claim 1, wherein the download manager is configured to download the executable content to the first client at a rate that is limited by a rate at which the first streaming video is provided to meet a minimum acceptable quality of the first streaming video as displayed on the first client.

9. The system of claim 1, further comprising a state source configured to provide the state of the video game to the first client.

10. The system of claim 9, wherein the state source is further configured to update a copy of the state of the video game stored on the first client.

11. The system of claim 9, wherein the state source is further configured to update a copy of the state of the video game stored at the state source based on data received from a game server.

12. The system of claim 1, wherein the transition logic is configured to provide notice to a user of the first client that the generation of the first streaming video can be transitioned from the video source to the first client.

13. The system of claim 12, wherein the notice is provided as a video overlay on the first streaming video or in a same browser window as the first streaming video is presented.

14. The system of claim 12, wherein the notice includes an amount of time remaining before the generation of the first streaming video at the video source will be terminated.

15. The system of claim 1, wherein the execution of the executable content on the first client is initiated while the first streaming video is being provided to the first client from the video source.

16. The system of claim 1, wherein the download manager is configured to continue providing executable content of the video game to the client after initiation of execution of the executable subset.

17. The system of claim 1, wherein the transition logic is configured to synchronize execution of the executable content on the first client with execution of the video game.

18. The system of claim 1, wherein the transition logic is configured to provide an IP address of the first client to a game server, the video source being configured to receive a state of the video game from the game server.

19. The system of claim 18, wherein the transition logic is configured to cause the game server to provide updates of the state of the video game to the first client.

20. The system of claim 1, further comprising qualification logic configured for determining if the first client is capable of receiving the executable content and the streaming video at a minimum level of quality in parallel.

21. The system of claim 1, wherein a total rate at which the streaming video and executable content are provided to the first client in parallel is greater than a bandwidth of a communication channel through which the first streaming video is communicated.

22. A game system comprising:

a game server configured to execute a multiplayer game session of a multiplayer video game;

a video server configured to provide a first streaming video and a second streaming video to a first client and a second client, respectively, based on a game state of the multiplayer video game received from the game server; and

a download manager configured to provide executable content of the video game from a code source to the first client via a network while the first streaming video is being provided to the first client from the video source, the download manager configured to initiate execution of the executable content on the first client;

transition logic configured to, during the multiplayer game session, transition communications with the game server from the video server to the first client following initiation of execution of the executable content on the first client;

wherein the game state of the video game is dependent on commands received from the first and second clients both prior to and following the transition.

23. The game system of claim 22, wherein transitioning communications includes transitioning from sending the game state from the game server to the video server, to sending the game state from the game server to the first client.

24. The game system of claim 22, wherein transitioning communications includes transitioning from receiving game commands from the video server at the game server, to receiving the game commands from the first client at the game server.

25. A game system comprising:

a game engine configured to maintain a global game state of a video game during a game session based on received game commands;

a video source configured to generate a first video stream for a first client based on a first subset of the global game state, the video source further configured to generate a second video stream for a second client based on a second subset of the global game state;

a download manager configured to provide executable content of the video game to the first client while the first streaming video is being provided to the first client, the download manager configured to initiate execution of the executable content on the first client;

transition logic configured to, during the game session, reassign the first subset of the global game state from the video source to the first client;

wherein the global game state of the video game is dependent on commands received from the first and second clients both prior to and following the reassignment.

26. The game system of claim 25,

wherein the received game commands include commands associated with the first client and commands associated with the second client;

wherein the transition logic is configured to, during the game session, transition the game engine from receiving the commands associated with the first client from the video source, to receiving the commands associated with the first client from the first client.