System and method for retaining system state

• US 9,782,676 B2
• Filed: 10/26/2015
• Issued: 10/10/2017
• Est. Priority Date: 12/05/2007
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment America LLC (Sony Group Corp.)
• Inventors: Speck, John, Perlman, Stephen G.
• Primary Examiner(s): DO, KHANG D
• Application Number:
  US14/923,359
• Publication Number:
  US 20160045826A1
• Time in Patent Office: 715 Days
• CPC Class Codes: A63F 13/12 involving interaction between a plurality of game devices, e.g. transmisison or distribution systems protocols for networked virtual reality, networked games H04L29/06034
• CPC Class Codes: A63F 13/30 Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
• CPC Class Codes: A63F 13/335 using Internet
• CPC Class Codes: A63F 13/35 Details of game servers
• CPC Class Codes: A63F 13/355 Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
• CPC Class Codes: A63F 13/358 Adapting the game course according to the network or server load, e.g. for reducing latency due to different connection speeds between clients
• CPC Class Codes: A63F 13/493 Resuming a game, e.g. after pausing, malfunction or power failure
• CPC Class Codes: A63F 2300/407 Data transfer via internet
• CPC Class Codes: A63F 2300/534 for network load management, e.g. bandwidth optimization, latency reduction
• CPC Class Codes: A63F 2300/535 for monitoring, e.g. of user parameters, terminal parameters, application parameters, network parameters
• CPC Class Codes: A63F 2300/538 for performing operations on behalf of the game client, e.g. rendering
• CPC Class Codes: A63F 2300/554 by saving game or status data
• CPC Class Codes: A63F 2300/636 involving process of starting or resuming a game

Abstract

An apparatus and method are described for retaining system state of an online application such as a video game. For example, a method according to one embodiment comprises: executing a application on a server in response to user input from a client; transmitting video generated by the application over a network connection from the server to the client; detecting that the network connection has become unusable or impaired; responsively pausing the execution of the application from a current point of execution; and resuming the execution of the application from the current point of execution upon detecting that the network connection has become usable or unimpaired.

Claims

1. A hosting service including one or more servers and storage, the hosting service being implemented for streaming video games to connected clients over the Internet, wherein execution of video games is processed by the one or more servers of the hosting service, the hosting service is configured implement a method comprising:

executing a video game on a server in response to user input from a client;

compressing video output from the video game by an encoder to generate interactive compressed streaming video;

transmitting the interactive compressed streaming video generated by the server over a network connection from the server to the client, the client is configured to have a decoder for decompressing the interactive compressed streaming video;

detecting by the server that the network connection has become impaired, wherein detecting that the network connection has become impaired comprises detecting that a network latency has increased above a specified threshold;

pausing, by the server without user input from the client, the execution of the video game from a current point of execution in response to detecting by the server that the network connection has become impaired;

saving, by the server, a state associated with the current point of execution, the saving occurs after a period of time passes after the network connection was detected to have become impaired;

generating a message for display at the client notifying that the network connection has become impaired; and

resuming, by the server, the execution of the video game from the current point of execution after receiving input from the client to resume play of the video game, the user input from the client to resume the play of the video game enabled after the server notifies the client that the network connection has become unimpaired,

wherein resuming execution of the video game also resumes transmission of the interactive compressed streaming video to the client while enabling user input from the client to control the play of the video game.

2. The method of claim 1, further comprising,

periodically transmitting messages, from the server to the client, to determine a quality of the network connection.

3. The method of claim 1, wherein saving of the state further includes terminating execution of the video game by the server at a last allowed save interval.

4. A hosting service including one or more servers and storage, the hosting service being implemented for streaming video games to connected clients over the Internet, wherein execution of video games is processed by the one or more servers of the hosting service, the hosting service is configured implement a method comprising:

executing a video game on a server in response to user input from a client;

compressing video output from the video game by an encoder to generate interactive compressed streaming video;

transmitting the interactive compressed streaming video generated by the server over a network connection from the server to the client, the client is configured to have a decoder for decompressing the interactive compressed streaming video;

detecting by the server that the network connection has become impaired, wherein detecting that the network connection has become impaired comprises detecting that a network latency has increased above a specified threshold;

pausing, by the server without user input from the client, the execution of the video game from a current point of execution in response to detecting by the server that the network connection has become impaired;

generating a message for display at the client notifying that the network connection has become impaired; and

resuming, by the server, the execution of the video game from the current point of execution after receiving input from the client to resume the play of the video game, the user input from the client to resume play of the video game enabled after the server notifies the client that the network connection has become unimpaired,

wherein resuming execution of the video game also resumes transmission of the interactive compressed streaming video to the client while enabling user input from the client to control the play of the video game;

wherein detecting that the network connection has become impaired further comprises detecting that a network bandwidth has dropped below a predefined level;

wherein the predefined level is based on a bandwidth required to deliver real-time video of the video game to the client at a specified resolution.

5. The method of claim 4, wherein the specified resolution is dropped to maintain the transmitting of the interactive compressed streaming video.

6. The method of claim 5, wherein when the specified resolution is dropped the client is caused to scale up an image size on a display screen of the client.

7. A hosting service including one or more servers and storage, the hosting service being implemented for streaming video games to connected clients over the Internet, wherein execution of video games is processed by the one or more servers of the hosting service, comprising:

a server for executing a video game in response to user input from a client;

an encoder for compressing video output from the video game to generate interactive compressed streaming video; and

a network interface for transmitting the interactive compressed streaming video generated by the server over a network connection from the server to the client, the client is configured to have a decoder for decompressing the interactive compressed streaming video;

wherein the server is configured to detect that the network connection has become impaired, wherein detecting that the network connection has become impaired comprises detecting that a network latency has increased above a specified threshold;

wherein the server is configured to pause execution of the video game without user input from the client, the video game being paused from a current point of execution in response to detecting by the server that the network connection has become impaired;

wherein the server is configured to send a message for display of the client notifying that the network connection has become impaired;

wherein the server is configured to resume execution of the video game from the current point of execution after receiving input from the client to resume play of the video game, the user input from the client to resume the play of the video game enabled after the server notifies the client that the network connection has become unimpaired;

wherein the server is configured to save a state associated with the current point of execution and the saving occurs after a period of time passes after the network connection was detected to have become impaired.

8. The hosting service of claim 7, wherein resuming execution of the video game also resumes transmission of the interactive compressed streaming video to the client while enabling user input from the client to control the play of the video game.

9. The hosting service of claim 7, wherein the server detects that the network connection has become impaired based on a network bandwidth dropping below a predefined level.

10. The hosting service of claim 9, wherein the predefined level is based on a bandwidth required to deliver real-time video of the video game to the client at a specified resolution.

11. The hosting service of claim 7, wherein the server is configured to periodically transmit messages to the client or receive messages from the client to determine a quality of the network connection.

12. The hosting service of claim 7, wherein saving of the state further includes terminating execution of the video game by the server at a last allowed save interval.

13. The hosting service of claim 10, wherein the specified resolution is dropped by the server to maintain the transmitting of the interactive compressed streaming video.

14. Computer readable media for streaming video games to connected clients over the Internet, the computer readable media being non-transitory, comprising:

program instructions for executing a video game on a server in response to user input from a client;

program instructions for compressing video output from the video game by an encoder to generate interactive compressed streaming video;

program instructions for transmitting the interactive compressed streaming video generated by the server over a network connection from the server to the client, the client is configured to have a decoder for decompressing the interactive compressed streaming video;

program instructions for detecting by the server that the network connection has become impaired, wherein detecting that the network connection has become impaired comprises detecting that a network latency has increased above a specified threshold;

program instructions for pausing, by the server without user input from the client, the execution of the video game from a current point of execution in response to detecting by the server that the network connection has become impaired;

program instructions for generating a message for display at the client notifying that the network connection has become impaired;

program instructions for resuming, by the server, the execution of the video game from the current point of execution after receiving input from the client to resume play of the video game, the user input from the client to resume the play of the video game enabled after the server notifies the client that the network connection has become unimpaired, and

program instructions for dropping a specified resolution to maintain the transmitting of the interactive compressed streaming video before pausing;

wherein resuming execution of the video game also resumes transmission of the interactive compressed streaming video to the client while enabling user input from the client to control the play of the video game.

15. The computer readable media of claim 14, further comprising,

program instructions for saving, by the server, a state associated with the current point of execution;

wherein saving occurs after a period of time passes after the network connection was detected to have become impaired.

16. The computer readable media of claim 14, wherein when the specified resolution is dropped the client is caused to scale up an image size on a display screen of the client.