Method for user session transitioning among streaming interactive video servers

• US 8,840,475 B2
• Filed: 12/05/2007
• Issued: 09/23/2014
• Est. Priority Date: 12/10/2002
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: OL2 Incorporated (Sony Group Corp.)
• Inventors: Perlman, Stephen G., van der Laan, Roger
• Primary Examiner(s): Bumgarner, Melba
• Assistant Examiner(s): NGUYEN, ANH-VO V
• Application Number:
  US11/999,473
• Publication Number:
  US 20090124387A1
• Time in Patent Office: 2,484 Days
• Field of Search: 463/42
• US Class Current: 463/42
• CPC Class Codes: A47L 13/51 Storing of cleaning tools, e.g. containers therefor
• CPC Class Codes: A47L 13/59 with movable squeezing members
• CPC Class Codes: A63F 13/12 involving interaction between a plurality of game devices, e.g. transmisison or distribution systems protocols for networked virtual reality, networked games H04L29/06034
• CPC Class Codes: A63F 13/30 Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
• CPC Class Codes: A63F 13/335 using Internet
• CPC Class Codes: A63F 13/355 Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
• CPC Class Codes: A63F 13/358 Adapting the game course according to the network or server load, e.g. for reducing latency due to different connection speeds between clients
• CPC Class Codes: A63F 13/48 Starting a game, e.g. activating a game device or waiting for other players to join a multiplayer session
• CPC Class Codes: A63F 13/52 involving aspects of the displayed game scene
• CPC Class Codes: A63F 13/795 for finding other players; for building a team; for providing a buddy list
• CPC Class Codes: A63F 2300/402 Communication between platforms, i.e. physical link to protocol
• CPC Class Codes: A63F 2300/531 Server assignment
• CPC Class Codes: A63F 2300/535 for monitoring, e.g. of user parameters, terminal parameters, application parameters, network parameters
• CPC Class Codes: A63F 2300/538 for performing operations on behalf of the game client, e.g. rendering
• CPC Class Codes: A63F 2300/552 for downloading to client devices, e.g. using OS version, hardware or software profile of the client device
• CPC Class Codes: A63F 2300/5566 by matching opponents or finding partners to build a team, e.g. by skill level, geographical area, background, play style
• CPC Class Codes: H04N 19/00 Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
• CPC Class Codes: H04N 19/107 between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/14 Coding unit complexity, e.g. amount of activity or edge presence estimation H04N19/146 takes precedence
• CPC Class Codes: H04N 19/146 : Data rate or code amount at the encoder output
• CPC Class Codes: H04N 19/154 : Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion use of rate-distortion criteria H04N19/147
• CPC Class Codes: H04N 19/166 : concerning the amount of transmission errors, e.g. bit error rate [BER]
• CPC Class Codes: H04N 19/17 : the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/176 : the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/436 : using parallelised computational arrangements
• CPC Class Codes: H04N 19/587 : involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
• CPC Class Codes: H04N 19/59 : involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
• CPC Class Codes: H04N 19/61 : in combination with predictive coding
• CPC Class Codes: H04N 19/895 : in combination with error concealment
• CPC Class Codes: H04N 21/23424 : involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/2343 : involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements video transcoding H04N19/40; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 21/234309 : by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo conversion of standards in analog television systems H04N7/01
• CPC Class Codes: H04N 21/234363 : by altering the spatial resolution, e.g. for clients with a lower screen resolution
• CPC Class Codes: H04N 21/23805 : Controlling the feeding rate to the network, e.g. by controlling the video pump
• CPC Class Codes: H04N 21/2393 : involving handling client requests scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04N 21/2402 : Monitoring of the downstream path of the transmission network, e.g. bandwidth available traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876
• CPC Class Codes: H04N 21/242 : Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/27 : Server based end-user applications
• CPC Class Codes: H04N 21/431 : Generation of visual interfaces for content selection or interaction; Content or additional data rendering
• CPC Class Codes: H04N 21/437 : Interfacing the upstream path of the transmission network, e.g. for transmitting client requests to a VOD server flow control in data networks H04L47/10; streaming protocols, e.g. RTP or RTCP, H04L65/65; scheduling or organising the servicing of application requests in data packet switching networks H04L67/60
• CPC Class Codes: H04N 21/472 : End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612
• CPC Class Codes: H04N 21/4781 : Games
• CPC Class Codes: H04N 21/6125 : involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/64738 : Monitoring network characteristics, e.g. bandwidth, congestion level data switched network analysis H04L41/14; monitoring functioning in data switched networks H04L43/0817; flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/64792 : Controlling the complexity of the content stream, e.g. by dropping packets intermediate media network packet handling H04L65/765; proxy provisioning conversion or adaptation for reducing the amount or size of exchanged application data H04L67/5651; negotiation of resources in wireless networks H04W28/16
• CPC Class Codes: H04N 21/6587 : Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 7/106 : for domestic distribution
• CPC Class Codes: H04W 28/06 : Optimizing the usage of the radio link, e.g. header compression, information sizing , discarding information system modifying transmission characteristic according to link quality by modifying frame length H04L1/0007; dynamic adaptation of the packet size for flow control or congestion control H04L47/365
• CPC Class Codes: H04W 4/00 : Services specially adapted for wireless communication networks; Facilities therefor

Abstract

A computer-implemented method includes receiving a request by a hosting service center from a remote user to loin a multiplayer interactive twitch game or application already in progress, the multiplayer interactive twitch game or application running on a first server of the hosting service center and being played remotely by other players via first compressed streaming interactive video. Following a determination that the user may join the multiplayer interactive twitch game or application based on a set of criteria, an inbound routing network transfers control signals received from the remote user to the first server. Compression of the first compressed streaming interactive video is then synchronized as between the remote user and the other players such that the remote user has the perception that the multiplayer interactive twitch game or application is responding instantly to the request.

Claims

1. A computer-implemented method comprising:

receiving a request by a hosting service center from a remote user to join a multiplayer interactive twitch video game already in progress,

wherein the multiplayer interactive twitch video game running on a first server of the hosting service center and being played remotely by other players via first compressed streaming interactive video,

wherein the remote user interacting with a user interface application running on a second server of the hosting service center via second compressed streaming interactive video to select the multiplayer interactive twitch video game to join,

wherein the first compressed streaming interactive video and the second compressed streaming interactive video being transmitted over the Internet from the hosting service center;

determining whether the remote user may join the multiplayer interactive twitch video game based on a set of criteria that includes a latency of a communication channel associated with the remote user;

upon determining that the set of criteria is met, instructing an inbound routing network to transfer control signals received from the remote user to the first server hosting the multiplayer interactive twitch video game; and

synchronizing compression of the first compressed streaming interactive video associated with the multiplayer interactive twitch video game as between the remote user and the other players,

wherein the first compressed streaming interactive video being compressed with a worst-case, round-trip latency of 90 ms, from control input of the remote user to display of a response to the control input on a client device of the remote user, over a transmission distance up to and including 1500 miles from the hosting service center to the client device of the remote user.

2. The computer-implemented method of claim 1 wherein the user interface application comprises a game finder application.

3. The computer-implemented method of claim 1 wherein the second compressed streaming interactive video is compressed with a worst-case, round-trip latency of 90 ms, from control input of the remote user to display of a response to the control input on the client device of the remote user, over a transmission distance up to and including 1500 miles the hosting service center to the client device of the remote user.