Method for multicasting views of real-time streaming interactive video

• US 10,052,556 B2
• Filed: 02/24/2015
• Issued: 08/21/2018
• Est. Priority Date: 12/10/2002
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment America LLC (Sony Group Corp.)
• Inventors: Perlman, Stephen G., van der Laan, Roger
• Primary Examiner(s): Deodhar, Omkar
• Application Number:
  US14/630,281
• Publication Number:
  US 20150165320A1
• Time in Patent Office: 1,274 Days
• CPC Class Codes: A63F 13/12 involving interaction between a plurality of game devices, e.g. transmisison or distribution systems protocols for networked virtual reality, networked games H04L29/06034
• CPC Class Codes: A63F 13/30 Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
• CPC Class Codes: A63F 13/335 using Internet
• CPC Class Codes: A63F 13/35 Details of game servers
• CPC Class Codes: A63F 13/358 Adapting the game course according to the network or server load, e.g. for reducing latency due to different connection speeds between clients
• CPC Class Codes: A63F 13/86 Watching games played by other players
• CPC Class Codes: A63F 2300/402 Communication between platforms, i.e. physical link to protocol
• CPC Class Codes: A63F 2300/407 Data transfer via internet
• CPC Class Codes: A63F 2300/531 Server assignment
• CPC Class Codes: A63F 2300/552 for downloading to client devices, e.g. using OS version, hardware or software profile of the client device
• CPC Class Codes: A63F 2300/577 for watching a game played by other players
• CPC Class Codes: A63F 2300/634 for replaying partially or entirely the game actions since the beginning of the game
• CPC Class Codes: H04L 47/283 in response to processing delays, e.g. caused by jitter or round trip time [RTT]
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04N 21/222 Secondary servers, e.g. proxy server, cable television Head-end provisioning of proxy services in data packet switching networks H04L67/56
• CPC Class Codes: H04N 21/23406 involving management of server-side video buffer
• CPC Class Codes: H04N 21/2343 involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements video transcoding H04N19/40; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 21/23805 : Controlling the feeding rate to the network, e.g. by controlling the video pump
• CPC Class Codes: H04N 21/2402 : Monitoring of the downstream path of the transmission network, e.g. bandwidth available traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876
• CPC Class Codes: H04N 21/4781 : Games
• CPC Class Codes: H04N 21/6125 : involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/6405 : Multicasting data broadcast and multicast in packet switching networks H04L12/18
• CPC Class Codes: H04N 21/64322 : IP
• CPC Class Codes: H04N 21/6587 : Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 21/8173 : End-user applications, e.g. Web browser, game
• CPC Class Codes: H04N 21/8545 : for generating interactive applications
• CPC Class Codes: H04N 7/106 : for domestic distribution
• CPC Class Codes: H04N 7/17318 : Direct or substantially direct transmission and handling of requests
• CPC Class Codes: H04W 28/16 : Central resource management; Negotiation of resources or communication parameters, e.g. negotiating bandwidth or QoS [Quality of Service]
• CPC Class Codes: H04W 4/06 : Selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS]; Services to user groups; One-way selective calling services
• CPC Class Codes: H04W 84/12 : WLAN [Wireless Local Area Networks]

Abstract

A method includes multicasting by a server center of streaming interactive video/audio streams to multiple destinations via an outbound Internet traffic interface. A given video/audio stream is routed to multiple destinations simultaneously. At least one of the video/audio streams is received at a delay buffer of the server center, the delay buffer storing a replayable portion of at least one of the video/audio streams.

Claims

1. A computer-implemented method for delivering an interface of video game streams by a hosting service to a client device of a spectator, comprising:

receiving, at a server of the hosting service, a request from the client device of the spectator, the request being for an interactive interface of video game streams;

selecting a plurality of video games being played;

sending requests to one or more computers executing each of the plurality of video games, the requests being for video content of each of the plurality of video games;

receiving, at the server, video content of each of the plurality of video games;

transmitting the video content of each of the plurality of video games to the client device to be displayed within an interactive interface, the interactive interface configured to display each transmitted video content as a thumbnail view within a respective thumbnail window of an array of thumbnail windows, the thumbnail window configured to be selectable, wherein the interactive interface enables simultaneous viewing of video content from the plurality of video games being played; and

receiving, at the server, a selection associated with one of the thumbnail windows from the client device, and each of the plurality of video games is a multiplayer video game;

wherein the selection enables the client device to join a video game as an active player within the video game in response to the selection.

2. The computer-implemented method of claim 1, further comprising:

sending a second request to a computer executing the video game, the second request being for an expanded view video stream of the video game;

receiving, at the server, the high quality video stream of the video game; and

transmitting the high quality video stream of the video game to the client device, the interactive interface configured to display the expanded view video stream of the video game as a secondary view that is larger in size than the thumbnail view, wherein the interactive interface enables viewing of the expanded video stream of the video game via the secondary view in response to selecting the thumbnail window displaying the thumbnail view of the video game.

3. The computer-implemented method of claim 1, further comprising:

sending a second request to the computer executing the video game, the second request being to join the video game;

receiving, at the server, permission to join the video game;

sending a third request to the hosting service to initiate a second computer to load the video game from a RAID array, wherein the interactive interface enables the client device to join the video game in response to selecting the thumbnail window displaying the thumbnail view of the video game.

4. The computer-implemented method of claim 3, wherein the client device is joined to the video game as the active player or as an observer, and being joined as the active player enables participation within the video game and being joined as the observer enables travel and observation within the video game.

5. The computer-implemented method of claim 4, further comprising:

receiving, at the server, from the computers, stats for each video game, the stats including at least one of a number of active players in each video game, a number of instantiations of each video game, and a number of spectators viewing each video game; and

transmitting the stats to the client device to be displayed within the interactive interface, wherein the interactive interface enables viewing of information regarding spectators and players with respect to the plurality of video games.

6. The computer-implemented method of claim 1, wherein the server for delivering the interface of video game streams and the computers executing the plurality of video games are a same computer.

7. The computer-implemented method of claim 1, wherein video content includes images of the video game, video loops, or video streams.

8. The computer-implemented method of claim 2, wherein selecting the secondary view or an interactive element associated therewith is operable to initiate the client device to join the video game being displayed in the secondary view.

9. The computer-implemented method of claim 2, wherein the secondary view is a full screen view or a pop-out view.

10. The computer-implemented method of claim 2, wherein the interactive interface is configured to provide a transition between the thumbnail window displaying the thumbnail view of the video game and the secondary view.

11. The computer-implemented method of claim 1, wherein the video content includes a delayed video stream.

12. The computer-implemented method of claim 1, wherein the selecting the plurality of games being played is based at least partially on at least one of a random selection of games or game titles, a selection of all a same game title, a selection of top-ranked players of a game title, a selection of players at a given level of a game title, a selection of lower-ranked players of a game title, a selection of games of buddies, or a selection of games having a most number of views or viewers.

13. The computer-implemented method of claim 1, wherein transmitting video content of a video game includes transmitting video captured by a camera of a player of the video game.

14. The computer-implemented method of claim 1,

wherein the selection enables the client device to join the video game as an observer within the video game in response to the selection.

15. The computer-implemented method of claim 1, further comprising:

receiving, at the server from the one or more computers, stats for each video game, the states including at least one of a number of active players in each video game, a number of instantiations of each video game, and a number of spectators viewing each video game; and

transmitting the stats to the client device to be displayed within the interactive interface for display.

16. A computer-implemented method for delivering an interface of video game streams by a hosting service to a client device of a spectator, comprising:

receiving, at a server of the hosting service, a request from the client device of the spectator, the request being for an interactive interface of video game streams for a plurality of video games being played via computers of the hosting service;

assembling, at the server, video content of each respective video game of the plurality of video games being played;

transmitting, by the server, the video content of each respective video game to the client device to be displayed within an interactive interface, the interactive interface configured to display each transmitted video content in an array of thumbnail views from respective thumbnail windows, each thumbnail window is selectable, wherein the interactive interface enables simultaneous viewing of video content from one or more of the plurality of video games being played; and

receiving, at the server, a selection associated with one of the thumbnail windows from the client device;

wherein the selection enables the client device to join the video game as an active player within the video game in response to the selection and enables communication between a player of the video game and the spectator of the client device.

17. The computer-implemented method of claim 16, wherein selecting the plurality of games being played is based at least partially on at least one of a random selection of games or game titles, a selection of all a same game title, a selection of top-ranked players of a game title, a selection of players at a given level of a game title, a selection of lower-ranked players of a game title, a selection of games of buddies, or a selection of games having a most number of views or viewers.

18. The computer-implemented method of claim 17, wherein transmitting video content of a video game includes transmitting video captured by a camera of a player of the video game.