Video Game Overlay

• US 20170106281A1
• Filed: 12/30/2016
• Published: 04/20/2017
• Est. Priority Date: 06/01/2009
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment America LLC (Sony Group Corp.)
• Inventors: Gault, Andrew Buchanan, Perry, David, Pereira, Rui Filipe Andrade
• Granted Patent: US 10,173,134 B2
• Time in Patent Office: Days
• CPC Class Codes: A63F 13/10 Control of the course of the game, e.g. start, progess, end
• CPC Class Codes: A63F 13/12 involving interaction between a plurality of game devices, e.g. transmisison or distribution systems protocols for networked virtual reality, networked games H04L29/06034
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/2145 the surface being also a display device, e.g. touch screens
• CPC Class Codes: A63F 13/30 Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
• CPC Class Codes: A63F 13/32 using local area network [LAN] connections
• CPC Class Codes: A63F 13/327 using wireless networks, e.g. Wi-Fi® or piconet
• CPC Class Codes: A63F 13/33 using wide area network [WAN] connections
• CPC Class Codes: A63F 13/335 using Internet
• CPC Class Codes: A63F 13/355 Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
• CPC Class Codes: A63F 13/45 Controlling the progress of the video game
• CPC Class Codes: A63F 2300/407 Data transfer via internet
• CPC Class Codes: A63F 2300/409 Data transfer via television network
• CPC Class Codes: A63F 2300/538 for performing operations on behalf of the game client, e.g. rendering
• CPC Class Codes: A63F 2300/552 for downloading to client devices, e.g. using OS version, hardware or software profile of the client device
• CPC Class Codes: G06F 9/45537 Provision of facilities of other operating environments, e.g. WINE I/O emulation G06F13/105
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence

Abstract

A video server is configured to provide streaming video to players of computer games over a computing network. The video server can provided video of different games to different players simultaneously. This is accomplished by rendering several video streams in parallel using a single GPU (Graphics Processing Unit). The output of the GPU is provided to graphics processing pipelines that are each associated with a specific client/player and are dynamically allocated as needed. A client qualifier may be used to assure that only clients capable of presenting the streaming video to a player at a minimum level of quality receive the video stream. Video frames provided by the video server optionally include overlays added to the output of the GPU. These overlays can include voice data received from another game player.

Claims

1. A method for generating video for a video game, comprising:

receiving encoded video data from a server computing system at a client computing system, the encoded video data including an encoded version of video data for the video game representing a game environment rendered based on game rules and one or more input signals;

decoding the received encoded video data at the client computing system to obtain the video data for the video game;

applying a video overlay to at least a portion of the video data for the video game at the client computing system to generate modified video data for the video game locally at the client computing system; and

providing the modified video data for the video game for display at the client computing system.

2. The method for generating video for the video game as recited in claim 1, wherein the video overlay is defined by overlay data sourced at the client computing system.

3. The method for generating video for the video game as recited in claim 2, wherein the overlay data provides one or more graphical controls for a computer program executing on the client computing system.

4. The method for generating video for the video game as recited in claim 3, wherein the computer program executing on the client computing system enables audio communication between a player of the video game at the client computing system and one or more other players of the video game.

5. The method for generating video for the video game as recited in claim 4, wherein the one or more other players of the video game are respectively associated with one or more other client computer systems.

6. The method for generating video for the video game as recited in claim 5, wherein the audio communication between the player of the video game at the client computing system and one or more other players of the video game at the one or more other client computer systems is transmitted through the server computing system.

7. The method for generating video for the video game as recited in claim 1, further comprising:

receiving overlay data through a network connection, the overlay data defining the video overlay.

8. The method for generating video for the video game as recited in claim 7, wherein the overlay data provides one or more graphical controls for a computer program executing on a remote computing system.

9. The method for generating video for the video game as recited in claim 8, wherein the computer program executing on the remote computing system enables audio communication between a player of the video game at the client computing system and one or more other players of the video game.

10. The method for generating video for the video game as recited in claim 1, further comprising:

transmitting information about a decoder capability of the client computing system to the server computing system;

dynamically provisioning an encoding pipeline at the server computing system, the encoding pipeline including an encoder compatible with the decoder capability of the client computing system; and

processing the video data for the video game through the encoding pipeline to generate the encoded video data.

11. The method for generating video for the video game as recited in claim 1, further comprising:

receiving encoded audio data at the client computing system;

decoding the encoded audio data to generate decoded audio data;

detecting activation of a graphical control presented by the video overlay, the graphical control defined to control playback of the decoded audio data; and

upon detecting activation of the graphical control, playing the decoded audio data at the client computing system.

12. The method for generating video for the video game as recited in claim 11, further comprising:

receiving overlay data through a network connection, the overlay data defining the video overlay, wherein the encoded audio data is included in the overlay data.

13. The method for generating video for the video game as recited in claim 1, further comprising:

detecting activation of a graphical control presented by the video overlay, the graphical control defined to establish an audio communication channel between the client computing system and one or more other client computing systems; and

upon detecting activation of the graphical control, establishing the audio communication channel between the client computing system and at least one other client computing system.

14. A method for generating video for a video game, comprising:

receiving one or more user input signals at a client computer system from a game controller;

generating video data for the video game at the client computer system, the video data for the video game representing a game environment rendered based on game rules and the one or more user input signals;

applying a video overlay to at least a portion of the video data for the video game at the client computing system to generate modified video data for the video game, wherein the video overlay is sourced separate from generation of the video data for the video game; and

providing the modified video data for the video game for display at the client computing system.

15. The method for generating video for the video game as recited in claim 14, wherein the video overlay is defined by overlay image data sourced at the client computing system.

16. The method for generating video for the video game as recited in claim 15, wherein the overlay image data provides one or more graphical controls for a computer program executing on the client computing system, the computer program separate from the video game.

17. The method for generating video for the video game as recited in claim 16, wherein the computer program executing on the client computing system enables data communication between a player of the video game at the client computing system and a social networking website.

18. The method for generating video for the video game as recited in claim 17, wherein the data communication between the player of the video game at the client computing system and the social networking website includes one or more of video data communication, image data communication, and audio data communication.

19. A video game system, comprising:

a network interface configured to receive encoded video data from a server computing system, the encoded video data including an encoded version of video data for a video game representing a game environment rendered based on game rules and one or more user input signals;

a decoder configured to decode the received encoded video data to obtain the video data for the video game;

overlay logic configured to apply a video overlay to at least a portion of the video data for the video game to generate modified video data for the video game locally at the video game system, the video overlay sourced independently from the video game; and

a video output interface configured to provide the modified video data for display on a display device.

20. The video game system as recited in claim 19, wherein the overlay data provides one or more graphical controls for a computer program executing locally on the video game system.