Video game recording and playback with visual display of game controller manipulation

• US 10,099,145 B2
• Filed: 12/27/2016
• Issued: 10/16/2018
• Est. Priority Date: 11/22/2006
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment America LLC (Sony Group Corp.)
• Inventors: Brunstetter, Aaron, Zalewski, Gary M.
• Primary Examiner(s): Pierce, Damon
• Application Number:
  US15/391,655
• Publication Number:
  US 20170144074A1
• Time in Patent Office: 658 Days
• Field of Search: None
• CPC Class Codes: A63F 13/00 Video games, i.e. games using an electronically generated display having two or more dimensions gaming systems which provide a financial reward G07F17/32
• CPC Class Codes: A63F 13/31 Communication aspects specific to video games, e.g. between several handheld game devices at close range
• CPC Class Codes: A63F 13/497 Partially or entirely replaying previous game actions
• CPC Class Codes: A63F 13/53 involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game
• CPC Class Codes: A63F 13/73 Authorising game programs or game devices, e.g. checking authenticity
• CPC Class Codes: A63F 13/86 Watching games played by other players
• CPC Class Codes: A63F 13/95 Storage media specially adapted for storing game information, e.g. video game cartridges
• CPC Class Codes: A63F 2300/305 for providing a graphical or textual hint to the player
• CPC Class Codes: A63F 2300/50 characterized by details of game servers
• CPC Class Codes: A63F 2300/577 for watching a game played by other players
• CPC Class Codes: A63F 2300/634 for replaying partially or entirely the game actions since the beginning of the game

Abstract

A system and method for recording and playback of game data is provided. A recording engine may be configured to record and playback game data, including broadcast data received over a network. The recording engine may be included in a game console or at other network-enabled devices, such as a desktop computer. The recording engine may be configured to record the game data in a buffer memory, an archival memory, and to assist in the display of the game (e.g., interacting with a graphics processing unit). Game data stored in the buffer memory may later be transferred to the archival memory. Playback commands may be operable when a portion of the game broadcast has been recorded. When a playback command is received, the game recording engine may access a portion of the game data from buffer or archival memory and displays a selected portion and may be subject to certain seek functions (e.g., fast forward and rewind). Spectators may be able to independently archive and playback game data using local memory.

Claims

1. A method for game playback with associated user commands, the method comprising:

receiving gameplay video data regarding a game title played by a player at a client device, wherein the gameplay video data comprises video of at least one in-game maneuver performed within a game environment of the game title;

receiving one or more control commands provided by the player to execute the in-game maneuver;

producing image data to illustrate how the one or more control commands were provided by the player to execute the in-game maneuver;

storing the gameplay video data in association with the produced image data in memory;

receiving a request for playback sent over a communication network from a spectator device, wherein the request indicates a portion of the gameplay video data that includes the video of the in-game maneuver; and

providing a video display to the requesting spectator device over the communication network, wherein the provided video display includes a plurality of display areas simultaneously displaying different content, wherein a first display area plays the video of the in-game maneuver as performed within the game environment, and wherein a second display area plays the produced image data illustrating how the one or more control commands were provided by the player to execute the in-game maneuver displayed in the first display area.

2. The method of claim 1, wherein providing the video display further comprises broadcasting the video display to at least one other spectator device.

3. The method of claim 1, wherein the request for playback sent from the spectator device is permitted when security credentials associated for viewing the gameplay video data are satisfied.

4. The method of claim 3, wherein the security credentials associated for viewing the gameplay video data are set by the player.

5. The method of claim 1, wherein the image data illustrating how the one or more control commands are provided corresponds to real-world actions by the player.

6. The method of claim 1, wherein the produced image data includes an image representation of the player performing real-world actions.

7. The method of claim 1 wherein the image representation includes an image representative of one or more hands of the player performing real-world actions.

8. The method of claim 1, wherein storing the gameplay video data in memory comprises storing the gameplay video data in a buffer, and wherein providing the video display comprises providing the video in real-time directly from the buffer.

9. The method of claim 1, wherein the video of the in-game maneuver is synchronized to the produced image data illustrating how the one or more control commands were provided by the player to execute the in-game maneuver.

10. The method of claim 9, wherein providing the video display includes providing a replay at a time after the in-game maneuver is executed.

11. The method of claim 1, wherein receiving the one or more control commands comprises detecting player movement within a three-dimensional space of a real-world environment via one or more sensors.

12. The method of claim 1, wherein the one or more control commands are received as a combination in a predetermined sequence.

13. An apparatus for game playback with associated user commands, the apparatus comprising:

a communication interface that communicates over a communication network, wherein the communication interface;

receives gameplay video data regarding a game title played by a player at a client device, wherein the gameplay video data comprises video of at least one in-game maneuver performed within a game environment of the game title,

receives one or more control commands provided by the player to execute the in-game maneuver, and

receives a request for playback sent from a requesting spectator device, wherein the request indicates a portion of the gameplay video data that includes the video of the in-game maneuver;

a processor that executes instructions stored in memory, wherein execution of the instructions by the processor

produces image data to illustrate how the one or more control commands were provided by the player to execute the in-game maneuver, and

generates a video display to be provided to the requesting spectator device over the communication network, wherein the generated video display includes a plurality of display areas simultaneously displaying different content, wherein a first display area plays the video of the in-game maneuver as performed within the game environment, and wherein a second display area plays the produced image data illustrating how the one or more control commands were provided by the player to execute the in-game maneuver displayed in the first display area; and

memory that stores the gameplay video data in association with the produced image data.

14. The apparatus of claim 13, further comprising a broadcast switch that broadcasts the video display to at least one other spectator device.

15. The apparatus of claim 13, wherein the request for playback sent from the requesting spectator device is permitted when security credentials associated for viewing the gameplay video data are satisfied, and wherein the security credentials associated for viewing the gameplay video data are set by the player.

16. The apparatus of claim 13, wherein the image data illustrating how the one or more control commands are provided corresponds to real-world actions by the player.

17. The apparatus of claim 13, wherein the produced image data includes an image representation of one or more hands of the player performing real-world actions.

18. The apparatus of claim 13, wherein the memory includes a buffer that stores the received gameplay video data, and wherein the video is provided in real-time directly from the buffer.

19. The apparatus of claim 13, wherein the video of the in-game maneuver is synchronized to the produced image data illustrating how the one or more control commands were provided by the player to execute the in-game maneuver.

20. A non-transitory computer-readable storage medium, having embodied thereon a program executable by a processor to perform a method for game playback with associated user commands, the method comprising:

receiving gameplay video data regarding a game title played by a player at a client device, wherein the gameplay video data comprises video of at least one in-game maneuver performed within a game environment of the game title;

receiving one or more control commands provided by the player to execute the in-game maneuver;

producing image data to illustrate how the one or more control commands were provided by the player to execute the in-game maneuver;

storing the gameplay video data in association with the produced image data in memory;

receiving a request for playback sent over a communication network from a spectator device, wherein the request indicates a portion of the gameplay video data that includes the video of the in-game maneuver; and

providing a video display to the requesting spectator device over the communication network, wherein the provided video display includes a plurality of display areas simultaneously displaying different content, wherein a first display area plays the video of the in-game maneuver as performed within the game environment, and wherein a second display area plays the produced image data illustrating how the one or more control commands were provided by the player to execute the in-game maneuver displayed in the first display area.