Video game recording and playback with visual display of game controller manipulation

• US 9,526,995 B2
• Filed: 08/31/2007
• Issued: 12/27/2016
• Est. Priority Date: 11/22/2006
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment America LLC (Sony Group Corp.)
• Inventors: Brunstetter, Aaron, Zalewski, Gary M.
• Primary Examiner(s): PIERCE, DAMON JOSEPH
• Application Number:
  US11/848,451
• Publication Number:
  US 20080119286A1
• Time in Patent Office: 3,406 Days
• Field of Search: 463 36- 39
• US Class Current: 1/1
• CPC Class Codes: A63F 13/00 Video games, i.e. games using an electronically generated display having two or more dimensions gaming systems which provide a financial reward G07F17/32
• CPC Class Codes: A63F 13/31 Communication aspects specific to video games, e.g. between several handheld game devices at close range
• CPC Class Codes: A63F 13/497 Partially or entirely replaying previous game actions
• CPC Class Codes: A63F 13/53 involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game
• CPC Class Codes: A63F 13/73 Authorising game programs or game devices, e.g. checking authenticity
• CPC Class Codes: A63F 13/86 Watching games played by other players
• CPC Class Codes: A63F 13/95 Storage media specially adapted for storing game information, e.g. video game cartridges
• CPC Class Codes: A63F 2300/305 for providing a graphical or textual hint to the player
• CPC Class Codes: A63F 2300/50 characterized by details of game servers
• CPC Class Codes: A63F 2300/577 for watching a game played by other players
• CPC Class Codes: A63F 2300/634 for replaying partially or entirely the game actions since the beginning of the game

Abstract

A system and method for recording and playback of game data is provided. A recording engine may be configured to record and playback game data, including broadcast data received over a network. The recording engine may be included in a game console or at other network-enabled devices, such as a desktop computer. The recording engine may be configured to record the game data in a buffer memory, an archival memory, and to assist in the display of the game (e.g., interacting with a graphics processing unit). Game data stored in the buffer memory may later be transferred to the archival memory. Playback commands may be operable when a portion of the game broadcast has been recorded. When a playback command is received, the game recording engine may access a portion of the game data from buffer or archival memory and displays a selected portion and may be subject to certain seek functions (e.g., fast forward and rewind). Spectators may be able to independently archive and playback game data using local memory.

Claims

1. A system for network playback of a video game, the system comprising:

a participant client computing device associated with at least one participant playing a video game, the participant client computing device coupled to a network, the participant client computing device including;

a recording engine that receives game data generated by the at least one participant playing the video game, the game data including controller manipulation data corresponding to a physical domain manipulation of a game controller coupled to the participant client computing device, the controller manipulation data generated during participant interaction with the video game, and

a memory coupled to the recording engine that stores the game data received by the recording engine and corresponding meta-data to identify different portions within the same game data; and

a spectator client computing device coupled to the network, the spectator client computing device including a processor and a memory storing executable instructions, wherein execution of the instructions by the processor;

generates a user interface that receives playback commands from a spectator associated with the spectator client computing device,

transmits the playback commands over the network, wherein the playback commands include;

an indication to play back a spectator-selected portion of the game data stored in the memory of the participant client computing device, wherein the spectator-selected portion of the game data is selected based on user input via a menu associated with the spectator client computing device, the user input corresponding with the meta-data included in the game data stored in the memory of the participant client computing device, and wherein the spectator-selected portion of the game data is a section of the stored game data that is shorter than the full length of the stored game data, and

an indication to edit the spectator-selected portion of game data, wherein editing includes introducing into the spectator-selected portion of game data at least one of advertising, captions, titles, special effects, slow-motion replay, accelerated reply, and picture-in-picture,

displays the spectator-selected portion of the game data on the spectator client computing device and one or more other spectator client computing devices coupled to the same network;

generates a textual interface that facilitates communication between a spectator of the spectator client computing device and one or more other spectators viewing the spectator-selected portion of game data, and

generates the menu that provides a plurality of options including searching other stored game data via the meta-data and sharing the spectator-selected portion of game data with one or more other the one or more other spectators.

2. The system of claim 1, wherein the spectator-selected portion of the game data is played back from the memory of the participant client computing device.

3. The system of claim 1, wherein the spectator-selected portion of the game data is played back from a network storage device communicatively coupled to the network, the game data having been copied to the network storage device from the participant client computing device.

4. The system of claim 1, wherein the recording engine stores the game data while the game data is simultaneously broadcast to another recipient over the network.

5. The system of claim 1, wherein the recording engine stores the game data while game data associated with a second video game is simultaneously broadcast to another recipient over the network.

6. The system of claim 1, wherein the spectator-selected portion of the game data played back in response to the playback commands includes a graphic display of the game controller.

7. The system of claim 6, wherein the graphic display of the game controller is scaled against a game environment of the video game.

8. The system of claim 6, wherein the graphic display of the game controller is visually blended with a game environment of the video game.

9. The system of claim 6, wherein the graphic display of the game controller includes at least one participant manipulation of the game controller that corresponds to the physical domain manipulation of the game controller by the at least one participant during interaction with the video game and that generated the spectator-selected portion of the game data stored in the memory of the participant client computing device.

10. The system of claim 9, wherein the game controller coupled to the participant client computing device generates controller manipulation data corresponding to pitch, roll, and yaw in three-dimensional space.

11. The system of claim 9, wherein play back of the game data includes a graphic representation of hands of the participant manipulating the game controller.

12. The system of claim 1, wherein the participant client computing device and spectator client computing device are each a portable gaming device and the network is a mobile ad-hoc network.

13. The system of claim 12, wherein the participant client computing device transmits the game data to the spectator client computing device over the mobile ad-hoc network.

14. A method for playback of game data, comprising

storing the game data in a memory device, the game data including controller manipulation data corresponding to a physical domain manipulation of a game controller by a participant during interaction with a video game and meta-data used to identify different portions within the same game data;

receiving over a network from a spectator client computing device a plurality of playback commands identifying a spectator-selected portion of the game data, wherein the spectator-selected portion of the game data is a section of the stored game data that is shorter than the full length of the stored game data, and wherein the plurality of playback commands include;

an indication to play back the spectator-selected portion of the game data, wherein the spectator-selected portion of the game data is selected based on user input via a menu associated with the spectator client computing device, the user input corresponding with the meta-data included in the game data stored in the memory device; and

an indication to edit the spectator-selected portion of the game data, wherein editing includes introducing into the spectator-selected portion of game data at least one of advertising, captions, titles, special effects, slow-motion replay, accelerated reply, and picture-in-picture;

accessing the spectator-selected portion of the game data stored in the memory device as identified by the playback commands;

displaying the spectator-selected portion of the game data at the spectator client computing device, wherein displaying the spectator-selected portion of the game data includes displaying a graphic display of a game controller and at least one participant manipulation of the game controller that corresponds to the physical domain manipulation of the game controller by the participant during interaction with the video game and that generated the spectator-selected portion of the game data stored in the memory device, and wherein the spectator-selected portion of the game data is also displayed on one or more other spectator client computing devices coupled to the same network;

facilitating by way of a textual interface communication between a spectator of the spectator client computing device and one or more other spectators viewing the spectator-selected portion of game data; and

providing a plurality of options on the menu including functions for searching other stored game data via the meta-data and sharing the spectator-selected portion of game data with the one or more other spectators.

15. The method of claim 14, wherein the game data is generated and stored in a memory at a participant client computing device, the play back of the spectator-selected portion of the game data occurring from the memory at the participant client computing device.

16. The method of claim 14, wherein the game data is generated at a participant client computing device and subsequently stored in a memory at a network storage device communicatively coupled to the network, the display of the spectator-selected portion of the game data occurring from the memory at the network storage device.

17. The method of claim 14, wherein a second portion of the game data is recorded simultaneously with the display of the spectator-selected portion of the game data.

18. The method of claim 14, wherein a second portion of the game data is recorded simultaneously with the display of the spectator-selected portion of game data received over the network.

19. The method of claim 14, wherein the display of the game controller is scaled against a game environment of the video game.

20. The method of claim 14, wherein the display of the game controller is visually blended with a game environment of the video game.

21. The method of claim 14, wherein the controller manipulation data is generated by a control device configured to generate controller manipulation data corresponding to pitch, roll, and yaw in three-dimensional space.

22. The method of claim 14, wherein displaying the spectator-selected portion of the game data further includes displaying a graphic representation of hands of a user manipulating the game controller.

23. A non-transitory computer readable storage medium having embodied thereon a program, the program having instructions for playback of game data, the instructions being executable by a processor to perform a method, the method comprising:

storing the game data in a memory device, the game data including controller manipulation data corresponding to a physical domain manipulation of a game controller by a participant during interaction with a video game and meta-data used to identify different portions within the same game data;

receiving over a network from a spectator client computing device a plurality of playback commands identifying a spectator-selected portion of the game data, wherein the spectator-selected portion of the game data is a section of the stored game data that is shorter than the full length of the stored game data, and wherein the plurality of playback commands include;

an indication to play back the spectator-selected portion of the game data, wherein the spectator-selected portion of the game data is selected based on user input via a menu associated with the spectator client computing device, the user input corresponding with the meta-data included in the game data stored in the memory device; and

an indication to edit the spectator-selected portion of the game data, wherein editing includes introducing into the spectator-selected portion of game data at least one of advertising, captions, titles, special effects, slow-motion replay, accelerated reply, and picture-in-picture;

accessing the spectator-selected portion of the game data in the memory device as identified by the playback commands;

displaying the spectator-selected portion of the game data on the spectator client computing device, wherein displaying the spectator-selected portion of the game data includes displaying a graphic display of a game controller and at least one participant manipulation of the game controller that corresponds to the physical domain manipulation of the game controller by the participant during interaction with the video game and that generated the spectator-selected portion of the game data stored in the memory device, and wherein the spectator-selected portion of the game data is also displayed on one or more other spectator client computing devices coupled to the same network;

facilitating by way of a textual interface communication between a spectator of the spectator client computing device and one or more other spectators viewing the spectator-selected portion of game data; and

providing a plurality of options on the menu including functions for searching other stored game data via the meta-data and sharing the spectator-selected portion of game data with the one or more other spectators.

24. The non-transitory computer-readable storage medium of claim 23, wherein a second portion of the game data is recorded simultaneously with the display of the spectator-selected portion of the game data.

25. The non-transitory computer-readable storage medium of claim 23, wherein a second portion of the game data is recorded simultaneously with the display of the spectator-selected portion of game data received over the network.

26. The non-transitory computer-readable storage medium of claim 23, wherein the display of the game controller is scaled against a game environment of the video game.

27. The non-transitory computer-readable storage medium of claim 23, wherein the display of the game controller is visually blended with a game environment of the video game.

28. The non-transitory computer-readable storage medium of claim 23, wherein the controller manipulation data is generated by a control device that generates controller manipulation data corresponding to pitch, roll, and yaw in three-dimensional space.

29. The non-transitory computer-readable storage medium of claim 23, wherein displaying the spectator-selected portion of the game data further includes displaying a graphic representation of hands of a user manipulating the game controller.

30. A method for playback of video content in a network environment, the method comprising:

storing in memory pre-recorded video content received from one or more providers of video content in the network environment at a network storage device, wherein the pre-recorded video content includes meta-data to identify different portions of the pre-recorded video content;

receiving a plurality of playback commands from a spectator client computing device in the network environment, the playback commands corresponding to a spectator-selected portion of a first pre-recorded video content stored at the network storage device, wherein the spectator-selected portion of the first pre-recorded video content is a section of the first pre-recorded video content that is shorter than the full length of the first pre-recorded video content, and wherein the playback commands include;

an indication to play back the spectator-selected portion of the first pre-recorded video content stored at the network storage device, wherein the spectator-selected portion of the first pre-recorded video content is selected based on user input via a menu associated with the spectator client computing device, the user input corresponding with the meta-data included in the pre-recorded video content stored in the memory, and

an indication to edit the spectator-selected portion of the first pre-recorded video content, wherein editing includes introducing into the spectator-selected portion of the first pre-recorded video content at least one of advertising, captions, titles, special effects, slow-motion replay, accelerated reply, and picture-in-picture;

retrieving the spectator-selected portion of the first pre-recorded video content from storage at the network storage device, wherein the retrieved spectator-selected portion of the first pre-recorded video content is identified by the playback commands received from the spectator client computing device;

transmitting the retrieved spectator-selected portion of the first pre-recorded video content to the spectator client computing device for display on a playback device associated with the spectator client computing device;

displaying the spectator-selected portion of the first pre-recorded video content on the spectator client computing device and one or more other spectator client computing devices coupled to the same network;

facilitating by way of a textual interface communication between a spectator of the spectator client computing device and one or more other spectators viewing the spectator-selected portion of the first pre-recorded video content; and

providing a plurality of options on the menu including functions for searching other stored pre-recorded video content via the meta-data and sharing the spectator-selected portion of the first pre-recorded video content with the one or more other spectators.

31. The method of claim 30, wherein the playback commands are received from the spectator client computing device via a gaming console, the gaming console coupled to the playback device.

32. The method of claim 30, wherein the pre-recorded video content corresponds to action in a video game.

33. The method of claim 30, further comprising:

receiving a further playback command from the spectator client computing device, the further playback command corresponding to a spectator-selected portion of a second pre-recorded video content stored at the network storage device;

retrieving the spectator-selected portion of the second pre-recorded video content from storage at the network storage device, wherein the retrieved spectator-selected portion of the second pre-recorded video content is identified by the further playback command; and

transmitting the retrieved spectator-selected portion of the second pre-recorded video content to the spectator client computing device for display on the playback device associated with the spectator client computing device, wherein the spectator client computing device alternates between viewing the spectator selected portions of the first and the second pre-recorded video content via instructions provided through a user interface displayed at the playback device.

34. The system of claim 30, wherein the spectator-selected portion of the first pre-recorded video content played back in response to the playback commands includes an advertisement within a graphic display of a game controller.

35. The method of claim 30, further comprising editing the spectator-selected portion of the first pre-recorded video content to include an advertisement when the indication to edit the spectator-selected portion of the first pre-recorded video content is an indication to introduce into the spectator-selected portion of the first pre-recorded video content at least one of captions, titles, special effects, slow-motion replay, accelerated reply, and picture-in-picture.