System and method of inferring user interest in different aspects of video game streams

• US 10,245,509 B2
• Filed: 10/21/2015
• Issued: 04/02/2019
• Est. Priority Date: 10/21/2015
• Status: Active Grant

• Current Assignee: Activision Publishing Incorporated (Microsoft Corporation)
• Original Assignee: Activision Publishing Incorporated (Microsoft Corporation)
• Inventors: Marr, Michael D., Kaplan, Keith S.
• Primary Examiner(s): Clarke, Jr., Robert T
• Application Number:
  US14/919,444
• Publication Number:
  US 20170113136A1
• Time in Patent Office: 1,259 Days
• CPC Class Codes: A63F 13/355 Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
• CPC Class Codes: A63F 13/497 Partially or entirely replaying previous game actions
• CPC Class Codes: H04L 65/1089 by adding media; by removing media
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality

Abstract

A system and method is provided that generates a game log that specifies game events during gameplay to enable efficient distribution of video game playback, facilitates the annotation of gameplay through content from users and others, and generates a video game stream that includes the game log and content. The system facilitates the efficient sharing of video game playback, as well as annotations from users and others. For example, e-sportscasters may use the system to broadcast video game playback with their commentary and/or graphical overlays. Video game players may use the system to share video game playback efficiently with other users. The system may also facilitate the sharing of loadout conditions and micro-transactions relevant to video game playback.

Claims

1. A computer-implemented method of determining interest in a portion or all of a video game stream used for playback of gameplay of a video games, the method being implemented in a computer system having one or more physical processors programmed with computer program instructions that, when executed by the one or more physical processors, cause the computer system to perform the method, the method comprising:

detecting, by the computer, an occurrence of an in-game action by one or more users engaged in the gameplay of the video game, wherein the occurrence of the in-game action is indicative that an event of interest has occurred or will occur during the gameplay, wherein the video game stream used for playback of the gameplay of the video game includes a game log and a metadata track, the game log specifies at least a first event that occurred during the gameplay of the video game and information that indicates at least a first time in which the first event occurred during the gameplay, and the metadata track includes annotation content relating to the gameplay;

generating, by the computer, an inference object based on the detected occurrence, wherein the inference object comprises portions of the video game stream used in the gameplay; and

causing, by the computer, at least one of a playback of a replay clip based on the inference object, wherein the replay clip comprises at least a portion of the gameplay that has been completed, or a generation of a virtual trading card based on the inference object.

2. The method of claim 1, wherein detecting an occurrence of an in-game action by one or more users engaged in the gameplay of the video game comprises:

detecting, by the computer, one or more user inputs, indicative of user interest, by the one or more users during the gameplay of the video game.

3. The method of claim 1, wherein detecting an occurrence of an in-game action by one or more users engaged in the gameplay of the video game comprises:

detecting, by the computer, one or more user inputs, indicative of user interest, by the one or more users, the user inputs being based on the video game playback.

4. The method of claim 1, wherein generating the inference object comprises:

generating, by the computer, the inference object during gameplay.

5. The method of claim 4, the method further comprising:

detecting, by the computer, an inference trigger that indicates that an event of interest has occurred or will occur during the gameplay of the video game, wherein the inference object is generated upon the detection of the inference trigger.

6. The method of claim 5, wherein the inference trigger comprises an occurrence of an in-game action by one or more users engaged in the gameplay of the video game, wherein the in-game action comprises an occurrence of at least one of a user obtaining a predefined performance metric during the gameplay or an in-game taunt.

7. The method of claim 5, wherein the inference trigger comprises an occurrence of a predictive trigger that uses predefined events to predict an occurrence of predefined gameplay during the gameplay of the video game.

8. The method of claim 1, wherein detecting an occurrence of an in-game action by one or more users engaged in the gameplay of the video game comprises:

identifying, by the computer, at least a portion of the metadata track of likely interest to the one or more users, the metadata track of likely interest comprising annotations conveying interest of the one or more users corresponding to at least a portion of the video game stream.

9. The method of claim 1, wherein detecting an occurrence of an in-game action by one or more users engaged in the gameplay of the video game comprises:

identifying, by the computer, one or more events of the game log of likely interest to the one or more users, wherein the game log comprises a record of at least one event that occurred during the gameplay of the video game, and wherein the at least one event corresponds to an in-game action by the one or more users and wherein the in-game action conveys an interest of the one or more users corresponding to at least a portion of the video game stream.

10. A system for determining interest in a portion or all of a video game stream used for playback of a gameplay of a video games, the system comprising:

one or more physical processors programmed with one or more computer program instructions which, when executed, cause the one or more physical processors to;

detect an occurrence of an in-game action by one or more users engaged in said gameplay of the video game, wherein the occurrence of the in-game action is indicative that an event of interest has occurred or will occur during the gameplay, wherein the video game stream includes a game log and a metadata track, the game log specifies at least a first event that occurred during gameplay of a video game and information that indicates at least a first time in which the first event occurred during the gameplay, and the metadata track includes annotation content relating to the gameplay;

generate an inference object based on the detected occurrence, wherein the inference object comprises portions of the video game stream used in the gameplay; and

generate at least one of a playback of a replay clip based on the inference object, wherein the replay clip comprises at least a portion of the gameplay that has been completed, or a generation of a virtual trading card based on the inference object.

11. The system of claim 10, wherein to detect an occurrence of an in-game action by one or more users engaged in the gameplay of the video game, the one or more physical processors are further caused to detect one or more user inputs, indicative of user interests, by the one or more users during the gameplay of the video game.

12. The system of claim 10, wherein to detect an occurrence of an in-game action by one or more users engaged in the gameplay of the video game, the one or more physical processors are further caused to detect one or more user inputs, indicative of user interests, by the one or more users, the user inputs being based on the video game playback.

13. The system of claim 10, wherein to generate the inference object, the one or more physical processors are further caused to:

generate the inference object during gameplay.

14. The system of claim 13, wherein the one or more physical processors are further caused to:

detect an inference trigger that indicates that an event of interest has occurred or will occur during the gameplay of the video game, wherein the inference object is generated upon the detection of the inference trigger.

15. The system of claim 14, wherein the inference trigger comprises an occurrence of an in-game action by one or more users engaged in the gameplay of the video game, wherein the in-game action comprises an occurrence of at least one of a user obtaining a predefined performance metric during the gameplay or an in-game taunt.

16. The system of claim 14, wherein the inference trigger comprises an occurrence of a predictive trigger that uses predefined events to predict an occurrence of interesting gameplay.

17. The system of claim 10, wherein to detect an occurrence of an in-game action by one or more users engaged in the gameplay of the video game, the one or more physical processors are further caused to identify at least a portion of the metadata track of likely interest to the one or more users, wherein the metadata track of likely interest comprises annotations conveying interest of the one or more users corresponding to at least a portion of the video game stream.

18. The system of claim 10, wherein to detect an occurrence of an in-game action by one or more users engaged in the gameplay of the video game, the one or more physical processors are further caused to identify one or more events of the game log of likely interest to the one or more users, wherein the game log comprises a record of at least one event that occurred during the gameplay of the video game, wherein the at least one event corresponds to an in-game action by the one or more users, and wherein the in-game action conveys interest of the one or more users corresponding to at least a portion of the video game stream.

19. A computer program product for determining interest in a portion or all of a video game stream used for playback of a gameplay of a video games, the computer program product comprising:

one or more tangible, non-transitory computer-readable storage devices;

program instructions, stored on at least one of the one or more tangible, non-transitory computer-readable tangible storage devices that, when executed, cause a computer to;

detect an occurrence of an in-game action by one or more users engaged in the gameplay of the video game, wherein the occurrence of the in-game action is indicative that an event of interest has occurred or will occur during the gameplay, wherein the video game stream includes a game log and a metadata track, the game log specifies at least a first event that occurred during gameplay of a video game and information that indicates at least a first time in which the first event occurred during the gameplay, and the metadata track includes annotation content relating to the gameplay;

generate, an inference object based on the detected occurrence, wherein the inference object comprises portions of the video game stream used in the gameplay; and

generate at least one of;

a playback of a replay clip based on the inference object, wherein the replay clip comprises at least a portion of the gameplay that has been completed, or a generation of a virtual trading card based on the inference object.

20. The computer program product of claim 19, wherein to detect an occurrence of an in-game action by one or more users engaged in the gameplay of the video game, the program instructions, when executed, further cause the computer to:

detect one or more user inputs, indicative of user interests, by the one or more users during the gameplay of the video game.

21. The computer program product of claim 19, wherein to detect an occurrence of an in-game action by one or more users engaged in the gameplay of the video game, the program instructions, when executed, further cause the computer to:

detect one or more user inputs, indicative of user interests, by the one or more users, the user inputs being based on the video game playback.

22. The computer program product of claim 19, wherein to generate the inference object, the program instructions, when executed, further cause the computer to:

generate the inference object during gameplay and detect an inference trigger that indicates that an event of interest has occurred or will occur during the gameplay of the video game, wherein the inference object is generated upon detection of the inference trigger.

23. The computer program product of claim 22, wherein the inference trigger comprises at least one of:

an occurrence of an in-game action by one or more players during the gameplay of the video game or an occurrence of an in-game achievement by one or more players during the gameplay of the video game.

24. The computer program product of claim 19, wherein to detect an occurrence of an in-game action by one or more users engaged in the gameplay of the video game, the program instructions, when executed, further cause the computer to:

identify at least a portion of the metadata track of likely interest to the one or more users, the metadata track of likely interest comprising annotations conveying interest of the one or more users corresponding to at least a portion of the video game stream.

25. The computer program product of claim 19, wherein to detect an occurrence of an in-game action by one or more users engaged in the gameplay of the video game, the program instructions, when executed, further cause the computer to:

identify one or more events of the game log of likely interest to the one or more users, wherein the game log comprises a record of at least one event that occurred during the gameplay of the video game, and wherein the at least one event corresponds to an in-game action by the one or more users, the in-game action conveying interest of the one or more users corresponding to at least a portion of the video game stream.