Contextual user interface based on video game playback
First Claim
1. A method for providing a graphical user interface (GUI) on a touchscreen of a home assistant device with artificial intelligence (AI) capabilities, the GUI providing content related to playback of a video game within an environment of the home assistant device, comprising:
- receiving video game state information from a video game console, the video game state information indicating a state of playback of a video game within the environment;
determining that the video game state information indicates that the state of the playback of the video game includes a player character controlled by a user having a health status approaching a level that results in termination of a current iteration of the playback of the video game, and that the video game state information indicates that an item controlled by the player character has an inventory level approaching a level that results in the item not being functional until the inventory level is replenished;
determining characteristics of the user while playing the video game;
generating a first hot button for display on the GUI of the touchscreen of the home assistant device based on the determination that the state of the playback of the video game includes a player character controlled by a user having a health status approaching a level that results in termination of a current iteration of the playback of the video game, the first hot button configured to instruct the video game console to use an item or ability corresponding to the player character to modify the health status such that it adjusted to a modified level away from the level that results in termination of the current iteration of the playback of the video game;
providing an audio response indicating that the first hot button was generated based on the characteristics of the user while playing the video game;
generating a second hot button for display on the GUI of the touchscreen of the home assistant device based on the determination that the video game state information indicates that an item controlled by the player character has an inventory level approaching a level that results in the item not being functional until it is replenished, the second hot button configured to instruct the video game console to use an item or ability corresponding to the player character to modify the inventory level such that it is adjusted to a modified inventory level away from the level that results in the item not being functional;
determining that the first hot button or the second hot button was selected via a touch on the touchscreen of the home assistant device or via a response to the audio response; and
instructing the video game console to modify the health status or modify the inventory level based on the selection of the first hot button or the second hot button.
1 Assignment
0 Petitions
Accused Products
Abstract
A contextual user interface based on video game playback is described. An assistant device can receive video game state information indicating a state of a playback of a video game on a video game console. Using that information, the assistant device can determine characteristics of the playback and generate a button on a graphical user interface (GUI) based on the characteristics. A user can then select the button and cause the assistant device to instruct the video game console to perform a corresponding action.
-
Citations
24 Claims
-
1. A method for providing a graphical user interface (GUI) on a touchscreen of a home assistant device with artificial intelligence (AI) capabilities, the GUI providing content related to playback of a video game within an environment of the home assistant device, comprising:
-
receiving video game state information from a video game console, the video game state information indicating a state of playback of a video game within the environment; determining that the video game state information indicates that the state of the playback of the video game includes a player character controlled by a user having a health status approaching a level that results in termination of a current iteration of the playback of the video game, and that the video game state information indicates that an item controlled by the player character has an inventory level approaching a level that results in the item not being functional until the inventory level is replenished; determining characteristics of the user while playing the video game; generating a first hot button for display on the GUI of the touchscreen of the home assistant device based on the determination that the state of the playback of the video game includes a player character controlled by a user having a health status approaching a level that results in termination of a current iteration of the playback of the video game, the first hot button configured to instruct the video game console to use an item or ability corresponding to the player character to modify the health status such that it adjusted to a modified level away from the level that results in termination of the current iteration of the playback of the video game; providing an audio response indicating that the first hot button was generated based on the characteristics of the user while playing the video game; generating a second hot button for display on the GUI of the touchscreen of the home assistant device based on the determination that the video game state information indicates that an item controlled by the player character has an inventory level approaching a level that results in the item not being functional until it is replenished, the second hot button configured to instruct the video game console to use an item or ability corresponding to the player character to modify the inventory level such that it is adjusted to a modified inventory level away from the level that results in the item not being functional; determining that the first hot button or the second hot button was selected via a touch on the touchscreen of the home assistant device or via a response to the audio response; and instructing the video game console to modify the health status or modify the inventory level based on the selection of the first hot button or the second hot button.
-
-
2. A method, comprising:
-
receiving video game state information representing a state of playback of a video game on a video game console; determining, by a processor of an assistant device, that the state of the playback of the video game includes a player character controlled by a user, the player character having characteristics based on the playback of the video game; determining, by the processor, characteristics of the user while playing the video game; generating, by the processor, a first button on a graphical user interface (GUI) displayed upon a display of the assistant device, the first button providing an indication of a first action that can be performed by the video game to modify the characteristics of the player character; providing an audio response indicating that the first button was generated, the audio response provided based on the characteristics of the user while playing the video game; determining, by the processor, that the first button was selected in response to the audio response; and instructing, by the processor, the video game console to modify the characteristics of the player character corresponding to the first action upon selection of the first button. - View Dependent Claims (3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A computer program product, comprising one or more non-transitory computer-readable media having computer program instructions stored therein, the computer program instructions being configured such that, when executed by one or more computing devices, the computer program instructions cause the one or more computing devices to:
-
receive video game state information representing a state of playback of a video game on a video game console; determine that the state of the playback of the video game includes a player character controlled by a user, the player character having characteristics based on the playback of the video game; determine characteristics of the user while playing the video game; generate a first button on a graphical user interface (GUI), the first button providing an indication of a first action that can be performed by the video game to modify the characteristics of the player character; provide an audio response indicating that the first button was generated, the audio response provided based on the characteristics of the user while playing the video game; determine that the first button was selected in response to the audio response; and instruct the video game console to modify the characteristics of the player character corresponding to the first action upon selection of the first button. - View Dependent Claims (12, 13, 14, 15, 16, 17)
-
-
18. An electronic device, comprising:
-
one or more processors; and memory storing instructions, wherein the processor is configured to execute the instructions such that the processor and memory are configured to; determine a state of a playback of a game played back on a game console, the game being played back by a user; generate a first button on a graphical user interface (GUI), the first button providing an indication of a first action that can be performed by the game to adjust the playback of the game based on the state of the playback; determine characteristics of the user while playing the game; provide an audio response indicating that the first button was generated, the audio response provided based on the characteristics of the user while playing the game; determine that the first button was selected in response to the audio response; and instruct the game console to adjust the playback of the game corresponding to the first action upon selection of the first button. - View Dependent Claims (19, 20, 21, 22, 23, 24)
-
Specification