×

Contextual user interface based on video game playback

  • US 10,166,465 B2
  • Filed: 06/21/2017
  • Issued: 01/01/2019
  • Est. Priority Date: 01/20/2017
  • Status: Active Grant
First Claim
Patent Images

1. A method for providing a graphical user interface (GUI) on a touchscreen of a home assistant device with artificial intelligence (AI) capabilities, the GUI providing content related to playback of a video game within an environment of the home assistant device, comprising:

  • receiving video game state information from a video game console, the video game state information indicating a state of playback of a video game within the environment;

    determining that the video game state information indicates that the state of the playback of the video game includes a player character controlled by a user having a health status approaching a level that results in termination of a current iteration of the playback of the video game, and that the video game state information indicates that an item controlled by the player character has an inventory level approaching a level that results in the item not being functional until the inventory level is replenished;

    determining characteristics of the user while playing the video game;

    generating a first hot button for display on the GUI of the touchscreen of the home assistant device based on the determination that the state of the playback of the video game includes a player character controlled by a user having a health status approaching a level that results in termination of a current iteration of the playback of the video game, the first hot button configured to instruct the video game console to use an item or ability corresponding to the player character to modify the health status such that it adjusted to a modified level away from the level that results in termination of the current iteration of the playback of the video game;

    providing an audio response indicating that the first hot button was generated based on the characteristics of the user while playing the video game;

    generating a second hot button for display on the GUI of the touchscreen of the home assistant device based on the determination that the video game state information indicates that an item controlled by the player character has an inventory level approaching a level that results in the item not being functional until it is replenished, the second hot button configured to instruct the video game console to use an item or ability corresponding to the player character to modify the inventory level such that it is adjusted to a modified inventory level away from the level that results in the item not being functional;

    determining that the first hot button or the second hot button was selected via a touch on the touchscreen of the home assistant device or via a response to the audio response; and

    instructing the video game console to modify the health status or modify the inventory level based on the selection of the first hot button or the second hot button.

View all claims
  • 1 Assignment
Timeline View
Assignment View
    ×
    ×