×

Mixed environment display of attached control elements

  • US 10,007,413 B2
  • Filed: 11/19/2015
  • Issued: 06/26/2018
  • Est. Priority Date: 04/27/2015
  • Status: Active Grant
First Claim
Patent Images

1. A first computing device, comprising:

  • a processor;

    a hardware display surface;

    one or more input devices;

    a memory having computer-executable instructions stored thereupon which, when executed by the processor, cause the first computing device toobtain control data defining one or more commands configured to cause an execution of a second set of computer-executable instructions at a second computing device, wherein the second computing device is configured to interact with an object,analyze image data from the one or more input devices to identify a physical characteristic of the object,obtain identification data indicating an association between a network address of the second computing device and the physical characteristic of the object,establish a connection with the second computing device using the network address in response to identifying the physical characteristic of the object,obtain status data indicating a status associated with the second computing device or the object,cause a display of one or more graphical elements comprising the status data and the one or more commands on the hardware display surface, wherein the hardware display surface is configured to display the one or more graphical elements with a real-world view of the object through a transparent section of the hardware display surface,capture a gesture of at least a portion of a hand, performed by a user, wherein the gesture is viewable by the user through the transparent section in the transparent section of the hardware display surface, and wherein the gesture is viewable by the user with the real-world view of the object,select at least one of the one or more graphical elements based on the gesture, andcommunicate the one or more commands to the second computing device in response to the selection of the one or more commands detected by the one or more input devices, wherein the communication of the one or more commands causes an execution of at least a portion of the second set of computer-executable instructions at the second computing device.

View all claims
  • 1 Assignment
Timeline View
Assignment View
    ×
    ×