Wearable computer with superimposed controls and instructions for external device
First Claim
1. A method comprising:
- determining, at a server network, that a remotely controllable target device is within an environment of a wearable computing device comprising a head-mounted display (HMD), wherein determining that the remotely controllable target device is within the environment of the wearable computing device comprises recognizing an optical identification on the remotely controllable target device;
obtaining, from the server network, target device information related to the remotely controllable target device, wherein the target device information defines a virtual control interface for controlling the remotely controllable target device;
while the HMD is oriented such that at least a portion of the remotely controllable target device is within a field of view of the HMD, controlling the HMD to display the virtual control interface as an image superimposed over the corresponding portion of the remotely controllable target device within the field of view;
while the HMD is oriented such that the remotely controllable target device is not within a field of view of the HMD, controlling the HMD to display the virtual control interface as an image within the field of view;
recognizing an interaction with the virtual control interface;
recognizing a control instruction for the remotely controllable target device based on the recognized interaction; and
transmitting the recognized control instruction from the wearable computing device to the server network for transmission to the remotely controllable target device.
2 Assignments
0 Petitions
Accused Products
Abstract
A wearable computing device includes a head-mounted display (HMD) that provides a field of view in which at least a portion of the environment of the wearable computing device is viewable. The HMD is operable to display images superimposed over the field of view. When the wearable computing device determines that a target device is within its environment, the wearable computing device obtains target device information related to the target device. The target device information may include information that defines a virtual control interface for controlling the target device and an identification of a defined area of the target device on which the virtual control image is to be provided. The wearable computing device controls the HMD to display the virtual control image as an image superimposed over the defined area of the target device in the field of view.
92 Citations
20 Claims
-
1. A method comprising:
-
determining, at a server network, that a remotely controllable target device is within an environment of a wearable computing device comprising a head-mounted display (HMD), wherein determining that the remotely controllable target device is within the environment of the wearable computing device comprises recognizing an optical identification on the remotely controllable target device; obtaining, from the server network, target device information related to the remotely controllable target device, wherein the target device information defines a virtual control interface for controlling the remotely controllable target device; while the HMD is oriented such that at least a portion of the remotely controllable target device is within a field of view of the HMD, controlling the HMD to display the virtual control interface as an image superimposed over the corresponding portion of the remotely controllable target device within the field of view; while the HMD is oriented such that the remotely controllable target device is not within a field of view of the HMD, controlling the HMD to display the virtual control interface as an image within the field of view; recognizing an interaction with the virtual control interface; recognizing a control instruction for the remotely controllable target device based on the recognized interaction; and transmitting the recognized control instruction from the wearable computing device to the server network for transmission to the remotely controllable target device. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A wearable computing device, comprising:
-
a head-mounted display (HMD); and a controller, wherein the controller is configured to perform operations comprising; transmitting, to a server network, information indicative of an environment of the wearable computing device; receiving, from the server network, information that a remotely controllable target device is within the environment of the wearable computing device; obtaining, from the server network, target device information related to the remotely controllable target device, wherein the target device information defines a virtual control interface for controlling the remotely controllable target device; while the HMD is oriented such that at least a portion of the remotely controllable target device is within a field of view of the HMD, controlling the HMD to display the virtual control interface as an image superimposed over the corresponding portion of the remotely controllable target device within the field of view; while the HMD is oriented such that the remotely controllable target device is not within a field of view of the HMD, controlling the HMD to display the virtual control interface as an image within the field of view; recognizing an interaction with the virtual control interface; recognizing a control instruction for the remotely controllable target device based on the recognized interaction; and transmitting the recognized control instruction from the wearable computing device to the server network for transmission to the remotely controllable target device. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20)
-
Specification