Interactivity with a mixed reality
First Claim
Patent Images
1. A method of interacting with a mixed reality, comprising:
- providing a mobile phone device having a physical handheld display;
using the mobile device to electronically capture image data of at least a portion of a multi-part real-world object;
using the image data to identify an attribute associated with the real-world object;
using the attribute to interact with software being operated at least in part remote to the mobile device to obtain a first command set for a first part of the real-world object and a second, different command set for a second part of the real-world object from a distal database storing a plurality command sets for multiple, mixed reality objects, where the command sets comprise network API addresses corresponding to commands that control the first and the second parts, respectively;
offering the first and the second command set to the mobile phone device;
combining at least one virtual interface comprising the commands sets with the image data of the real-world object to form mixed reality representations of the first and the second parts;
displaying the at least one virtual interface on the handheld display to allow a user to select a command from one of the command sets; and
executing the command by issuing call over a network from the mobile device to a corresponding network API address of the command drawn from the network API addresses.
12 Assignments
0 Petitions
Accused Products
Abstract
Methods of interacting with a mixed reality are presented. A mobile device captures an image of a real-world object where the image has content information that can be used to control a mixed reality object through an offered command set. The mixed reality object can be real, virtual, or a mixture of both real and virtual.
-
Citations
19 Claims
-
1. A method of interacting with a mixed reality, comprising:
-
providing a mobile phone device having a physical handheld display; using the mobile device to electronically capture image data of at least a portion of a multi-part real-world object; using the image data to identify an attribute associated with the real-world object; using the attribute to interact with software being operated at least in part remote to the mobile device to obtain a first command set for a first part of the real-world object and a second, different command set for a second part of the real-world object from a distal database storing a plurality command sets for multiple, mixed reality objects, where the command sets comprise network API addresses corresponding to commands that control the first and the second parts, respectively; offering the first and the second command set to the mobile phone device; combining at least one virtual interface comprising the commands sets with the image data of the real-world object to form mixed reality representations of the first and the second parts; displaying the at least one virtual interface on the handheld display to allow a user to select a command from one of the command sets; and executing the command by issuing call over a network from the mobile device to a corresponding network API address of the command drawn from the network API addresses. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19)
-
Specification