Interactivity with a mixed reality
First Claim
Patent Images
1. A mixed-reality command server computer system comprising at least one processor, one programmed to:
- receive, from a mobile device;
image data captured by an image sensor of the mobile device, the image data including an image of a real-world object; and
sensor data captured by a second sensor of the mobile device;
derive attributes associated with the real-world object with the image data;
determine that a virtual object is local to the mobile device based on at least one of the image data and the sensor data, wherein the virtual object is associated with a game;
derive a command set for the real-world object as a mixed-reality object based on the attributes and the sensor data, wherein;
the mixed-reality object comprises a virtual representation of the real-world object in the game; and
the command set includes at least one command corresponding to an in-game interaction with the virtual representation of the real-world object and involving the virtual object; and
cause the mobile device to present the command set to a user via a display of the mobile device within a mixed-reality view, such that when the mobile device is moved, the command set moves within the display of the mobile device to remain in proper relation to the image of the real-world object within the mixed reality view.
3 Assignments
0 Petitions
Accused Products
Abstract
Methods of interacting with a mixed reality are presented. A mobile device captures an image of a real-world object where the image has content information that can be used to control a mixed reality object through an offered command set. The mixed reality object can be real, virtual, or a mixture of both real and virtual.
116 Citations
20 Claims
-
1. A mixed-reality command server computer system comprising at least one processor, one programmed to:
-
receive, from a mobile device; image data captured by an image sensor of the mobile device, the image data including an image of a real-world object; and sensor data captured by a second sensor of the mobile device; derive attributes associated with the real-world object with the image data; determine that a virtual object is local to the mobile device based on at least one of the image data and the sensor data, wherein the virtual object is associated with a game; derive a command set for the real-world object as a mixed-reality object based on the attributes and the sensor data, wherein; the mixed-reality object comprises a virtual representation of the real-world object in the game; and the command set includes at least one command corresponding to an in-game interaction with the virtual representation of the real-world object and involving the virtual object; and cause the mobile device to present the command set to a user via a display of the mobile device within a mixed-reality view, such that when the mobile device is moved, the command set moves within the display of the mobile device to remain in proper relation to the image of the real-world object within the mixed reality view. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20)
-
Specification