CONTROLLING A VIRTUAL OBJECT WITH A REAL CONTROLLER DEVICE
First Claim
1. A method for controlling a virtual object displayed by a near-eye, augmented reality display with a real controller device comprising:
- receiving user input data from the real controller device requesting an action to be performed by the virtual object;
determining a user perspective of the virtual object being displayed by the near-eye, augmented reality display;
applying the user input data requesting the action to be performed by the virtual object based on the user perspective; and
displaying the action being performed by the virtual object from the user perspective in a display field of view of the near-eye, augmented reality display.
2 Assignments
0 Petitions
Accused Products
Abstract
Technology is described for controlling a virtual object displayed by a near-eye, augmented reality display with a real controller device. User input data is received from a real controller device requesting an action to be performed by the virtual object. A user perspective of the virtual object being displayed by the near-eye, augmented reality display is determined. The user input data requesting the action to be performed by the virtual object is applied based on the user perspective, and the action is displayed from the user perspective. The virtual object to be controlled by the real controller device may be identified based on user input data which may be from a natural user interface (NUI). A user selected force feedback object may also be identified, and the identification may also be based on NUI input data.
211 Citations
20 Claims
-
1. A method for controlling a virtual object displayed by a near-eye, augmented reality display with a real controller device comprising:
-
receiving user input data from the real controller device requesting an action to be performed by the virtual object; determining a user perspective of the virtual object being displayed by the near-eye, augmented reality display; applying the user input data requesting the action to be performed by the virtual object based on the user perspective; and displaying the action being performed by the virtual object from the user perspective in a display field of view of the near-eye, augmented reality display. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A system for controlling a virtual object displayed by a near-eye, augmented reality display with a real controller device comprising:
-
the near-eye augmented reality display having a display field of view including a real object and the virtual object and being supported by a near-eye support structure; one or more processors being communicatively coupled to the near-eye, augmented reality display for controlling the display; the one or more processors being communicatively coupled to at least one capture device for receiving image data and depth data from which the one or more processors determine a three dimensional (3D) mapping of the display field of view and the one or more processors determining a user perspective of the virtual object based on the 3D mapping of the display field of view; the one or more processors being communicatively coupled to the real controller device for receiving user input data requesting an action to be performed by the virtual object; the one or more processors applying the user input data requesting the action to be performed by the virtual object based on the user perspective; and the one or more processors causing the near-eye, augmented reality display to display the action being performed by the virtual object from the user perspective. - View Dependent Claims (13, 14, 15, 16, 17)
-
-
18. One or more processor readable storage devices comprising instructions which cause one or more processors to execute a method for providing force feedback for a user selected force feedback object by a real controller device providing input data to a near-eye augmented reality display device system, the method comprising:
-
identifying a virtual object to be controlled by a real controller device; identifying a user selected force feedback object for which force feedback is to be activated by the real controller device based on received user input; applying a user input command received from the real controller device for controlling action of the virtual object based on a user perspective; and identifying a collision between the virtual object under control of the real controller device and the user selected force feedback object; determining a force value for a force acting upon the user selected force feedback object based on physical properties of the virtual object and the user selected force feedback object in the collision; and sending the force value to the real controller device for representing the force value. - View Dependent Claims (19, 20)
-
Specification