Multi-Step Placement of Virtual Objects

• US 20180300952A1
• Filed: 04/17/2017
• Published: 10/18/2018
• Est. Priority Date: 04/17/2017
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Evans, David Anthony, Scott, Jason Bradley, Chevrier, Jedd, Copic, John, Paulovich, Jonathan Gustav, Schutz, Timothy James
• Granted Patent: US 10,692,287 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 9/453 Help systems
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]

Abstract

A technique is described herein for placing a virtual object within any type of modified-reality environment. The technique involves receiving the user'"'"'s specification of plural values in plural stages. The plural values collectively define an object display state. The technique places the virtual object in the modified-reality environment in accordance with the object display state. Overall, the technique allows the user to place the virtual object in the modified-reality environment with high precision and low ambiguity by virtue of its guided piecemeal specification of the object display state.

Claims

1. A method, implemented by one or more computing devices, for placing a virtual object in a modified-reality environment, comprising:

presenting the modified-reality environment via a display device;

receiving first input information in response to a first input action performed by a user;

generating first value information based on the first input information;

displaying a guide to the user within the modified-reality environment;

receiving second input information in response to a second input action performed by the user, in response to interaction by the user with the guide;

generating second value information based on the second input information; and

placing a virtual object in the modified-reality environment based on an object display state specified by at least the first value information and the second value information.

2. The method of claim 1, wherein the input information is received from an input processing engine, and wherein the input processing engine includes one or more of:

a gaze detection engine configured to project a ray defined by a gaze of the user into the modified-reality environment; and

/or

a voice recognition engine configured to interpret a voice command issued by the user; and

/or

a body-movement detection engine configured to interpret a bodily gesture made by the user based on image information that captures the bodily gesture; and

/or

a controller input engine configured to interpret a control signal emitted by a controller operated by the user.

3. The method of claim 1,

further comprising, prior to receiving the first input information, displaying an initial guide to a user within the modified-reality environment,

wherein the first input information is received in response to interaction by the user with the initial guide,

wherein the initial guide corresponds to a grid that is displayed over a surface in the modified-reality environment.

4. The method of claim 1, wherein the guide has a placement that is constrained in at least one regard by the first value information.

5. The method of claim 1, wherein the first input information is received in response to a selection by the user of a point on a selected surface of the modified-reality environment.

6. The method of claim 1,

wherein the guide corresponds to a line that extends from a first point in the modified-reality environment, the first point being specified by the first value information, and

wherein the second input information is received in response to selection by the user of a second point that lies on the line.

7. The method of claim 6,

wherein the first point lies on a surface of the modified-reality environment, and

wherein the line is normal to the surface at the first point.

8. The method of claim 6, further comprising restricting possible selections by the user to points along the line.

9. The method of claim 1, further comprising repeating the method by collecting an instance of additional input information by:

presenting an additional guide;

receiving an instance of additional input information in response to interaction by the user with the additional guide; and

generating the instance of additional value information in response to the instance of additional input information.

10. The method of claim 9, wherein the instance of additional value information governs a size of the virtual object in the modified-reality environment.

11. The method of claim 9, wherein the instance of additional value information governs a rotation of the virtual object in the modified-reality environment with respect to at least one axis of rotation.

12. The method of claim 9,

wherein one additional guide corresponds to a control element having a range of selection points along an axis, and

wherein an instance of additional input information is received in response to selection by the user of one of the selection points that lie on the axis.

13. The method of claim 12, wherein the selection point that is selected governs a rate of change of some aspect of the virtual object.

14. One or more computing devices for placing a virtual object in a modified-reality environment, comprising:

a scene presentation component configured to present the modified-reality environment via a display device;

an input processing engine configured to;

receive input signals from a user in response to input actions taken by a user while engaging the modified-reality environment; and

process those input signals to provide input information;

a first-stage specification component configured to;

receive first input information in response to a first input action performed by the user, the first input information being provided by the input processing engine; and

generate first value information based on the first input information; and

a second-stage specification component configured to;

display a guide to the user within the modified-reality environment, the guide having a placement that is constrained in at least one regard by the first value information;

receive second input information in response to a second input action performed by the user, in response to interaction by the user with the guide, the second input information being provided by the input processing engine; and

generate second value information based on the second input information,

the scene presentation component being configured to place a virtual object in the modified-reality environment based on an object display state specified by at least the first value information and the second value information.

15. The one or more computing devices of claim 14,

wherein the first-stage specification component is further configured to, prior to receiving the first input information, display an initial guide to a user within the modified-reality environment,

wherein the first-stage specification component is configured to receive the first input information in response to interaction by the user with the initial guide.

16. The one or more computing devices of claim 14, wherein first-stage specification component is configured to receive the first input information based on a selection by the user of a point on a selected surface of the modified-reality environment.

17. The one or more computing devices of claim 14,

wherein the guide corresponds to a line that extends from a first point in the modified-reality environment, the first point being specified by the first value information, and

wherein the second-stage specification component is configured to receive the second input information in response to selection by the user of a second point that lies on the line.

18. The one or more computing devices of claim 14, further comprising at least one additional specification component, each of said at least one additional specification component being configured to:

present an additional guide;

receive at an instance of additional input information in response to interaction by the user with the additional guide; and

generate an instance of additional value information in response to the instance of additional input information.

19. The one or more computing devices of claim 18, wherein the instance of additional value information governs a size or rotation of the virtual object in the modified-reality environment.

20. A computer-readable storage medium for storing computer-readable instructions, the computer-readable instructions, when executed by one or more processor devices, performing a method that comprises:

presenting a modified-reality environment via a display device;

receiving first input information in response to a selection by a user of a point on a surface of the modified-reality environment;

generating first value information based on the first input information;

displaying a guide to the user within the modified-reality environment, the guide corresponding to a line that extends from the point on the surface;

receiving second input information in response to selection by a user of a point on the line;

generating second value information based on the second input information; and

placing a virtual object in the modified-reality environment based on an object display state specified by at least the first value information and the second value information.