Three-dimensional user input

• US 9,529,454 B1
• Filed: 06/19/2015
• Issued: 12/27/2016
• Est. Priority Date: 06/19/2015
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: McGrath, Michael David, Hoof, Jonathan Ross
• Primary Examiner(s): Tzeng, Fred
• Application Number:
  US14/745,197
• Publication Number:
  US 20160370882A1
• Time in Patent Office: 557 Days
• Field of Search: 345/158
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser

Abstract

Examples are disclosed herein that relate to processing three-dimensional user input. One example provides a method of processing user input in a three-dimensional coordinate system, comprising receiving a user input of an origin reset for the three-dimensional coordinate system, responsive to receiving the user input of the origin reset, resetting an origin of the three-dimensional coordinate system, receiving three-dimensional user input in the three-dimensional coordinate system, while the origin remains set, measuring at least one three-dimensional displacement of the three-dimensional user input relative to the origin, and causing movement of a user interface element displayed in a user interface, the movement based on the at least one measured three-dimensional displacement.

Claims

1. A method of processing user input in a three-dimensional coordinate system, comprising:

receiving a user input of an origin reset for the three-dimensional coordinate system;

responsive to receiving the user input of the origin reset, resetting an origin of the three-dimensional coordinate system;

receiving three-dimensional user input in the three-dimensional coordinate system;

while the origin remains set, measuring at least one three-dimensional displacement of the three-dimensional user input relative to the origin; and

causing movement of a user interface element displayed in a user interface, the movement based on the at least one measured three-dimensional displacement.

2. The method of claim 1, wherein causing the movement includes translating the user interface element along a direction of the at least one three-dimensional displacement.

3. The method of claim 1, wherein causing the movement includes translating the user interface element a distance, the distance determined by scaling a magnitude of the three-dimensional displacement.

4. The method of claim 1, further comprising, responsive to the three-dimensional displacement exceeding a threshold displacement, resetting the origin of the three-dimensional coordinate system.

5. The method of claim 1, wherein causing the movement includes translating the user interface element at a speed proportional to a speed at which the three-dimensional displacement was supplied.

6. The method of claim 1, wherein the user input of the origin reset comprises a hand gesture.

7. The method of claim 1, wherein the user input of the origin reset comprises voice input.

8. The method of claim 1, wherein the user interface element is selected by a user input of a gaze direction.

9. The method of claim 1, wherein the three-dimensional user input is received via a depth camera.

10. The method of claim 1, further comprising, while the origin remains set, displaying the origin in the user interface.

11. The method of claim 1, wherein causing the movement includes scrolling the user interface element.

12. A method of processing user input in a three-dimensional coordinate system, comprising:

receiving a user input of a gaze direction;

mapping the gaze direction to a point in a user interface;

receiving a user input of an origin reset for the three-dimensional coordinate system;

responsive to receiving the user input of the origin reset, resetting an origin of the three-dimensional coordinate system;

receiving three-dimensional user input in the three-dimensional coordinate system;

while the origin remains set, measuring at least one three-dimensional displacement of the three-dimensional user input relative to the origin; and

causing movement of a user interface element displayed in the user interface, the movement based on the at least one measured three-dimensional displacement and beginning at the point to which the gaze direction is mapped.

13. The method of claim 12, wherein the point to which the gaze direction is mapped overlaps the user interface element.

14. The method of claim 12, wherein causing the movement of the user interface element includes translating the user interface element along a direction of the three-dimensional displacement.

15. The method of claim 12, further comprising determining a vector based on the three-dimensional displacement, a tail of the vector located at the point to which the gaze direction is mapped.

16. The method of claim 12, further comprising, responsive to the three-dimensional displacement exceeding a threshold displacement, resetting the origin of the three-dimensional coordinate system.

17. A head mounted display device, comprising:

a display;

an outward-facing image sensor; and

a computing device comprising a processor and a storage device holding instructions executable by the processor to;

display, on the display, a user interface;

receive, via the outward-facing image sensor, a user input of an origin reset for a three-dimensional coordinate system;

responsive to receiving the user input of the origin reset, reset an origin of the three-dimensional coordinate system;

receive three-dimensional user input in the three-dimensional coordinate system;

while the origin remains set, measure, via the outward-facing image sensor, at least one three-dimensional displacement of the three-dimensional user input relative to the origin; and

cause movement of a user interface element displayed in the user interface, the movement based on the at least one measured three-dimensional displacement.

18. The method of claim 17, wherein the three-dimensional user input is received via a three-dimensional input device held or worn by a user.

19. The method of claim 17, wherein the three-dimensional user input is received via the outward-facing image sensor.

20. The method of claim 17, wherein the instructions are further executable to:

receive, via a gaze sensor, a user input of a gaze direction; and

map the gaze direction to a point in the user interface,

wherein the movement of the user interface element begins at the point to which the gaze direction is mapped.