Pre-Button Event Stylus Position

• US 20140347329A1
• Filed: 11/16/2012
• Published: 11/27/2014
• Est. Priority Date: 11/18/2011
• Status: Abandoned Application

• Current Assignee: zSpace Inc.
• Original Assignee: Z Space Incorporated A Corporation
• Inventors: Ware, John C.
• Application Number:
  US14/358,755
• Publication Number:
  US 20140347329A1
• Time in Patent Office: Days
• US Class Current: 345/179
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0383 Signal control means within the pointing device
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object

Abstract

Embodiments of the present invention generally relate to methods and systems for correcting position and orientation displacement for a freehand user input device. Systems and methods include measuring the position and orientation of a freehand user input device over a period of time, determining the position and orientation as related to a specific time point at activation of a button, applying a temporal offset to the time point of the activation of the button to determine a button press start time, determining the position and orientation in the virtual space associated with the button press start time and associating the button press to the position and orientation in the virtual space.

Claims

1. A system, comprising:

a display screen configured to project a virtual space to a user comprising one or more projections;

a freehand user input device having a button;

a tracking device configured to;

position a pointer in a first position and a first orientation in the virtual space correlated to a first position and first orientation of the freehand user input device in the physical space;

detect that a button has been activated on the freehand user input device to affect the one or more projections in the virtual space;

detect that the freehand user input device has moved to a second position and second orientation in the physical space and the pointer has moved to a second position and second orientation in the virtual space; and

correlate the activation of the button to a third position and third orientation in the virtual space in response to the detecting either that the button has been activated, or that the freehand user input device or the pointer has moved.

2. The system of claim 1, wherein the third position and third orientation in the virtual space correspond to a position and orientation in the virtual space at which the pointer was located at a predetermined point in time before the pointer was located in the second position and second orientation in the virtual space.

3. The system of claim 2, wherein the third position and third orientation in the virtual space are substantially the first position and first orientation in the virtual space.

4. The system of claim 3, wherein the tracking device is configured to determine the predetermined point in time based upon measurements taken of the position and orientation of the freehand user input device or the pointer over a first period of time.

5. The system of claim 4, wherein the tracking device is configured to measure an offset of the freehand user input device or pointer, wherein the offset is a second period of time.

6. The system of claim 5, wherein the second period of time measured by the tracking device is the time from beginning of a button press to the activation of the button.

7. The system of claim 5, wherein the second period of time measured by the tracking device includes measurements of the position and orientation of the freehand user input device or pointer at points in time prior to the detection of the button press.

8. The system of claim 7, wherein the tracking device is configured to measure the X-axis, Y-axis and Z-axis positions in measuring the offset.

9. The system of claim 8, wherein the tracking device is configured to measure the yaw, pitch and roll orientations in measuring the offset.

10. The system of claim 1, wherein the tracking device is configured to detect a position of an object.

11. The system of claim 1, wherein the tracking device is configured to correlate the button activation to the third position and third orientation by associating the effect of the button activation to the third position and third orientation.

12. The system of claim 1, wherein the tracking device is configured to correlate the button activation to the third position and third orientation by moving the pointer to the third position and third orientation.

13. The system of claim 12, wherein the tracking device is configured to affect a virtual object that is spatially related to the third position and third orientation based on the button activation.

14. The system of claim 1, wherein the pointer is a virtual beam rendered in the virtual space.

15. A system, comprising:

a display screen configured to render a projected virtual space to a user comprising one or more projections;

a freehand user input device having a button;

a tracking device configured to;

position a virtual pointer in a first position and a first orientation in the virtual space correlated to a first position and first orientation of the freehand user input device in the physical space, where the first position and the first orientation in the virtual space intersects a virtual object at the first position and first orientation in the virtual space;

detect that the button has been activated on the freehand user input device to affect the virtual object at the first position and the first orientation in the virtual space;

detect that the freehand user input device has moved to a second position and second orientation in the physical space and the virtual pointer has moved to a second position and second orientation in the virtual space;

correlate the activation of the button to the first position and first orientation in the virtual space in response to the detecting;

upon detecting that the button has been activated on the freehand user input device, perform the button activation effect on the virtual object; and

render the object in rendering the projected virtual space on the display screen.

16. A system, comprising:

a display screen configured to render a projection of a virtual space to a user comprising one or more projections;

a freehand user input device having a button; and

a tracking device configured to;

position a virtual pointer in a first position and a first orientation in the virtual space with a one to one correspondence to a first position and first orientation of the freehand user input device in the physical space;

detect that a button has been pressed on the freehand user input device to affect the one or more projections in the virtual space;

detect that the freehand user input device has moved to a second position and second orientation in the physical space and the virtual pointer has moved to a second position and second orientation in the virtual space;

move the pointer in the virtual space to a third position and third orientation in the virtual space in response to the detecting, independent of the second position and second orientation of the freehand user input device in the physical space; and

upon performing the effect, return the position and orientation of the virtual pointer in the virtual space to a one to one correspondence with the position and orientation of the freehand user input device in the physical space.

17. A method, comprising:

positioning and/or orienting a freehand user input device in a first position and first orientation in a physical space, wherein the positioning and/or orienting causes a corresponding virtual pointer in a virtual space to be positioned and/or oriented in a first position and a first orientation in the virtual space;

detecting that a button has been activated on the freehand user input device to affect a virtual object in the virtual space associated with the corresponding virtual pointer'"'"'s first position and first orientation, wherein the freehand user input device has moved to a second position and second orientation in the physical space and the corresponding virtual pointer has moved to a second position and second orientation in the virtual space; and

correlating the activation of the button to a third position and third orientation in the virtual space in response to the detecting.

18. The method of claim 17, wherein the third position and third orientation in the virtual space is a position and orientation at which the pointer was located at a predetermined point in time before the pointer was located in the second position and second orientation in the virtual space.

19. The method of claim 18, wherein the button activation affects a virtual object that is spatially related to the third position and third orientation.

20. The method of claim 18, wherein the third position and third orientation in the virtual space is substantially the same position and orientation as the first position and first orientation in the virtual space.

21. The method of claim 20, wherein the predetermined point in time is a constant which is calculated based upon measurements taken of the position and orientation of the freehand user input device or the pointer over a period of time.

22. The method of claim 21, further comprising measuring an offset of the freehand user input device or the pointer, wherein the offset is a period of time.

23. The method of claim 22, wherein the measurements taken are a measurement of position and orientation of the freehand user input device or the pointer over time from beginning to completion of a button activation.

24. The method of claim 23, wherein the measurements taken include one or more of X-axis position, Y-axis position, Z-axis position, yaw orientation, pitch orientation and roll orientation value.

25. The method of claim 17, wherein the button activation causes the movement of the freehand user input device to the second position and second orientation.

26. The method of claim 17, wherein the first position and a first orientation in the virtual space corresponds to a point.

27. The method of claim 17, wherein the first position and a first orientation in the virtual space corresponds to a region.

28. The method of claim 17, further comprising measuring an offset of the freehand user input device or pointer, wherein the offset is a period of time.