SPATIALLY-AWARE PROJECTION PEN INTERFACE

• US 20100103101A1
• Filed: 08/06/2009
• Published: 04/29/2010
• Est. Priority Date: 10/27/2008
• Status: Active Grant

• Current Assignee: Autodesk, Inc.
• Original Assignee: Autodesk, Inc.
• Inventors: GROSSMAN, Tovi, FITZMAURICE, George, GUIMBRETIERE, Francois V., SONG, Hyunyoung, KURTENBACH, Gordon
• Granted Patent: US 8,884,876 B2
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: G06F 3/03542 Light pens for emitting or receiving light
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus

Abstract

One embodiment of the present invention sets forth a technique for providing an end user with a digital pen embedded with a spatially-aware miniature projector for use in a design environment. Paper documents are augmented to allow a user to access additional information and computational tools through projected interfaces. Virtual ink may be managed in single and multi-user environments to enhance collaboration and data management. The spatially-aware projector pen provides end-users with dynamic visual feedback and improved interaction capabilities.

Claims

1. A computer-implemented method for configuring a spatially-aware projection pen to provide a user interface, the method comprising:

receiving a position of the spatially-aware projection pen in three-dimensional space from a position tracking mechanism;

receiving a signal indicating that a user interface menu has been activated through an input mechanism of the spatially-aware projection pen;

outputting the user interface menu as a projected image that is displayed on a display surface by a projector within the spatially-aware projection pen;

determining that a menu item specified by the user interface menu has been selected;

deactivating the function for displaying the user interface menu; and

configuring the spatially-aware projection pen for an operation based on the selected menu item.

2. The method of claim 1, further comprising the step of locking the user interface menu to a specific position on the display surface.

3. The method of claim 2, wherein the step of determining comprises determining that a boundary delineating a first region of the user interface menu has been crossed by a virtual cursor to select a first menu item associated with the first region, wherein the virtual cursor has a position that is controlled by movements of the spatially-aware projection pen.

4. The method of claim 1, further comprising, prior to the step of determining, the step of locking the user interface menu to the position of the spatially-aware projection pen in the three-dimensional space.

5. The method of claim 4, wherein the step of determining comprises locking a virtual cursor to the position of the spatially-aware projection pen in the three-dimensional space and activating the input mechanism to lock the user interface menu to a position on the display surface.

6. The method of claim 5, wherein the step of determining comprises determining that a boundary delineating a first region of the user interface menu has been crossed by a virtual cursor to select a first menu item associated with the first region, wherein the virtual cursor has a position that is controlled by movements of the spatially-aware projection pen.

7. The method of claim 6, wherein the three-dimensional space is partitioned into a surface input layer that includes the display surface, a hover input layer of the that is directly above the display surface, and a spatial input layer that is directly above the hover input layer, and the boundary delineating the first region of the user interface menu is crossed in the hover input layer.

8. The method of claim 4, wherein the three-dimensional space is partitioned into a surface input layer that includes the display surface, a hover input layer that is directly above the display surface, and a spatial input layer that is directly above the hover input layer, and the boundary delineating the first region of the user interface menu is crossed in the surface input layer.

9. The method of claim 1, wherein the user interface menu comprises a radial menu that includes a plurality of regions separated by boundaries, wherein each of the regions represents a different menu item included in the radial menu.

10. The method of claim 1, further comprising repeating the steps of outputting and determining for each level of hierarchy of the selected menu item.

11. A computer-readable medium including instructions that, when executed by a processing unit within a spatially-aware projection pen, cause the spatially-aware projection pen to provide a user interface, by performing the steps of:

receiving a position of the spatially-aware projection pen in three-dimensional space from a position tracking mechanism;

receiving a signal indicating that a user interface menu has been activated through an input mechanism of the spatially-aware projection pen;

outputting the user interface menu as a projected image that is displayed on a display surface by a projector within the spatially-aware projection pen;

determining that a menu item specified by the user interface menu has been selected;

deactivating the function for displaying the user interface menu; and

configuring the spatially-aware projection pen for an operation based on the selected menu item.

12. The computer-readable medium of claim 11, further comprising the step of locking the user interface menu to a specific position on the display surface.

13. The computer-readable medium of claim 12, wherein the step of determining comprises determining that a boundary delineating a first region of the user interface menu has been crossed by a virtual cursor to select a first menu item associated with the first region, wherein the virtual cursor has a position that is controlled by movements of the spatially-aware projection pen.

14. The computer-readable medium of claim 11, further comprising, prior to the step of determining, the step of locking the user interface menu to the position of the spatially-aware projection pen in the three-dimensional space.

15. The computer-readable medium of claim 14, wherein the step of determining comprises locking a virtual cursor to the position of the spatially-aware projection pen in the three-dimensional space and activating an input mechanism to lock the user interface menu to a position on the display surface.

16. The computer-readable medium of claim 15, wherein the step of determining comprises determining that a boundary delineating a first region of the user interface menu has been crossed by a virtual cursor to select a first menu item associated with the first region, wherein the virtual cursor has a position that is controlled by movements of the spatially-aware projection pen.

17. The computer-readable medium of claim 16, wherein the three-dimensional space is partitioned into a surface input layer that includes the display surface, a hover input layer of the that is directly above the display surface, and a spatial input layer that is directly above the hover input layer, and the boundary delineating the first region of the user interface menu is crossed in the hover input layer.

18. The computer-readable medium of claim 14, wherein the three-dimensional space is partitioned into a surface input layer that includes the display surface, a hover input layer that is directly above the display surface, and a spatial input layer that is directly above the hover input layer, and the boundary delineating the first region of the user interface menu is crossed in the surface input layer.

19. The computer-readable medium of claim 11, wherein the user interface menu comprises a radial menu that includes a plurality of regions separated by boundaries, wherein each of the regions represents a different menu item included in the radial menu.

20. The computer-readable medium of claim 11, further comprising repeating the steps of outputting and determining for each level of hierarchy of the selected menu item.

21. A spatially-aware projection pen configured to provide a user interface, comprising:

an enclosure that is configured to be grasped by a human hand and housing an input mechanism, a position tracking mechanism, a projector, and a processor,

wherein the processor is configured to;

receive an input signal indicating that display of a user interface menu is activated through the input mechanism of the spatially-aware projection pen,

receive a position of the spatially-aware projection pen in three-dimensional space from the position tracking mechanism,

output the user interface menu to a projected image that is displayed on a display surface by the projector within the spatially-aware projection pen,

determine a menu item specified by the user interface menu is selected,

deactivate the function for displaying the user interface menu, and

configure the spatially-aware projection pen for an operation based on the selected menu item.

22. The spatially-aware projection pen of claim 21, wherein the user interface menu comprises a radial menu that includes a plurality of regions separated by boundaries, wherein each of the regions represents a different menu item included in the radial menu.