Physical object for intuitive navigation in a three-dimensional space

• US 9,098,115 B2
• Filed: 04/08/2011
• Issued: 08/04/2015
• Est. Priority Date: 04/08/2011
• Status: Active Grant

• Current Assignee: Autodesk, Inc.
• Original Assignee: Autodesk, Inc.
• Inventors: Glueck, Michael, Khan, Azam, Anderson, Sean
• Primary Examiner(s): Mengistu, Amare
• Assistant Examiner(s): Rodriguez, Joseph G
• Application Number:
  US13/083,435
• Publication Number:
  US 20120256834A1
• Time in Patent Office: 1,579 Days
• Field of Search: 345/163, 345/173, 463/32
• US Class Current: 1/1
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/03543 Mice or pucks G06F3/03541 takes precedence
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object

Abstract

A computer-implemented method for manipulating graphics objects within a display viewed by an end-user is disclosed. The method involves: receiving motion information generated in response to the end-user moving an object that is external to the display; determining at least one zone of motion in which the end-user moves the object; determining a first motion type associated with the movement of the object within the at least one zone of motion; and based on the at least one zone of motion and the first motion type, determining at least one change to a viewpoint associated with one or more graphics objects displayed to the end-user within the display. The at least one change to the viewpoint causes an alteration in how the one or more graphics objects are displayed to the end-user within the display.

Claims

1. A computer-implemented method for manipulating graphics objects within a display viewed by an end-user, the method comprising:

capturing visual data of the end-user moving an inanimate object that is external to the display within a plurality of zones of motion, wherein each zone of motion included in the plurality of zones of motion is associated with a different expected motion type;

determining at least one zone of motion in the plurality of zones of motion in which the end-user moves the inanimate object;

determining a first motion type associated with the movement of the inanimate object within the at least one zone of motion, wherein the first motion type comprises an expected motion type associated with the at least one zone of motion; and

based on the at least one zone of motion and the first motion type, determining at least one change to a viewpoint associated with one or more graphics objects displayed to the end-user within the display,

wherein the at least one change to the viewpoint causes an alteration in how the one or more graphics objects are displayed to the end-user within the display.

2. The method of claim 1, further comprising transmitting the at least one change to the viewpoint to a software application that generates the one or more graphics objects displayed within the display.

3. The method of claim 1, further comprising transmitting the at least one change to the viewpoint to a display engine configured to manage how the one or more graphics objects are displayed within the display.

4. The method of claim 1, wherein the inanimate object external to the display comprises a hand-held cube.

5. The method of claim 4, wherein at least one face of the hand-held cube includes a distinct visual mark that identifies the at least one face of the hand-held cube and enables the first motion type associated with the movement of the cube within the at least one zone of motion to be determined.

6. The method of claim 1, wherein the at least one zone comprises a zone of rotation, the first motion type corresponds to a rotation of the inanimate object external to the display within the zone of rotation, and the at least one change to the viewpoint comprises a rotation of the viewpoint relative to the one or more graphics objects.

7. The method of claim 1, wherein the at least one zone comprises a panning zone, the first motion type corresponds to a translation of the inanimate object external to the display within the panning zone in a first direction relative to a first position, and the at least one change to the viewpoint comprises a translation of the viewpoint in a direction corresponding to the first direction relative to the one or more graphics objects.

8. The method of claim 1, wherein the at least one zone comprises a zooming zone, the first motion type corresponds to a translation of the inanimate object external to the display within the zooming zone toward or away from a first position, and the at least one change to the viewpoint comprises a zoom into or a zoom out from the one or more graphics objects.

9. A non-transitory computer-readable medium storing instructions that, when executed by a processing unit, cause the processing unit to manipulate graphics objects within a display viewed by an end-user, by performing the steps of:

capturing visual data of the end-user moving an inanimate object that is external to the display within a plurality of zones of motion, wherein each zone of motion included in the plurality of zones of motion is associated with a different expected motion type;

determining at least one zone of motion in the plurality of zones of motion in which the end-user moves the inanimate object;

determining a first motion type associated with the movement of the inanimate object within the at least one zone of motion, wherein the first motion type comprises an expected motion type associated with the at least one zone of motion; and

based on the at least one zone of motion and the first motion type, determining at least one change to a viewpoint associated with one or more graphics objects displayed to the end-user within the display,

wherein the at least one change to the viewpoint causes an alteration in how the one or more graphics objects are displayed to the end-user within the display.

10. The computer-readable medium of claim 9, wherein the steps further comprise transmitting the at least one change to the viewpoint to a software application that generates the one or more graphics objects displayed within the display.

11. The computer-readable medium of claim 9, wherein the steps further comprise transmitting the at least one change to the viewpoint to a display engine configured to manage how the one or more graphics objects are displayed within the display.

12. The computer-readable medium of claim 9, wherein the inanimate object external to the display comprises a hand-held cube.

13. The computer-readable medium of claim 9, wherein at least one face of the hand-held cube includes a distinct visual mark that identifies the at least one face of the hand-held cube and enables the first motion type associated with the movement of the cube within the at least one zone of motion to be determined.

14. The computer-readable medium of claim 9, wherein the at least one zone comprises a zone of rotation, the first motion type corresponds to a rotation of the inanimate object external to the display within the zone of rotation, and the at least one change to the viewpoint comprises a rotation of the viewpoint relative to the one or more graphics objects.

15. The computer-readable medium of claim 9, wherein the at least one zone comprises a panning zone, the first motion type corresponds to a translation of the inanimate object external to the display within the panning zone in a first direction relative to a first position, and the at least one change to the viewpoint comprises a translation of the viewpoint in a direction corresponding to the first direction relative to the one or more graphics objects.

16. The computer-readable medium of claim 9, wherein the at least one zone comprises a zooming zone, the first motion type corresponds to a translation of the inanimate object external to the display within the zooming zone toward or away from a first position, and the at least one change to the viewpoint comprises a zoom into or a zoom out from the one or more graphics objects.

17. A system comprising:

a computer system configured to;

capturing visual data of the end-user moving an inanimate object that is external to the display within a plurality of zones of motion, wherein each zone of motion included in the plurality of zones of motion is associated with a different expected motion type;

determine at least one zone of motion in the plurality of zones of motion in which the end-user moves the inanimate object;

determine a first motion type associated with the movement of the inanimate object within the at least one zone of motion, wherein the first motion type comprises an expected motion type associated with the at least one zone of motion; and

based on the at least one zone of motion and the first motion type, determine at least one change to a viewpoint associated with one or more graphics objects displayed to the end-user within the display,

wherein the at least one change to the viewpoint causes an alteration in how the one or more graphics objects are displayed to the end-user within the display.

18. The system of claim 17, further comprising the inanimate object external to the display that comprises a hand-held cube, wherein at least one face of the hand-held cube includes a distinct visual mark that identifies the at least one face of the hand-held cube.

19. The system of claim 17, further comprising a camera configured to:

capture the motion information related to the end-user moving the inanimate object that is external to the display; and

provide the motion information to the computer system.

20. The system of claim 17, wherein the display is configured to display the one or more graphics objects from the viewpoint based on the at least one change to the viewpoint.