Method and system for mapping virtual coordinates

• US 7,788,607 B2
• Filed: 12/01/2006
• Issued: 08/31/2010
• Est. Priority Date: 12/01/2005
• Status: Expired due to Fees

• Current Assignee: Navisense
• Original Assignee: Navisense
• Inventors: Boillot, Marc Andre
• Primary Examiner(s): Bashore, William L
• Assistant Examiner(s): UM, DANIEL H
• Application Number:
  US11/566,148
• Publication Number:
  US 20070126696A1
• Time in Patent Office: 1,369 Days
• Field of Search: 715/863
• US Class Current: 715/863
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials

Abstract

A system (100) and method (200) for mapping a virtual user interface (VUI) to a graphical user interface (GUI) is provided. The method can include identifying (202) a range of object movement in a first coordinate system of the Virtual User Interface (101), identifying (204) a display range in a second coordinate system of the graphical user interface (103), and mapping (206) the range of object motion to the display range to produce a virtual mapping. The method can further include tracking (211) a finger (214) movement (310), applying (213) the virtual mapping to the finger movement to produce a second movement (312), and handling (215) a touchless control (102) in accordance with the second movement.

Claims

1. A method for ultrasonic mapping of a virtual user interface (VUI) to a graphical user interface (GUI), the method comprising,

identifying a range of object movement from ultrasonic distance tracking of a closest point on the object with respect to a pivot point of the object in a three-dimensional coordinate system of the virtual user interface (VUI);

identifying a display range in a second coordinate system of the graphical user interface (GUI);

mapping the ultrasonic range of object movement of the closest point with respect to the pivot point in the three-dimensional coordinate system of the VUI to the display range of the GUI to produce a virtual mapping;

generating a rectangular representation of the display range from the virtual mapping established by the pivot point, and

controlling the GUI in response to the object movement in the VUI according to the virtual mapping,

where the object is;

a finger that is kept relatively straight with respect to a knuckle or wrist pivot point;

or

a hand that moves when an arm of the hand is kept relatively straight with respect to an elbow or shoulder pivot point;

and no sensory electronics or labeled markers are affixed or attached to the object for mapping the VUI to the GUI,

wherein the step of identifying a range of object movement further comprises;

identifying the pivot point of the object from the ultrasonic tracking of the closest point;

from a distance from a tip of the object to the pivot point, identifying a displacement range of the object; and

generating a spherical representation of the range from the pivot point, the distance, and the displacement range.

2. The method of claim 1, wherein a step of mapping the range of object movement to the display range further comprises:

converting

a finger range with respect to a knuckle or wrist pivot point, or

an arm range with respect to an elbow or shoulder pivot point to a Cartesian representation.

3. The method of claim 1, wherein the virtual mapping provides a one-to-one correspondence of a first location in the VUI to a second location in the GUI, where the one-to-one correspondence maps

a full range of conical finger movement with respect to a generally stationary hand or wrist pivot point, or

a full range of conical arm movement with respect to a generally stationary elbow or shoulder pivot point,

to the full display range.

4. The method of claim 1, further comprising:

tracking a finger movement in the virtual user interface (VUI);

applying the virtual mapping to the finger movement to produce a second movement; and

handling a touchless object in accordance with the second movement.

5. The method of claim 4, wherein the virtual mapping provides a one-to-one correspondence of the three dimensional coordinate system to the second coordinate system, such that a fixed finger movement distance along an arc of the range in the three dimensional coordinate system corresponds to a fixed handling of the touchless object.