Computing interface system

• US 8,743,052 B1
• Filed: 03/14/2013
• Issued: 06/03/2014
• Est. Priority Date: 11/24/2012
• Status: Active Grant

• Current Assignee: Opdig, Inc.
• Original Assignee: Eric Jeffrey Keller, Frank Peter Lambrecht, Vinh V.I. Lam
• Inventors: Keller, Eric Jeffrey, Lam, Vinh Vi, Lambrecht, Frank Peter
• Primary Examiner(s): Boddie, William
• Assistant Examiner(s): Edwards, Carolyn R
• Application Number:
  US13/804,871
• Time in Patent Office: 446 Days
• Field of Search: 345156-178
• US Class Current: 345/156
• CPC Class Codes: G06F 2203/0331 Finger worn pointing device
• CPC Class Codes: G06F 2203/0383 Remote input, i.e. interface arrangements in which the signals generated by a pointing device are transmitted to a PC at a remote location, e.g. to a PC in a LAN
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0233 Character input methods
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

Computing interface systems and methods are disclosed. Some implementations include a first accelerometer attached to a first fastening article that is capable of holding the first accelerometer in place on a portion of a thumb of a user. Some implementations may also include a second accelerometer attached to a second fastening article that is capable of holding the second accelerometer in place on a portion of a wrist of a user. Some implementations may additionally or alternatively include magnetometers and/or gyroscopes attached to the first and second fastening articles. Some implementations may also include a processing device configured to receive measurements from the accelerometers, magnetometers, and/or gyroscopes and identify, based on the measurements, symbols associated with motions of a user'"'"'s hand and/or the orientation of the hand. Some implementations may allow a user to control a cursor in a three dimensional virtual space and interact with objects in that space.

Claims

1. A method comprising:

receiving a first set of acceleration measurements from a first accelerometer that is structurally attached to a thumb of a user;

receiving a second set of acceleration measurements from a second accelerometer that is structurally attached to a wrist of the user;

detecting, based at least in part on the first set of acceleration measurements, when the thumb is tapped on a surface;

when a tap of the thumb is detected, determining, based at least in part on the first set of acceleration measurements and the second set of acceleration measurements, an orientation of the first accelerometer relative to the second accelerometer;

identifying, based on the orientation, a tap target, from among a plurality of tap targets located on fingers of the user, that was touched during the tap;

assigning a symbol associated with the tap target to the tap;

transmitting, storing, or displaying the symbol;

receiving a first set of magnetic flux measurements from a first magnetometer that is structurally attached to the thumb of the user; and

receiving a second set of magnetic flux measurements from a second magnetometer that is structurally attached to the wrist of the user; and

wherein the orientation is determined based at least in part on the first set of magnetic flux measurements and the second set of magnetic flux measurements, and wherein determining the orientation comprises;

filtering the first set acceleration measurements to determine a first estimate of acceleration experienced by the first accelerometer while the thumb was at rest with respect to a hand of the user on the tap target;

filtering the second set of acceleration measurements to determine a second estimate of acceleration experienced by the second accelerometer while the thumb was at rest with respect to the hand of the user on the tap target;

filtering the first set magnetic flux measurements to determine a first estimate of magnetic flux experienced by the first magnetometer while the thumb was at rest with respect to the hand of the user on the tap target;

filtering the second set of magnetic flux measurements to determine a second estimate of magnetic flux experienced by the second accelerometer while the thumb was at rest with respect to the hand of the user on the tap target; and

determining a rotation that will approximately align the first estimate of acceleration with the second estimate of acceleration and that also will approximately align the first estimate of magnetic flux with the second estimate of magnetic flux.

2. A method comprising:

receiving a first set of acceleration measurements from a first accelerometer that is structurally attached to a thumb of a user;

receiving a second set of acceleration measurements from a second accelerometer that is structurally attached to a wrist of the user;

detecting, based at least in part on the first set of acceleration measurements, when the thumb is tapped on a surface;

when a tap of the thumb is detected, determining, based at least in part on the first set of acceleration measurements and the second set of acceleration measurements, an orientation of the first accelerometer relative to the second accelerometer;

identifying, based on the orientation, a tap target, from among a plurality of tap targets located on fingers of the user, that was touched during the tap;

assigning a symbol associated with the tap target to the tap;

transmitting, storing, or displaying the symbol;

determining, based on the second set of acceleration measurements, an estimate of an orientation of an acceleration experienced by the second accelerometer with respect to the axes of the second accelerometer during the tap; and

wherein assigning the symbol to the tap comprises selecting the symbol from among a plurality of symbols associated with the tap target based on the orientation of the acceleration experienced by the second accelerometer.

3. The method of claim 2, in which the acceleration experienced by the second accelerometer is dominated by acceleration caused by the gravitational force of the Earth and the selection is made based at least in part on an estimate of an angle between the gravitational acceleration and an axis running approximately parallel to a forearm of the user.

4. The method of claim 2, in which the user is enabled to indicate a choice from among the plurality of the symbols associated with the tap target, by adjusting the angle of wrist or the angle of a forearm of the user with respect to the gravitational force of the Earth during the tap.

5. The method of claim 2, in which the user is enabled to turn a palm side of the wrist down to face towards the Earth to enter a cursor manipulation mode, in which acceleration measurements from the second accelerometer are used to move a cursor in a virtual space.

6. The method of claim 2, in which determining the orientation comprises:

filtering the first set of acceleration measurements to determine an estimate of a deceleration vector caused by the impact of the thumb with the tap target.

7. A system comprising:

a data processing apparatus;

a data storage device storing instructions executable by the data processing apparatus that upon execution by the data processing apparatus cause the data processing apparatus to perform operations comprising;

receiving a first set of acceleration measurements from a first accelerometer that is structurally attached to a thumb of a user;

receiving a second set of acceleration measurements from a second accelerometer that is structurally attached to a wrist of the user;

detecting, based at least in part on the first set of acceleration measurements, when the thumb is tapped on a surface;

when a tap of the thumb is detected, determining, based at least in part on the first set of acceleration measurements and the second set of acceleration measurements, an orientation of the first accelerometer relative to the second accelerometer;

identifying, based on the orientation, a tap target, from among a plurality of tap targets located on fingers of the user, that was touched during the tap;

assigning a symbol associated with the tap target to the tap;

transmitting, storing, or displaying the symbol; and

filtering the first set of acceleration measurements to determine an estimate of a deceleration vector caused by the impact of the thumb with the tap target.

8. The system of claim 7, in which the operations comprise:

determining, based on the second set of acceleration measurements, an estimate of an orientation of an acceleration experienced by the second accelerometer with respect to the axes of the second accelerometer during the tap; and

wherein assigning the symbol to the tap comprises selecting the symbol from among a plurality of symbols associated with the tap target based on the orientation of the acceleration experienced by the second accelerometer.

9. The system of claim 8, in which the user is enabled to indicate a choice from among the plurality of the symbols associated with the tap target, by adjusting the angle of wrist or the angle of a forearm of the user with respect to the gravitational force of the Earth during the tap.

10. The system of claim 8, in which the user is enabled to turn a palm side of the wrist down to face towards the Earth to enter a cursor manipulation mode, in which acceleration measurements from the second accelerometer are used to move a cursor in a virtual space.

11. A system comprising:

a data processing apparatus;

a data storage device storing instructions executable by the data processing apparatus that upon execution by the data processing apparatus cause the data processing apparatus to perform operations comprising;

receiving a first set of acceleration measurements from a first accelerometer that is structurally attached to a thumb of a user;

receiving a second set of acceleration measurements from a second accelerometer that is structurally attached to a wrist of the user;

detecting, based at least in part on the first set of acceleration measurements, when the thumb is tapped on a surface;

when a tap of the thumb is detected, determining, based at least in part on the first set of acceleration measurements and the second set of acceleration measurements, an orientation of the first accelerometer relative to the second accelerometer;

identifying, based on the orientation, a tap target, from among a plurality of tap targets located on fingers of the user, that was touched during the tap;

assigning a symbol associated with the tap target to the tap;

transmitting, storing, or displaying the symbol;

receiving a first set of magnetic flux measurements from a first magnetometer that is structurally attached to the thumb of the user; and

receiving a second set of magnetic flux measurements from a second magnetometer that is structurally attached to the wrist of the user; and

wherein the orientation is determined based at least in part on the first set of magnetic flux measurements and the second set of magnetic flux measurements, and wherein determining the orientation comprises;

filtering the first set acceleration measurements to determine a first estimate of acceleration experienced by the first accelerometer while the thumb was at rest with respect to a hand of the user on the tap target;

filtering the second set of acceleration measurements to determine a second estimate of acceleration experienced by the second accelerometer while the thumb was at rest with respect to the hand of the user on the tap target;

filtering the first set magnetic flux measurements to determine a first estimate of magnetic flux experienced by the first magnetometer while the thumb was at rest with respect to the hand of the user on the tap target;

filtering the second set of magnetic flux measurements to determine a second estimate of magnetic flux experienced by the second accelerometer while the thumb was at rest with respect to the hand of the user on the tap target; and

determining a rotation that will approximately align the first estimate of acceleration with the second estimate of acceleration and that also will approximately align the first estimate of magnetic flux with the second estimate of magnetic flux.

12. A system comprising:

a data processing apparatus;

a data storage device storing instructions executable by the data processing apparatus that upon execution by the data processing apparatus cause the data processing apparatus to perform operations comprising;

receiving a first set of acceleration measurements from a first accelerometer that is structurally attached to a thumb of a user;

receiving a second set of acceleration measurements from a second accelerometer that is structurally attached to a wrist of the user;

detecting, based at least in part on the first set of acceleration measurements, when the thumb is tapped on a surface;

when a tap of the thumb is detected, determining, based at least in part on the first set of acceleration measurements and the second set of acceleration measurements, an orientation of the first accelerometer relative to the second accelerometer;

identifying, based on the orientation, a tap target, from among a plurality of tap targets located on fingers of the user, that was touched during the tap;

assigning a symbol associated with the tap target to the tap;

transmitting, storing, or displaying the symbol;

determining, based on the second set of acceleration measurements, an estimate of an orientation of an acceleration experienced by the second accelerometer with respect to the axes of the second accelerometer during the tap; and

wherein assigning the symbol to the tap comprises selecting the symbol from among a plurality of symbols associated with the tap target based on the orientation of the acceleration experienced by the second accelerometer.

13. The system of claim 12, in which the acceleration experienced by the second accelerometer is dominated by acceleration caused by the gravitational force of the Earth and the selection is made based at least in part on an estimate of an angle between the gravitational acceleration and an axis running approximately parallel to a forearm of the user.

14. The system of claim 12, in which the user is enabled to indicate a choice from among the plurality of the symbols associated with the tap target, by adjusting the angle of wrist or the angle of a forearm of the user with respect to the gravitational force of the Earth during the tap.

15. The system of claim 12, in which the user is enabled to turn a palm side of the wrist down to face towards the Earth to enter a cursor manipulation mode, in which acceleration measurements from the second accelerometer are used to move a cursor in a virtual space.

16. The system of claim 12, in which determining the orientation comprises:

filtering the first set of acceleration measurements to determine an estimate of a deceleration vector caused by the impact of the thumb with the tap target.