COMPUTING INTERFACE SYSTEM

• US 20140176439A1
• Filed: 02/25/2014
• Published: 06/26/2014
• Est. Priority Date: 11/24/2012
• Status: Active Grant

• Current Assignee: Opdig, Inc.
• Original Assignee: Opdig, Inc.
• Inventors: Keller, Eric Jeffrey, Lam, Vinh Vi, Lambrecht, Frank Peter
• Granted Patent: US 10,503,275 B2
• Time in Patent Office: Days
• US Class Current: 345/159
• CPC Class Codes: G06F 2203/0331 Finger worn pointing device
• CPC Class Codes: G06F 2203/0383 Remote input, i.e. interface arrangements in which the signals generated by a pointing device are transmitted to a PC at a remote location, e.g. to a PC in a LAN
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0233 Character input methods
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

Computing interface systems and methods are disclosed. Some implementations include a first accelerometer attached to a first fastening article that is capable of holding the first accelerometer in place on a portion of a thumb of a user. Some implementations may also include a second accelerometer attached to a second fastening article that is capable of holding the second accelerometer in place on a portion of a wrist of a user. Some implementations may additionally or alternatively include magnetometers and/or gyroscopes attached to the first and second fastening articles. Some implementations may also include a processing device configured to receive measurements from the accelerometers, magnetometers, and/or gyroscopes and identify, based on the measurements, symbols associated with motions of a user'"'"'s hand and/or the orientation of the hand. Some implementations may allow a user to control a cursor in a three dimensional virtual space and interact with objects in that space.

Claims

1. A system comprising:

a first accelerometer;

a first fastening article attached to the first accelerometer, the first fastening article capable of holding the first accelerometer in place on a portion of a thumb of a user;

a second accelerometer;

a second fastening article attached to the second accelerometer, the second fastening article capable of holding the second accelerometer in place on a portion of a wrist of a user;

a first magnetometer attached to the first fastening article; and

a second magnetometer attached to the second fastening article.

2. The system of claim 1, in which the first fastening article is a ring band.

3. The system of claim 1, in which the second fastening article is a wrist band.

4. The system of claim 1, comprising:

a first gyroscope attached to the first fastening article; and

a second gyroscope attached to the second fastening article.

5. The system of claim 1, comprising two or more wires that connect the first fastening device to the second fastening device.

6. The system of claim 1, comprising a wireless transmitter attached to the second fastening article, wherein the wireless transmitter is configured to transmit data based on acceleration measurements from the second accelerometer to a computing device.

7. The system of claim 1, comprising a wireless transmitter attached to the second fastening article, wherein the wireless transmitter is configured to transmit data based on acceleration measurements from the first accelerometer to a computing device.

8. The system of claim 1, comprising a processing device configured to:

receive acceleration measurements from the first accelerometer; and

determine, based at least in part on the received acceleration measurements, when a thumb of a user wearing the first fastening article and the second fastening article has been tapped against a surface.

9. The system of claim 8, in which the processing device is further configured to:

receive acceleration measurements from the second accelerometer;

when a tap of the thumb is detected, determine, based at least in part on acceleration measurements from the first accelerometer and the second accelerometer, which tap target from among a set of tap targets located on fingers of a hand of the user have been tapped by the thumb; and

map the tap of the tap target to a symbol associated with the tap target.

10. The system of claim 8, in which the processing device is attached to the second fastening article.

11. The system of claim 8, in which the processing device is part of a remote computing device.

12. The system of claim 1, comprising a processing device configured to:

receive acceleration measurements from the first accelerometer;

determine, based at least in part on the received acceleration measurements, when a thumb of a user wearing the first fastening article has been tapped against a surface;

receive acceleration measurements from the second accelerometer;

receive magnetic flux measurements from the first magnetometer and from the second magnetometer;

when a tap of the thumb is detected, determine, based at least in part on acceleration measurements from the first accelerometer and the second accelerometer and on magnetic flux measurements from the first magnetometer and the second magnetometer, which tap target from among a set of tap targets located on fingers of a hand of the user have been tapped by the thumb; and

map the tap of the tap target to a symbol associated with the tap target.

13. A method comprising:

receiving a first set of acceleration measurements from a first accelerometer that is attached to a thumb of a user;

receiving a second set of acceleration measurements from a second accelerometer that is attached to a wrist of the user;

receiving a first set of magnetic flux measurements from a first magnetometer that is attached to the thumb of the user;

receiving a second set of magnetic flux measurements from a second magnetometer that is attached to the wrist of the user;

detecting, based at least in part on the first set of acceleration measurements, when the thumb is tapped on a surface;

when a tap of the thumb is detected, determining, based at least in part on the first set of acceleration measurements and the second set of acceleration measurements, an orientation of the first accelerometer relative to the second accelerometer, wherein the orientation is determined based at least in part on the first set of magnetic flux measurements and the second set of magnetic flux measurements;

identifying, based on the orientation, a tap target, from among a plurality of tap targets located on fingers of the user, that was touched during the tap;

assigning a symbol associated with the tap target to the tap; and

transmitting, storing, or displaying the symbol.

14. The method of claim 13, in which determining the orientation comprises:

filtering the first set acceleration measurements to determine a first estimate of acceleration experienced by the first accelerometer while the thumb was at rest with respect to a hand of the user on the tap target; and

filtering the second set of acceleration measurements to determine a second estimate of acceleration experienced by the second accelerometer while the thumb was at rest with respect to the hand of the user on the tap target.

15. The method of claim 13, in which determining the orientation comprises:

filtering the first set magnetic flux measurements to determine a first estimate of magnetic flux experienced by the first magnetometer while the thumb was at rest with respect to the hand of the user on the tap target; and

filtering the second set of magnetic flux measurements to determine a second estimate of magnetic flux experienced by the second accelerometer while the thumb was at rest with respect to the hand of the user on the tap target.

16. The method of claim 13, comprising:

receiving a first set of angular rate measurements from a first gyroscope that is attached to the thumb of the user; and

receiving a second set of angular rate measurements from a second gyroscope that is attached to the wrist of the user; and

wherein the orientation is determined based at least in part on first set of angular rate measurements and the second set of angular rate measurements.

17. The method of claim 13, comprising:

determining, based on the second set of acceleration measurements, an estimate of an orientation of an acceleration experienced by the second accelerometer with respect to the axes of the second accelerometer during the tap; and

wherein assigning the symbol to the tap comprises selecting the symbol from among a plurality of symbols associated with the tap target based on the orientation of the acceleration experienced by the second accelerometer.

18. The method of claim 17, in which the acceleration experienced by the second accelerometer is dominated by acceleration caused by the gravitational force of the Earth and the selection is made based at least in part on an estimate of an angle between the gravitational acceleration and an axis running approximately parallel to a forearm of the user.

19. The method of claim 17, in which the user is enabled to indicate a choice from among the plurality of the symbols associated with the tap target, by adjusting the angle of wrist or the angle of a forearm of the user with respect to the gravitational force of the Earth during the tap.

20. The method of claim 17, in which the user is enabled to turn a palm side of the wrist down to face towards the Earth to enter a cursor manipulation mode, in which acceleration measurements from the second accelerometer are used to move a cursor in a virtual space.

21. The method of claim 13, in which determining the orientation comprises:

filtering the first set of acceleration measurements to determine an estimate of a deceleration vector caused by the impact of the thumb with the tap target.

22. A system comprising:

a data processing apparatus;

a data storage device storing instructions executable by the data processing apparatus that upon execution by the data processing apparatus cause the data processing apparatus to perform operations comprising;

receiving a first set of acceleration measurements from a first accelerometer that is attached to a thumb of a user;

receiving a second set of acceleration measurements from a second accelerometer that is attached to a wrist of the user;

receiving a first set of magnetic flux measurements from a first magnetometer that is attached to the thumb of the user;

receiving a second set of magnetic flux measurements from a second magnetometer that is attached to the wrist of the user;

detecting, based at least in part on the first set of acceleration measurements, when the thumb is tapped on a surface;

when a tap of the thumb is detected, determining, based at least in part on the first set of acceleration measurements and the second set of acceleration

measurements, an orientation of the first accelerometer relative to the second accelerometer, wherein the orientation is determined based at least in part on first set of magnetic flux measurements and the second set of magnetic flux measurements;

identifying, based on the orientation, a tap target, from among a plurality of tap targets located on fingers of the user, that was touched during the tap;

assigning a symbol associated with the tap target to the tap; and

transmitting, storing, or displaying the symbol.

23. The system of claim 22 in which determining the orientation comprises:

filtering the first set acceleration measurements to determine a first estimate of acceleration experienced by the first accelerometer while the thumb was at rest with respect to a hand of the user on the tap target; and

filtering the second set of acceleration measurements to determine a second estimate of acceleration experienced by the second accelerometer while the thumb was at rest with respect to the hand of the user on the tap target.

24. The system of claim 22 in which determining the orientation comprises:

filtering the first set magnetic flux measurements to determine a first estimate of magnetic flux experienced by the first magnetometer while the thumb was at rest with respect to the hand of the user on the tap target; and

filtering the second set of magnetic flux measurements to determine a second estimate of magnetic flux experienced by the second accelerometer while the thumb was at rest with respect to the hand of the user on the tap target.

25. The system of claim 22, in which the operations comprise:

receiving a first set of angular rate measurements from a first gyroscope that is attached to the thumb of the user; and

receiving a second set of angular rate measurements from a second gyroscope that is attached to the wrist of the user; and

wherein the orientation is determined based at least in part on first set of angular rate measurements and the second set of angular rate measurements.

26. The system of claim 22, in which the operations comprise:

determining, based on the second set of acceleration measurements, an estimate of an orientation of an acceleration experienced by the second accelerometer with respect to the axes of the second accelerometer during the tap; and

wherein assigning the symbol to the tap comprises selecting the symbol from among a plurality of symbols associated with the tap target based on the orientation of the acceleration experienced by the second accelerometer.

27. The system of claim 26, in which the acceleration experienced by the second accelerometer is dominated by acceleration caused by the gravitational force of the Earth and the selection is made based at least in part on an estimate of an angle between the gravitational acceleration and an axis running approximately parallel to a forearm of the user.

28. The system of claim 26, in which the user is enabled to indicate a choice from among the plurality of the symbols associated with the tap target, by adjusting the angle of wrist or the angle of a forearm of the user with respect to the gravitational force of the Earth during the tap.

29. The system of claim 26, in which the user is enabled to turn a palm side of the wrist down to face towards the Earth to enter a cursor manipulation mode, in which acceleration measurements from the second accelerometer are used to move a cursor in a virtual space.

30. The system of claim 22, in which determining the orientation comprises:

filtering the first set of acceleration measurements to determine an estimate of a deceleration vector caused by the impact of the thumb with the tap target.