COMPUTING INTERFACE SYSTEM

• US 20140267024A1
• Filed: 03/14/2014
• Published: 09/18/2014
• Est. Priority Date: 03/15/2013
• Status: Abandoned Application

• Current Assignee: Opdig, Inc.
• Original Assignee: Opdig, Inc.
• Inventors: Keller, Eric Jeffrey, Lam, Vinh Vi, Lambrecht, Frank Peter
• Application Number:
  US14/212,678
• Publication Number:
  US 20140267024A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0233 Character input methods
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

Computing interface systems and methods are disclosed. Some implementations include a first accelerometer attached to a first fastening article that is capable of holding the first accelerometer in place on a portion of a thumb of a user. Some implementations may also include a second accelerometer attached to a second fastening article that is capable of holding the second accelerometer in place on a portion of a wrist of a user. Some implementations may additionally or alternatively include magnetometers and/or gyroscopes attached to the first and second fastening articles. Some implementations may also include a processing device configured to receive measurements from the accelerometers, magnetometers, and/or gyroscopes and identify, based on the measurements, symbols associated with motions of a user'"'"'s hand and/or the orientation of the hand. Some implementations may allow a user to control a cursor in a three dimensional virtual space and interact with objects in that space.

Claims

1. A method comprising:

receiving a first set of acceleration measurements from a first accelerometer that is attached to a thumb of a user;

detecting, based at least in part on the first set of acceleration measurements, a first event corresponding to engagement of a working surface;

during the first event, tracking motion of the first accelerometer, based at least in part on the first set of acceleration measurements;

determining, based at least in part on the tracked motion of the first accelerometer during the first event, image data; and

transmitting, storing, or displaying the image data.

2. The method of claim 1, in which the working surface corresponds to a physical surface.

3. The method of claim 1, comprising determining an orientation of the working surface.

4. The method of claim 3, in which determining the orientation of the working surface comprises:

determining a path through three dimensional space traversed by the first accelerometer during a working surface definition gesture; and

fitting a plane to the path.

5. The method of claim 3, comprising determining a three dimensional position of at least one point on the working surface.

6. The method of claim 1, comprising:

detecting a working surface definition gesture; and

determining an orientation of the working surface based at least in part on a portion of the first set of acceleration measurements corresponding to the working surface definition gesture.

7. The method of claim 6, comprising estimating an orientation of a gravity vector based on a portion of the first set of acceleration measurements corresponding to a time period at the beginning of the working surface definition gesture.

8. The method of claim 6, comprising:

receiving a second set of acceleration measurements from a second accelerometer that is attached to a wrist of the user; and

wherein detecting the working surface definition gesture comprises detecting, based at least in part on the first set of acceleration measurements and the second set of acceleration measurements, when the thumb of the user is placed in contact with the medial segment of an index finger of the user.

9. The method of claim 1, comprising:

receiving a second set of acceleration measurements from a second accelerometer that is attached to a wrist of the user; and

wherein detecting the first event comprises detecting, based at least in part on the first set of acceleration measurements and the second set of acceleration measurements, when the thumb of the user is placed in contact with the medial segment of an index finger of the user.

10. The method of claim 9, comprising detecting a termination of the first event by detecting, based at least in part on the first set of acceleration measurements and the second set of acceleration measurements, when the thumb of the user is place in an orientation approximately orthogonal to the length of a forearm of the user.

11. The method of claim 1, comprising:

receiving a second set of acceleration measurements from a second accelerometer that is attached to a wrist of the user;

receiving a first set of magnetic flux measurements from a first magnetometer that is attached to the thumb of the user;

receiving a second set of magnetic flux measurements from a second magnetometer that is attached to the wrist of the user; and

wherein detecting the first event comprises detecting, based at least in part on the first set of acceleration measurements and the second set of acceleration measurements and the first set of magnetic flux measurements and the second set of magnetic flux measurements, when the thumb of the user is placed in an orientation indicating engagement of the working surface.

12. The method of claim 1, in which detecting the first event comprises:

tracking the position of the first accelerometer; and

detecting when a distance between the first accelerometer and the working surface is below a threshold.

13. The method of claim 1, comprising:

detecting, based at least in part on the first set of acceleration measurements, a tap of the thumb of the user against a tap target on a finger of the user; and

configuring, based in part on the tap detected, a virtual writing utensil for editing an image based on the tracked motion of the first accelerometer during the first event.

14. The method of claim 1, in which determining the image data comprises:

receiving a first set of angular rate measurements from a first gyroscope that is attached to the thumb of the user; and

compensating, based at least in part on the first set of angular rate measurements, for variations in the orientation of the first accelerometer with respect to the orientation of the working surface.

15. The method of claim 1, comprising:

receiving a second set of acceleration measurements from a second accelerometer that is attached to a wrist of the user;

detecting, based at least in part on the second set of acceleration measurements, a sequence of taps against a sensor module housing the second accelerometer; and

initiating a hand-writing mode upon detection of the sequence of taps against the sensor module.

16. The method of claim 15, in which initiating hand-writing mode comprises prompting the user to perform a working surface definition gesture.

17. The method of claim 1, in which the image data is encoded as text.

18. A system comprising:

a data processing apparatus;

a data storage device storing instructions executable by the data processing apparatus that upon execution by the data processing apparatus cause the data processing apparatus to perform operations comprising;

receiving a first set of acceleration measurements from a first accelerometer that is attached to a thumb of a user;

detecting, based at least in part on the first set of acceleration measurements, a first event corresponding to engagement of a working surface;

during the first event, tracking motion of the first accelerometer, based at least in part on the first set of acceleration measurements;

determining, based at least in part on the tracked motion of the first accelerometer during the first event, image data; and

transmitting, storing, or displaying the image data.

19. The method of claim 18, in which the working surface corresponds to a physical surface.

20. The system of claim 18, in which the operations comprise:

determining an orientation of the working surface.

21. The system of claim 20, in which determining the orientation of the working surface comprises:

determining a path through three dimensional space traversed by the first accelerometer during a working surface definition gesture; and

fitting a plane to the path.

22. The system of claim 20, in which the operations comprise:

determining a three dimensional position of at least one point on the working surface.

23. The system of claim 18, in which the operations comprise:

detecting a working surface definition gesture; and

determining an orientation of the working surface based at least in part on a portion of the first set of acceleration measurements corresponding to the working surface definition gesture.

24. The system of claim 23, in which the operations comprise:

estimating an orientation of a gravity vector based on a portion of the first set of acceleration measurements corresponding to a time period at the beginning of the working surface definition gesture.

25. The system of claim 23, in which the operations comprise:

receiving a second set of acceleration measurements from a second accelerometer that is attached to a wrist of the user; and

wherein detecting the working surface definition gesture comprises detecting, based at least in part on the first set of acceleration measurements and the second set of acceleration measurements, when the thumb of the user is placed in contact with the medial segment of an index finger of the user.

26. The system of claim 18, in which the operations comprise:

receiving a second set of acceleration measurements from a second accelerometer that is attached to a wrist of the user; and

wherein detecting the first event comprises detecting, based at least in part on the first set of acceleration measurements and the second set of acceleration measurements, when the thumb of the user is placed in contact with the medial segment of an index finger of the user.

27. The system of claim 26, in which the operations comprise:

detecting a termination of the first event by detecting, based at least in part on the first set of acceleration measurements and the second set of acceleration measurements, when the thumb of the user is place in an orientation approximately orthogonal to the length of a forearm of the user.

28. The system of claim 18, in which the operations comprise:

receiving a second set of acceleration measurements from a second accelerometer that is attached to a wrist of the user;

receiving a first set of magnetic flux measurements from a first magnetometer that is attached to the thumb of the user;

receiving a second set of magnetic flux measurements from a second magnetometer that is attached to the wrist of the user; and

wherein detecting the first event comprises detecting, based at least in part on the first set of acceleration measurements and the second set of acceleration measurements and the first set of magnetic flux measurements and the second set of magnetic flux measurements, when the thumb of the user is placed in an orientation indicating engagement of the working surface.

29. The system of claim 18, in which detecting the first event comprises:

tracking the position of the first accelerometer; and

detecting when a distance between the first accelerometer and the working surface is below a threshold.

30. The system of claim 18, in which the operations comprise:

detecting, based at least in part on the first set of acceleration measurements, a tap of the thumb of the user against a tap target on a finger of the user; and

configuring, based in part on the tap detected, a virtual writing utensil for editing an image based on the tracked motion of the first accelerometer during the first event.

31. The system of claim 18, in which determining the image data comprises:

receiving a first set of angular rate measurements from a first gyroscope that is attached to the thumb of the user; and

compensating, based at least in part on the first set of angular rate measurements, for variations in the orientation of the first accelerometer with respect to the orientation of the working surface.

32. The system of claim 18, in which the operations comprise:

receiving a second set of acceleration measurements from a second accelerometer that is attached to a wrist of the user;

detecting, based at least in part on the second set of acceleration measurements, a sequence of taps against a sensor module housing the second accelerometer; and

initiating a hand-writing mode upon detection of the sequence of taps against the sensor module.

33. The system of claim 32, in which initiating hand-writing mode comprises prompting the user to perform a working surface definition gesture.

34. The system of claim 18, in which the image data is encoded as text.