Methods and apparatus for processing combinations of kinematical inputs

• US 8,159,455 B2
• Filed: 07/18/2008
• Issued: 04/17/2012
• Est. Priority Date: 07/18/2008
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Leung, Omar S.
• Primary Examiner(s): Wang, Quan-Zhen
• Assistant Examiner(s): Eurice, Michael J
• Application Number:
  US12/176,148
• Publication Number:
  US 20100013768A1
• Time in Patent Office: 1,369 Days
• Field of Search: 345156-169, 345/172, 345/173, 463 1- 47, 715/863, 382/296
• US Class Current: 345/156
• CPC Class Codes: G01C 9/00 Measuring inclination, e.g. by clinometers, by levels
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/03543 Mice or pucks G06F3/03541 takes precedence

Abstract

Methods and apparatus for processing combinations of force and velocity data generated over a given period of time. In one embodiment, an input device comprising one or more force sensors and one or more motion sensors is manipulated relative to a surface. A receiving system is adapted to receive input sequences or “gestures” which are triggered upon the occurrence of one or more conditions detected by the input device. An application executing in the receiving system may be implemented such that the system responds differently to each specific gesture provided by the user.

Claims

1. An input system comprising:

one or more sensors operable to output one or more physical parameters of an input device reflective of at least one of, a force applied to the input device by a user, a speed of motion of the input device, a direction of motion of the input device, and an acceleration of the input device;

one or more processors;

one or more computer readable memories comprising instructions that, when executed by the one or more processors, perform operations comprising,

determining, based on an output of at least one sensor, an angle of tilt of the input device about a tilt axis;

determining if the angle of tilt of the input device is within a predetermined range;

if the angle of tilt is within the predetermined range, operating the input system in a gesture mode in which the output of the sensors is monitored to determine if a gesture of at least one predetermined gesture has been performed; and

if the angle of tilt is not within the predetermined range, outputting a signal to move a cursor displayed on a graphical user interface based on a velocity of movement of the input device along a surface, the velocity determined based on the output of the at least one sensor.

2. The input system of claim 1, wherein the input system comprises a mouse.

3. The input system of claim 2, wherein the one or more sensors, one or more processors and one or more computer readable memories are contained within a single housing of the mouse.

4. The input system of claim 1, wherein at least one of the computer readable memories further stores one or more profiles, each profile corresponding to a respective predetermined gesture;

and

wherein the operations further comprise determining if the predetermined gesture has been performed based on the output of the sensors and the profile corresponding to the gesture.

5. The input system of claim 4, wherein the profiles comprise a profile corresponding to a tilt and drag gesture.

6. The input system of claim 4, wherein the profiles comprise a profile corresponding to a tilt and tap gesture.

7. An input system comprising:

one or more sensors operable to output one or more physical parameters of an input device reflective of at least one of, a force applied to the input device by a user, a speed of motion of the input device, a direction of motion of the input device, and an acceleration of the input device;

one or more processors; and

one or more computer readable memories comprising instructions that, when executed by the one or more processors, perform operations comprising,

determining, based on an output of the one or more sensors, if a gesture of a plurality of predetermined gestures has been performed, each predetermined gesture comprising a ordered set of conditions on one or more physical parameters of the input device;

if the gesture has been performed, outputting a signal corresponding to the performed gesture; and

if a gesture has not been performed, outputting a signal to move a cursor displayed on a graphical user interface based on a velocity of movement of the input device along a surface, the velocity determined based on the output of the one or more sensors.

8. The input system of claim 7, wherein the input system comprises a mouse.

9. The input system of claim 8 wherein the one or more sensors, one or more processors and one or more computer readable memories are contained within a single housing of the mouse.

10. The input system of claim 7, wherein the one or more computer readable memories further stores one or more profiles, each profile corresponding to a respective one of the predetermined gestures;

and

wherein the operations further comprise determining if the gesture of the at least one predetermined gesture has been performed based on the output of the sensors and the profile corresponding to the gesture.

11. The input system of claim 10, wherein the profiles comprise a profile corresponding to a brush gesture.

12. The input system of claim 10, wherein the profiles comprise a profile corresponding to a scoop gesture.

13. The input system of claim 10, wherein the profiles comprise a profile corresponding to a nudge gesture.

14. A method for operating an input device of a computing system comprising:

in a first mode,

outputting a signal to move a cursor displayed on a graphical user interface based on a velocity of movement of the input device along a surface,

monitoring one or more parameters of the input device to detect a satisfaction of a first condition of a set of ordered conditions for a predefined gesture, and

upon detecting the satisfaction of the first condition, changing to a second mode;

in the second mode,

monitoring one or more parameters of the input device to detect satisfaction of a second condition of the set of ordered conditions for a predefined gesture, and

upon detecting the satisfaction of the second condition while in the second mode, executing the predefined gesture; and

wherein either the first condition is based at least in part on a force applied to the input device and the second condition is based at least in part on a velocity of motion of the device or the first condition is based at least in part on a velocity of motion of the device and the second condition is based at least in part on a force applied to the input device.

15. The method of claim 14, wherein:

the first condition is satisfied if the velocity of motion of the input device exceeds a designated value; and

the second condition is satisfied if the force applied to the input device decreases to a first magnitude.

16. The method of claim 15, wherein the first magnitude comprises 0 newtons.

17. The method of claim 14, wherein:

the first condition is satisfied if the velocity of motion of the input device exceeds a designated value while the force applied to the input device comprises 0 newtons; and

the second condition is satisfied if the force applied to the input device increases to a first magnitude.

18. The method of claim 14, wherein:

the first condition is satisfied if the velocity of motion of the input device comprises a magnitude of zero meters per second; and

the second condition is satisfied if the force applied to the input device comprises a vector angle within a designated range.

19. The method of claim 14, wherein the second mode further comprises the operations of:

monitoring one or more parameters of the input device to detect satisfaction of a third condition of the set of ordered conditions for a predefined gesture; and

upon detecting the satisfaction of the third condition while in the second mode, changing to the first mode.

20. A method for operating an input device of a computing system comprising:

in a first mode,

outputting a signal to move a cursor displayed on a graphical user interface based on a velocity of movement of the input device along a surface,

monitoring one or more parameters of the input device to detect a satisfaction of a first condition of a set of ordered conditions for a predefined gesture, and

upon detecting the satisfaction of the first condition, changing to a second mode;

in the second mode,

monitoring one or more parameters of the input device to detect satisfaction of a second condition of the set of ordered conditions for a predefined gesture, and

upon detecting the satisfaction of the second condition while in the second mode, executing the predefined gesture; and

wherein the first condition is based at least in part on an angle of tilt of the input device about a tilt axis and the second condition is based at least in part on at least one of a velocity of motion of the device and a force applied to the input device.

21. The method of claim 20, wherein the angle of tilt of the input device about a tilt axis is determined based at least in part on data from an inclination sensor.

22. The method of claim 20, wherein the angle of tilt of the input device about a tilt axis is determined by determining if a first acceleration quantity has increased to a first magnitude while a second acceleration quantity has decreased to a second magnitude.

23. The method of claim 20, wherein:

the first condition is satisfied if the angle of tilt comprises an angle within a predetermined range; and

the second condition is satisfied if the force comprises a direction that is parallel with the tilt axis.

24. The method of claim 20, wherein:

the first condition is satisfied if the angle of tilt comprises an angle within a predetermined range; and

the second condition is satisfied if the force comprises a direction that is perpendicular the tilt axis.

25. The method of claim 20, wherein:

the first condition is satisfied if the angle of tilt comprises an angle within a predetermined range; and

the second condition is satisfied if the force decreases to a second magnitude after increasing to a first magnitude.

26. The method of claim 20, wherein:

the first condition is satisfied if the angle of tilt comprises an angle within a predetermined range; and

the second condition is satisfied if, while a change in acceleration is detected, the force decreases to a second magnitude after increasing to a first magnitude.

27. The method of claim 20, wherein the second mode further comprises the operations of:

monitoring one or more parameters of the input device to detect satisfaction of a third condition of the set of ordered conditions for a predefined gesture; and

upon detecting the satisfaction of the third condition while in the second mode, changing to the first mode.

28. At least one computer readable memory comprising instructions which, when executed by at least one processor, perform operations comprising:

in a first mode,

outputting a signal to move a cursor displayed on a graphical user interface based on a velocity of movement of an input device along a surface,

monitoring one or more parameters of the input device to detect a satisfaction of a first condition of a set of ordered conditions for a predefined gesture, and

upon detecting the satisfaction of the first condition, changing to a second mode;

in the second mode,

monitoring one or more parameters of the input device to detect satisfaction of a second condition of the set of ordered conditions for a predefined gesture, and

upon detecting the satisfaction of the second condition while in the second mode, executing the predefined gesture; and

wherein either the first condition is based at least in part on a force applied to the input device and the second condition is based at least in part on a velocity of motion of the device or the first condition is based at least in part on a velocity of motion of the device and the second condition is based at least in part on a force applied to the input device.

29. The at least one computer readable memory of claim 28, wherein:

the first condition is satisfied if the velocity of motion of the input device exceeds a designated value; and

the second condition is satisfied if the force applied to the input device decreases to a first magnitude.

30. The at least one computer readable memory of claim 28, wherein:

the first condition is satisfied if the velocity of motion of the input device exceeds a designated value while the force applied to the input device comprises 0 newtons; and

the second condition is satisfied if the force applied to the input device increases to a first magnitude.

31. The at least one computer readable memory of claim 28, wherein:

the first condition is satisfied if the velocity of motion of the input device comprises a magnitude of zero meters per second; and

the second condition is satisfied if the force applied to the input device comprises a vector angle within a designated range.

32. The at least one computer readable memory of claim 31, wherein the designated range comprises a range of between 10°

and 20°

when measured from a vertical axis.

33. The at least one computer readable memory of claim 28, wherein the second mode further comprises the operations of:

monitoring one or more parameters of the input device to detect satisfaction of a third condition of the set of ordered conditions for a predefined gesture; and

upon detecting the satisfaction of the third condition while in the second mode, changing to the first mode.

34. At least one computer readable memory comprising instructions which, when executed by at least one processor, perform operations comprising:

in a first mode,

outputting a signal to move a cursor displayed on a graphical user interface based on a velocity of movement of an input device along a surface,

monitoring one or more parameters of the input device to detect a satisfaction of a first condition of a set of ordered conditions for a predefined gesture, and

upon detecting the satisfaction of the first condition, changing to a second mode;

in the second mode,

monitoring one or more parameters of the input device to detect satisfaction of a second condition of the set of ordered conditions for a predefined gesture, and

upon detecting the satisfaction of the second condition while in the second mode, executing the predefined gesture; and

wherein the first condition is based at least in part on an angle of tilt of the input device about a tilt axis and the second condition is based at least in part on at least one of a velocity of motion of the device and a force applied to the input device.

35. The at least one computer readable memory of claim 34, wherein the angle of tilt of the input device about a tilt axis is determined based at least in part on data from an inclination sensor.

36. The at least one computer readable memory of claim 34, wherein the angle of tilt of the input device about a tilt axis is determined by determining if a first acceleration quantity has increased to a first magnitude while a second acceleration quantity has decreased to a second magnitude.

37. The at least one computer readable memory of claim 34, wherein:

the first condition is satisfied if the angle of tilt comprises an angle within a predetermined range; and

the second condition is satisfied if the force comprises a direction that is parallel with the tilt axis.

38. The at least one computer readable memory of claim 34, wherein:

the first condition is satisfied if the angle of tilt comprises an angle within a predetermined range; and

the second condition is satisfied if the force comprises a direction that is perpendicular the tilt axis.

39. The at least one computer readable memory of claim 34, wherein:

the first condition is satisfied if the angle of tilt comprises an angle within a predetermined range; and

the second condition is satisfied if the force decreases to a second magnitude after increasing to a first magnitude.

40. The at least one computer readable memory of claim 34, wherein:

the first condition is satisfied if the angle of tilt comprises an angle within a predetermined range; and

the first condition is satisfied if, while a change in acceleration is detected, the force decreases to a second magnitude after increasing to a first magnitude.

41. The at least one computer readable memory of claim 34, wherein the second mode further comprises the operations of:

monitoring one or more parameters of the input device to detect satisfaction of a third condition of the set of ordered conditions for a predefined gesture; and

upon detecting the satisfaction of the third condition while in the second mode, changing to the first mode.