MULTI-TOUCH GESTURE DICTIONARY

• US 20070177803A1
• Filed: 01/03/2007
• Published: 08/02/2007
• Est. Priority Date: 01/30/2006
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Computer Incorporated (Apple Inc.)
• Inventors: Haggerty, Myra Mary, Westerman, Wayne Carl, ELIAS, JOHN GREER
• Granted Patent: US 7,840,912 B2
• Time in Patent Office: Days
• US Class Current: 382/188
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04895 Guidance during keyboard input operation, e.g. prompting
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

A multi-touch gesture dictionary is disclosed herein. The gesture dictionary can include a plurality of entries, each corresponding to a particular chord. The dictionary entries can include a variety of motions associated with the chord and the meanings of gestures formed from the chord and the motions. The gesture dictionary may take the form of a dedicated computer application that may be used to look up the meaning of gestures. The gesture dictionary may also take the form of a computer application that may be easily accessed from other applications. The gesture dictionary may also be used to assign user-selected meanings to gestures. Also disclosed herein are computer systems incorporating multi-touch gesture dictionaries. The computer systems can include, desktop computers, tablet computers, notebook computers, handheld computers, personal digital assistants, media players, mobile telephones, and the like.

Claims

1. A method of providing to a user a dictionary of multi-touch gestures, each of the gestures comprising a chord and a motion associated with the chord, the method comprising:

identifying a chord presented to the multi-touch interface by the user; and

displaying a dictionary entry for the identified chord, the dictionary entry comprising a visual depiction of one or more motions associated with the identified chord and, for each of the one or more motions associated with the identified chord, a meaning of a gesture comprising the identified chord and the motion.

2. The method of claim 1 further comprising:

identifying a subsequent chord presented to the multi-touch interface by the user; and

displaying a dictionary entry for the identified subsequent chord, the dictionary entry comprising a visual depiction of one or more motions associated with the identified chord and, for each of the one or more motions associated with the identified chord, a meaning of a gesture comprising the identified chord and the motion.

3. The method of claim 1 or 2 wherein the dictionary entry comprises one or more motion icons, each motion icon including a graphical depiction of a motion and a textual description of a corresponding meaning.

4. The method of claim 3 wherein the motion icons are arranged consistently for a plurality of dictionary entries corresponding to a plurality of chords.

5. The method of claim 1 or 2 wherein the dictionary entry comprises an animation of the one or more motions.

6. The method of claim 1 or 2 further comprising:

identifying a motion of the identified chord performed by the user; and

providing feedback to the user indicating a gesture formed by the identified chord and the identified motion.

7. The method of claim 6 wherein the feedback includes visual feedback.

8. The method of claim 7 wherein the visual feedback includes highlighting a motion icon associated with the gesture formed by the identified chord and the identified motion.

9. The method of claim 6 wherein the feedback includes audible feedback.

10. The method of claim 9 wherein the audible feedback includes speaking a meaning of the gesture formed by the identified chord and the identified motion.

11. The method of claim 1 or 2 wherein the chord comprises a predetermined arrangement of hand parts in a predetermined configuration and further comprises one or more modifier keys.

12. A method of providing to a user a dictionary of multi-touch gestures, each of the gestures comprising a chord and a motion associated with the chord, wherein a chord comprises a predetermined number of hand parts in a predetermined configuration, the method comprising:

identifying a chord presented to the multi-touch interface by the user, wherein the chord is presented during use of a non-dictionary application;

detecting an absence of motion associated with the identified chord for a predetermined period of time; and

displaying a dictionary entry for the identified chord, the dictionary entry comprising a visual depiction of one or more motions associated with the identified chord and, for each of the one or more motions associated with the identified chord, a meaning of a gesture comprising the identified chord and the motion.

13. The method of claim 12 further comprising:

identifying a subsequent chord presented to the multi-touch interface by the user; and

displaying a dictionary entry for the identified subsequent chord, the dictionary entry comprising a visual depiction of one or more motions associated with the identified subsequent chord and, for each of the one or more motions associated with the identified subsequent chord, a meaning of a gesture comprising the identified subsequent chord and the motion.

14. The method of claim 12 or 13 further comprising:

identifying a motion of the identified chord performed by the user; and

executing the meaning of the gesture formed by the identified chord and the identified motion.

15. The method of claim 14 further comprising:

providing feedback to the user indicating a gesture formed by the identified chord and the identified motion.

16. The method of claim 15 wherein the feedback includes visual feedback.

17. The method of claim 16 wherein the visual feedback includes highlighting a motion icon associated with the gesture formed by the identified chord and the identified motion.

18. The method of claim 15 wherein the feedback includes audible feedback.

19. The method of claim 17 wherein the audible feedback includes speaking a meaning of the gesture formed by the identified chord and the identified motion.

20. The method of claim 12 or 13 wherein the dictionary entry comprises one or more motion icons, each motion icon including a graphical depiction of a motion and a textual description of a corresponding meaning.

21. The method of claim 20 wherein the motion icons are arranged consistently for a plurality of dictionary entries corresponding to a plurality of chords.

22. The method of claim 12 or 13 wherein the dictionary entry comprises an animation of the one or more motions.

23. The method of claim 12 wherein the chord further comprises one or more modifier keys.

24. A method for permitting a user to define meanings of one or more multi-touch gestures, each of the gestures comprising a chord and a motion associated with the chord, wherein a chord comprises a predetermined number of hand parts in a predetermined configuration, the method comprising:

displaying a dictionary entry for a chord, the dictionary entry comprising a visual depiction of one or more motions associated with the chord; and

accepting at least one input from the user to assign a meaning to a gesture comprising the chord and a selected motion.

25. The method of claim 24 wherein displaying a dictionary entry for a chord comprises displaying motions that may be easily performed for the chord in a manner different from motions that may be less easily performed.

26. The method of claim 25 wherein motions that may be less easily performed are not displayed.

27. The method of claim 24 or 25 wherein the dictionary entry comprises one or more motion icons, each motion icon including a graphical depiction of a motion and a textual description of a corresponding meaning.

28. The method of claim 27 wherein the motion icons are arranged consistently for a plurality of dictionary entries corresponding to a plurality of chords.

29. The method of claim 24 or 25 wherein the dictionary entry comprises an animation of the one or more motions.

30. The method of claim 24 or 25 wherein accepting inputs from the user to assign a meaning to a gesture comprising the chord and a selected motion assigns the meaning to an unused gesture.

31. The method of claim 24 or 25 wherein accepting inputs from the user to assign a meaning to a gesture comprising the chord and a selected motion changes a default meaning of a gesture.

32. The method of claim 24 or 25 further comprising accepting inputs from the user to define a gesture comprising a string of one or more gestures.

33. The method of claim 24 wherein the chord further comprises one or more modifier keys.

34. A computer system having a multi-touch interface and a graphical user interface, wherein the computer system includes a computer memory encoded with executable instructions causing the computer system to:

identify a chord comprising a predetermined number of hand parts in a predetermined configuration presented to the multi-touch interface by a user; and

display a dictionary entry for the identified chord, the dictionary entry comprising a visual depiction of one or more motions associated with the identified chord and, for each of the one or more motions associated with the identified chord, a meaning of a gesture comprising the identified chord and the motion;

thereby providing to the user a dictionary of multi-touch gestures.

35. The computer system of claim 34 wherein the computer system is selected from the group consisting of a desktop computer, a tablet computer, and a notebook computer.

36. The computer system of claim 34 wherein the computer system comprises at least one of a handheld computer, a personal digital assistant, a media player, and a mobile telephone.

37. The computer system of claim 34, 35, or 36 wherein the dictionary entry comprises one or more motion icons, each motion icon including a graphical depiction of a motion and a textual description of a corresponding meaning.

38. The computer system of claim 37 wherein the motion icons are arranged consistently for a plurality of dictionary entries corresponding to a plurality of chords.

39. The computer system of claim 34, 35, or 36 wherein the dictionary entry comprises an animation of the one or more motions.

40. The computer system of claim 34, 35, or 36 wherein the executable instructions further cause the computer to:

identify a motion of the identified chord performed by the user; and

provide feedback to the user indicating a gesture formed by the identified chord and the identified motion.

41. The computer system of claim 40 wherein the feedback includes visual feedback.

42. The computer system of claim 41 wherein the visual feedback includes a highlighted motion icon associated with the gesture formed by the identified chord and the identified motion.

43. The computer system of claim 40 wherein the feedback includes audible feedback.

44. The computer system of claim 43 wherein the audible feedback includes a spoken meaning of the gesture formed by the identified chord and the identified motion.

45. The computer system of claim 34 wherein the chord further comprises one or more modifier keys.

46. A computer system having a multi-touch interface and a graphical user interface, wherein the computer system includes a computer memory encoded with executable instructions causing the computer system to:

identify a chord comprising a predetermined number of hand parts in a predetermined configuration presented to the multi-touch interface by a user, wherein the chord is presented during use of a non-dictionary application;

detect an absence of motion associated with the identified chord for a predetermined period of time; and

display a dictionary entry for the identified chord, the dictionary entry comprising a visual depiction of one or more motions associated with the identified chord and, for each of the one or more motions associated with the identified chord, a meaning of a gesture comprising the identified chord and the motion;

thereby providing to the user a dictionary of multi-touch gestures.

47. The computer system of claim 46 wherein the computer system is selected from the group of a desktop computer, a tablet computer, and a notebook computer.

48. The computer system of claim 46 wherein the computer system comprises at least one of a handheld computer, a personal digital assistant, a media player, and a mobile telephone.

49. The computer system of claim 46, 47, or 48 wherein the dictionary entry comprises one or more motion icons, each motion icon including a graphical depiction of a motion and a textual description of a corresponding meaning.

50. The computer system of claim 49 wherein the motion icons are arranged consistently for a plurality of dictionary entries corresponding to a plurality of chords.

51. The computer system of claim 46, 47, or 48 wherein the dictionary entry comprises an animation of the one or more motions.

52. The computer system of claim 46, 47, or 48 wherein the executable instructions further cause the computer to:

identify a motion of the identified chord performed by the user; and

execute the meaning of the gesture formed by the identified chord and the identified motion.

53. The computer system of claim 52 wherein the executable instructions further cause the computer to provide feedback to the user indicating a gesture formed by the identified chord and the identified motion.

54. The computer system of claim 53 wherein the feedback includes visual feedback.

55. The computer system of claim 54 wherein the visual feedback includes a highlighted motion icon associated with the gesture formed by the identified chord and the identified motion.

56. The computer system of claim 53 wherein the feedback includes audible feedback.

57. The computer system of claim 56 wherein the audible feedback includes a spoken meaning of the gesture formed by the identified chord and the identified motion.

58. The computer system of claim 46 wherein the chord further comprises one or more modifier keys.

59. A computer system having a multi-touch interface and a graphical user interface, wherein the computer system includes a computer memory encoded with executable instructions causing the computer system to:

display a dictionary entry for a chord comprising a predetermined number of hand parts in a predetermined configuration, the dictionary entry comprising a visual depiction of one or more motions associated with the chord; and

accept at least one input from the user to assign a meaning to a gesture comprising the chord and a selected motion.

60. The computer system of claim 59 wherein the computer system is selected from the group consisting of a desktop computer, a tablet computer, and a notebook computer.

61. The computer system of claim 59 wherein the computer system comprises at least one of a handheld computer, a personal digital assistant, a media player, and a mobile telephone.

62. The computer system of claim 59, 60, or 61 wherein the dictionary entry comprises one or more motion icons, each motion icon including a graphical depiction of a motion and a textual description of a corresponding meaning.

63. The computer system of claim 62 wherein the motion icons are arranged consistently for a plurality of dictionary entries corresponding to a plurality of chords.

64. The computer system of claim 59, 60, or 61 wherein the dictionary entry comprises an animation of the one or more motions.

65. The computer system of claim 59 wherein the chord further comprises one or more modifier keys.

66. A mobile telephone having a multi-touch interface and a graphical user interface, wherein the mobile telephone includes a memory encoded with executable instructions causing the mobile telephone to:

identify a chord comprising a predetermined number of hand parts in a predetermined configuration presented to the multi-touch interface by a user; and

display a dictionary entry for the identified chord, the dictionary entry comprising a visual depiction of one or more motions associated with the identified chord and, for each of the one or more motions associated with the identified chord, a meaning of a gesture comprising the identified chord and the motion;

thereby providing to the user a dictionary of multi-touch gestures.

67. The mobile telephone of claim 66 wherein the dictionary entry comprises one or more motion icons, each motion icon including a graphical depiction of a motion and a textual description of a corresponding meaning.

68. The mobile telephone of claim 66 wherein the dictionary entry comprises an animation of the one or more motions.

69. The mobile telephone of claim 66 wherein the executable instructions further cause the computer to:

identify a motion of the identified chord performed by the user; and

provide feedback to the user indicating a gesture formed by the identified chord and the identified motion.

70. The mobile telephone of claim 69 wherein the feedback includes visual feedback comprising a highlighted motion icon associated with the gesture formed by the identified chord and the identified motion.

71. The mobile telephone of claim 69 wherein the feedback includes audible feedback comprising a spoken meaning of the gesture formed by the identified chord and the identified motion.

72. The computer system of claim 66 wherein the chord further comprises one or more modifier keys.