Contextual gesture interface

• US 6,340,979 B1
• Filed: 08/16/1999
• Issued: 01/22/2002
• Est. Priority Date: 12/04/1997
• Status: Expired due to Term

• Current Assignee: Blackberry Limited
• Original Assignee: Nortel Networks Limited (Nortel Networks Corporation)
• Inventors: Blouin, Francois, Comeau, Guillaume, Craddock, Arthur Julian Patterson, Beaton, Brian Finlay, Smith, Colin Donald
• Primary Examiner(s): Bayerl, Raymond J.
• Assistant Examiner(s): Nguyen, Thomas T.
• Application Number:
  US09/374,262
• Time in Patent Office: 890 Days
• Field of Search: 345/352, 345/353, 345/354, 345/355, 345/326, 345/356, 345/357, 345/173, 345/174, 345/179, 345/358, 178/18.01, 178/18.02, 178/18.04
• US Class Current: 715/764
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H04M 1/72445 for supporting Internet browser applications
• CPC Class Codes: H04M 1/72469 for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
• CPC Class Codes: H04M 2250/22 including a touch pad, a touch sensor or a touch detector digitizers for touch screens G06F3/041

Abstract

The system and method consistent with the present invention provides a contextual gesture interface for electronic devices. The contextual gesture interface activates a function corresponding to the characteristics of an object making contact with a display. The system may determine the time period of the contact as well as the size of the contact. The functions may include a wide array of navigation tools or editing tools. The contextual gesture interface of the present invention may be especially useful in portable electronic devices with small displays.

Claims

1. A method of providing a contextual user interface comprising the steps of:

ascertaining a current user application out of a plurality of applications;

detecting an object making contact with a physical viewing area;

determining which type of object, of a plurality of types of objects, has made contact with the physical viewing area by performing the substeps of;

determining a characteristic of the contact;

determining a rate of change in the amount of pressure imposed by the object on the physical viewing area; and

computing a point size of the contact based on the rate of change in the amount of pressure, thereby determining which type of object of the plurality of types of objects has made contact with the physical viewing area,

and

activating a function corresponding to the contact characteristic, the type of object making contact, and the current user application.

2. The method of claim 1, wherein determining a characteristic of the contact includes:

determining a time period of contact.

3. The method of claim 1, wherein determining a characteristic of the contact includes:

determining the contact characteristic as a prolonged finger-sized object, and

wherein the activating step includes the substep of

activating a navigation tool.

4. The method of claim 1, wherein determining a characteristic of the contact includes:

determining the contact characteristic as a prolonged stylus-sized object, and

wherein the activating step includes the substep of

activating a drawing tool.

5. The method of claim 1, wherein the determining a characteristics of the contact step includes the substep of

determining the direction of movement of the contact.

6. The method of claim 1, wherein the determining a characteristics of the contact step includes the substep of

determining the speed of movement of the contact.

7. The method of claim 1, wherein when the current user application is a navigation application, the determining a characteristic of the contact step includes the substep of determining the contact characteristic as a quick drag, and

the activating step includes the substep of

activating a next page function.

8. The method of claim 7, wherein when the current user application is an editing application, the determining a characteristic of the contact step includes the substep of

determining the contact characteristic as a quick drag, and the activating step includes the substep of

highlighting a section of a document underlying the user input.

9. The method of claim 8, wherein when the current user application is a graphics application, the determining a characteristic of the contact step includes the substep of

determining the contact characteristic as a quick drag, and the activating step includes the substep of

drawing a line in a section of a document underlying the user input.

10. The method of claim 9, wherein when the current user application is a network browser application, the determining a characteristic of the contact step includes the substep of

determining the contact characteristic as a lingering touch, and the activating step includes the substeps of

enabling a graphical tool, and

disabling functions of underlying document.

11. The method of claim 1, wherein the detecting step includes the substeps of

measuring an analog voltage signal from the physical viewing area, and

converting the analog voltage signal to a digital value.

12. The method of claim 11, further including the step of

transmitting the digital value to a processor.

13. The method of claim 12, further including the step of

analyzing the digital value by the processor.

14. The method of claim 1, wherein the determining step includes the substeps of:

determining the amount of pressure imposed on the physical viewing area by the object;

determining a time period of contact; and

computing a point size of the contact based on the amount of pressure imposed on the physical viewing area as a function of the time.

15. The method of claim 1, wherein the computing a point size step includes determining points of contact of the object by using points of contact data, wherein the points of contact data is generated by a controller that generates at least 150 points of contact per second based on the contact made by the object on the physical viewing area.

16. The method of claim 1, wherein determining a rate of change in the amount of pressure imposed by the object on the physical viewing area includes:

determining whether the pressure imposed by the object on the physical viewing area changes gradually or sharply over a predetermined range of time.

17. An apparatus for providing a contextual user interface comprising:

means for ascertaining a current user application out of a plurality of applications;

means for detecting an object making contact with a physical viewing area;

means for determining which type of object, of a plurality of types of objects, has made contact with the physical viewing area, wherein the means for determining includes;

means for determining a characteristic of the contact;

means for determining a rate of change in the amount of pressure imposed by the object on the physical viewing area; and

means for computing a point size of the contact based on the rate of change in the amount of pressure, thereby determining which type of object of the plurality of types of objects has made contact with the physical viewing area,

and

means for activating a function corresponding to the contact characteristic, the type of object making contact, and the current user application.

18. The apparatus of claim 17, wherein the means for determining a characteristic of the contact includes:

means for determining the time period of the contact.

19. The apparatus of claim 17, wherein the means for determining a characteristic of the contact includes:

means for determining the contact characteristic as a prolonged finger-sized object, and

wherein the activating means includes;

means for activating a navigation tool.

20. The apparatus of claim 17, wherein the means for determining a characteristic of the contact includes:

means for determining the contact characteristic as a prolonged stylus-sized object, and

wherein the activating means includes;

means for activating a drawing tool.

21. The apparatus of claim 17, wherein the means for determining a characteristic of the contact includes:

means for determining the direction of movement of the contact.

22. The apparatus of claim 17, wherein the means for determining a characteristic of the contact includes:

means for determining the speed of movement of the contact.

23. The apparatus of claim 17, wherein when the current user application is a navigation application, the means for determining a characteristic of the contact includes:

means for determining the contact characteristic as a quick drag, and

the activating means includes;

means for activating a next page function.

24. The apparatus of claim 23, wherein when the current user application is an editing application, the means for determining a characteristic of the contact includes:

means for determining the contact characteristic as a quick drag, and

the activating means includes;

means for highlighting a section of a document underlying the user input.

25. The apparatus of claim 24, wherein when the current user application is a graphics application, the means for determining a characterstic of the contract includes:

means for determining the contact characteristic as a quick drag, and the activating means includes;

means for drawing a line in a section of a document underlying the user input.

26. The apparatus of claim 25, wherein when the current user application is a network browser application, the means for determining a characteristic of the contact includes:

means for determining the contact characteristic as a lingering touch, and the activating means includes;

means for enabling a graphical tool, and

means for disabling functions of underlying document.

27. The apparatus of claim 17, wherein the detecting means includes

means for measuring an analog voltage signal from the physical viewing area, and

means for converting the analog voltage signal to a digital value.

28. The apparatus of claim 27, further including

means for transmitting the digital value to a processor.

29. The apparatus of claim 28, further including

means for analyzing the digital value.

30. The apparatus of claim 17, wherein the means for computing a point size includes means for determining point of contact of the object, wherein the means for determining points of contact of the object includes:

means for using points of contact data, wherein the points of contact data is generated by a controller that generates at least 150 points of contact per second based on the contact made by the object on the physical viewing area.

31. The apparatus of claim 17, wherein the means for determining a rate of change in the amount of pressure includes:

means for determining whether the pressure imposed by the object oil the physical viewing area changes gradually or sharply over a predetermined range of time.

32. A method of providing a contextual user interface comprising the steps of:

detecting an object making contact with a physical viewing area;

determining characteristics of the contact, based on a rate of change in the amount of pressure imposed by the object on the physical viewing area; and

activating a function corresponding to the contact characteristics and current user task,

wherein the determining step includes;

determining points of contact of the object, by using points of contact data, wherein the points of contact data is generated by a controller that generates at least 150 points of contact per second based on the contact made by the object on the physical viewing area.

33. An apparatus for providing a contextual user interface comprising:

means for detecting an object making contact with a physical viewing area;

means for determining characteristics of the contact, based on a rate of change in the amount of pressure imposed by the object on the physical viewing area; and

means for activating a function corresponding to the contact characteristics and current user tasks,

wherein the means for determining includes;

means for determining points of contact of the object, by using points of contact data, wherein the points of contact data is generated by a controller that generates at least 150 points of contact per second based on the contact made by the object on the physical viewing area.

34. A method for providing a touch-responsive user interface including a touch screen device comprising a physical viewing area, the method comprising the steps of:

presenting a first application tool on the physical viewing area;

presenting a second application tool on the physical viewing area, wherein the second application tool is superimposed on top of the first application tool;

detecting an object making contact on the physical viewing area, wherein the contact is located on the second application tool superimposed on top of the first application tool;

determining the pointer size of the object making contact on the physical viewing area; and

activating either the first application tool or the second application tool, based on the determined pointer size of the object.

35. The method of claim 34, wherein the first application tool is a drawing tool, the method further comprising the steps of:

determining that the pointer size correlates to a stylus pointer; and

activating the first application tool based on the determination that the pointer correlates to a stylus pointer.

36. The method of claim 34, wherein the second application is a navigation tool, the method further comprising the steps of:

determining that the pointer size correlates to a finger; and

activating the second application tool based on the determination that the pointer correlates to a finger.

37. The method of claim 34, wherein the step of determining the pointer size of the object further includes the steps of:

determining the amount of pressure imposed by the object on the physical viewing area;

determining the amount of time the object makes contact with the physical viewing area; and

determining the pointer size of the object based on the amount of change in the pressure imposed by the object as a function of a range of time the object makes contact with the physical viewing area.

38. The method of claim 34, wherein the step of determining the pointer size of the object further includes the steps of:

determining points of contact of the object, by using points of contact data, wherein the points of contact data is generated by an analog controller that generates at least 150 points of contact per second based on the contact made by the object on the physical viewing area;

computing a centroid of the points of contact,

computing a standard deviation of the centroid, and

computing the pointer size based on the centroid and the standard deviation.

39. The method of claim 34, wherein the step of determining the pointer size of the object further includes the steps of:

determining points of contact of the object, by using points of contact data, wherein the points of contact data is generated by an analog controller that generates at least 150 points of contact per second based on the contact made by the object on the physical viewing area;

determining the amount of pressure imposed by the object on the physical viewable area;

determining the amount of time the object makes contact with the physical viewable area; and

determining a pointer size based on the determined amount of pressure as a function of the determined time.

40. A method of providing a touch-responsive user interface comprising the steps of:

detecting an object making contact with a physical viewing area;

determining a pointer size of the object; and

activating a function corresponding to the pointer size,

wherein the determining step includes the substeps of;

determining a rate of change in the amount of pressure imposed by the object on the physical viewing area thereby determining whether the pressure imposed by the object on the physical viewing area changes gradually or sharply over a predetermined range of time; and

computing a pointer size based on the rate of change in the amount of pressure.

41. The method of claim 40, wherein the computing step includes:

associating the pointer size with a stylus pointer when the pressure imposed by the object changes sharply; and

associating the pointer size with a finger when the pressure imposed by the object changes gradually.

42. An apparatus for providing a touch-responsive user interface comprising:

means for detecting an object making contact with a physical viewing area;

means for determining a pointer size of the object; and

means for activating a function corresponding to the pointer size,

wherein the means for determining includes;

means for determining a rate of change in the amount of pressure imposed by the object on the physical viewing area, thereby determining whether the pressure imposed by the object on the physical viewing area changes gradually or sharply over a predetermined range of time; and

means for computing a pointer size based on the rate of change in the amount of pressure.

43. The apparatus of claim 42, wherein the means for computing includes:

means for associating the pointer size with a stylus pointer when the pressure imposed by the object changes sharply; and

means for associating the pointer size with a finger when the pressure imposed by the object changes gradually.