Multi-touch input discrimination

• US 7,855,718 B2
• Filed: 01/03/2007
• Issued: 12/21/2010
• Est. Priority Date: 01/03/2007
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Westerman, Wayne C.
• Primary Examiner(s): Eisen; Alexander
• Assistant Examiner(s): Marinelli; Patrick
• Application Number:
  US11/619,464
• Publication Number:
  US 20080158145A1
• Time in Patent Office: 1,448 Days
• Field of Search: 345158-173, 382/172, 382/312, 382/191, 382/181, 382/203, 382/210
• US Class Current: 345/173
• CPC Class Codes: G06F 3/04182 Filtering of noise external to the device and not generated by digitiser components
• CPC Class Codes: G06F 3/04186 Touch location disambiguation
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06V 40/107 Static hand or arm

Abstract

Techniques for identifying and discriminating between different input patterns to a multi-touch touch-screen device are described. By way of example, large objects hovering a short distance from the touch-surface (e.g., a cheek, thigh or chest) may be identified and distinguished from physical contacts to the surface. In addition, rough contacts due to, for example, ears and earlobes, may be similarly identified and distinguished from contacts due to fingers, thumbs, palms and finger clasps.

Claims

1. A method to discriminate input sources to a touch-surface device, comprising:

obtaining a proximity image;

segmenting the proximity image to identify a plurality of patches;

determining a minor axis radius value for each of the plurality of patches;

identifying one of the plurality of patches as being associated with a large object if the minor axis radius value of the patch is above a first specified threshold; and

using the identified patch to control an operation of a touch-surface device.

2. The method of claim 1, wherein the large object comprises a cheek.

3. The method of claim 1, wherein the large object comprises a leg.

4. The method of claim 1, further comprising:

identifying a second of the plurality of patches as being associated with a palm if the minor axis value of the second patch is less than the first specified threshold and greater than a second specified threshold; and

using the identified second patch to control an operation of a touch-surface device.

5. The method of claim 4, further comprising:

identifying a third of the plurality of patches as being associated with a finger if the minor axis value of the third patch is less than the second specified threshold; and

using the identified third patch to control an operation of a touch-surface device.

6. The method of claim 5, wherein the patch associated with the finger contact comprises a patch associated with a thumb.

7. The method of claim 1, wherein the first specified threshold is represented by a constant function.

8. The method of claim 4, wherein the second specified threshold is represented by a constant function.

9. The method of claim 1, wherein the first specified threshold is represented by a linear function.

10. The method of claim 4, wherein the second specified threshold is represented by a linear function.

11. The method of claim 1, wherein the first specified threshold is represented by a non-linear function.

12. The method of claim 4, wherein the second specified threshold is represented by a non-linear function.

13. The method of claim 1, wherein one or more of the plurality of patches are associated with objects that are in physical contact with a surface of the touch-surface device.

14. The method of claim 1, wherein one or more of the plurality of patches are associated with objects that are not in physical contact with a surface of the touch-surface device.

15. The method of claim 4, wherein the second specified threshold is represented by a linear function.

16. The method of claim 1, wherein the act of obtaining comprises obtaining a proximity image from a capacitive touch-surface device.

17. The method of claim 1, wherein the act of obtaining comprises obtaining a proximity image from a pressure-sensitive touch-surface device.

18. The method of claim 1, wherein the act of obtaining comprises:

obtaining a first proximity image, the first proximity image comprising a plurality of pixels, each pixel having a value; and

subtracting sensor element baseline values from the plurality of pixels values in the first proximity image.

19. The method of claim 1, wherein the act of obtaining comprises:

obtaining a first proximity image; and

filtering the first proximity image to generate a filtered proximity image.

20. The method of claim 19, wherein the act of filtering comprises spatially filtering the first proximity image.

21. The method of claim 20, wherein the act of spatially filtering comprises inserting a border around the first proximity image prior to spatially filtering the first proximity image.

22. The method of claim 19, wherein the act of filtering comprises temporally filtering the first proximity image with a second proximity image.

23. The method of claim 19, further comprising constraining pixel values associated with the filtered proximity image to be less than a specified value.

24. The method of claim 1, wherein the touch-surface device comprises one of the following devices:

tablet computer system, notebook computer system, portable music player, portable video player, personal digital assistant and mobile telephone.

25. A program storage device, readable by a programmable control device, comprising instructions stored thereon for causing the programmable control device to perform the method of claim 1.

26. A portable electronic device, comprising:

a multi-touch input touch-surface component;

means for receiving a proximity image from the multi-touch input touch-surface; and

processing means for performing acts in accordance with claim 1.

27. The device in accordance with claim 26, wherein the portable electronic device comprises a tablet computer system.

28. The device in accordance with claim 26, wherein the portable electronic device comprises a hand-held computer system.

29. The device in accordance with claim 26, wherein the portable electronic device comprises a mobile telephone.

30. The device in accordance with claim 26, wherein the portable electronic device comprises a portable music player system.

31. The device in accordance with claim 26, wherein the portable electronic device comprises a portable video player system.

32. A method to identify an input source to a multi-touch touch-surface device, comprising:

obtaining a proximity image;

segmenting the proximity image to identify a patch;

determining a minor axis radius value for the patch;

identifying the patch as being associated with a large object if the minor axis radius value of the patch is above a first specified threshold; and

using the identified patch to control an operation of a multi-touch touch-surface device.

33. The method of claim 32, wherein the first specified threshold is represented by a constant function.

34. The method of claim 32, wherein the first specified threshold is represented by a linear function.

35. The method of claim 32, wherein the first specified threshold is represented by a non-linear function.

36. The method of claim 32, wherein the identified patch is associated with an object that is in physical contact with a surface of the touch-surface device.

37. The method of claim 32, wherein the identified patch is associated with an object that is not in physical contact with a surface of the touch-surface device.

50. A program storage device, readable by a programmable control device, comprising instructions stored thereon for causing the programmable control device to perform the method of claim 32.

51. The method of claim 32, wherein the multi-touch touch-surface device comprises one of the following devices:

tablet computer system, notebook computer system, portable music player, portable video player, personal digital assistant and mobile telephone.

38. A method to identify an input source to a multi-touch touch-surface device, comprising:

obtaining a proximity image;

segmenting the proximity image to identify a patch;

determining a minor axis radius value for the patch;

identifying the patch as being associated with a palm if the minor axis value of the patch is less than a first specified threshold and greater than a second specified threshold; and

using the identified patch to control an operation of a multi-touch touch-surface device.

39. The method of claim 38, wherein the first specified threshold is represented by a constant function.

40. The method of claim 38, wherein the first specified threshold is represented by a linear function.

41. The method of claim 38, wherein the first specified threshold is represented by a non-linear function.

42. The method of claim 38, wherein the identified patch is associated with an object that is in physical contact with a surface of the multi-touch touch-surface device.

43. The method of claim 38, wherein the identified patch is associated with an object that is not in physical contact with a surface of the multi-touch touch-surface device.

52. A program storage device, readable by a programmable control device, comprising instructions stored thereon for causing the programmable control device to perform the method of claim 38.

53. The method of claim 38, wherein the multi-touch touch-surface device comprises one of the following devices:

tablet computer system, notebook computer system, portable music player, portable video player, personal digital assistant and mobile telephone.

44. A method to identify an input source to a multi-touch touch-surface device, comprising:

obtaining a proximity image;

segmenting the proximity image to identify a patch;

determining a minor axis radius value for the patch;

identifying a patch as being associated with a finger if the minor axis value of the patch is less than a first specified threshold; and

using the identified patch to control an operation of a multi-touch touch-surface device.

45. The method of claim 44, wherein the first specified threshold is represented by a constant function.

46. The method of claim 44, wherein the first specified threshold is represented by a linear function.

47. The method of claim 44, wherein the first specified threshold is represented by a non-linear function.

48. The method of claim 44, wherein the identified patch is associated with an object that is in physical contact with a surface of the multi-touch touch-surface device.

49. The method of claim 44, wherein the identified patch is associated with an object that is not in physical contact with a surface of the multi-touch touch-surface device.

54. A program storage device, readable by a programmable control device, comprising instructions stored thereon for causing the programmable control device to perform the method of claim 44.

55. The method of claim 44, wherein the multi-touch touch-surface device comprises one of the following devices:

tablet computer system, notebook computer system, portable music player, portable video player, personal digital assistant and mobile telephone.

56. A method to identify an input source to a multi-touch touch-surface device, comprising:

obtaining a proximity image;

segmenting the proximity image to identify a plurality of patches;

determining that at least five of the identified patches are associated with finger contacts to a touch-surface;

identifying the at least five identified patches as being associated with a finger-clasp operation;

and using the identified finger-clasp operation to control an operation of a multi-touch touch-surface device.

57. The method of claim 56, wherein the multi-touch touch-surface device comprises one of the devices selected from the group consisting of:

a tablet computer system, a hand-held computer system, a portable music player system, a portable video player system.

58. The method of claim 56, wherein the multi-touch touch-surface device comprises a mobile telephone.

59. A method to identify an input source to a multi-touch touch-surface device, comprising:

obtaining a proximity image;

segmenting the proximity image to identify a plurality of patches;

determining that at least two of the identified patches have major axis radius values larger than approximately 15 millimeters;

identifying the at least two identified patches as being associated with a fingerclasp operation; and

using the identified finger-clasp operation to control an operation of a multitouch touch-surface device.

60. The method of claim 59, wherein the multi-touch touch-surface device comprises one of the devices selected from the group consisting of:

a tablet computer system, a hand-held computer system, a portable music player system, a portable video player system.

61. The method of claim 59, wherein the multi-touch touch-surface device comprises a mobile telephone.

62. A method to identify an input source to a touch-surface device, comprising:

obtaining a proximity image;

segmenting the proximity image to identify one or more patches, each patch having a plurality of pixels, each pixel having a value;

determining a signal density value for at least one of the one or more patches;

identifying the at least one patch as being associated with an object contacting a touch-surface of a touch-surface device if the at least one patch has a signal density value greater than a specified value;

identifying the at least one patch as being associated with an object hovering above the touch-surface if the at least one patch has a signal density value less than the specified value; and

performing a control operation on the touch-surface device in response to the acts of identifying.

63. The method of claim 62, wherein the signal density value is determined by dividing the sum of all pixel values in a patch by the number of pixels in the patch.

64. The method of claim 62, wherein the signal density value is determined by dividing the sum of all pixel values in a patch by a radius of the patch.

65. The method of claim 64, wherein the radius of the patch comprises a geometric mean radius of the patch.

66. The method of claim 62, wherein the signal density value is determined by dividing the sum of all pixel values in a patch by the patches'"'"' area.

67. The method of claim 62, wherein the control operation comprises causing the touch-surface device to change an operational state.

68. The method of claim 62, wherein the control operation comprises performing a specified function.

69. The method of claim 62, wherein the control operation comprises ignoring the object contacting the touch-surface.

70. The method of claim 62, wherein the touch-surface device comprises one of the devices selected from the group consisting of:

a tablet computer system, a hand-held computer system, a portable music player system, a portable video player system.

71. The method of claim 62, wherein the touch-surface device comprises a mobile telephone.

72. A program storage device, readable by a programmable control device, comprising instructions stored thereon for causing the programmable control device to perform the method of claim 62.

73. A method to identify an input source to a multi-touch touch-surface device, comprising:

obtaining a proximity image;

segmenting the proximity image to identify a plurality of patches;

determining that at least two of the identified patches have major axis radius values larger than threshold;

identifying the at least two identified patches as being associated with a finger-clasp operation; and

using the identified finger-clasp operation to control an operation of a multi-touch touch-surface device.

74. The method of claim 73, wherein the multi-touch touch-surface device comprises one of the devices selected from the group consisting of:

a tablet computer system, a hand-held computer system, a portable music player system, a portable video player system.

75. The method of claim 73, wherein the multi-touch touch-surface device comprises a mobile telephone.