Sensor arrangement for use with a touch sensor

• US 9,626,032 B2
• Filed: 07/30/2007
• Issued: 04/18/2017
• Est. Priority Date: 01/26/1998
• Status: Expired due to Term

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Westerman, Wayne, Elias, John G.
• Primary Examiner(s): SIM, MATTHEW Y
• Application Number:
  US11/830,781
• Publication Number:
  US 20080128182A1
• Time in Patent Office: 3,550 Days
• CPC Class Codes: G06F 18/24137 Distances to cluster centroïds
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04106 Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/0235 using chord techniques G06F3/0234 takes precedence
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/04166 Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving Synchronisation with the driving of the display or the backlighting unit to avoid interferences generated internally G06F3/04184
• CPC Class Codes: G06F 3/04186 Touch location disambiguation
• CPC Class Codes: G06F 3/0446 using a grid-like structure of electrodes in at least two directions, e.g. using row and column electrodes
• CPC Class Codes: G06F 3/0447 Position sensing using the local deformation of sensor cells
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06V 30/19173 Classification techniques
• CPC Class Codes: G06V 30/1983 Syntactic or structural pattern recognition, e.g. symbolic string recognition
• CPC Class Codes: G06V 40/107 : Static hand or arm
• CPC Class Codes: H03K 17/9622 : using a plurality of detectors, e.g. keyboard
• CPC Class Codes: H03K 2217/960725 : Charge-transfer

Abstract

Apparatus and methods are disclosed for simultaneously tracking multiple finger and palm contacts as hands approach, touch, and slide across a proximity-sensing, multi-touch surface. Identification and classification of intuitive hand configurations and motions enables unprecedented integration of typing, resting, pointing, scrolling, 3D manipulation, and handwriting into a versatile, ergonomic computer input device.

Claims

1. A method for selecting a state of a computing system including a touch sensing surface, the method comprising:

detecting a set of plurality of contacts touched down on or near the surface;

detecting a liftoff of a first subset of one or more contacts of the set, wherein a second subset of one or more contacts of the set remains touched down;

determining a motion of the first subset, prior to the liftoff, from a first position on the surface to a second position on the surface;

selecting, while the first subset remains lifted off from the surface after the liftoff, one of a plurality of post-liftoff states, wherein the selection is determined by first information including the motion of the first subset, prior to the liftoff, from the first position on the surface to the second position on the surface; and

the selection occurs while the second subset remains touched down.

2. The method of claim 1, wherein the motion of the first subset prior to the liftoff of the first subset is an amount of change in direction of the first subset.

3. The method of claim 2, wherein selecting the one of the plurality of post-liftoff states includes selecting termination of the input in response to a determination that the amount of change in direction is greater than a predetermined curve threshold.

4. The method of claim 1, further comprising:

selecting an input of the computing system prior to the liftoff; and

generating the input based on the first subset prior to the liftoff.

5. The method of claim 4, wherein generating the input is based on the set of contacts.

6. The method of claim 4, further comprising:

determining whether the input is a currently-selected input at the time of the liftoff, wherein the first information includes the determination that the input is currently-selected at the time of the liftoff.

7. The method of claim 4, wherein the input includes one of a cursor motion, a scroll motion, and a drag motion.

8. The method of claim 4, wherein generating the input includes initiating the input based on one of a synchronized motion of the first subset and a synchronized touchdown of the first subset.

9. The method of claim 8, wherein generating the input includes generating a motion of the input while the first subset remains touched down after the initiating of the input, and the motion of the input while the first subset remains touched down is based on a combination of motions of contacts in the first and second subsets.

10. The method of claim 4, wherein one of the post-liftoff states includes terminating the input.

11. The method of claim 10, wherein terminating the input is selected if the motion of the first subset is determined to be paused prior to the liftoff.

12. The method of claim 10, wherein terminating the input is selected if the motion of the first subset is determined to be decelerating prior to the liftoff.

13. The method of claim 4, wherein one of the post-liftoff states includes continuing a motion of the input.

14. The method of claim 13, wherein continuing the motion of the input is selected if the motion of the first subset is determined to be moving at a constant speed prior to the liftoff.

15. The method of claim 13, wherein continuing the motion of the input is selected if the motion of the first subset is determined to be greater than a predetermined acceleration prior to the liftoff.

16. The method of claim 13, wherein a speed of the continuing motion of the input is based on the motion of the first subset prior to the liftoff.

17. The method of claim 16, wherein the speed of the continuing motion of the input is set to a same speed as the motion of the first subset prior to the liftoff.

18. The method of claim 13, further comprising:

detecting a touchdown of one or more contacts after the liftoff of the first subset; and

terminating the input in response to detecting the touchdown of the one or more contacts after the liftoff of the first subset.

19. The method of claim 13, further comprising:

adjusting the continued motion of the input based on the second subset.

20. The method of claim 19, wherein adjusting the continued motion includes adjusting the continued motion based on a motion of the second subset.

21. The method of claim 20, wherein adjusting the continued motion based on the motion of the second subset includes adjusting the continued motion based on a translation motion of the second subset.

22. The method of claim 19, further comprising:

detecting one or more liftoffs of the one or more contacts in the second subset, wherein adjusting the continued motion includes terminating the continued motion in response to detecting that all of the one or more contacts in the second subset have lifted off.

23. A non-transitory computer-readable storage medium storing computer-readable program instructions executable to perform a method of selecting a state of a computing system including a touch sensing surface, the method comprising:

detecting a set of plurality of contacts touched down on or near the surface;

detecting a liftoff of a first subset of one or more contacts of the set, wherein a second subset of one or more contacts of the set remains touched down;

determining a motion of the first subset, prior to the liftoff, from a first position on the surface to a second position on the surface;

selecting, while the first subset remains lifted off from the surface after the liftoff, one of a plurality of post-liftoff states, wherein the selection is determined by first information including the motion of the first subset, prior to the liftoff, from the first position on the surface to the second position on the surface; and

the selection occurs while the second subset remains touched down.

24. The non-transitory computer-readable storage medium of claim 23, wherein the input includes one of a cursor motion, a scroll motion, and a drag motion.

25. The non-transitory computer-readable storage medium of claim 23, wherein generating the input includes initiating the input based on one of a synchronized motion of the first subset and a synchronized touchdown of the first subset.

26. The non-transitory computer-readable storage medium of claim 25, wherein generating the input includes generating a motion of the input while the first subset remains touched down after the initiating of the input, and the motion of the input while the first subset remains touched down is based on a combination of motions of contacts in the first and second subsets.

27. The non-transitory computer-readable storage medium of claim 23, wherein the motion of the first subset prior to the liftoff of the first subset is an amount of change in direction of the first subset.

28. The non-transitory computer-readable storage medium of claim 27, wherein selecting the one of the plurality of post-liftoff states includes selecting termination of the input in response to a determination that the amount of change in direction is greater than a predetermined curve threshold.

29. The non-transitory computer-readable storage medium of claim 23, the method further comprising:

selecting an input of the computing system prior to the liftoff; and

generating the input based on the first subset prior to the liftoff.

30. The method of claim 29, wherein generating the input is based on the set of contacts.

31. The method of claim 29, the method further comprising:

determining whether the input is a currently-selected input at the time of the liftoff, wherein the first information includes the determination that the input is currently-selected at the time of the liftoff.

32. The non-transitory computer-readable storage medium of claim 29, wherein the input is generated prior to the liftoff of the first subset, and the plurality of post-liftoff states includes terminating the input.

33. The non-transitory computer-readable storage medium of claim 32, wherein terminating the input is selected if the motion of the first subset is determined to be paused prior to the liftoff.

34. The non-transitory computer-readable storage medium of claim 32, wherein terminating the input is selected if the motion of the first subset is determined to be decelerating prior to the liftoff.

35. The non-transitory computer-readable storage medium of claim 29, wherein the input is generated prior to the liftoff of the first subset, and the plurality of post-liftoff states includes continuing a motion of the input.

36. The non-transitory computer-readable storage medium of claim 35, the method further comprising:

detecting a touchdown of one or more contacts after the liftoff of the first subset; and

terminating the input in response to detecting the touchdown of the one or more contacts after the liftoff of the first subset.

37. The non-transitory computer-readable storage medium of claim 35, wherein continuing the motion of the input is selected if the motion of the first subset is determined to be moving at a constant speed prior to the liftoff.

38. The non-transitory computer-readable storage medium of claim 35, wherein continuing the motion of the input is selected if the motion of the first subset is determined to be greater than a predetermined acceleration prior to the liftoff.

39. The non-transitory computer-readable storage medium of claim 35, wherein a speed of the continuing motion of the input is based on the motion of the first subset prior to the liftoff.

40. The non-transitory computer-readable storage medium of claim 39, wherein the speed of the continuing motion of the input is set to a same speed as the motion of the first subset prior to the liftoff.

41. The non-transitory computer-readable storage medium of claim 35, the method further comprising:

adjusting the continued motion of the input based on the second subset.

42. The non-transitory computer-readable storage medium of claim 41, wherein adjusting the continued motion includes adjusting the continued motion based on a motion of the second subset.

43. The non-transitory computer-readable storage medium of claim 42, wherein adjusting the continued motion based on the motion of the second subset includes adjusting the continued motion based on a translation motion of the second subset.

44. The non-transitory computer-readable storage medium of claim 41, the method further comprising:

detecting one or more liftoffs of the one or more contacts in the second subset, wherein adjusting the continued motion includes terminating the continued motion in response to detecting that all of the one or more contacts in the second subset have lifted off.

45. An apparatus comprising:

a touch sensing surface; and

an input system that

detects a set of plurality of contacts touched down on or near the surface,

detects a liftoff of a first subset of one or more contacts of the set, wherein a second subset of one or more contacts of the set remains touched down,

determines a motion of the first subset, prior to the liftoff, from a first position on the surface to a second position on the surface,

selects, while the first subset remains lifted off from the surface after the liftoff, one of a plurality of post-liftoff states, wherein the selection is determined by first information including the motion of the first subset, prior to the liftoff, from the first position on the surface to the second position on the surface; and

the selection occurs while the second subset remains touched down.

46. The apparatus of claim 45, wherein the input includes one of a cursor motion, a scroll motion, and a drag motion.

47. The apparatus of claim 45, wherein generating the input includes initiating the input based on one of a synchronized motion of the first subset and a synchronized touchdown of the first subset.

48. The apparatus of claim 47, wherein generating the input includes generating a motion of the input while the first subset remains touched down after the initiating of the input, and the motion of the input while the first subset remains touched down is based on a combination of motions of contacts in the first and second subsets.

49. The apparatus of claim 45, wherein the motion of the first subset prior to the liftoff of the first subset is an amount of change in direction of the first subset.

50. The apparatus of claim 49, wherein the input system selects termination of the input as the post-liftoff state in response to a determination that the amount of change in direction is greater than a predetermined curve threshold.

51. The apparatus of claim 45, wherein the input system further selects an input of the computing system prior to the liftoff, generates the input based on the first subset prior to the liftoff.

52. The apparatus of claim 51, wherein the input system generates the input based on the set of contacts.

53. The apparatus of claim 51, wherein the input system further determines whether the input is a currently-selected input at the time of the liftoff, wherein the first information includes the determination that the input is currently-selected at the time of the liftoff.

54. The apparatus of claim 51, wherein one of the post-liftoff states includes terminating the input.

55. The apparatus of claim 54, wherein terminating the input is selected if the motion of the first subset is determined to be paused prior to the liftoff.

56. The apparatus of claim 54, wherein terminating the input is selected if the motion of the first subset is determined to be decelerating prior to the liftoff.

57. The apparatus of claim 51, wherein one of the post-liftoff states includes continuing a motion of the input.

58. The apparatus of claim 57, wherein the input system further detects a touchdown of one or more contacts after the liftoff of the first subset, and terminates the input in response to detecting the touchdown of the one or more contacts after the liftoff of the first subset.

59. The apparatus of claim 57, wherein continuing the motion of the input is selected if the motion of the first subset is determined to be moving at a constant speed prior to the liftoff.

60. The apparatus of claim 57, wherein continuing the motion of the input is selected if the motion of the first subset is determined to be greater than a predetermined acceleration prior to the liftoff.

61. The apparatus of claim 57, wherein a speed of the continuing motion of the input is based on the motion of the first subset prior to the liftoff.

62. The apparatus of claim 61, wherein the speed of the continuing motion of the input is set to a same speed as the motion of the first subset prior to the liftoff.

63. The apparatus of claim 57, wherein the input system further adjusts the continued motion of the input based on the second subset.

64. The apparatus of claim 63, wherein adjusting the continued motion includes adjusting the continued motion based on a motion of the second subset.

65. The apparatus of claim 64, wherein adjusting the continued motion based on the motion of the second subset includes adjusting the continued motion based on a translation motion of the second subset.

66. The apparatus of claim 63, wherein the input system further detects one or more liftoffs of the one or more contacts in the second subset, wherein adjusting the continued motion includes terminating the continued motion in response to detecting that all of the one or more contacts in the second subset have lifted off.