Devices, methods, and graphical user interfaces for manipulating user interfaces with physical gestures

• US 10,248,308 B2
• Filed: 01/28/2016
• Issued: 04/02/2019
• Est. Priority Date: 08/10/2015
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Karunamuni, Chanaka G., Chaudhri, Imran A.
• Primary Examiner(s): Mengistu, Amare
• Assistant Examiner(s): Zubajlo, Jennifer
• Application Number:
  US15/009,676
• Publication Number:
  US 20170046060A1
• Time in Patent Office: 1,160 Days
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

An electronic device with a display, a touch-sensitive surface, and one or more sensors to detect intensity of contacts with the touch-sensitive surface: detects a first gesture that includes concurrently detecting a first contact and a second contact, detecting an intensity of the first contact, and detecting an intensity of the second contact; and, in response to detecting the first gesture: in accordance with a determination that the first gesture meets first operation criteria (including a criterion that is met when the intensities of the first and second contact satisfy a respective intensity threshold), performs a first operation; and, in accordance with a determination that the first gesture meets second operation criteria, wherein the second operation criteria are capable of being met when the intensities of the first and second contacts do not satisfy the respective intensity threshold, performs a second operation that is different from the first operation.

Claims

1. A computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with a display, a touch-sensitive surface, and one or more sensors to detect intensities of contacts with the touch-sensitive surface cause the device to:

detect a first gesture that includes;

detecting a first contact moving across the touch-sensitive surface,

concurrently detecting a second contact moving across the touch-sensitive surface,

wherein the first contact and the second contact move relative to each other across the touch-sensitive surface,

detecting an intensity of the first contact, and

concurrently detecting an intensity of the second contact; and

,

in response to detecting the first gesture;

in accordance with a determination that the first gesture meets first operation criteria, perform a first operation, wherein the first operation criteria include that;

the intensity of the first contact is greater than a respective intensity threshold,

the intensity of the second contact is greater than the respective intensity threshold, and,

a difference between the intensity of the first contact and the intensity of the second contact is less than a similarity threshold; and

,

in accordance with a determination that the first gesture meets second operation criteria that are distinct from the first operation criteria, perform a second operation that is different from the first operation, wherein;

the second operation criteria are met when the difference between the intensity of the first contact and the intensity of the second contact is greater than the similarity threshold, and

the second operation criteria are capable of being met when the intensities of the first and second contacts do not satisfy the respective intensity threshold.

2. The computer readable storage medium of claim 1, including instructions which, when executed by the electronic device, cause the electronic device to:

in accordance with a determination that the difference between the intensity of the first contact and the intensity of the second contact is less than the similarity threshold and that the first intensity and the second intensity are less than the respective intensity threshold, forgo performance of the first operation.

3. The computer readable storage medium of claim 1, including instructions which, when executed by the electronic device, cause the electronic device to:

in accordance with a determination that the difference between the intensity of the first contact and the intensity of the second contact is less than the similarity threshold and that the first intensity and the second intensity are less than the respective intensity threshold, perform a third operation that is different from the first operation.

4. The computer readable storage medium of claim 1, wherein:

the device includes sensors that are configured to detect a range of contact intensities, from an input-detection intensity threshold at which a contact is detected as present on the touch-sensitive surface through a plurality of contact intensities that are higher than the input-detection intensity threshold; and

the respective intensity threshold is higher than the input-detection intensity threshold.

5. The computer readable storage medium of claim 1, wherein:

in accordance with a determination that the first and second contacts are moving toward each other, the first operation is a first type of operation; and

in accordance with a determination that the first and second contacts are moving away from each other, the first operation is a second type of operation that is the reverse of the first type of operation.

6. The computer readable storage medium of claim 1, wherein the first operation is a text-modification operation and the second operation is a zooming operation.

7. The computer readable storage medium of claim 1, wherein the first operation criteria include a criterion that is met when movement of the first and second contacts is less than a predefined movement threshold.

8. The computer readable storage medium of claim 1, wherein the first contact is detected at a first edge of the touch-sensitive surface and the second contact is detected at a second edge of the touch-sensitive surface, and detecting the first gesture includes:

detecting the first contact moving toward the first edge; and

detecting the second contact moving toward the second edge.

9. The computer readable storage medium of claim 1, wherein the first contact is detected at a first edge of the touch-sensitive surface and the second contact is detected at a second edge of the touch-sensitive surface, and detecting the first gesture includes:

detecting the first contact moving away from the first edge; and

detecting the second contact moving away from the second edge.

10. The computer readable storage medium of claim 1, wherein detecting the first gesture includes:

detecting the first contact moving in a first direction along a first edge of the touch-sensitive surface; and

detecting the second contact moving in a second direction along a second edge of the touch-sensitive surface, wherein the second direction is opposite to the first direction and the second edge is opposite to the first edge.

11. The computer readable storage medium of claim 10, wherein:

in accordance with a determination that the first contact is moving in the first direction and the second contact is moving in the second direction, the first operation is a first type of operation; and

in accordance with a determination that the first contact is moving in the second direction and the second contact is moving in the first direction, the first operation is a second type of operation that is the reverse of the first type of operation.

12. The computer readable storage medium of claim 1, wherein the first contact and the second contact are two simultaneous thumb contacts on the touch-sensitive surface.

13. The computer readable storage medium of claim 12, wherein detecting the first gesture includes detecting the two simultaneous thumb contacts on the touch-sensitive surface moving apart in opposite directions.

14. The computer readable storage medium of claim 12, wherein detecting the first gesture includes detecting the two simultaneous thumb contacts on the touch-sensitive surface moving toward each other.

15. The computer readable storage medium of claim 12, wherein:

the first gesture meets the first operation criteria when at least one thumb contact of the two simultaneous thumb contacts exceeds a first intensity threshold; and

the first gesture meets the second operation criteria when the first gesture does not meet the first operation criteria.

16. The computer readable storage medium of claim 1, wherein:

in accordance with a determination that the first gesture is a bend gesture, performing the first operation includes performing a first function from a first set of functions; and

in accordance with a determination that the first gesture is a twist gesture, performing the first operation includes performing a second function from a second set of functions distinct from the first set of functions.

17. An electronic device, comprising:

a display;

a touch-sensitive surface;

one or more sensors to detect intensities of contacts with the touch-sensitive surface;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

detecting a first gesture that includes;

detecting a first contact moving across the touch-sensitive surface,

concurrently detecting a second contact moving across the touch-sensitive surface,

wherein the first contact and the second contact move relative to each other across the touch-sensitive surface,

detecting an intensity of the first contact, and

concurrently detecting an intensity of the second contact; and

, in response to detecting the first gesture;

in accordance with a determination that the first gesture meets first operation criteria, performing a first operation, wherein the first operation criteria include that;

the intensity of the first contact is greater than a respective intensity threshold,

the intensity of the second contact is greater than the respective intensity threshold, and,

a difference between the intensity of the first contact and the intensity of the second contact is less than a similarity threshold; and

,

in accordance with a determination that the first gesture meets second operation criteria that are distinct from the first operation criteria, performing a second operation that is different from the first operation, wherein;

the second operation criteria are met when the difference between the intensity of the first contact and the intensity of the second contact is greater than the similarity threshold, and

the second operation criteria are capable of being met when the intensities of the first and second contacts do not satisfy the respective intensity threshold.

18. The electronic device of claim 17, wherein the one or more programs include instructions for:

in accordance with a determination that the difference between the intensity of the first contact and the intensity of the second contact is less than the similarity threshold and that the first intensity and the second intensity are less than the respective intensity threshold, forgoing performance of the first operation.

19. The electronic device of claim 17, wherein the one or more programs include instructions for:

in accordance with a determination that the difference between the intensity of the first contact and the intensity of the second contact is less than the similarity threshold and that the first intensity and the second intensity are less than the respective intensity threshold, performing a third operation that is different from the first operation.

20. The electronic device of claim 17, wherein:

the device includes sensors that are configured to detect a range of contact intensities, from an input-detection intensity threshold at which a contact is detected as present on the touch-sensitive surface through a plurality of contact intensities that are higher than the input-detection intensity threshold; and

the respective intensity threshold is higher than the input-detection intensity threshold.

21. The electronic device of claim 17, wherein:

in accordance with a determination that the first and second contacts are moving toward each other, the first operation is a first type of operation; and

in accordance with a determination that the first and second contacts are moving away from each other, the first operation is a second type of operation that is the reverse of the first type of operation.

22. The electronic device of claim 17, wherein the first operation is a text-modification operation and the second operation is a zooming operation.

23. The electronic device of claim 17, wherein the first operation criteria include a criterion that is met when movement of the first and second contacts is less than a predefined movement threshold.

24. The electronic device of claim 17, wherein the first contact is detected at a first edge of the touch-sensitive surface and the second contact is detected at a second edge of the touch-sensitive surface, and detecting the first gesture includes:

detecting the first contact moving toward the first edge; and

detecting the second contact moving toward the second edge.

25. The electronic device of claim 17, wherein the first contact is detected at a first edge of the touch-sensitive surface and the second contact is detected at a second edge of the touch-sensitive surface, and detecting the first gesture includes:

detecting the first contact moving away from the first edge; and

detecting the second contact moving away from the second edge.

26. The electronic device of claim 17, wherein detecting the first gesture includes:

detecting the first contact moving in a first direction along a first edge of the touch- sensitive surface; and

detecting the second contact moving in a second direction along a second edge of the touch-sensitive surface, wherein the second direction is opposite to the first direction and the second edge is opposite to the first edge.

27. The electronic device of claim 26, wherein:

in accordance with a determination that the first contact is moving in the first direction and the second contact is moving in the second direction, the first operation is a first type of operation; and

in accordance with a determination that the first contact is moving in the second direction and the second contact is moving in the first direction, the first operation is a second type of operation that is the reverse of the first type of operation.

28. The electronic device of claim 17, wherein the first contact and the second contact are two simultaneous thumb contacts on the touch-sensitive surface.

29. The electronic device of claim 28, wherein detecting the first gesture includes detecting the two simultaneous thumb contacts on the touch-sensitive surface moving apart in opposite directions.

30. The electronic device of claim 28, detecting the first gesture includes detecting the two simultaneous thumb contacts on the touch-sensitive surface moving toward each other.

31. The electronic device of claim 28, wherein:

the first gesture meets the first operation criteria when at least one thumb contact of the two simultaneous thumb contacts exceeds a first intensity threshold; and

the first gesture meets the second operation criteria when the first gesture does not meet the first operation criteria.

32. The electronic device of claim 17, wherein:

in accordance with a determination that the first gesture is a bend gesture, performing the first operation includes performing a first function from a first set of functions; and

in accordance with a determination that the first gesture is a twist gesture, performing the first operation includes performing a second function from a second set of functions distinct from the first set of functions.

33. A method, comprising:

at an electronic device with a display, a touch-sensitive surface, and one or more sensors to detect intensities of contacts with the touch-sensitive surface;

detecting a first gesture that includes;

detecting a first contact moving across the touch-sensitive surface,

concurrently detecting a second contact moving across the touch-sensitive surface,

wherein the first contact and the second contact move relative to each other across the touch-sensitive surface,

detecting an intensity of the first contact, and

concurrently detecting an intensity of the second contact; and

, in response to detecting the first gesture;

in accordance with a determination that the first gesture meets first operation criteria, performing a first operation, wherein the first operation criteria include that;

the intensity of the first contact is greater than a respective intensity threshold,

the intensity of the second contact is greater than the respective intensity threshold, and,

a difference between the intensity of the first contact and the intensity of the second contact is less than a similarity threshold; and

,

in accordance with a determination that the first gesture meets second operation criteria that are distinct from the first operation criteria, performing a second operation that is different from the first operation, wherein;

the second operation criteria are met when the difference between the intensity of the first contact and the intensity of the second contact is greater than the similarity threshold, and

the second operation criteria are capable of being met when the intensities of the first and second contacts do not satisfy the respective intensity threshold.

34. The method of claim 33, including:

in accordance with a determination that the difference between the intensity of the first contact and the intensity of the second contact is less than the similarity threshold and that the first intensity and the second intensity are less than the respective intensity threshold, forgoing performance of the first operation.

35. The method of claim 33, including:

in accordance with a determination that the difference between the intensity of the first contact and the intensity of the second contact is less than the similarity threshold and that the first intensity and the second intensity are less than the respective intensity threshold, performing a third operation that is different from the first operation.

36. The method of claim 33, wherein:

the device includes sensors that are configured to detect a range of contact intensities, from an input-detection intensity threshold at which a contact is detected as present on the touch-sensitive surface through a plurality of contact intensities that are higher than the input-detection intensity threshold; and

the respective intensity threshold is higher than the input-detection intensity threshold.

37. The method of claim 33, wherein:

in accordance with a determination that the first and second contacts are moving toward each other, the first operation is a first type of operation; and

in accordance with a determination that the first and second contacts are moving away from each other, the first operation is a second type of operation that is the reverse of the first type of operation.

38. The method of claim 33, wherein the first operation is a text-modification operation and the second operation is a zooming operation.

39. The method of claim 33, wherein the first operation criteria include a criterion that is met when movement of the first and second contacts is less than a predefined movement threshold.

40. The method of claim 33, wherein the first contact is detected at a first edge of the touch-sensitive surface and the second contact is detected at a second edge of the touch-sensitive surface, and detecting the first gesture includes:

detecting the first contact moving toward the first edge; and

detecting the second contact moving toward the second edge.

41. The method of claim 33, wherein the first contact is detected at a first edge of the touch-sensitive surface and the second contact is detected at a second edge of the touch-sensitive surface, and detecting the first gesture includes:

detecting the first contact moving away from the first edge; and

detecting the second contact moving away from the second edge.

42. The method of claim 33, wherein detecting the first gesture includes:

detecting the first contact moving in a first direction along a first edge of the touch- sensitive surface; and

detecting the second contact moving in a second direction along a second edge of the touch-sensitive surface, wherein the second direction is opposite to the first direction and the second edge is opposite to the first edge.

43. The method of claim 42, wherein:

in accordance with a determination that the first contact is moving in the first direction and the second contact is moving in the second direction, the first operation is a first type of operation; and

in accordance with a determination that the first contact is moving in the second direction and the second contact is moving in the first direction, the first operation is a second type of operation that is the reverse of the first type of operation.

44. The method of claim 33, wherein the first contact and the second contact are two simultaneous thumb contacts on the touch-sensitive surface.

45. The method of claim 44, wherein detecting the first gesture includes detecting the two simultaneous thumb contacts on the touch-sensitive surface moving apart in opposite directions.

46. The method of claim 44 detecting the first gesture includes detecting the two simultaneous thumb contacts on the touch-sensitive surface moving toward each other.

47. The method of claim 44, wherein:

the first gesture meets the first operation criteria when at least one thumb contact of the

two simultaneous thumb contacts exceeds a first intensity threshold; and

the first gesture meets the second operation criteria when the first gesture does not meet the first operation criteria.

48. The method of claim 33, wherein:

in accordance with a determination that the first gesture is a bend gesture, performing the first operation includes performing a first function from a first set of functions; and

in accordance with a determination that the first gesture is a twist gesture, performing the first operation includes performing a second function from a second set of functions distinct from the first set of functions.