Touch input cursor manipulation

• US 10,222,980 B2
• Filed: 04/27/2017
• Issued: 03/05/2019
• Est. Priority Date: 03/19/2015
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Alonso Ruiz, Marcos, Lemay, Stephen O., Jon, Tiffany S., King, Nicholas V., Chaudhri, Imran A., Coffman, Patrick L., Winer, Morgan H., Fettes, Alastair K., Jong, Nicholas K.
• Primary Examiner(s): Sherman, Stephen G
• Application Number:
  US15/499,693
• Publication Number:
  US 20170235483A1
• Time in Patent Office: 677 Days
• Field of Search: 345158, 345173-178, 178 1801- 1809, 178 1811, 715856-863
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

The method for manipulating a cursor is performed at a portable multifunction device with one or more processors, memory, and a touch screen display. Initially, content of an electronic document is displayed on the display, where a cursor is displayed within the electronic document. Two substantially simultaneous touch inputs are then detected on the touch screen display, and preferably anywhere on the touch screen display. In response to detecting the two substantially simultaneous touch inputs, a portion of the content in the document closest to the cursor is selected, and the portion of the content is displayed as selected content.

Claims

1. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions which, when executed by an electronic device with a touch-sensitive display, cause the electronic device to:

concurrently display an onscreen keyboard and a content presentation region on the touch-sensitive display, wherein the content presentation region displays text input received from the onscreen keyboard;

detect a touch input on the onscreen keyboard displayed on the touch-sensitive display;

in response to detecting the touch input on the onscreen keyboard displayed on the touch-sensitive display, determine whether the touch input satisfies one or more criteria for entering a text selection mode; and

in accordance with a determination that the touch input satisfies the one or more criteria for entering the text selection mode;

concurrently display, in the content presentation region, a first cursor at a first location and a second cursor at a second location that is different from the first location, wherein;

the second cursor moves in accordance with movement of the touch input while in the text selection mode; and

the first cursor indicates where the second cursor will be located after the touch input ends.

2. The non-transitory computer readable storage medium of claim 1, wherein the one or more criteria for entering the text selection mode include the touch input including a two-finger drag gesture over the onscreen keyboard.

3. The non-transitory computer readable storage medium of claim 1, wherein:

the device has one or more sensors to detect intensities of contacts with the touch-sensitive display;

the touch input on the touch-sensitive display includes an input by a contact on the onscreen keyboard, and

the one or more criteria for entering the text selection mode include the contact on the onscreen keyboard having an intensity that exceeds a predetermined deep press intensity threshold.

4. The non-transitory computer readable storage medium of claim 1, including instructions which, when executed by the electronic device, cause the electronic device to:

in accordance with the determination that the touch input satisfies the one or more criteria for entering the text selection mode;

visually obscure keys on the onscreen keyboard.

5. The non-transitory computer readable storage medium of claim 4, wherein visually obscuring the keys on the onscreen keyboard includes applying a blurring effect to the onscreen keyboard.

6. The non-transitory computer readable storage medium of claim 4, wherein visually obscuring the keys on the onscreen keyboard includes transforming the onscreen keyboard into an onscreen touchpad.

7. The non-transitory computer readable storage medium of claim 4, wherein visually obscuring the keys on the onscreen keyboard includes making the onscreen keyboard semitransparent to partially reveal content lying underneath the onscreen keyboard.

8. The non-transitory computer readable storage medium of claim 1, wherein one of the first and second cursors is already displayed in the content presentation region before both of the first and second cursors are concurrently displayed in the content presentation region.

9. The non-transitory computer readable storage medium of claim 1, including instructions which, when executed by the electronic device, cause the electronic device to:

detect a lift-off of the touch input after detecting the movement of the touch input; and

in response to detecting the lift-off of the touch input;

cease to display the first cursor.

10. The non-transitory computer readable storage medium of claim 9, wherein the onscreen keyboard is obscured in accordance with the determination that the touch input satisfies the one or more criteria for entering the text selection mode, and the non-transitory computer readable storage medium includes instructions which, when executed by the electronic device, cause the electronic device to:

in response to detecting the lift-off of the touch input, restore display of the onscreen keyboard.

11. The non-transitory computer readable storage medium of claim 1, wherein the device has one or more sensors to detect intensities of contacts with the touch-sensitive display, and the non-transitory computer readable storage medium includes instructions which, when executed by the electronic device, cause the electronic device to:

in the text selection mode, detect that an intensity of a contact in the touch input exceeds a predetermined intensity threshold;

after detecting that the intensity of the contact in the touch input exceeds the predetermined intensity threshold, detect movement of the contact in the touch input;

in response to detecting the movement of the contact in the touch input, after detecting that the intensity of the contact in the touch input exceeds the predetermined intensity threshold;

select a portion of the text input in accordance with the movement of the contact in the touch input.

12. The non-transitory computer readable storage medium of claim 11, wherein the selected portion of the text input begins at a position of the first cursor when the detected intensity of the contact in the touch input exceeded the predetermined intensity threshold.

13. The non-transitory computer readable storage medium of claim 11, including instructions which, when executed by the electronic device, cause the electronic device to:

detect lift-off of the contact in the touch input after selecting the portion of the text input in accordance with the movement of the contact in the touch input; and

,

in response to detecting the lift-off of the contact in the touch input, confirm selection of the portion of the text input.

14. The non-transitory computer readable storage medium of claim 11, including instructions which, when executed by the electronic device, cause the electronic device to:

after selecting the portion of the text input, while the portion of the text input is selected, detect an intensity of the contact in the touch input that exceeds the predetermined intensity threshold; and

,

in response to detecting the intensity of the contact in the touch input that exceeds the predetermined intensity threshold while the portion of the text input is selected, clear selection of the portion of the text input.

15. The non-transitory computer readable storage medium of claim 11, including instructions which, when executed by the electronic device, cause the electronic device to:

after selecting the portion of the text input, while the portion of the text input is selected, detect an intensity of the contact in the touch input that exceeds the predetermined intensity threshold and that is followed by lift-off of the contact without further movement of the contact; and

,

in response to detecting the intensity of the contact in the touch input that exceeds the predetermined intensity threshold and that is followed by lift-off of the contact without further movement of the contact, confirm selection of the portion of the text input.

16. The non-transitory computer readable storage medium of claim 11, including instructions which, when executed by the electronic device, cause the electronic device to:

after selecting the portion of the text input, while the portion of the text input is selected, detect an intensity of the contact in the touch input that exceeds the predetermined intensity threshold and that is followed by further movement of the contact; and

,

in response to detecting the intensity of the contact in the touch input that exceeds the predetermined intensity threshold and that is followed by the further movement of the contact;

clear selection of the portion of the text input.

17. The non-transitory computer readable storage medium of claim 16, including instructions which, when executed by the electronic device, cause the electronic device to:

in response to detecting the intensity of the contact in the touch input that exceeds the predetermined intensity threshold and that is followed by the further movement of the contact;

start selection of a new portion of the text input in accordance with the further movement of the contact.

18. The non-transitory computer readable storage medium of claim 16, including instructions which, when executed by the electronic device, cause the electronic device to:

in response to detecting the intensity of the contact in the touch input that exceeds the predetermined intensity threshold and that is followed by the further movement of the contact;

further move the second cursor and the first cursor within the content presentation region in accordance with the further movement of the contact.

19. The non-transitory computer readable storage medium of claim 1, wherein the device has one or more sensors to detect intensities of contacts with the touch-sensitive display, and the non-transitory computer readable storage medium includes instructions which, when executed by the electronic device, cause the electronic device to:

in the text selection mode, detect a first local intensity peak in the touch input followed by a second local intensity peak in the touch input that both exceed a predetermined intensity threshold; and

,

in response to detecting the first local intensity peak followed by the second local intensity peak that both exceed the predetermined intensity threshold, select a first predetermined unit of the text input according to a current location of the first cursor.

20. The non-transitory computer readable storage medium of claim 19, including instructions which, when executed by the electronic device, cause the electronic device to:

after detecting the first local intensity peak followed by the second local intensity peak, detect a third consecutive local intensity peak in the touch input that exceeds the predetermined intensity threshold; and

in response to detecting the three consecutive local intensity peaks in the touch input that all exceed the predetermined deep press intensity threshold, select a second predetermined unit of the text input that is larger than and includes the first predetermined unit of the text input.

21. An electronic device, comprising:

a touch-sensitive display;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

concurrently displaying an onscreen keyboard and a content presentation region on the touch-sensitive display, wherein the content presentation region displays text input received from the onscreen keyboard;

detecting a touch input on the onscreen keyboard displayed on the touch-sensitive display;

in response to detecting the touch input on the onscreen keyboard displayed on the touch-sensitive display, determining whether the touch input satisfies one or more criteria for entering a text selection mode; and

in accordance with a determination that the touch input satisfies the one or more criteria for entering the text selection mode;

concurrently displaying, in the content presentation region, a first cursor at a first location and a second cursor at a second location that is different from the first location wherein;

the second cursor moves in accordance with movement of the touch input while in the text selection mode; and

the first cursor indicates where the second cursor will be located after the touch input ends.

22. The electronic device of claim 21, wherein the one or more criteria for entering the text selection mode include the touch input including a two-finger drag gesture over the onscreen keyboard.

23. The electronic device of claim 21, wherein:

the device has one or more sensors to detect intensities of contacts with the touch-sensitive display;

the touch input on the touch-sensitive display includes an input by a contact on the onscreen keyboard, and

the one or more criteria for entering the text selection mode include the contact on the onscreen keyboard having an intensity that exceeds a predetermined deep press intensity threshold.

24. The electronic device of claim 21, wherein the one or more programs include instructions for:

in accordance with the determination that the touch input satisfies the one or more criteria for entering the text selection mode;

visually obscuring keys on the onscreen keyboard.

25. The electronic device of claim 24, wherein visually obscuring the keys on the onscreen keyboard includes applying a blurring effect to the onscreen keyboard.

26. The electronic device of claim 24, wherein visually obscuring the keys on the onscreen keyboard includes transforming the onscreen keyboard into an onscreen touchpad.

27. The electronic device of claim 24, wherein visually obscuring the keys on the onscreen keyboard includes making the onscreen keyboard semitransparent to partially reveal content lying underneath the onscreen keyboard.

28. The electronic device of claim 21, wherein one of the first and second cursors is already displayed in the content presentation region before both of the first and second cursors are concurrently displayed in the content presentation region.

29. The electronic device of claim 21, wherein the one or more programs include instructions for:

detecting a lift-off of the touch input after detecting the movement of the touch input; and

in response to detecting the lift-off of the touch input;

ceasing to display the first cursor.

30. The electronic device of claim 29, wherein the onscreen keyboard is obscured in accordance with the determination that the touch input satisfies the one or more criteria for entering the text selection mode, and the one or more programs include instructions for:

in response to detecting the lift-off of the touch input, restoring display of the onscreen keyboard.

31. The electronic device of claim 21, wherein the device has one or more sensors to detect intensities of contacts with the touch-sensitive display, and the one or more programs include instructions for:

in the text selection mode, detecting that an intensity of a contact in the touch input exceeds a predetermined intensity threshold;

after detecting that the intensity of the contact in the touch input exceeds the predetermined intensity threshold, detecting movement of the contact in the touch input;

in response to detecting the movement of the contact in the touch input, after detecting that the intensity of the contact in the touch input exceeds the predetermined intensity threshold;

selecting a portion of the text input in accordance with the movement of the contact in the touch input.

32. The electronic device of claim 31, wherein the selected portion of the text input begins at a position of the first cursor when the detected intensity of the contact in the touch input exceeded the predetermined intensity threshold.

33. The electronic device of claim 31, wherein the one or more programs include instructions for:

detecting lift-off of the contact in the touch input after selecting the portion of the text input in accordance with the movement of the contact in the touch input; and

,

in response to detecting the lift-off of the contact in the touch input, confirming selection of the portion of the text input.

34. The electronic device of claim 31, wherein the one or more programs include instructions for:

after selecting the portion of the text input, while the portion of the text input is selected, detecting an intensity of the contact in the touch input that exceeds the predetermined intensity threshold; and

,

in response to detecting the intensity of the contact in the touch input that exceeds the predetermined intensity threshold while the portion of the text input is selected, clearing selection of the portion of the text input.

35. The electronic device of claim 31, wherein the one or more programs include instructions for:

after selecting the portion of the text input, while the portion of the text input is selected, detecting an intensity of the contact in the touch input that exceeds the predetermined intensity threshold and that is followed by lift-off of the contact without further movement of the contact; and

,

in response to detecting the intensity of the contact in the touch input that exceeds the predetermined intensity threshold and that is followed by lift-off of the contact without further movement of the contact, confirming selection of the portion of the text input.

36. The electronic device of claim 31, wherein the one or more programs include instructions for:

after selecting the portion of the text input, while the portion of the text input is selected, detecting an intensity of the contact in the touch input that exceeds the predetermined intensity threshold and that is followed by further movement of the contact; and

,

in response to detecting the intensity of the contact in the touch input that exceeds the predetermined intensity threshold and that is followed by the further movement of the contact;

clearing selection of the portion of the text input.

37. The electronic device of claim 36, wherein the one or more programs include instructions for:

in response to detecting the intensity of the contact in the touch input that exceeds the predetermined intensity threshold and that is followed by the further movement of the contact;

starting selection of a new portion of the text input in accordance with the further movement of the contact.

38. The electronic device of claim 36, wherein the one or more programs include instructions for:

in response to detecting the intensity of the contact in the touch input that exceeds the predetermined intensity threshold and that is followed by the further movement of the contact;

further moving the second cursor and the first cursor within the content presentation region in accordance with the further movement of the contact.

39. The electronic device of claim 21, wherein the device has one or more sensors to detect intensities of contacts with the touch-sensitive display, and the one or more programs include instructions for:

in the text selection mode, detecting a first local intensity peak in the touch input followed by a second local intensity peak in the touch input that both exceed a predetermined intensity threshold; and

,

in response to detecting the first local intensity peak followed by the second local intensity peak that both exceed the predetermined intensity threshold, selecting a first predetermined unit of the text input according to a current location of the first cursor.

40. The electronic device of claim 39, wherein the one or more programs include instructions for:

after detecting the first local intensity peak followed by the second local intensity peak, detecting a third consecutive local intensity peak in the touch input that exceeds the predetermined intensity threshold; and

in response to detecting the three consecutive local intensity peaks in the touch input that all exceed the predetermined deep press intensity threshold, selecting a second predetermined unit of the text input that is larger than and includes the first predetermined unit of the text input.

41. A method, comprising:

at an electronic device having one or more processors, memory, and a touch-sensitive display;

concurrently displaying an onscreen keyboard and a content presentation region on the touch-sensitive display, wherein the content presentation region displays text input received from the onscreen keyboard;

detecting a touch input on the onscreen keyboard displayed on the touch-sensitive display;

in response to detect the touch input on the onscreen keyboard displayed on the touch-sensitive display, determining whether the touch input satisfies one or more criteria for entering a text selection mode; and

in accordance with a determination that the touch input satisfies the one or more criteria for entering the text selection mode;

concurrently displaying, in the content presentation region, a first cursor at a first location and a second cursor at a second location that is different from the first location, wherein;

the second cursor moves in accordance with movement of the touch input while in the text selection mode; and

the first cursor indicates where the second cursor will be located after the touch input ends.

42. The method of claim 41, wherein the one or more criteria for entering the text selection mode include the touch input including a two-finger drag gesture over the onscreen keyboard.

43. The method of claim 41, wherein:

the device has one or more sensors to detect intensities of contacts with the touch-sensitive display;

the touch input on the touch-sensitive display includes an input by a contact on the onscreen keyboard, and

the one or more criteria for entering the text selection mode include the contact on the onscreen keyboard having an intensity that exceeds a predetermined deep press intensity threshold.

44. The method of claim 41, including:

in accordance with the determination that the touch input satisfies the one or more criteria for entering the text selection mode;

visually obscuring keys on the onscreen keyboard.

45. The method of claim 44, wherein visually obscuring the keys on the onscreen keyboard includes applying a blurring effect to the onscreen keyboard.

46. The method of claim 44, wherein visually obscuring the keys on the onscreen keyboard includes transforming the onscreen keyboard into an onscreen touchpad.

47. The method of claim 44, wherein visually obscuring the keys on the onscreen keyboard includes making the onscreen keyboard semitransparent to partially reveal content lying underneath the onscreen keyboard.

48. The method of claim 41, wherein one of the first and second cursors is already displayed in the content presentation region before both of the first and second cursors are concurrently displayed in the content presentation region.

49. The method of claim 41, including:

detecting a lift-off of the touch input after detecting the movement of the touch input; and

in response to detecting the lift-off of the touch input;

ceasing to display the first cursor.

50. The method of claim 49, wherein the onscreen keyboard is obscured in accordance with the determination that the touch input satisfies the one or more criteria for entering the text selection mode, and the method includes:

in response to detecting the lift-off of the touch input, restoring display of the onscreen keyboard.

51. The method of claim 41, wherein the device has one or more sensors to detect intensities of contacts with the touch-sensitive display, and the method includes:

in the text selection mode, detecting that an intensity of a contact in the touch input exceeds a predetermined intensity threshold;

after detecting that the intensity of the contact in the touch input exceeds the predetermined intensity threshold, detecting movement of the contact in the touch input;

in response to detecting the movement of the contact in the touch input, after detecting that the intensity of the contact in the touch input exceeds the predetermined intensity threshold;

selecting a portion of the text input in accordance with the movement of the contact in the touch input.

52. The method of claim 51, wherein the selected portion of the text input begins at a position of the first cursor when the detected intensity of the contact in the touch input exceeded the predetermined intensity threshold.

53. The method of claim 51, including:

detecting lift-off of the contact in the touch input after selecting the portion of the text input in accordance with the movement of the contact in the touch input; and

,

in response to detecting the lift-off of the contact in the touch input, confirming selection of the portion of the text input.

54. The method of claim 51, including:

after selecting the portion of the text input, while the portion of the text input is selected, detecting an intensity of the contact in the touch input that exceeds the predetermined intensity threshold; and

,

in response to detecting the intensity of the contact in the touch input that exceeds the predetermined intensity threshold while the portion of the text input is selected, clearing selection of the portion of the text input.

55. The method of claim 51, including:

after selecting the portion of the text input, while the portion of the text input is selected, detecting an intensity of the contact in the touch input that exceeds the predetermined intensity threshold and that is followed by lift-off of the contact without further movement of the contact; and

,

in response to detecting the intensity of the contact in the touch input that exceeds the predetermined intensity threshold and that is followed by lift-off of the contact without further movement of the contact, confirming selection of the portion of the text input.

56. The method of claim 51, including:

after selecting the portion of the text input, while the portion of the text input is selected, detecting an intensity of the contact in the touch input that exceeds the predetermined intensity threshold and that is followed by further movement of the contact; and

,

in response to detecting the intensity of the contact in the touch input that exceeds the predetermined intensity threshold and that is followed by the further movement of the contact;

clearing selection of the portion of the text input.

57. The method of claim 56, including:

in response to detecting the intensity of the contact in the touch input that exceeds the predetermined intensity threshold and that is followed by the further movement of the contact;

starting selection of a new portion of the text input in accordance with the further movement of the contact.

58. The method of claim 56, including:

in response to detecting the intensity of the contact in the touch input that exceeds the predetermined intensity threshold and that is followed by the further movement of the contact;

further moving the second cursor and the first cursor within the content presentation region in accordance with the further movement of the contact.

59. The method of claim 41, wherein the device has one or more sensors to detect intensities of contacts with the touch-sensitive display, and the method includes:

in the text selection mode, detecting a first local intensity peak in the touch input followed by a second local intensity peak in the touch input that both exceed a predetermined intensity threshold; and

,

in response to detecting the first local intensity peak followed by the second local intensity peak that both exceed the predetermined intensity threshold, selecting a first predetermined unit of the text input according to a current location of the first cursor.

60. The method of claim 59, including:

after detecting the first local intensity peak followed by the second local intensity peak, detecting a third consecutive local intensity peak in the touch input that exceeds the predetermined intensity threshold; and

in response to detecting the three consecutive local intensity peaks in the touch input that all exceed the predetermined deep press intensity threshold, selecting a second predetermined unit of the text input that is larger than and includes the first predetermined unit of the text input.