Touch Input Cursor Manipulation

• US 20160274761A1
• Filed: 09/24/2015
• Published: 09/22/2016
• Est. Priority Date: 03/19/2015
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Jong, Nicholas K., Alonso Ruiz, Marcos, Lemay, Stephen O., Jon, Tiffany S., King, Nicholas V., Chaudhri, Imran A., Coffman, Patrick L., Winer, Morgan H.
• Granted Patent: US 9,785,305 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

The method for manipulating a cursor is performed at a portable multifunction device with one or more processors, memory, and a touch screen display. Initially, content of an electronic document is displayed on the display, where a cursor is displayed within the electronic document. Two substantially simultaneous touch inputs are then detected on the touch screen display, and preferably anywhere on the touch screen display. In response to detecting the two substantially simultaneous touch inputs, a portion of the content in the document closest to the cursor is selected, and the portion of the content is displayed as selected content.

Claims

1. A method, comprising:

at an electronic device having one or more processors, memory, a touch-sensitive display, and one or more sensors to detect intensities of contacts with the touch-sensitive display;

concurrently displaying an onscreen keyboard and a content presentation region on the touch-sensitive display, wherein the content presentation region displays text input received from the onscreen keyboard;

detecting a touch input on the onscreen keyboard displayed on the touch-sensitive display, wherein detecting the touch input includes detecting movement of a contact and liftoff of the contact;

in response to detecting the touch input on the onscreen keyboard displayed on the touch-sensitive display;

in accordance with a determination that the touch input on the onscreen keyboard satisfies text-selection criteria, wherein the text-selection criteria include a criterion that is met when a characteristic intensity of the contact increases above a text-selection intensity threshold, performing a text selection operation based on the movement of the contact; and

,

in accordance with a determination that the touch input on the onscreen keyboard satisfies text-entry criteria, wherein the text-entry criteria include a criterion that is met when the characteristic intensity of the contact does not increase above the text-selection intensity threshold, entering text into the content presentation region based on the touch input.

3. The method of claim 1, wherein the text-entry criteria include a criterion that is met when the contact does not move outside of the onscreen keyboard before liftoff of the contact is detected.

6. The method of claim 1, wherein the text-selection criteria include a criterion that is met when the contact does not move more than a threshold distance before detecting an increase in the characteristic intensity of the contact above the text-selection intensity threshold.

7. The method of claim 1, wherein the text-selection operation includes one of:

moving a cursor within the content region or selecting text within the content region.

8. The method of claim 1, including, in response to detecting that the text-selection criteria have been met, generating a tactile output that is indicative of an entry into a text selection mode of operation.

9. The method of claim 1, including, in response to detecting that the text-selection criteria have been met, changing an appearance of the onscreen keyboard to indicate that the device is operating in a text selection mode of operation, wherein changing the appearance of the onscreen keyboard includes maintaining display of the keys in the onscreen keyboard while obscuring characters displayed on the keys of the onscreen keyboard.

10. The method of claim 9, including ending the text selection mode of operation and, in conjunction with the end of the text selection mode of operation, reversing the change in appearance of the onscreen keyboard to reveal the characters on the keys of the onscreen keyboard.

11. The method of claim 1, including, when the touch input satisfies the text-selection criteria, detecting movement of the contact after the touch input has satisfied the text-selection criteria and moving a cursor in the content region in accordance with the movement of the contact detected after the touch input has satisfied the text-selection criteria.

12. The method of claim 1, including:

when the touch input satisfies the text-selection criteria, detecting a first subsequent change in the characteristic intensity of the contact followed by additional movement of the contact on the touch-sensitive display; and

,

in response to detecting the first subsequent change in the characteristic intensity of the contact;

in accordance with a determination that the touch input satisfies selection-start criteria, wherein the selection-start criteria include a criterion that is met when the characteristic intensity of the contact increases above a selection-start intensity threshold, starting to select content in the content region at a location of a cursor in accordance with the additional movement of the contact; and

in accordance with a determination that the touch input does not satisfy the selection-start criteria, moving the cursor in accordance with the additional movement of the contact without starting to select content in the content region.

13. The method of claim 12, including when the touch input satisfies selection-start criteria, after starting to select content in the content region, detecting liftoff of the contact from the touch-sensitive display and confirming the selection in response to detecting the liftoff of the contact.

14. The method of claim 12, including:

when the touch input satisfies selection-start criteria, after starting to select content in the content region, and while continuing to detect the contact on the touch-sensitive display, detecting a second subsequent change in intensity of the contact;

in response to detecting the second subsequent change in the characteristic intensity of the contact;

in accordance with a determination that the second subsequent change in the characteristic intensity of the contact satisfies selection-cancellation criteria, wherein the selection-cancellation criteria include a criterion that is met when the characteristic intensity of the contact increases above a selection-cancellation intensity threshold cancelling the selection; and

in accordance with a determination that the second subsequent change in the characteristic intensity of the contact does not satisfy the selection-cancellation criteria, maintaining the selection.

15. The method of claim 14, wherein the selection-cancellation criterion include a criterion that is met when the contact moves no more than a threshold distance within a threshold amount of time before the characteristic intensity of the contact increases above the selection-cancellation intensity threshold.

16. The method of claim 14, including, in response to detecting that the selection-cancellation criteria have been met, generating a tactile output that is indicative of an exit from the text selection mode of operation.

17. The method of claim 14, including:

after canceling the selection, and while continuing to detect the contact on the touch-sensitive display, detecting a third subsequent change in the characteristic intensity of the contact; and

,

in response to detecting the third subsequent change in the characteristic intensity of the contact;

in accordance with a determination that the touch input satisfies the selection-start criteria, starting to select content in the content region at a location of the cursor; and

in accordance with a determination that the touch input does not satisfy the selection-start criteria, forgoing starting to select content in the content region.

18. The method of claim 17, wherein starting to select content in response to detecting the third subsequent change in the characteristic intensity of the contact includes selecting a respective word at the location of the cursor.

19. The method of claim 18, wherein the selected respective word is a first word, and the method includes:

while the first word is selected, detecting first subsequent movement of the contact; and

in response to detecting the first subsequent movement of the contact while the first word is selected;

in accordance with a determination that the touch input meets selection-movement criteria which includes a movement criterion that is met when the contact moves more than a respective threshold amount;

canceling selection of the first word; and

selecting a second word that is adjacent to the first word in a first direction in accordance with the first subsequent movement of the contact, such that the selected respective word is the second word.

20. The method of claim 18, including:

while the respective word is selected, detecting first subsequent movement of the contact; and

in response to detecting the first subsequent movement of the contact while the respective word is selected;

in accordance with a determination that the touch input meets selection-expansion criteria which includes a movement criterion that is met when the contact moves more than a respective threshold amount, expanding the selection to include a word that is adjacent to the respective word in a first direction in accordance with the first subsequent movement of the contact.

21. The method of claim 18, including:

while the respective word is selected, detecting a fourth subsequent change in the characteristic intensity of the contact above a respective intensity threshold; and

,

in response to detecting the fourth subsequent change in the characteristic intensity of the contact, in accordance with a determination that the touch input meets the selection-cancellation criteria, which includes a criterion that is met when the amount of time between when the third subsequent change in the characteristic intensity of the contact is detected and when the fourth subsequent change in the characteristic intensity of the contact is detected is greater than the delay threshold, cancelling selection of the respective word.

22. The method of claim 18, including:

while the respective word is selected, detecting a fourth subsequent change in the characteristic intensity of the contact above a respective intensity threshold; and

,

in response to detecting the fourth subsequent change in the characteristic intensity of the contact, in accordance with a determination that the touch input meets sentence-selection criteria which include

a movement criterion that is met when the contact moves less than a threshold amount within a threshold time period before the fourth subsequent change in intensity of the contact was detected and

a time criterion that is met when an amount of time between when the third subsequent change in the characteristic intensity of the contact is detected and when the fourth subsequent change in the characteristic intensity of the contact is detected is less than a delay threshold,

expanding the selection to include the respective sentence that contains the respective word.

23. The method of claim 22, including:

while the respective sentence is selected, detecting second subsequent movement of the contact; and

in response to detecting the second subsequent movement of the contact while the respective sentence is selected;

in accordance with a determination that the touch input meets selection-expansion criteria which includes a movement criterion that is met when the contact moves more than a respective threshold amount, expanding the selection to include a sentence that is adjacent to the respective sentence in a first direction in accordance with the second subsequent movement of the contact

24. The method of claim 22, wherein the respective sentence is selected in response to the fourth subsequent change in the characteristic intensity of the contact and the method includes, while the respective sentence is selected:

detecting a fifth subsequent change in the characteristic intensity of the contact above the respective intensity threshold; and

,

in response to detecting the fifth subsequent change in the characteristic intensity of the contact, in accordance with a determination that the touch input meets the selection-cancellation criteria, which includes a criterion that is met when the amount of time between when the fourth subsequent change in the characteristic intensity of the contact is detected and when the fifth subsequent change in the characteristic intensity of the contact is detected is greater than the delay threshold, cancelling selection of the respective sentence.

25. The method of claim 24, including:

in response to detecting the fifth subsequent change in the characteristic intensity of the contact, in accordance with a determination that the touch input meets paragraph-selection criteria which include

a movement criterion that is met when the contact moves less than the threshold amount within the threshold time period before the fifth subsequent change in intensity of the contact was detected and

a time criterion that is met when an amount of time between when the fourth subsequent change in the characteristic intensity of the contact is detected and when the fifth subsequent change in the characteristic intensity of the contact is detected is less than the delay threshold,

expanding the selection to include the respective paragraph that contains the respective sentence.

26. The method of claim 25, including:

while the respective paragraph is selected, detecting third subsequent movement of the contact; and

in response to detecting the third subsequent movement of the contact while the respective paragraph is selected;

in accordance with a determination that the touch input meets selection-expansion criteria which includes a movement criterion that is met when the contact moves more than a respective threshold amount, expanding the selection to include a paragraph that is adjacent to the respective paragraph in a first direction in accordance with the third subsequent movement of the contact

27. The method of claim 26, wherein the respective paragraph is selected in response to the fifth subsequent change in the characteristic intensity of the contact and the method includes, while the respective paragraph is selected:

detecting a sixth subsequent change in the characteristic intensity of the contact above the respective intensity threshold; and

,

in response to detecting the sixth subsequent change in the characteristic intensity of the contact, in accordance with a determination that the touch input meets selection-cancellation criteria, which includes a criterion that is met when the amount of time between when the fifth subsequent change in the characteristic intensity of the contact is detected and when the sixth subsequent change in the characteristic intensity of the contact is detected is greater than the delay threshold, cancelling selection of the respective paragraph.

28. The method of claim 27, including:

in response to detecting the sixth subsequent change in the characteristic intensity of the contact, in accordance with a determination that the touch input meets document selection criteria which include

a movement criterion that is met when the contact moves less than the threshold amount within the threshold time period before the sixth subsequent change in intensity of the contact was detected and

a time criterion that is met when an amount of time between when the fifth subsequent change in the characteristic intensity of the contact is detected and when the sixth subsequent change in the characteristic intensity of the contact is detected is less than the delay threshold,

expanding the selection to include the respective document that contains the respective paragraph.

31. The method of claim 1, wherein performing the text selection operation based on the movement of the contact in accordance with a determination that the touch input satisfies text-selection criteria includes:

in response to detecting an increase in the characteristic intensity of the contact above the text-selection intensity threshold, changing an appearance of the onscreen keyboard;

in response to detecting movement of the contact while the appearance of the onscreen keyboard has been changed, performing the text selection operation based on the movement; and

,

in response to detecting liftoff of the contact from the touch-sensitive display, reversing the change in appearance of the onscreen keyboard that occurred in response to detecting the increase in the characteristic intensity of the contact above the text-selection intensity threshold.

32. The method of claim 1, wherein the contact in the touch input is a continuously detected contact and touchdown of the contact is detected at a location of a character key in the onscreen keyboard.

2. (canceled)

4. (canceled)

5. (canceled)

29. An electronic device, comprising:

a touch-sensitive display;

one or more sensors to detect intensities of contacts with the touch-sensitive display;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

concurrently displaying an onscreen keyboard and a content presentation region on the touch-sensitive display, wherein the content presentation region displays text input received from the onscreen keyboard;

detecting a touch input on the onscreen keyboard displayed on the touch-sensitive display, wherein detecting the touch input includes detecting movement of a contact and liftoff of the contact;

in response to detecting the touch input on the onscreen keyboard displayed on the touch-sensitive display;

in accordance with a determination that the touch input satisfies text-selection criteria, wherein the text-selection criteria include a criterion that is met when a characteristic intensity of the contact increases above a text-selection intensity threshold, performing a text selection operation based on the movement of the contact; and

in accordance with a determination that the touch input satisfies text-entry criteria, wherein the text-entry criteria include a criterion that is met when the characteristic intensity of the contact does not increase above the text-selection intensity threshold, entering text into the content presentation region based on the touch input.

30. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with a touch-sensitive display and one or more sensors to detect intensities of contacts with the touch-sensitive display, cause the device to:

concurrently display an onscreen keyboard and a content presentation region on the touch-sensitive display, wherein the content presentation region displays text input received from the onscreen keyboard;

detect a touch input on the onscreen keyboard displayed on the touch-sensitive display, wherein detecting the touch input includes detecting movement of a contact and liftoff of the contact;

in response to detecting the touch input on the onscreen keyboard displayed on the touch-sensitive display;

in accordance with a determination that the touch input satisfies text-selection criteria, wherein the text-selection criteria include a criterion that is met when a characteristic intensity of the contact increases above a text-selection intensity threshold, perform a text selection operation based on the movement of the contact; and

,

in accordance with a determination that the touch input satisfies text-entry criteria, wherein the text-entry criteria include a criterion that is met when the characteristic intensity of the contact does not increase above the text-selection intensity threshold, enter text into the content presentation region based on the touch input.

33. A computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with a touch-sensitive display and one or more sensors to detect intensities of contacts with the touch-sensitive display, cause the device to:

concurrently display an onscreen keyboard and a content presentation region on the touch-sensitive display, wherein the content presentation region displays text input received from the onscreen keyboard;

detect a touch input by a contact on the onscreen keyboard displayed on the touch-sensitive display, wherein detecting the touch input includes

detecting touchdown of the contact at a location of a character key in the onscreen keyboard,

detecting movement of the contact on the onscreen keyboard displayed on the touch-sensitive display, and

detecting liftoff of the contact from the touch-sensitive display;

in response to detecting the touch input by the contact on the onscreen keyboard displayed on the touch-sensitive display;

in accordance with a determination that the touch input on the onscreen keyboard satisfies text-selection criteria, wherein the text-selection criteria include a criterion that is met when a characteristic intensity of the contact increases above a text-selection intensity threshold, perform a text selection operation based on the movement of the contact on the onscreen keyboard displayed on the touch-sensitive display, wherein performing the text selection operation includes;

in response to detecting an increase in the characteristic intensity of the contact above the text-selection intensity threshold, changing an appearance of the onscreen keyboard;

in response to detecting movement of the contact on the onscreen keyboard while the appearance of the onscreen keyboard has been changed, performing the text selection operation based on the movement of the contact; and

,

in response to detecting liftoff of the contact from the touch-sensitive display, reversing the change in appearance of the onscreen keyboard that occurred in response to detecting the increase in the characteristic intensity of the contact above the text-selection intensity threshold; and

,

in accordance with a determination that the touch input on the onscreen keyboard satisfies text-entry criteria, wherein the text-entry criteria include a criterion that is met when the characteristic intensity of the contact does not increase above the text-selection intensity threshold, enter text into the content presentation region based on the touch input.