Methods and graphical user interfaces for editing on a multifunction device with a touch screen display

• US 9,846,533 B2
• Filed: 09/24/2009
• Issued: 12/19/2017
• Est. Priority Date: 03/16/2009
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Ording, Bas, Kocienda, Kenneth L., Moore, Bradford Allen, van Os, Marcel, Williamson, Richard, Forstall, Scott
• Primary Examiner(s): Vu, Kieu
• Assistant Examiner(s): CHAUDHURI, ANITA
• Application Number:
  US12/565,754
• Publication Number:
  US 20100235793A1
• Time in Patent Office: 3,008 Days
• Field of Search: 715760, 715762, 715763, 715764, 715765, 715766, 715773, 715778, 715864, 715865, 715866
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 2203/04805 Virtual magnifying lens, i.e. window or frame movable on top of displayed information to enlarge it for better reading or selection
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: H04M 1/72436 for text messaging, e.g. short messaging services [SMS] or e-mails
• CPC Class Codes: H04M 1/72445 for supporting Internet browser applications
• CPC Class Codes: H04M 2250/22 including a touch pad, a touch sensor or a touch detector digitizers for touch screens G06F3/041
• CPC Class Codes: H04M 2250/70 methods for entering alphabetical characters, e.g. multi-tap or dictionary disambiguation methods for entering alphabetical characters per se G06F3/0237

Abstract

In some embodiments, a device displays content on a touch screen display and detects input by finger gestures. In response to the finger gestures, the device selects content, visually distinguishes the selected content, and/or updates the selected content based on detected input. In some embodiments, the device displays a command display area that includes one or more command icons; detects activation of a command icon in the command display area; and, in response to detecting activation of the command icon in the command display area, performs a corresponding action with respect to the selected content. Exemplary actions include cutting, copying, and pasting content.

Claims

1. A method, comprising:

at a multifunction device with a touch screen display;

displaying content on the touch screen display;

detecting one or more fingers on the touch screen display;

recognizing a gesture made by the one or more fingers on the touch screen display, wherein the gesture is one gesture in a plurality of predefined gestures operable to select or assist in selecting a portion of the content;

performing an action with respect to the content in response to recognizing the gesture;

wherein;

the gesture is a stationary pressing gesture by two fingers on the touch screen display that includes contact by a first finger at a first location in the content and concurrent contact by a second finger at a second location in the content;

in response to recognizing the stationary pressing gesture by two fingers;

selecting a portion of content located between the first location and the second location; and

displaying a start-point object and an end-point object at respective ends of the selected portion of content located between the first location and the second location; and

after selecting the portion of content located between the first location and the second location;

continuing to detect the stationary pressing gesture by the two fingers on the touch screen display for at least a predefined time period; and

,

in response to continuing to detect the stationary pressing gesture by the two fingers for at least the predefined time period;

increasing the selected portion of content to a sentence, wherein the sentence contains the portion of content located between the first location and the second location; and

displaying the start-point object and the end-point object at respective ends of the sentence.

2. A method, comprising:

at a multifunction device with a touch screen display;

displaying content on the touch screen display;

detecting one or more fingers on the touch screen display;

recognizing a gesture made by the one or more fingers on the touch screen display, wherein the gesture is one gesture in a plurality of predefined gestures operable to select or assist in selecting a portion of the content;

performing an action with respect to the content in response to recognizing the gesture;

wherein;

the gesture is a stationary pressing gesture by two fingers on the touch screen display that includes contact by a first finger at a first location in the content and concurrent contact by a second finger at a second location in the content;

in response to recognizing the stationary pressing gesture by two fingers;

selecting a portion of content located between the first location and the second location; and

displaying a start-point object and an end-point object at respective ends of the selected portion of content located between the first location and the second location; and

after selecting the portion of content located between the first location and the second location;

continuing to detect the stationary pressing gesture by the two fingers on the touch screen display for at least a predefined time period; and

,

in response to continuing to detect the stationary pressing gesture by the two fingers for at least the predefined time period;

increasing the selected portion of content to a paragraph, wherein the paragraph contains the portion of content located between the first location and the second location; and

displaying the start-point object and the end-point object at respective ends of the paragraph.

3. A method, comprising:

at a multifunction device with a touch screen display;

displaying content on the touch screen display;

detecting one or more fingers on the touch screen display;

recognizing a gesture made by the one or more fingers on the touch screen display, wherein the gesture is one gesture in a plurality of predefined gestures operable to select or assist in selecting a portion of the content;

performing an action with respect to the content in response to recognizing the gesture;

wherein;

the gesture is a stationary pressing gesture by two fingers on the touch screen display that includes contact by a first finger at a first location in the content and concurrent contact by a second finger at a second location in the content;

in response to recognizing the stationary pressing gesture by two fingers;

selecting a portion of content located between the first location and the second location; and

displaying a start-point object and an end-point object at respective ends of the selected portion of content located between the first location and the second location; and

after selecting the portion of content located between the first location and the second location;

continuing to detect the stationary pressing gesture by the two fingers on the touch screen display for at least a predefined time period; and

,

in response to continuing to detect the stationary pressing gesture by the two fingers for at least the predefined time period;

selecting all of the content; and

displaying the start-point object and the end-point object at respective ends of the content.

4. A method, comprising:

at a multifunction device with a touch screen display;

displaying content on the touch screen display;

detecting one or more fingers on the touch screen display;

recognizing a gesture made by the one or more fingers on the touch screen display, wherein the gesture is one gesture in a plurality of predefined gestures operable to select or assist in selecting a portion of the content;

performing an action with respect to the content in response to recognizing the gesture;

wherein;

the gesture is a stationary pressing gesture by two fingers on the touch screen display that includes contact by a first finger at a first location in the content and concurrent contact by a second finger at a second location in the content;

in response to recognizing the stationary pressing gesture by two fingers;

selecting a portion of content located between the first location and the second location; and

displaying a start-point object and an end-point object at respective ends of the selected portion of content located between the first location and the second location; and

after selecting the portion of content located between the first location and the second location;

continuing to detect the stationary pressing gesture by the two fingers on the touch screen display for a succession of predefined time periods; and

,

in response to continuing to detect the stationary pressing gesture by the two fingers for each time period in the succession of predefined time periods;

increasing the selected portion of content, wherein the increased selected portion of content contains the portion of content located between the first location and the second location; and

displaying the start-point object and the end-point object at respective ends of the increased selected portion of content.

5. A method, comprising:

at a multifunction device with a touch screen display;

displaying content on the touch screen display;

detecting one or more fingers on the touch screen display;

recognizing a gesture made by the one or more fingers on the touch screen display, wherein the gesture is one gesture in a plurality of predefined gestures operable to select or assist in selecting a portion of the content;

performing an action with respect to the content in response to recognizing the gesture;

wherein;

the gesture is a margin-initiated selection gesture by a single finger, wherein the margin-initiated selection gesture is a single-finger gesture that comprises an initial finger contact outside the content in a margin adjacent to a word in the content followed by movement of the finger contact to a location in the content;

in response to recognizing the margin-initiated selection gesture by the single finger;

selecting a portion of the content, wherein the word begins or ends the selected portion of content; and

updating the selected portion of the content in accordance with movement of the finger contact to the location in the content.

6. A method, comprising:

at a multifunction device with a touch screen display;

displaying content on the touch screen display;

detecting one or more fingers on the touch screen display;

recognizing a gesture made by the one or more fingers on the touch screen display, wherein the gesture is one gesture in a plurality of predefined gestures operable to select or assist in selecting a portion of the content;

performing an action with respect to the content in response to recognizing the gesture;

wherein;

the content is configured to scroll vertically, but not horizontally, on the touch screen display;

the gesture is a swipe-initiated selection gesture by a single finger, wherein the swipe-initiated selection gesture is a single-finger gesture that comprises;

a finger contact initially at a first location in the content, wherein the finger contact is initially moving in a direction within a predefined angle of a horizontal axis on the touch screen display and the finger contact moves with an initial speed above a predefined threshold initial speed, and

movement of the finger contact to a second location in the content;

in response to recognizing the swipe-initiated selection gesture by the single finger;

selecting a portion of the content, wherein the first location begins or ends the selected portion of content; and

updating the selected portion of the content in accordance with the movement of the finger contact to the second location in the content.

7. The method of claim 6, including:

displaying a start-point object and an end-point object at respective ends of the updated selected portion of the content.

8. The method of claim 6, including:

in response to detecting lift off of the finger contact;

displaying a command display area adjacent to the updated selected portion of the content, wherein the command display area includes an icon for copying selected content.

9. A multifunction device, comprising:

a touch screen display;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying content on the touch screen display;

detecting one or more fingers on the touch screen display;

recognizing a gesture made by the one or more fingers on the touch screen display, wherein the gesture is one gesture in a plurality of predefined gestures operable to select or assist in selecting a portion of the content;

performing an action with respect to the content in response to recognizing the gesture;

wherein;

the gesture is a stationary pressing gesture by two fingers on the touch screen display that includes contact by a first finger at a first location in the content and concurrent contact by a second finger at a second location in the content;

in response to recognizing the stationary pressing gesture by two fingers;

selecting a portion of content located between the first location and the second location; and

displaying a start-point object and an end-point object at respective ends of the selected portion of content located between the first location and the second location; and

after selecting the portion of content located between the first location and the second location;

continuing to detect the stationary pressing gesture by the two fingers on the touch screen display for at least a predefined time period; and

,

in response to continuing to detect the stationary pressing gesture by the two fingers for at least the predefined time period;

increasing the selected portion of content to a sentence, wherein the sentence contains the portion of content located between the first location and the second location; and

displaying the start-point object and the end-point object at respective ends of the sentence.

10. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a multifunction device with a touch screen display, cause the device to:

display content on the touch screen display;

detect one or more fingers on the touch screen display;

recognize a gesture made by the one or more fingers on the touch screen display, wherein the gesture is one gesture in a plurality of predefined gestures operable to select or assist in selecting a portion of the content;

perform an action with respect to the content in response to recognizing the gesture wherein;

the gesture is a stationary pressing gesture by two fingers on the touch screen display that includes contact by a first finger at a first location in the content and concurrent contact by a second finger at a second location in the content;

in response to recognizing the stationary pressing gesture by two fingers;

select a portion of content located between the first location and the second location; and

display a start-point object and an end-point object at respective ends of the selected portion of content located between the first location and the second location; and

after selecting the portion of content located between the first location and the second location;

continue to detect the stationary pressing gesture by the two fingers on the touch screen display for at least a predefined time period; and

,

in response to continuing to detect the stationary pressing gesture by the two fingers for at least the predefined time period;

increase the selected portion of content to a sentence, wherein the sentence contains the portion of content located between the first location and the second location; and

display the start-point object and the end-point object at respective ends of the sentence.

11. A multifunction device, comprising:

a touch screen display;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying content on the touch screen display;

detecting one or more fingers on the touch screen display;

recognizing a gesture made by the one or more fingers on the touch screen display, wherein the gesture is one gesture in a plurality of predefined gestures operable to select or assist in selecting a portion of the content;

performing an action with respect to the content in response to recognizing the gesture;

wherein;

the gesture is a stationary pressing gesture by two fingers on the touch screen display that includes contact by a first finger at a first location in the content and concurrent contact by a second finger at a second location in the content;

in response to recognizing the stationary pressing gesture by two fingers;

selecting a portion of content located between the first location and the second location; and

displaying a start-point object and an end-point object at respective ends of the selected portion of content located between the first location and the second location; and

after selecting the portion of content located between the first location and the second location;

continuing to detect the stationary pressing gesture by the two fingers on the touch screen display for at least a predefined time period; and

,

in response to continuing to detect the stationary pressing gesture by the two fingers for at least the predefined time period;

increasing the selected portion of content to a paragraph, wherein the paragraph contains the portion of content located between the first location and the second location; and

displaying the start-point object and the end-point object at respective ends of the paragraph.

12. A multifunction device, comprising:

a touch screen display;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying content on the touch screen display;

detecting one or more fingers on the touch screen display;

recognizing a gesture made by the one or more fingers on the touch screen display, wherein the gesture is one gesture in a plurality of predefined gestures operable to select or assist in selecting a portion of the content;

performing an action with respect to the content in response to recognizing the gesture;

wherein;

the gesture is a stationary pressing gesture by two fingers on the touch screen display that includes contact by a first finger at a first location in the content and concurrent contact by a second finger at a second location in the content;

in response to recognizing the stationary pressing gesture by two fingers;

selecting a portion of content located between the first location and the second location; and

displaying a start-point object and an end-point object at respective ends of the selected portion of content located between the first location and the second location; and

after selecting the portion of content located between the first location and the second location;

continuing to detect the stationary pressing gesture by the two fingers on the touch screen display for at least a predefined time period; and

,

in response to continuing to detect the stationary pressing gesture by the two fingers for at least the predefined time period;

selecting all of the content; and

displaying the start-point object and the end-point object at respective ends of the content.

13. A multifunction device, comprising:

a touch screen display;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying content on the touch screen display;

detecting one or more fingers on the touch screen display;

recognizing a gesture made by the one or more fingers on the touch screen display, wherein the gesture is one gesture in a plurality of predefined gestures operable to select or assist in selecting a portion of the content;

performing an action with respect to the content in response to recognizing the gesture;

wherein;

the gesture is a stationary pressing gesture by two fingers on the touch screen display that includes contact by a first finger at a first location in the content and concurrent contact by a second finger at a second location in the content;

in response to recognizing the stationary pressing gesture by two fingers;

selecting a portion of content located between the first location and the second location; and

displaying a start-point object and an end-point object at respective ends of the selected portion of content located between the first location and the second location; and

after selecting the portion of content located between the first location and the second location;

continuing to detect the stationary pressing gesture by the two fingers on the touch screen display for a succession of predefined time periods; and

,

in response to continuing to detect the stationary pressing gesture by the two fingers for each time period in the succession of predefined time periods;

increasing the selected portion of content, wherein the increased selected portion of content contains the portion of content located between the first location and the second location; and

displaying the start-point object and the end-point object at respective ends of the increased selected portion of content.

14. A multifunction device, comprising:

a touch screen display;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying content on the touch screen display;

detecting one or more fingers on the touch screen display;

recognizing a gesture made by the one or more fingers on the touch screen display, wherein the gesture is one gesture in a plurality of predefined gestures operable to select or assist in selecting a portion of the content;

performing an action with respect to the content in response to recognizing the gesture;

wherein;

the gesture is a margin-initiated selection gesture by a single finger, wherein the margin-initiated selection gesture is a single-finger gesture that comprises an initial finger contact outside the content in a margin adjacent to a word in the content followed by movement of the finger contact to a location in the content;

in response to recognizing the margin-initiated selection gesture by the single finger;

selecting a portion of the content, wherein the word begins or ends the selected portion of content; and

updating the selected portion of the content in accordance with movement of the finger contact to the location in the content.

15. A multifunction device, comprising:

a touch screen display;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying content on the touch screen display;

detecting one or more fingers on the touch screen display;

recognizing a gesture made by the one or more fingers on the touch screen display, wherein the gesture is one gesture in a plurality of predefined gestures operable to select or assist in selecting a portion of the content;

performing an action with respect to the content in response to recognizing the gesture;

wherein;

the content is configured to scroll vertically, but not horizontally, on the touch screen display;

the gesture is a swipe-initiated selection gesture by a single finger, wherein the swipe-initiated selection gesture is a single-finger gesture that comprises;

a finger contact initially at a first location in the content, wherein the finger contact is initially moving in a direction within a predefined angle of a horizontal axis on the touch screen display and the finger contact moves with an initial speed above a predefined threshold initial speed, and

movement of the finger contact to a second location in the content;

in response to recognizing the swipe-initiated selection gesture by the single finger;

selecting a portion of the content, wherein the first location begins or ends the selected portion of content; and

updating the selected portion of the content in accordance with the movement of the finger contact to the second location in the content.

16. The device of claim 15, including instructions for:

displaying a start-point object and an end-point object at respective ends of the updated selected portion of the content.

17. The device of claim 15, including instructions for:

in response to detecting lift off of the finger contact;

displaying a command display area adjacent to the updated selected portion of the content, wherein the command display area includes an icon for copying selected content.

18. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a multifunction device with a touch screen display, cause the device to:

display content on the touch screen display;

detect one or more fingers on the touch screen display;

recognize a gesture made by the one or more fingers on the touch screen display, wherein the gesture is one gesture in a plurality of predefined gestures operable to select or assist in selecting a portion of the content;

perform an action with respect to the content in response to recognizing the gesture;

wherein;

the gesture is a stationary pressing gesture by two fingers on the touch screen display that includes contact by a first finger at a first location in the content and concurrent contact by a second finger at a second location in the content;

in response to recognizing the stationary pressing gesture by two fingers;

select a portion of content located between the first location and the second location; and

display a start-point object and an end-point object at respective ends of the selected portion of content located between the first location and the second location; and

after selecting the portion of content located between the first location and the second location;

continue to detect the stationary pressing gesture by the two fingers on the touch screen display for at least a predefined time period; and

,

in response to continuing to detect the stationary pressing gesture by the two fingers for at least the predefined time period;

increase the selected portion of content to a paragraph, wherein the paragraph contains the portion of content located between the first location and the second location; and

display the start-point object and the end-point object at respective ends of the paragraph.

19. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a multifunction device with a touch screen display, cause the device to:

display content on the touch screen display;

detect one or more fingers on the touch screen display;

recognize a gesture made by the one or more fingers on the touch screen display, wherein the gesture is one gesture in a plurality of predefined gestures operable to select or assist in selecting a portion of the content;

perform an action with respect to the content in response to recognizing the gesture;

wherein;

the gesture is a stationary pressing gesture by two fingers on the touch screen display that includes contact by a first finger at a first location in the content and concurrent contact by a second finger at a second location in the content;

in response to recognizing the stationary pressing gesture by two fingers;

select a portion of content located between the first location and the second location; and

display a start-point object and an end-point object at respective ends of the selected portion of content located between the first location and the second location; and

after selecting the portion of content located between the first location and the second location;

continue to detect the stationary pressing gesture by the two fingers on the touch screen display for at least a predefined time period; and

,

in response to continuing to detect the stationary pressing gesture by the two fingers for at least the predefined time period;

select all of the content; and

display the start-point object and the end-point object at respective ends of the content.

20. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a multifunction device with a touch screen display, cause the device to:

display content on the touch screen display;

detect one or more fingers on the touch screen display;

recognize a gesture made by the one or more fingers on the touch screen display, wherein the gesture is one gesture in a plurality of predefined gestures operable to select or assist in selecting a portion of the content;

perform an action with respect to the content in response to recognizing the gesture;

wherein;

the gesture is a stationary pressing gesture by two fingers on the touch screen display that includes contact by a first finger at a first location in the content and concurrent contact by a second finger at a second location in the content;

in response to recognizing the stationary pressing gesture by two fingers;

select a portion of content located between the first location and the second location; and

display a start-point object and an end-point object at respective ends of the selected portion of content located between the first location and the second location; and

after selecting the portion of content located between the first location and the second location;

continue to detect the stationary pressing gesture by the two fingers on the touch screen display for a succession of predefined time periods; and

,

in response to continuing to detect the stationary pressing gesture by the two fingers for each time period in the succession of predefined time periods;

increase the selected portion of content, wherein the increased selected portion of content contains the portion of content located between the first location and the second location; and

display the start-point object and the end-point object at respective ends of the increased selected portion of content.

21. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a multifunction device with a touch screen display, cause the device to:

display content on the touch screen display;

detect one or more fingers on the touch screen display;

recognize a gesture made by the one or more fingers on the touch screen display, wherein the gesture is one gesture in a plurality of predefined gestures operable to select or assist in selecting a portion of the content;

perform an action with respect to the content in response to recognizing the gesture;

wherein;

the gesture is a margin-initiated selection gesture by a single finger, wherein the margin-initiated selection gesture is a single-finger gesture that comprises an initial finger contact outside the content in a margin adjacent to a word in the content followed by movement of the finger contact to a location in the content;

in response to recognizing the margin-initiated selection gesture by the single finger;

selecting a portion of the content, wherein the word begins or ends the selected portion of content; and

updating the selected portion of the content in accordance with movement of the finger contact to the location in the content.

22. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a multifunction device with a touch screen display, cause the device to:

display content on the touch screen display;

detect one or more fingers on the touch screen display;

recognize a gesture made by the one or more fingers on the touch screen display, wherein the gesture is one gesture in a plurality of predefined gestures operable to select or assist in selecting a portion of the content;

perform an action with respect to the content in response to recognizing the gesture;

wherein;

the content is configured to scroll vertically, but not horizontally, on the touch screen display;

the gesture is a swipe-initiated selection gesture by a single finger, wherein the swipe-initiated selection gesture is a single-finger gesture that comprises;

a finger contact initially at a first location in the content, wherein the finger contact is initially moving in a direction within a predefined angle of a horizontal axis on the touch screen display and the finger contact moves with an initial speed above a predefined threshold initial speed, and

movement of the finger contact to a second location in the content;

in response to recognizing the swipe-initiated selection gesture by the single finger;

select a portion of the content, wherein the first location begins or ends the selected portion of content; and

update the selected portion of the content in accordance with the movement of the finger contact to the second location in the content.

23. The computer readable storage medium of claim 22, including instructions that cause the device to:

display a start-point object and an end-point object at respective ends of the updated selected portion of the content.

24. The computer readable storage medium of claim 22, including instructions that cause the device to:

in response to detecting lift off of the finger contact;

display a command display area adjacent to the updated selected portion of the content, wherein the command display area includes an icon for copying selected content.