Portable multifunction device, method, and graphical user interface for interacting with user input elements in displayed content

• US 8,451,232 B2
• Filed: 12/19/2007
• Issued: 05/28/2013
• Est. Priority Date: 01/07/2007
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Tolmasky, Francisco Ryan, Williamson, Richard, Coleman, Patricia J., Blumenberg, Chris, Dunn, Corbin Robert, Lemay, Stephen O., Van Os, Marcel
• Primary Examiner(s): Shalwala, Bipin
• Assistant Examiner(s): SPAR, ILANA L
• Application Number:
  US11/960,394
• Publication Number:
  US 20080165143A1
• Time in Patent Office: 1,987 Days
• Field of Search: 345173-178, 715708-716, 715/810, 715812-814, 715/859, 715/773
• US Class Current: 345/173
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04855 Interaction with scrollbars
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04M 1/27475 using interactive graphical means or pictorial representations
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 1/72427 for supporting games or graphical animations
• CPC Class Codes: H04M 1/7243 with interactive means for internal management of messages
• CPC Class Codes: H04M 1/72445 for supporting Internet browser applications
• CPC Class Codes: H04M 2250/22 including a touch pad, a touch sensor or a touch detector digitizers for touch screens G06F3/041

Abstract

In one aspect of the invention, a computer-implemented method in a portable multifunction device with a touch screen display includes: displaying content on the touch screen display, wherein the content includes a plurality of user input elements; detecting a contact by a finger with the touch screen display; choosing a user input element in the plurality of user input elements based on proximity of the user input element to the contact; displaying information associated with the chosen user input element over the displayed content; detecting a break in the contact by the finger with the touch screen display; and receiving input for the chosen user input element.

Claims

1. A method, comprising:

at a portable multifunction device with a touch screen display;

displaying a webpage on the touch screen display, wherein the webpage includes a plurality of user input elements;

detecting a contact by a finger with the touch screen display;

choosing a user input element in the plurality of user input elements based on proximity of the user input element to the contact, wherein the chosen user input element is displayed with text that corresponds to the chosen user input element, the text having a first size;

detecting selection of the chosen user input element;

in response to detecting selection of the chosen user input element;

enlarging the webpage so as to display an area of the webpage that includes a plurality of user interface objects, including the chosen user input element, and

displaying an input interface for selecting input for the chosen user input element, wherein;

the input interface includes a plurality of text input choices for entering text into the chosen user input element, wherein text in the plurality of text input choices is displayed at a second size that is larger than the first size;

in accordance with a determination that the chosen user input element is a user input element of a first type, the displayed input interface includes a list of predefined multi-character text input choices for the chosen user input element; and

in accordance with a determination that the chosen user input element is a user input element of a second type distinct from the first type of user input element, the displayed input interface includes a soft keyboard;

while displaying the input interface, detecting activation of a respective text input choice of the plurality of text input choices;

displaying the respective text input choice in the chosen user input element, wherein;

when the displayed input interface includes the list of predefined multi-character input choices, the respective text input choice is a respective predefined multi-character text input choice from the list of predefined multi-character text input choices; and

when the displayed input interface includes the soft keyboard, the respective text input choice is a respective key of a plurality of keys in the soft keyboard; and

using the respective text input choice as input for the chosen user input element, wherein;

when the displayed input interface includes the list of predefined multi-character input choices, the input includes the respective predefined multi-character text input choice for the chosen user input element; and

when the displayed input interface includes the soft keyboard, the input includes a character corresponding to the respective key.

2. The method of claim 1, wherein the webpage includes a word processing, spreadsheet, email or presentation document.

3. The method of claim 1, wherein the webpage includes an electronic form.

4. The method of claim 1, wherein the webpage includes an online form.

5. The method of claim 1, wherein the user input elements include a user input element selected from the set consisting of:

text input fields, pull down lists, and form fields.

6. The method of claim 1, wherein

the contact includes an area of contact;

and

choosing the user input element includes determining a point within the area of contact, and choosing the user input element based on proximity of the user input element to the determined point.

7. The method of claim 1, wherein enlarging the webpage includes enlarging the text that corresponds to the chosen user input element to a larger size than the first size.

8. The method of claim 1, including:

displaying, in the input interface, an activatible icon that, when activated, causes the input interface to cease to be displayed;

while displaying the input interface, detecting activation of the activatible icon; and

in response to detecting activation of the activatible icon, ceasing to display the input interface.

9. The method of claim 1, including:

displaying, in the input interface, an activatible icon that, when activated, causes a selected input for the chosen user input element to be sent to a remote server;

while displaying the input interface, detecting activation of the activatible icon; and

in response to detecting activation of the activatible icon, sending the selected input for the chosen user input element to the remote server.

10. The method of claim 1, wherein:

prior to detecting selection of the chosen user input element, the chosen user input element is offset with respect to a respective axis of the touch screen display; and

the method further comprises, in response to detecting selection of the chosen user input element, substantially centering the chosen user input element with respect to the respective axis on the touch screen display.

11. The method of claim 1, wherein the first size of the text that corresponds to the chosen user input element renders the text illegible or barely legible.

12. A graphical user interface on a portable multifunction device with a touch screen display, comprising:

a webpage that includes a plurality of user input elements;

wherein;

a contact of a finger with the touch screen display is detected;

a user input element is chosen based on proximity of the user input element to the contact, wherein the chosen user input element is displayed with text that corresponds to the chosen user input element, the text having a first size;

selection of the chosen user input element is detected;

in response to detecting selection of the chosen user input element;

display of the webpage is enlarged so as to display an area of the webpage that includes a plurality of user interface objects, including the chosen user input element, and

an input interface for selecting input for the chosen user input element is displayed, wherein;

the input interface includes a plurality of text input choices for entering text into the chosen user input element, wherein text in the plurality of text input choices is displayed at a second size that is larger than the first size;

in accordance with a determination that the chosen user input element is a user input element of a first type, the displayed input interface includes a list of predefined multi-character text input choices for the chosen user input element; and

in accordance with a determination that the chosen user input element is a user input element of a second type distinct from the first type of user input element, the displayed input interface includes a keyboard;

while displaying the input interface, activation of a respective text input choice of the plurality of text input choices is detected;

the respective text input choice is displayed in the chosen user input element wherein;

when the displayed input interface includes the list of predefined multi-character input choices, the respective text input choice is a respective predefined multi-character text input choice from the list of predefined multi-character text input choices; and

when the displayed input interface includes the soft keyboard, the respective text input choice is a respective key of a plurality of keys in the soft keyboard; and

the respective text input choice is used as input for the chosen user input element wherein;

when the displayed input interface includes the list of predefined multi-character input choices, the input includes the respective predefined multi-character text input choice for the chosen user input element; and

when the displayed input interface includes the soft keyboard, the input includes a character corresponding to the respective key.

13. A portable multifunction device, comprising:

a touch screen display;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions to;

display a webpage on the touch screen display, wherein the webpage includes a plurality of user input elements;

detect a contact by a finger with the touch screen display;

choose a user input element in the plurality of user input elements based on proximity of the user input element to the contact, wherein the chosen user input element is displayed with text that corresponds to the chosen user input element, the text having a first size;

detect selection of the chosen user input element;

in response to detecting selection of the chosen user input element;

enlarge the webpage so as to display an area of the webpage that includes a plurality of user interface objects, including the chosen user input element, and

display an input interface for selecting input for the chosen user input element, wherein;

the input interface includes a plurality of text input choices for entering text into the chosen user input element, wherein text in the plurality of text input choices is displayed at a second size that is larger than the first size;

in accordance with a determination that the chosen user input element is a user input element of a first type, the displayed input interface includes a list of predefined multi-character text input choices for the chosen user input element; and

in accordance with a determination that the chosen user input element is a user input element of a second type distinct from the first type of user input element, the displayed input interface includes a keyboard;

while displaying the input interface, detect activation of a respective text input choice of the plurality of text input choices;

display the respective text input choice in the chosen user input element, wherein;

when the displayed input interface includes the list of predefined multi-character input choices, the respective text input choice is a respective predefined multi-character text input choice from the list of predefined multi-character text input choices; and

when the displayed input interface includes the soft keyboard, the respective text input choice is a respective key of a plurality of keys in the soft keyboard; and

use the respective text input choice as input for the chosen user input element, wherein;

when the displayed input interface includes the list of predefined multi-character input choices, the input includes the respective predefined multi-character text input choice for the chosen user input element; and

when the displayed input interface includes the soft keyboard, the input includes a character corresponding to the respective key.

14. The device of claim 13, wherein the user input elements include a user input element selected from the set consisting of:

text input fields, pull down lists, and form fields.

15. The device of claim 13, wherein enlarging the webpage includes enlarging the text that corresponds to the chosen user input element to a larger size than the first size.

16. The device of claim 13, including instructions for:

displaying, in the input interface, an activatible icon that, when activated, causes the input interface to cease to be displayed;

while displaying the input interface, detecting activation of the activatible icon; and

in response to detecting activation of the activatible icon, ceasing to display the input interface.

17. The device of claim 13, including instructions for:

displaying, in the input interface, an activatible icon that, when activated, causes a selected input for the chosen user input element to be sent to a remote server;

while displaying the input interface, detecting activation of the activatible icon; and

in response to detecting activation of the activatible icon, sending the selected input for the chosen user input element to the remote server.

18. The device of claim 13, wherein:

prior to detecting selection of the chosen user input element, the chosen user input element is offset with respect to a respective axis of the touch screen display; and

the device includes instructions for, in response to detecting selection of the chosen user input element, substantially centering the chosen user input element with respect to the respective axis on the touch screen display.

19. The device of claim 13, wherein the first size of the text that corresponds to the chosen user input element renders the text illegible or barely legible.

20. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a portable multifunction device with a touch screen display, cause the device to:

display a webpage on the touch screen display, wherein the webpage includes a plurality of user input elements;

detect a contact by a finger with the touch screen display;

choose a user input element in the plurality of user input elements based on proximity of the user input element to the contact, wherein the chosen user input element is displayed with text that corresponds to the chosen user input element, the text having a first size;

detect selection of the chosen user input element;

in response to detecting selection of the chosen user input element;

enlarge the webpage so as to display an area of the webpage that includes a plurality of user interface objects, including the chosen user input element, and

display an input interface for selecting input for the chosen user input element, wherein;

the input interface includes a plurality of text input choices for entering text into the chosen user input element, wherein text in the plurality of text input choices is displayed at a second size that is larger than the first size;

in accordance with a determination that the chosen user input element is a user input element of a first type, the displayed input interface includes a list of predefined multi-character text input choices for the chosen user input element; and

in accordance with a determination that the chosen user input element is a user input element of a second type distinct from the first type of user input element, the displayed input interface includes a keyboard;

while displaying the input interface, detect activation of a respective text input choice of the plurality of text input choices;

display the respective text input choice in the chosen user input element, wherein;

when the displayed input interface includes the list of predefined multi-character input choices, the respective text input choice is a respective predefined multi-character text input choice from the list of predefined multi-character text input choices; and

when the displayed input interface includes the soft keyboard, the respective text input choice is a respective key of a plurality of keys in the soft keyboard; and

use the respective text input choice as input for the chosen user input element, wherein;

when the displayed input interface includes the list of predefined multi-character input choices, the input includes the respective predefined multi-character text input choice for the chosen user input element; and

when the displayed input interface includes the soft keyboard, the input includes a character corresponding to the respective key.

21. The computer readable storage medium of claim 20, wherein the user input elements include a user input element selected from the set consisting of:

text input fields, pull down lists, and form fields.

22. The computer readable storage medium of claim 20, wherein enlarging the webpage includes enlarging the text that corresponds to the chosen user input element to a larger size than the first size.

23. The computer readable storage medium of claim 20, including instructions which cause the device to:

display, in the input interface, an activatible icon that, when activated, causes the input interface to cease to be displayed;

while displaying the input interface, detect activation of the activatible icon; and

in response to detecting activation of the activatible icon, cease to display the input interface.

24. The computer readable storage medium of claim 20, including instructions which cause the device to:

display, in the input interface, an activatible icon that, when activated, causes a selected input for the chosen user input element to be sent to a remote server;

while displaying the input interface, detect activation of the activatible icon; and

in response to detecting activation of the activatible icon, send the selected input for the chosen user input element to the remote server.

25. The computer readable storage medium of claim 20, wherein:

prior to detecting selection of the chosen user input element, the chosen user input element is offset with respect to a respective axis of the touch screen display; and

the computer readable storage medium includes instructions which cause the device to, in response to detecting selection of the chosen user input element, substantially center the chosen user input element with respect to the respective axis on the touch screen display.

26. The computer readable storage medium of claim 20, wherein the first size of the text that corresponds to the chosen user input element renders the text illegible or barely legible.