Portable multifunction device, method, and graphical user interface for interacting with user input elements in displayed content

• US 10,228,824 B2
• Filed: 05/23/2016
• Issued: 03/12/2019
• Est. Priority Date: 01/07/2007
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Tolmasky, Francisco Ryan, Williamson, Richard, Coleman, Patricia J., Blumenberg, Christopher, Dunn, Corbin Robert, Lemay, Stephen O., Van Os, Marcel
• Primary Examiner(s): Sasinowski, Andrew
• Application Number:
  US15/162,004
• Publication Number:
  US 20160266746A1
• Time in Patent Office: 1,023 Days
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04855 Interaction with scrollbars
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04M 1/27475 using interactive graphical means or pictorial representations
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 1/72427 for supporting games or graphical animations
• CPC Class Codes: H04M 1/7243 with interactive means for internal management of messages
• CPC Class Codes: H04M 1/72445 for supporting Internet browser applications
• CPC Class Codes: H04M 2250/22 including a touch pad, a touch sensor or a touch detector digitizers for touch screens G06F3/041

Abstract

A portable multifunction device includes a touch screen display, and one or more programs configured to be executed by one or more processors. The one or more programs including instructions for displaying an application, wherein the application includes a plurality of input elements that include a respective user input element. Detecting a first input that corresponds to selection of the respective user input element. In response to detecting the first input, enlarging the respective input element, and displaying an input interface for selecting input for the respective user input element, wherein the input interface includes a plurality of text input choices. While displaying the input interface, detecting a second input that corresponds to selection of a respective text input choice of the plurality of text input choices. After detecting the second input, using text that corresponds to the respective text input choice as input for the respective user input element.

Claims

1. A portable multifunction device, comprising:

a touch screen display;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying an application on the touch screen display, wherein the application includes a plurality of input elements that include a respective user input element;

detecting a first input that corresponds to selection of the respective user input element;

in response to detecting the first input that corresponds to the selection of the respective user input element;

enlarging the respective input element; and

displaying an input interface for selecting input for the respective user input element, wherein;

the input interface includes a plurality of text input choices for entering text into the respective user input element;

while displaying the input interface, detecting a second input that corresponds to selection of a respective text input choice of the plurality of text input choices; and

after detecting the second input that corresponds to selection of the respective text input choice, using text that corresponds to the respective text input choice as input for the respective user input element.

2. The device of claim 1, wherein the respective user input element is enlarged in response to detecting liftoff of a contact from the touch screen display.

3. The device of claim 1, wherein, prior to detecting selection of the respective user input element, the respective user input element is offset with respect to a respective axis of the touch screen display.

4. The device of claim 1, wherein the application is one of:

a word processing document, a spreadsheet document, an email, or a presentation document.

5. The device of claim 1, wherein the user input element includes a user input element selected from the set consisting of:

a text input field, a pull down list, and a form field.

6. The device of claim 1, including instructions for, in response to detecting the first input, enlarging text that corresponds to the respective user input element.

7. The device of claim 1, including instructions for, in response to detecting the first input:

displaying an activatible icon that, when activated, causes the input interface to cease to be displayed;

while displaying the input interface, detecting activation of the activatible icon; and

in response to detecting activation of the activation icon, ceasing to display the input interface.

8. The device of claim 1, including instructions for, in response to detecting the first input:

displaying an activatible icon that, when activated, causes a selected input for the respective user input element to be sent to a remote server;

while displaying the input interface, detecting activation of the activatible icon; and

in response to detecting activation of the activatible icon, sending the selected input for the respective user input element to the remote server.

9. The device of claim 1, including instructions for, in response to detecting the first input, centering the respective user input element within a portion of the display.

10. The device of claim 1, wherein the second input is a single tap input and the respective text input choice includes a plurality of text characters as input for the respective user input element.

11. The device of claim 1, wherein the respective user input element is a pull down list.

12. A method, comprising:

at a portable multifunction device with a touch screen display;

displaying an application on the touch screen display, wherein the application includes a plurality of input elements that include a respective user input element;

detecting a first input that corresponds to selection of the respective user input element;

in response to detecting the first input that corresponds to the selection of the respective user input element;

enlarging the respective input element; and

displaying an input interface for selecting input for the respective user input element, wherein;

the input interface includes a plurality of text input choices for entering text into the respective user input element;

while displaying the input interface, detecting a second input that corresponds to selection of a respective text input choice of the plurality of text input choices; and

after detecting the second input that corresponds to selection of the respective text input choice, using text that corresponds to the respective text input choice as input for the respective user input element.

13. The method of claim 12, wherein the respective user input element is enlarged in response to detecting liftoff of a contact from the touch screen display.

14. The method of claim 12, wherein, prior to detecting selection of the respective user input element, the respective user input element is offset with respect to a respective axis of the touch screen display.

15. The method of claim 12, wherein the application is one of:

a word processing document, a spreadsheet document, an email, or a presentation document.

16. The method of claim 12, wherein the user input element includes a user input element selected from the set consisting of:

a text input field, a pull down list, and a form field.

17. The method of claim 12, further in response to detecting the first input:

enlarging text that corresponds to the respective user input element.

18. The method of claim 12, including instructions for, in response to detecting the first input:

displaying an activatible icon that, when activated, causes the input interface to cease to be displayed;

while displaying the input interface, detecting activation of the activatible icon; and

in response to detecting activation of the activation icon, ceasing to display the input interface.

19. The method of claim 12, further in response to detecting the first input:

displaying an activatible icon that, when activated, causes a selected input for the respective user input element to be sent to a remote server;

while displaying the input interface, detecting activation of the activatible icon; and

in response to detecting activation of the activatible icon, sending the selected input for the respective user input element to the remote server.

20. The method of claim 12, further in response to detecting the first input:

centering the respective user input element within a portion of the display.

21. The method of claim 12, wherein the second input is a single tap input and the respective text input choice includes a plurality of text characters as input for the respective user input element.

22. The method of claim 12, wherein the respective user input element is a pull down list.

23. A non-transitory computer-readable storage medium comprising one or more programs for execution by one or more processors of a first device, the one or more programs including instructions which, when executed by the one or more processors, cause the first device to:

display an application on the touch screen display, wherein the application includes a plurality of input elements that include a respective user input element;

detect a first input that corresponds to selection of the respective user input element;

in response to detecting the first input that corresponds to the selection of the respective user input element;

enlarge the respective input element; and

display an input interface for selecting input for the respective user input element, wherein;

the input interface includes a plurality of text input choices for entering text into the respective user input element;

while displaying the input interface, detecting a second input that corresponds to selection of a respective text input choice of the plurality of text input choices; and

after detecting the second input that corresponds to selection of the respective text input choice, using text that corresponds to the respective text input choice as input for the respective user input element.

24. The non-transitory computer-readable storage medium of claim 23, wherein the respective user input element is enlarged in response to detecting liftoff of a contact from the touch screen display.

25. The non-transitory computer-readable storage medium of claim 23, wherein, prior to detecting selection of the respective user input element, the respective user input element is offset with respect to a respective axis of the touch screen display.

26. The non-transitory computer-readable storage medium of claim 23, wherein the application is one of:

a word processing document, a spreadsheet document, an email, or a presentation document.

27. The non-transitory computer-readable storage medium of claim 23, wherein the user input element includes a user input element selected from the set consisting of:

a text input field, a pull down list, and a form field.

28. The non-transitory computer-readable storage medium of claim 23, further in response to detecting the first input:

enlarge text that corresponds to the respective user input element.

29. The non-transitory computer-readable storage medium of claim 23, including instructions for, in response to detecting the first input:

display an activatible icon that, when activated, causes the input interface to cease to be displayed;

while displaying the input interface, detect activation of the activatible icon; and

in response to detecting activation of the activation icon, cease to display the input interface.

30. The non-transitory computer-readable storage medium of claim 23, further in response to detecting the first input:

display an activatible icon that, when activated, causes a selected input for the respective user input element to be sent to a remote server;

while displaying the input interface, detect activation of the activatible icon; and

in response to detecting activation of the activatible icon, send the selected input for the respective user input element to the remote server.

31. The non-transitory computer-readable storage medium of claim 23, further in response to detecting the first input:

center the respective user input element within a portion of the display.

32. The non-transitory computer-readable storage medium of claim 23, wherein the second input is a single tap input and the respective text input choice includes a plurality of text characters as input for the respective user input element.

33. The non-transitory computer-readable storage medium of claim 23, wherein the respective user input element is a pull down list.

34. A method, comprising:

at a portable multifunction device with a touch screen display;

displaying an application on the touch screen display, wherein the application includes a plurality of input elements that include a respective user input element;

detecting user contact with the touch screen display;

selecting a user input element in the plurality of user input elements based on proximity of the user input element to the detected user contact;

detecting a break of the user contact with the touch screen display;

in response to detecting a break of the user contact with the touch screen display, enlarging an area that includes the chosen user input element on the touch screen display; and

receiving input for the chosen user input element.

35. The method of claim 34, wherein the user input elements include one or more radio buttons, text input fields, check boxes, pull down lists, or form fields.

36. The method of claim 34, wherein

the contact includes an area of contact;

and

selecting the user input element includes determining a point within the area of contact, and selecting the user input element based on proximity of the user input element to the determined point.

37. The method of claim 34, wherein receiving input comprises:

receiving text input via a soft keyboard on the touch screen display,

detecting a finger contact with a radio button on the touch screen display,

detecting a finger contact with a check box on the touch screen display, or

detecting a finger contact with an item in a pull down list on the touch screen display.

38. A portable multifunction device, comprising:

a touch screen display;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying an application on the touch screen display, wherein the application includes a plurality of input elements that include a respective user input element;

detecting user contact with the touch screen display;

selecting a user input element in the plurality of user input elements based on proximity of the user input element to the detected user contact;

detecting a break of the user contact with the touch screen display;

in response to detecting a break of the user contact with the touch screen display, enlarging an area that includes the chosen user input element on the touch screen display; and

receiving input for the chosen user input element.

39. The device of claim 38, wherein the user input elements include one or more radio buttons, text input fields, check boxes, pull down lists, or form fields.

40. The device of claim 38, wherein

the contact includes an area of contact;

and

selecting the user input element includes determining a point within the area of contact, and selecting the user input element based on proximity of the user input element to the determined point.

41. The device of claim 38, wherein receiving input comprises:

receiving text input via a soft keyboard on the touch screen display,

detecting a finger contact with a radio button on the touch screen display,

detecting a finger contact with a check box on the touch screen display, or

detecting a finger contact with an item in a pull down list on the touch screen display.

42. A non-transitory computer-readable storage medium comprising one or more programs for execution by one or more processors of a first device, the one or more programs including instructions which, when executed by the one or more processors, cause the first device to:

display an application on the touch screen display, wherein the application includes a plurality of input elements that include a respective user input element;

detect user contact with the touch screen display;

select a user input element in the plurality of user input elements based on proximity of the user input element to the detected user contact;

detect a break of the user contact with the touch screen display;

in response to detecting a break of the user contact with the touch screen display, enlarge an area that includes the chosen user input element on the touch screen display; and

receive input for the chosen user input element.

43. The non-transitory computer-readable storage medium of claim 42, wherein the user input elements include one or more radio buttons, text input fields, check boxes, pull down lists, or form fields.

44. The non-transitory computer-readable storage medium of claim 42, wherein

the contact includes an area of contact;

and

instructions for selecting the user input element includes determining a point within the area of contact, and selecting the user input element based on proximity of the user input element to the determined point.

45. The non-transitory computer-readable storage medium of claim 42, wherein instructions for receiving input comprises:

receiving text input via a soft keyboard on the touch screen display,

detecting a finger contact with a radio button on the touch screen display,

detecting a finger contact with a check box on the touch screen display, or

detecting a finger contact with an item in a pull down list on the touch screen display.