Portable electronic device, method, and graphical user interface for displaying structured electronic documents

• US 10,656,778 B2
• Filed: 01/29/2019
• Issued: 05/19/2020
• Est. Priority Date: 09/06/2006
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Forstall, Scott, Blumenberg, Chris, Boule, Andre M. J., Chaudhri, Imran, Christie, Gregory N., Lemay, Stephen O., Van Os, Marcel, Williamson, Richard J.
• Primary Examiner(s): Sherman, Stephen G
• Application Number:
  US16/260,905
• Publication Number:
  US 20190155458A1
• Time in Patent Office: 476 Days
• Field of Search: 345173-179, 178 1801- 1809, 178 1811
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality

Abstract

At an electronic device with a touch screen display, display a user interface, where the user interface includes at least two windows of an application, a first icon displayed in association with a first window of the at least two windows, and a second icon at a location different from the at least two windows. While displaying the at least two windows, detect a gesture on the touch screen display. In response to detecting the gesture: in accordance with detecting the gesture on the first icon associated with the first window on the touch screen display, remove from the display the first window of the at least two displayed windows corresponding to the gesture; and in accordance with detecting the gesture on the second icon at the location different from the at least two windows of the application, display a new window of the application on the touch screen display.

Claims

1. A method, comprising:

at an electronic device with a touch screen display;

displaying, on the touch screen display, at least a portion of a structured electronic document, wherein the structured electronic document comprises content that includes an item of inline multimedia content in the displayed portion of the structured electronic document;

detecting a first gesture on the item of inline multimedia content in the displayed portion of the structured electronic document;

in response to detecting the first gesture;

enlarging the item of inline multimedia content on the touch screen display; and

ceasing to display other content in the structured electronic document besides the enlarged item of inline multimedia content;

while the enlarged item of inline multimedia content is displayed, detecting a second gesture that includes detecting a touch contact on the touch screen display;

in response to detecting the second gesture, displaying one or more playback controls for playing the enlarged item of inline multimedia content that were not displayed on the touch screen display prior to detecting the touch contact on the touch screen display;

detecting a third gesture on the one or more playback controls; and

in response to detecting the third gesture, playing the enlarged item of inline multimedia content.

2. The method of claim 1, wherein the structured electronic document is a web page, an HTML document, or an XML document.

3. The method of claim 1, wherein the inline multimedia content comprises video content or audio content.

4. The method of claim 1, wherein the content can be played with a QuickTime plugin, a Windows Media plugin, or a Flash plugin.

5. The method of claim 1, wherein enlarging the item of inline multimedia content comprises displaying a zooming animation of the item.

6. The method of claim 1, wherein enlarging the item of inline multimedia content comprises simultaneously zooming and translating the item of inline multimedia content on the touch screen display.

7. The method of claim 1, wherein enlarging the item of inline multimedia content comprises rotating the item of inline multimedia content by 90°

.

8. The method of claim 1, wherein enlarging the item of inline multimedia content comprises expanding the item of inline multimedia content such that a width of the item of inline multimedia content is the same as a width of the touch screen display.

9. The method of claim 1, wherein:

the item of inline multimedia content has a full size;

the touch screen display has a size; and

enlarging the item of inline multimedia content comprises enlarging the item of inline multimedia content to the smaller of the full size of the item and the size of the touch screen display.

10. The method of claim 1, wherein ceasing to display other content in the structured electronic document besides the item of inline multimedia content comprises fading out the other content in the structured electronic document besides the item of inline multimedia content.

11. The method of claim 1, wherein the one or more playback controls comprise a play icon, a pause icon, a sound volume icon, a playback progress bar icon, or a combination thereof.

12. The method of claim 1, wherein displaying one or more playback controls comprises displaying one or more playback controls on top of the enlarged item of inline multimedia content.

13. The method of claim 1, wherein the one or more playback controls are superimposed on top of the enlarged item of inline multimedia content.

14. The method of claim 1, wherein the one or more playback controls are semitransparent.

15. The method of claim 1, further comprising:

overriding an instruction in the structured electronic document to automatically start playing the item of inline multimedia content.

16. The method of claim 1, wherein playing the enlarged item of inline multimedia content comprises playing the enlarged item of inline multimedia content with a plugin for a content type associated with the item of inline multimedia content.

17. The method of claim 1, further comprising:

ceasing to display the one or more playback controls while the enlarged item of inline multimedia content is played.

18. The method of claim 17, wherein ceasing to display the one or more playback controls comprises fading out the one or more playback controls.

19. The method of claim 17, wherein ceasing to display the one or more playback controls comprises ceasing to display of the one or more playback controls after a predetermined time.

20. The method of claim 17, wherein ceasing to display the one or more playback controls comprising ceasing display after no contact is detected on the touch screen display for a predetermined time.

21. The method of claim 1, further comprising:

after enlarging the item of inline multimedia content on the touch screen display and ceasing to display the other content in the structured electronic document besides the enlarged item of inline multimedia content, detecting a fourth gesture on the touch screen display; and

in response to detecting the fourth gesture, displaying, on the touch screen display, at least the entire portion of the structured electronic document that was displayed before enlarging the item of inline multimedia content.

22. The method of claim 21, wherein the fourth gesture comprises a tap gesture on a playback completion icon on the touch screen display.

23. The method of claim 21, wherein displaying at least the entire portion of the structured electronic document that was displayed before enlarging the item of inline multimedia content includes returning the item of inline multimedia content to a size at which it was displayed prior to being enlarged.

24. The method of claim 1, wherein the first gesture, the second gesture, and the third gesture are finger gestures or stylus gestures.

25. The method of claim 1, wherein the first gesture, the second gesture, and the third gesture are tap gestures.

26. The method of claim 25, wherein the tap gesture is a double tap with a single finger, a double tap with two fingers, a single tap with a single finger, or a single tap with two fingers.

27. An electronic device, comprising:

a touch screen display;

one or more processors; and

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions to;

display, on the touch screen display of the electronic device, at least a portion of a structured electronic document, wherein the structured electronic document comprises content that includes an item of inline multimedia content in the displayed portion of the structured electronic document;

detect a first gesture on the item of inline multimedia content in the displayed portion of the structured electronic document;

in response to detecting the first gesture;

enlarge the item of inline multimedia content on the touch screen display; and

cease to display other content in the structured electronic document besides the enlarged item of inline multimedia content;

while the enlarged item of inline multimedia content is displayed, detect a second gesture that includes detecting a touch contact on the touch screen display;

in response to detecting the second gesture, display one or more playback controls for playing the enlarged item of inline multimedia content that were not displayed on the touch screen display prior to detecting the touch contact on the touch screen display;

detect a third gesture on the one of the playback controls; and

in response to detecting the third gesture, play the enlarged item of inline multimedia content.

28. The electronic device of claim 27, wherein the structured electronic document is a web page, an HTML document, or an XML document.

29. The electronic device of claim 27, wherein the inline multimedia content comprises video content or audio content.

30. The electronic device of claim 27, wherein the content can be played with a QuickTime plugin, a Windows Media plugin, or a Flash plugin.

31. The electronic device of claim 27, wherein enlarging the item of inline multimedia content comprises displaying a zooming animation of the item.

32. The electronic device of claim 27, wherein enlarging the item of inline multimedia content comprises simultaneously zooming and translating the item of inline multimedia content on the touch screen display.

33. The electronic device of claim 27, wherein enlarging the item of inline multimedia content comprises rotating the item of inline multimedia content by 90°

.

34. The electronic device of claim 27, wherein enlarging the item of inline multimedia content comprises expanding the item of inline multimedia content such that a width of the item of inline multimedia content is the same as a width of the touch screen display.

35. The electronic device of claim 27, wherein:

the item of inline multimedia content has a full size;

the touch screen display has a size; and

enlarging the item of inline multimedia content comprises enlarging the item of inline multimedia content to the smaller of the full size of the item and the size of the touch screen display.

36. The electronic device of claim 27, wherein ceasing to display other content in the structured electronic document besides the item of inline multimedia content comprises fading out the other content in the structured electronic document besides the item of inline multimedia content.

37. The electronic device of claim 27, wherein the one or more playback controls comprise a play icon, a pause icon, a sound volume icon, a playback progress bar icon, or a combination thereof.

38. The electronic device of claim 27, wherein displaying one or more playback controls comprises displaying one or more playback controls on top of the enlarged item of inline multimedia content.

39. The electronic device of claim 27, wherein the one or more playback controls are superimposed on top of the enlarged item of inline multimedia content.

40. The electronic device of claim 27, wherein the one or more playback controls are semitransparent.

41. The electronic device of claim 27, wherein the one or more programs further include instructions to:

override an instruction in the structured electronic document to automatically start playing the item of inline multimedia content.

42. The electronic device of claim 27, wherein playing the enlarged item of inline multimedia content comprises playing the enlarged item of inline multimedia content with a plugin for a content type associated with the item of inline multimedia content.

43. The electronic device of claim 27, wherein the one or more programs further include instructions to:

cease to display the one or more playback controls while the enlarged item of inline multimedia content is played.

44. The electronic device of claim 43, wherein ceasing to display the one or more playback controls comprises fading out the one or more playback controls.

45. The electronic device of claim 43, wherein ceasing to display the one or more playback controls comprises ceasing to display of the one or more playback controls after a predetermined time.

46. The electronic device of claim 43, wherein ceasing to display the one or more playback controls comprising ceasing display after no contact is detected on the touch screen display for a predetermined time.

47. The electronic device of claim 27, wherein the one or more programs further include instructions to:

after enlarging the item of inline multimedia content on the touch screen display and ceasing to display the other content in the structured electronic document besides the enlarged item of inline multimedia content, detect a fourth gesture on the touch screen display; and

in response to detecting the fourth gesture, display, on the touch screen display, at least the entire portion of the structured electronic document that was displayed before enlarging the item of inline multimedia content.

48. The electronic device of claim 47, wherein the fourth gesture comprises a tap gesture on a playback completion icon on the touch screen display.

49. The electronic device of claim 47, wherein displaying at least the entire portion of the structured electronic document that was displayed before enlarging the item of inline multimedia content includes returning the item of inline multimedia content to a size at which it was displayed prior to being enlarged.

50. The electronic device of claim 27, wherein the first gesture, the second gesture, and the third gesture are finger gestures or stylus gestures.

51. The electronic device of claim 27, wherein the first gesture, the second gesture, and the third gesture are tap gestures.

52. The electronic device of claim 51, wherein the tap gesture is a double tap with a single finger, a double tap with two fingers, a single tap with a single finger, or a single tap with two fingers.

53. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with a touch screen display, cause the electronic device to:

display, on the touch screen display of the electronic device, at least a portion of a structured electronic document, wherein the structured electronic document comprises content that includes an item of inline multimedia content in the displayed portion of the structured electronic document;

detect a first gesture on the item of inline multimedia content in the displayed portion of the structured electronic document;

in response to detecting the first gesture;

enlarge the item of inline multimedia content on the touch screen display; and

cease to display other content in the structured electronic document besides the enlarged item of inline multimedia content;

while the enlarged item of inline multimedia content is displayed, detect a second gesture that includes detecting a touch contact on the touch screen display;

in response to detecting the second gesture, display one or more playback controls for playing the enlarged item of inline multimedia content that were not displayed on the touch screen display prior to detecting the touch contact on the touch screen display;

detect a third gesture on the one of the playback controls; and

in response to detecting the third gesture, play the enlarged item of inline multimedia content.

54. The non-transitory computer readable storage medium of claim 53, wherein the structured electronic document is a web page, an HTML document, or an XML document.

55. The non-transitory computer readable storage medium of claim 53, wherein the inline multimedia content comprises video content or audio content.

56. The non-transitory computer readable storage medium of claim 53, wherein the content can be played with a QuickTime plugin, a Windows Media plugin, or a Flash plugin.

57. The non-transitory computer readable storage medium of claim 53, wherein enlarging the item of inline multimedia content comprises displaying a zooming animation of the item.

58. The non-transitory computer readable storage medium of claim 53, wherein enlarging the item of inline multimedia content comprises simultaneously zooming and translating the item of inline multimedia content on the touch screen display.

59. The non-transitory computer readable storage medium of claim 53, wherein enlarging the item of inline multimedia content comprises rotating the item of inline multimedia content by 90°

.

60. The non-transitory computer readable storage medium of claim 53, wherein enlarging the item of inline multimedia content comprises expanding the item of inline multimedia content such that a width of the item of inline multimedia content is the same as a width of the touch screen display.

61. The non-transitory computer readable storage medium of claim 53, wherein:

the item of inline multimedia content has a full size;

the touch screen display has a size; and

enlarging the item of inline multimedia content comprises enlarging the item of inline multimedia content to the smaller of the full size of the item and the size of the touch screen display.

62. The non-transitory computer readable storage medium of claim 53, wherein ceasing to display other content in the structured electronic document besides the item of inline multimedia content comprises fading out the other content in the structured electronic document besides the item of inline multimedia content.

63. The non-transitory computer readable storage medium of claim 53, wherein the one or more playback controls comprise a play icon, a pause icon, a sound volume icon, a playback progress bar icon, or a combination thereof.

64. The non-transitory computer readable storage medium of claim 53, wherein displaying one or more playback controls comprises displaying one or more playback controls on top of the enlarged item of inline multimedia content.

65. The non-transitory computer readable storage medium of claim 53, wherein the one or more playback controls are superimposed on top of the enlarged item of inline multimedia content.

66. The non-transitory computer readable storage medium of claim 53, wherein the one or more playback controls are semitransparent.

67. The non-transitory computer readable storage medium of claim 53, wherein the one or more programs comprise further instructions, which when executed by the electronic device, further cause the electronic device to:

override an instruction in the structured electronic document to automatically start playing the item of inline multimedia content.

68. The non-transitory computer readable storage medium of claim 53, wherein playing the enlarged item of inline multimedia content comprises playing the enlarged item of inline multimedia content with a plugin for a content type associated with the item of inline multimedia content.

69. The non-transitory computer readable storage medium of claim 53, wherein the one or more programs comprise further instructions, which when executed by the electronic device, further cause the electronic device to:

cease to display the one or more playback controls while the enlarged item of inline multimedia content is played.

70. The non-transitory computer readable storage medium of claim 69, wherein ceasing to display the one or more playback controls comprises fading out the one or more playback controls.

71. The non-transitory computer readable storage medium of claim 69, wherein ceasing to display the one or more playback controls comprises ceasing to display of the one or more playback controls after a predetermined time.

72. The non-transitory computer readable storage medium of claim 69, wherein ceasing to display the one or more playback controls comprising ceasing display after no contact is detected on the touch screen display for a predetermined time.

73. The non-transitory computer readable storage medium of claim 53, wherein the one or more programs comprise further instructions, which when executed by the electronic device, further cause the electronic device to:

after enlarging the item of inline multimedia content on the touch screen display and ceasing to display the other content in the structured electronic document besides the enlarged item of inline multimedia content, detect a fourth gesture on the touch screen display; and

in response to detecting the fourth gesture, display, on the touch screen display, at least the entire portion of the structured electronic document that was displayed before enlarging the item of inline multimedia content.

74. The non-transitory computer readable storage medium of claim 73, wherein the fourth gesture comprises a tap gesture on a playback completion icon on the touch screen display.

75. The non-transitory computer readable storage medium of claim 73, wherein displaying at least the entire portion of the structured electronic document that was displayed before enlarging the item of inline multimedia content includes returning the item of inline multimedia content to a size at which it was displayed prior to being enlarged.

76. The non-transitory computer readable storage medium of claim 53, wherein the first gesture, the second gesture, and the third gesture are finger gestures or stylus gestures.

77. The non-transitory computer readable storage medium of claim 53, wherein the first gesture, the second gesture, and the third gesture are tap gestures.

78. The non-transitory computer readable storage medium of claim 77, wherein the tap gesture is a double tap with a single finger, a double tap with two fingers, a single tap with a single finger, or a single tap with two fingers.