Portable Electronic Device, Method, and Graphical User Interface for Displaying Inline Multimedia Content

• US 20080165148A1
• Filed: 12/20/2007
• Published: 07/10/2008
• Est. Priority Date: 01/07/2007
• Status: Abandoned Application

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Chaudhri, Imran, Christie, Greg, Lemay, Stephen O., Williamson, Richard, Pisula, Charles J., Omernick, Timothy P.
• Application Number:
  US11/961,773
• Publication Number:
  US 20080165148A1
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 16/9577 Optimising the visualization of content, e.g. distillation of HTML documents
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G09G 2340/045 Zooming at least part of an image, i.e. enlarging it or shrinking it
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 2250/22 including a touch pad, a touch sensor or a touch detector

Abstract

In a computer-implemented method at least a portion of a structured electronic document comprising content is displayed on a touch screen display of a portable electronic device. A gesture is detected on an item of inline multimedia content in the displayed portion of the structured electronic document. In response, the item of inline multimedia content on the touch screen display is enlarged and display of other content in the structured electronic document besides the enlarged item of inline multimedia content is ceased. A gesture on a play icon is detected. In response, the enlarged item of inline multimedia content is played.

Claims

1. A computer-implemented method, comprising:

at a portable electronic device with a touch screen display,

displaying at least a portion of a structured electronic document on the touch screen display, wherein the structured electronic document comprises content;

detecting a first gesture on an item of inline video content in the displayed portion of the structured electronic document;

in response to detecting the first gesture,

enlarging the item of inline video content on the touch screen display, and

ceasing to display all other content in the structured electronic document besides the enlarged item of inline video content;

while the enlarged item of inline video content is displayed, detecting a second gesture on the touch screen display;

in response to detecting the second gesture, displaying one or more playback controls for playing the enlarged item of inline video content, wherein the one or more playback controls are displayed on top of the enlarged item of inline video content;

detecting a third gesture on one of the playback controls; and

in response to detecting the third gesture, playing the enlarged item of inline video content;

ceasing to display the one or more playback controls after no contact is detected with the touch screen display for a predetermined time;

detecting a fourth gesture on the touch screen display; and

in response to detecting the fourth gesture, displaying, again, at least the portion of the structured electronic document.

2. A computer-implemented method, comprising:

at a portable electronic device with a touch screen display,

displaying at least a portion of a structured electronic document on the touch screen display, wherein the structured electronic document comprises content;

detecting a first gesture on an item of inline multimedia content in the displayed portion of the structured electronic document;

in response to detecting the first gesture,

enlarging the item of inline multimedia content on the touch screen display, and

ceasing to display other content in the structured electronic document besides the enlarged item of inline multimedia content;

detecting a third gesture on a play icon; and

in response to detecting the third gesture, playing the enlarged item of inline multimedia content.

3. The method of claim 2, including:

while the enlarged item of inline multimedia content is displayed, detecting a second gesture on the touch screen display;

in response to detecting the second gesture, displaying one or more playback controls for playing the enlarged item of inline multimedia content;

4. The method of claim 2, wherein the structured electronic document is a web page.

5. The method of claim 2, wherein the structured electronic document is an HTML or XML document.

6. The method of claim 2, wherein the inline multimedia content comprises video and/or audio content.

7. The method of claim 2, wherein:

the item of inline multimedia content has a full size;

the touch screen display has a size; and

enlarging the item of inline multimedia content comprises enlarging the item of inline multimedia content to the smaller of the full size of the item and the size of the touch screen display.

8. The method of claim 2, wherein enlarging the item of inline multimedia content comprises animated zooming in on the item.

9. The method of claim 2, wherein enlarging the item of inline multimedia content comprises rotating the item of inline multimedia content by 90°

.

10. The method of claim 2, wherein enlarging the item of inline multimedia content comprises simultaneously zooming and translating the item of inline multimedia content on the touch screen display.

11. The method of claim 2, wherein enlarging the item of inline multimedia content comprises expanding the item of inline multimedia content so that the width of the item of inline multimedia content is substantially the same as the width of the touch screen display.

12. The method of claim 2, wherein ceasing to display other content in the structured electronic document besides the item of inline multimedia content comprises fading out the other content in the structured electronic document besides the item of inline multimedia content.

13. The method of claim 2, including overriding an instruction in the structured electronic document to automatically start playing the item of inline multimedia content.

14. The method of claim 3, wherein the one or more playback controls comprise a play icon, a pause icon, a sound volume icon, and/or a playback progress bar icon.

15. The method of claim 3, wherein displaying one or more playback controls comprises displaying one or more playback controls on top of the enlarged item of inline multimedia content.

16. The method of claim 3, wherein, while playing the enlarged item of inline multimedia content, ceasing to display the one or more playback controls.

17. The method of claim 16, wherein ceasing to display the one or more playback controls comprises fading out the one or more playback controls.

18. The method of claim 16, wherein the display of the one or more playback controls is ceased after a predetermined time.

19. The method of claim 16, wherein the display of the one or more playback controls is ceased after no contact is detected with the touch screen display for a predetermined time.

20. The method of claim 2, wherein playing the enlarged item of inline multimedia content comprises playing the enlarged item of inline multimedia content with a plugin for a content type associated with the item of inline multimedia content.

21. The method of claim 2, including;

detecting a fourth gesture on the touch screen display;

in response to detecting the fourth gesture,

displaying, again, at least the portion of the structured electronic document.

22. The method of claim 21, wherein the fourth gesture comprises a tap gesture on a playback completion icon.

23. The method of claim 21, wherein the item of inline multimedia content returns to the size at which it was displayed prior to being enlarged.

24. The method of claim 2, wherein the first and second gestures are finger gestures.

25. The method of claim 2, wherein the first and second gestures are stylus gestures.

26. The method of claim 2, wherein the first and second gestures are tap gestures.

27. The method of claim 26, wherein the tap gesture is a double tap with a single finger, a double tap with two fingers, a single tap with a single finger, or a single tap with two fingers.

28. A graphical user interface on a portable electronic device with a touch screen display, comprising:

at least a portion of a structured electronic document, wherein the structured electronic document comprises content;

an item of inline multimedia content in the portion of the structured electronic document; and

a play icon;

wherein;

in response to detecting a first gesture on the item of inline multimedia content,

the item of inline multimedia content on the touch screen display is enlarged, and

display of other content in the structured electronic document besides the enlarged item of inline multimedia content is ceased; and

in response to detecting a third gesture on the play icon, the enlarged item of inline multimedia content is played.

29. The graphical user interface of claim 28, including:

one or more playback controls, wherein;

in response to detecting a second gesture on the touch screen display while the enlarged item of inline multimedia content is displayed, the one or more playback controls for playing the enlarged item of inline multimedia content are displayed.

30. A portable electronic device, comprising:

a touch screen display;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including;

instructions for displaying at least a portion of a structured electronic document on the touch screen display, wherein the structured electronic document comprises content;

instructions for detecting a first gesture on an item of inline multimedia content in the displayed portion of the structured electronic document;

instructions for enlarging the item of inline multimedia content on the touch screen display in response to detecting the first gesture;

instructions for ceasing to display other content in the structured electronic document besides the enlarged item of inline multimedia content in response to detecting the first gesture;

instructions for detecting a third gesture on a play icon; and

instructions for playing the enlarged item of inline multimedia content in response to detecting the third gesture.

31. A computer readable storage medium storing one or more programs, the one or more programs, comprising instructions, which when executed by a portable electronic device with a touch screen display, cause the device to:

display at least a portion of a structured electronic document on the touch screen display, wherein the structured electronic document comprises content;

detect a first gesture on an item of inline multimedia content in the displayed portion of the structured electronic document;

enlarge the item of inline multimedia content on the touch screen display in response to detecting the first gesture;

cease to display other content in the structured electronic document besides the enlarged item of inline multimedia content in response to detecting the first gesture;

detect a third gesture on a play icon; and

play the enlarged item of inline multimedia content in response to detecting the third gesture.

32. A portable electronic device with a touch screen display, comprising:

means for displaying at least a portion of a structured electronic document on the touch screen display, wherein the structured electronic document comprises content;

means for detecting a first gesture on an item of inline multimedia content in the displayed portion of the structured electronic document;

means for enlarging the item of inline multimedia content on the touch screen display in response to detecting the first gesture;

means for ceasing to display other content in the structured electronic document besides the enlarged item of inline multimedia content in response to detecting the first gesture;

means for detecting a third gesture on a play icon; and

means for playing the enlarged item of inline multimedia content in response to detecting the third gesture.