Systems and methods for presenting and interacting with a picture-in-picture representation of video content on an electronic device with a touch-sensitive display

• US 10,795,490 B2
• Filed: 05/08/2017
• Issued: 10/06/2020
• Est. Priority Date: 06/12/2014
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Chaudhri, Imran A., Khoe, May-Li, Zambetti, Nicholas, Yang, Lawrence Y.
• Primary Examiner(s): Hailu, Tadesse
• Application Number:
  US15/589,900
• Publication Number:
  US 20170245017A1
• Time in Patent Office: 1,247 Days
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 2203/04803 Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04N 21/00 Selective content distribution, e.g. interactive television or video on demand [VOD] real-time bi-directional transmission of motion video data H04N7/14 ; broadcast or conference over packet switching networks H04L12/18
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/854 Content authoring

Abstract

Systems and methods for multitasking using touch-sensitive devices are disclosed herein. In one aspect, a method includes: playing video content in a full-screen mode on a touch-sensitive display of an electronic device. While playing the video content in the full-screen mode, the method further includes: receiving a request to display a home screen on the touch-sensitive display. In response receiving the request, the method also includes: (i) displaying the home screen; (ii) resizing the video content to fit within a reduced area of the touch-sensitive display; and (iii) displaying the resized video content overlaying the home screen.

Claims

1. A non-transitory computer-readable storage medium storing executable instructions that, when executed by an electronic device with a touch-sensitive display, cause the electronic device to:

play video content in a full-screen mode on the touch-sensitive display, within a first application;

while playing the video content in the full-screen mode, receive a request to display a home screen on the touch-sensitive display;

in response to receiving the request;

display the home screen on the touch-sensitive display; and

display a resized representation of the video content that fits within a reduced area of the touch-sensitive display, wherein the reduced area overlays the home screen at a first location on the touch-sensitive display;

while displaying the resized representation of the video content;

detecting a contact on the home screen at an affordance associated with a second application, distinct from the first application;

in response to detecting the contact on the home screen at the affordance associated with the second application;

cease to display the home screen; and

display, on the touch-sensitive display, a user interface for the second application, the user interface including content of a predetermined content type displayed at a second location on the touch-sensitive display that at least partially overlaps the first location; and

display the resized representation of the video content at a third location different from the second location, wherein the third location is automatically selected by the device so that the third location in which the resized representation of the video content is displayed does not overlap with the second location of the touch-sensitive display in which the content of the predetermined content type is displayed, wherein the user interface for the second application is displayed while continuing to display the resized representation of the video content at the third location.

2. The non-transitory computer-readable storage medium of claim 1, wherein the request is received via a selection of a button of the electronic device.

3. The non-transitory computer-readable storage medium of claim 2, wherein the button is a hardware button of the electronic device.

4. The non-transitory computer-readable storage medium of claim 2, wherein the button is displayed on the touch-sensitive display.

5. The non-transitory computer-readable storage medium of claim 1, wherein the executable instructions further cause the electronic device to:

detect a contact on the resized representation of the video content; and

in response to detecting the contact, move the resized representation of the video content in accordance with movement of the contact on the touch-sensitive display.

6. The non-transitory computer-readable storage medium of claim 1, wherein the executable instructions further include instructions for causing the electronic device to:

prior to displaying the resized representation of the video content at the third location;

determine whether the application contains any content of the predetermined content type;

upon determining that the application contains content of the predetermined content type;

determine the second location on the touch-sensitive display that corresponds to the content of the predetermined content type; and

automatically determine the third location based on the second location.

7. The non-transitory computer-readable storage medium of claim 6, wherein the predetermined content type is identified by the application.

8. The non-transitory computer-readable storage medium of claim 6, wherein the predetermined content type is identified by a user of the electronic device.

9. The non-transitory computer-readable storage medium of claim 1, wherein the content of the predetermined content type is a keyboard.

10. An electronic device, comprising:

a touch-sensitive display;

one or more processors; and

memory storing one or more programs which, when executed by the one or more processors, cause the electronic device to;

play video content in a full-screen mode on the touch-sensitive display, within a first application;

while playing the video content in the full-screen mode, receive a request to display a home screen on the touch-sensitive display;

in response to receiving the request;

display the home screen on the touch-sensitive display; and

display a resized representation of the video content that fits within a reduced area of the touch-sensitive display, wherein the reduced area overlays the home screen at a first location on the touch-sensitive display;

while displaying the resized representation of the video content;

detect a contact on the home screen at an affordance associated with a second application, distinct from the first application;

in response to detecting the contact on the home screen at the affordance associated with the second application;

cease to display the home screen; and

display, on the touch-sensitive display, a user interface for the application, the user interface including content of a predetermined content type displayed at a second location on the touch-sensitive display that at least partially overlaps the first location; and

display the resized representation of the video content at a third location different from the second location, wherein the third location is automatically selected by the device so that the third location in which the resized representation of the video content is displayed does not overlap with the second location of the touch-sensitive display in which the content of the predetermined content type is displayed, wherein the user interface for the second application is displayed while continuing to display the resized representation of the video content at the third location.

11. The electronic device of claim 10, wherein the request is received via a selection of a button of the electronic device.

12. The electronic device of claim 11, wherein the button is a hardware button of the electronic device.

13. The electronic device of claim 11, wherein the button is displayed on the touch-sensitive display.

14. The electronic device of claim 10, wherein the one or more programs further cause the electronic device to:

detect a contact on the resized representation of the video content; and

in response to detecting the contact, move the resized representation of the video content in accordance with movement of the contact on the touch-sensitive display.

15. The electronic device of claim 10, wherein the one or more programs further cause the electronic device to:

prior to displaying the resized representation of the video content at the third location;

determine whether the application contains any content of a predetermined content type;

upon determining that the application contains content of the predetermined content type;

determine the second location on the touch-sensitive display that corresponds to the content of the predetermined content type; and

automatically determine the third location based on the second location.

16. The electronic device of claim 10, wherein the content of the predetermined content type is a keyboard.

17. A method, comprising:

at an electronic device with a touch-sensitive display;

playing video content in a full-screen mode on the touch-sensitive display, within a first application;

while playing the video content in the full-screen mode, receiving a request to display a home screen on the touch-sensitive display;

in response to receiving the request;

displaying the home screen on the touch sensitive display; and

displaying a resized representation of the video content that fits within a reduced area of the touch-sensitive display, wherein the reduced area overlays the home screen at a first location on the touch-sensitive display;

while displaying the resized representation of the video content;

detecting a contact on the home screen at an affordance associated with a second application, distinct from the first application;

in response to detecting the contact on the home screen at the affordance associated with the second application;

ceasing to display the home screen; and

displaying, on the touch-sensitive display, a user interface for the second application, the user interface including content of a predetermined content type displayed at a second location on the touch-sensitive display that at least partially overlaps the first location; and

displaying the representation of the video content at a third location different from the second location, wherein the third location is automatically selected by the device so that the third location in which the resized representation of the video content is displayed does not overlap with the second location of the touch-sensitive display in which the content of the predetermined content type is displayed, wherein the user interface for the second application is displayed while continuing to display the resized representation of the video content at the third location.

18. The method of claim 17, wherein the request is received via a selection of a button of the electronic device.

19. The method of claim 18, wherein the button is a hardware button of the electronic device.

20. The method of claim 18, wherein the button is displayed on the touch-sensitive display.

21. The method of claim 17, further comprising:

detecting a contact on the resized representation of the video content; and

in response to detecting the contact, moving the resized representation of the video content in accordance with movement of the contact on the touch-sensitive display.

22. The method of claim 17, further comprising, prior to displaying the resized representation of the video content at the third location:

determining whether the application contains any content of a predetermined content type;

upon determining that the application contains content of the predetermined content type;

determining the second location on the touch-sensitive display that corresponds to the content of the predetermined content type; and

automatically determining the third location based on the second location.

23. The method of claim 17, wherein the content of the predetermined content type is a keyboard.