Systems, devices, and methods for dynamically providing user interface controls at a touch-sensitive secondary display

• US 10,303,289 B2
• Filed: 07/20/2017
• Issued: 05/28/2019
• Est. Priority Date: 07/29/2016
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Sepulveda, Raymond S., Wong, Chun Kin Minor, Coffman, Patrick L., Edwards, Dylan R., Wilson, Eric Lance, Suzuki, Gregg S., Wilson, Christopher I., Yang, Lawrence Y., Souza Dos Santos, Andre, Bernstein, Jeffrey T., Kerr, Duncan R., Morrell, John B.
• Primary Examiner(s): Sherman, Stephen G
• Application Number:
  US15/655,707
• Publication Number:
  US 20180032203A1
• Time in Patent Office: 677 Days
• CPC Class Codes: G06F 1/1615 with several enclosures having relative motions, each enclosure supporting at least one I/O or computing function constructional details of portable telephones comprising a plurality of mechanically joined movable body parts H04M1/0206
• CPC Class Codes: G06F 1/1647 including at least an additional display G06F1/1692 takes precedence
• CPC Class Codes: G06F 2203/04805 Virtual magnifying lens, i.e. window or frame movable on top of displayed information to enlarge it for better reading or selection
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Disclosed herein are systems, devices, and methods for dynamically updating a touch-sensitive secondary display. An example method includes receiving a request to open an application and, in response, (i) displaying, on a primary display, a plurality of user interface (UI) objects associated with the application, the plurality including a first UI object displayed with associated content and other UI objects displayed without associated content; and (ii) displaying, on the touch-sensitive secondary display, a set of affordances representing the plurality of UI objects. The method also includes: detecting, via the touch-sensitive secondary display, a swipe gesture in a direction from a first affordance and towards a second affordance, the first affordance representing the first UI object and the second affordance represents a distinct second UI object. In response to detecting the swipe gesture, the method includes: updating the primary display to display associated content for the second UI object.

Claims

1. A non-transitory computer-readable storage medium storing instructions that, when executed by one or more processors of a computing system with a first housing that includes a primary display, and a second housing at least partially containing (i) a physical keyboard and (ii) a touch-sensitive secondary display distinct from the primary display, cause the computing system to:

receive a request to open an application;

in response to receiving the request;

display, on the primary display, a plurality of user interface objects associated with the application, the plurality including a first user interface object displayed with its associated content and other user interface objects displayed without their associated content;

display, on the touch-sensitive secondary display, a set of affordances that each represent one of the plurality of user interface objects;

detect, via the touch-sensitive secondary display, a swipe gesture in a direction from a first affordance of the set of affordances and towards a second affordance of the set of affordances, wherein the first affordance represents the first user interface object and the second affordance represents a second user interface object that is distinct from the first user interface object; and

in response to detecting the swipe gesture, update the primary display to cease displaying associated content for the first user interface object and to display associated content for the second user interface object.

2. The non-transitory computer-readable storage medium of claim 1, wherein the instructions, when executed by the one or more processors, cause the computing system to:

detect continuous travel of the swipe gesture across the touch-sensitive secondary display, including the swipe gesture contacting a third affordance that represents a third user interface object; and

,

in response to detecting that the swipe gesture contacts the third affordance, update the primary display to display associated content for the third user interface object.

3. The non-transitory computer-readable storage medium of claim 2, wherein each affordance in the set of affordance includes a representation of a respective associated content for a respective user interface object of the plurality.

4. The non-transitory computer-readable storage medium of claim 3, wherein the instructions, when executed by the one or more processors, cause the computing system to:

before detecting the swipe gesture, detect an initial contact with the touch-sensitive secondary display over the first affordance; and

,

in response to detecting the initial contact, increase a magnification level of the first affordance.

5. The non-transitory computer-readable storage medium of claim 1, wherein:

the application is a web browsing application, and

the plurality of user interface objects each correspond to web-browsing tabs.

6. The non-transitory computer-readable storage medium of claim 5, wherein the instructions, when executed by the one or more processors, cause the computing system to:

detect an input at a uniform resource locator (URL) input portion of the web browsing application on the primary display; and

in response to detecting the input, update the touch-sensitive secondary display to include representations of favorite URLs.

7. The non-transitory computer-readable storage medium of claim 1, wherein:

the application is a photo-browsing application, and

the plurality of user interface objects each correspond to individual photos.

8. The non-transitory computer-readable storage medium of claim 1, wherein:

the application is a video-editing application, and

the plurality of user interface object each correspond to individual frames in a respective video.

9. A method, comprising:

at a computing system comprising one or more processors, memory, a first housing that includes a primary display, and a second housing at least partially containing (i) a physical keyboard and (ii) a touch-sensitive secondary display distinct from the primary display;

receiving a request to open an application;

in response to receiving the request;

displaying, on the primary display, a plurality of user interface objects associated with the application, the plurality including a first user interface object displayed with its associated content and other user interface objects displayed without their associated content;

displaying, on the touch-sensitive secondary display, a set of affordances that each represent one of the plurality of user interface objects;

detecting, via the touch-sensitive secondary display, a swipe gesture in a direction from a first affordance of the set of affordances and towards a second affordance of the set of affordances, wherein the first affordance represents the first user interface object and the second affordance represents a second user interface object that is distinct from the first user interface object; and

in response to detecting the swipe gesture, updating the primary display to cease displaying associated content for the first user interface object and to display associated content for the second user interface object.

10. The method of claim 9, further comprising:

detecting continuous travel of the swipe gesture across the touch-sensitive secondary display, including the swipe gesture contacting a third affordance that represents a third user interface object; and

,

in response to detecting that the swipe gesture contacts the third affordance, updating the primary display to display associated content for the third user interface object.

11. The method of claim 10, wherein each affordance in the set of affordance includes a representation of a respective associated content for a respective user interface object of the plurality.

12. The method of claim 11, further comprising:

before detecting the swipe gesture, detecting an initial contact with the touch-sensitive secondary display over the first affordance; and

,

in response to detecting the initial contact, increasing a magnification level of the first affordance.

13. The method of claim 9, wherein:

the application is a web browsing application, and

the plurality of user interface objects each correspond to web-browsing tabs.

14. The method of claim 13, further comprising:

detecting an input at a uniform resource locator (URL) input portion of the web browsing application on the primary display; and

in response to detecting the input, updating the touch-sensitive secondary display to include representations of favorite URLs.

15. The method of claim 9, wherein:

the application is a photo-browsing application, and

the plurality of user interface objects each correspond to individual photos.

16. The method of claim 9, wherein:

the application is a video-editing application, and

the plurality of user interface object each correspond to individual frames in a respective video.

17. An electronic device, comprising:

one or more processors;

a first housing that includes a primary display;

a second housing at least partially containing (i) a physical keyboard and (ii) a touch-sensitive secondary display distinct from the primary display; and

memory storing one or more programs that are configured to be executed by the one or more processors, the one or more programs including instructions for;

receiving a request to open an application;

in response to receiving the request;

displaying, on the primary display, a plurality of user interface objects associated with the application, the plurality including a first user interface object displayed with its associated content and other user interface objects displayed without their associated content;

displaying, on the touch-sensitive secondary display, a set of affordances that each represent one of the plurality of user interface objects;

detecting, via the touch-sensitive secondary display, a swipe gesture in a direction from a first affordance of the set of affordances and towards a second affordance of the set of affordances, wherein the first affordance represents the first user interface object and the second affordance represents a second user interface object that is distinct from the first user interface object; and

in response to detecting the swipe gesture, updating the primary display to cease displaying associated content for the first user interface object and to display associated content for the second user interface object.

18. The electronic device of claim 17, wherein the one or more programs further include instructions for:

detecting continuous travel of the swipe gesture across the touch-sensitive secondary display, including the swipe gesture contacting a third affordance that represents a third user interface object; and

,

in response to detecting that the swipe gesture contacts the third affordance, updating the primary display to display associated content for the third user interface object.

19. The electronic device of claim 18, wherein each affordance in the set of affordance includes a representation of a respective associated content for a respective user interface object of the plurality.

20. The electronic device of claim 19, wherein the one or more programs further include instructions for:

before detecting the swipe gesture, detecting an initial contact with the touch-sensitive secondary display over the first affordance; and

,

in response to detecting the initial contact, increasing a magnification level of the first affordance.

21. The electronic device of claim 17, wherein:

the application is a web browsing application, and

the plurality of user interface objects each correspond to web-browsing tabs.

22. The electronic device of claim 21, wherein the one or more programs further include instructions for:

detecting an input at a uniform resource locator (URL) input portion of the web browsing application on the primary display; and

,

in response to detecting the input, updating the touch-sensitive secondary display to include representations of favorite URLs.

23. The electronic device of claim 17, wherein:

the application is a photo-browsing application, and

the plurality of user interface objects each correspond to individual photos.

24. The electronic device of claim 17, wherein:

the application is a video-editing application, and

the plurality of user interface object each correspond to individual frames in a respective video.