Systems, devices, and methods for dynamically providing user interface controls at a touch-sensitive secondary display

• US 10,613,808 B2
• Filed: 09/22/2016
• Issued: 04/07/2020
• Est. Priority Date: 01/23/2014
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Bernstein, Jeffrey Traer, Kerr, Duncan R., Morrell, John B., Yang, Lawrence Y., Wilson, Eric Lance, Meyer, Adam S.
• Primary Examiner(s): Nguyen, Tuan S
• Application Number:
  US15/273,627
• Publication Number:
  US 20170010847A1
• Time in Patent Office: 1,293 Days
• Field of Search: None
• CPC Class Codes: G06F 1/1613 for portable computers cooling arrangements therefor G06F1/203; constructional details or arrangements for pocket calculators, electronic agendas or books G06F15/0216; constructional details of portable telephone sets: with several bodies H04M1/0202
• CPC Class Codes: G06F 1/165 the additional display being small, e.g. for presenting status information
• CPC Class Codes: G06F 1/1662 Details related to the integrated keyboard
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/021 Arrangements integrating additional peripherals in a keyboard, e.g. card or barcode reader, optical scanner
• CPC Class Codes: G06F 3/0238 Programmable keyboards key guide holders G06F3/0224
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G06Q 20/12 specially adapted for electronic shopping systems
• CPC Class Codes: G06Q 20/40145 Biometric identity checks
• CPC Class Codes: G06Q 30/0641 Shopping interfaces
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 5/12 : Synchronisation between the display unit and other units, e.g. other display units, video-disc players

Abstract

A method is performed at a computing system with a first housing that includes a primary display and a second housing at least partially containing (i) a physical keyboard and a touch-sensitive secondary display (“TSSD”) that is distinct from the primary display. The method includes: displaying, on the primary display, a first user interface for an application and displaying, on the TSSD, a first set of affordances corresponding to a first portion of the application. The method further includes: detecting a swipe gesture on the TSSD. If the swipe gesture was performed in a first direction, the method includes: displaying a second set of affordances corresponding to the first portion on the TSSD. If the swipe gesture was performed in a second direction substantially perpendicular to the first direction, the method includes: displaying a third set of affordances corresponding to a second portion of the application on the TSSD.

Claims

1. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by one or more processors of a computing system with a first housing that includes a primary display and a second housing at least partially containing (i) a physical keyboard and (ii) a touch-sensitive secondary display that is distinct from the primary display, cause the computing system to:

display, on the primary display, a first user interface for an application executed by the computing system;

display a second user interface on the touch-sensitive secondary display, the second user interface comprising a first set of one or more affordances corresponding to the application, wherein the first set of one or more affordances corresponds to a first portion of the application;

detect a swipe gesture on the touch-sensitive secondary display;

in accordance with a determination that the swipe gesture was performed in a first direction, display a second set of one or more affordances corresponding to the application on the touch-sensitive secondary display, wherein at least one affordance in the second set of one or more affordances is distinct from the first set of one or more affordances, and wherein the second set of one or more affordances also corresponds to the first portion of the application; and

,

in accordance with a determination that the swipe gesture was performed in a second direction substantially perpendicular to the first direction, display a third set of one or more affordances corresponding to the application on the touch-sensitive secondary display, wherein the third set of one or more affordances is distinct from the second set of one or more affordances, and wherein the third set of one or more affordances corresponds to a second portion of the application that is distinct from the first portion of the application.

2. The non-transitory computer-readable storage medium of claim 1, wherein the second portion is displayed on the primary display in a compact view within the first user interface prior to detecting the swipe gesture, and the instructions, when executed by the one or more processors, cause the computing system to:

display the second portion on the primary display in an expanded view within the first user interface in accordance with the determination that the swipe gesture was performed in the second direction substantially perpendicular to the first direction.

3. The non-transitory computer-readable storage medium of claim 1, wherein the first user interface for the application executed by the computing system is displayed on the primary display in a full-screen mode, and

wherein the first set of one or more affordances displayed on the touch-sensitive secondary display includes controls corresponding to the full-screen mode.

4. The non-transitory computer-readable storage medium of claim 1, wherein the second set of one or more affordances and the third set of one or more affordances includes at least one system-level affordance corresponding to at least one system-level functionality.

5. The non-transitory computer-readable storage medium of claim 1, wherein the instructions, when executed by the one or more processors, cause the computing system to:

after displaying the third set of one or more affordances on the touch-sensitive secondary display;

detect a user input selecting the first portion on the first user interface; and

, in response to detecting the user input;

cease to display the third set of one or more affordances on the touch-sensitive secondary display, wherein the third set of one or more affordances corresponds to the second portion of the application; and

display the second set of one or more affordances, wherein the second set of one or more affordances corresponds to the first portion of the application.

6. The non-transitory computer-readable storage medium of claim 1, wherein the first direction is substantially parallel to a major dimension of the touch-sensitive secondary display.

7. The non-transitory computer-readable storage medium of claim 1, wherein the first direction is substantially perpendicular to a major dimension of the touch-sensitive secondary display.

8. The non-transitory computer-readable storage medium of claim 1, wherein the first portion is one of a menu, tab, folder, tool set, or toolbar of the application, and

wherein the second portion is one of a menu, tab, folder, tool set, or toolbar of the application.

9. The non-transitory computer-readable storage medium of claim 1, wherein the instructions also cause the computing system to:

in accordance with the determination that the swipe gesture was performed in the second direction substantially perpendicular to the first direction, cease to display the second set of one or more affordances on the touch-sensitive secondary display.

10. The non-transitory computer-readable storage medium of claim 9, wherein while the second set of affordances on displayed at the touch-sensitive secondary display, representations of the second set of affordances are displayed within the first user interface for the application, and the instructions also cause the computing system to:

in accordance with the determination that the swipe gesture was performed in the second direction substantially perpendicular to the first direction, cease to display on the primary display the representations of the second set of affordances and display on the primary display representations of the third set of affordances.

11. A method, comprising:

at a computing system comprising one or more processors, memory, a first housing that includes a primary display, and a second housing at least partially containing (i) a physical keyboard and a touch-sensitive secondary display that is distinct from the primary display;

displaying, on the primary display, a first user interface for an application executed by the computing system;

displaying a second user interface on the touch-sensitive secondary display, the second user interface comprising a first set of one or more affordances corresponding to the application, wherein the first set of one or more affordances corresponds to a first portion of the application;

detecting a swipe gesture on the touch-sensitive secondary display;

in accordance with a determination that the swipe gesture was performed in a first direction, displaying a second set of one or more affordances corresponding to the application on the touch-sensitive secondary display, wherein at least one affordance in the second set of one or more affordances is distinct from the first set of one or more affordances, and wherein the second set of one or more affordances also corresponds to the first portion of the application; and

,

in accordance with a determination that the swipe gesture was performed in a second direction substantially perpendicular to the first direction, displaying a third set of one or more affordances corresponding to the application on the touch-sensitive secondary display, wherein the third set of one or more affordances is distinct from the second set of one or more affordances, and wherein the third set of one or more affordances corresponds to a second portion of the application that is distinct from the first portion of the application.

12. The method of claim 11, wherein the second portion is displayed on the primary display in a compact view within the first user interface prior to detecting the swipe gesture, and the method includes:

displaying the second portion on the primary display in an expanded view within the first user interface in accordance with the determination that the swipe gesture was performed in the second direction substantially perpendicular to the first direction.

13. The method of claim 11, wherein the first user interface for the application executed by the computing system is displayed on the primary display in a full-screen mode, and

wherein the first set of one or more affordances displayed on the touch-sensitive secondary display includes controls corresponding to the full-screen mode.

14. The method of claim 11, wherein the second set of one or more affordances and the third set of one or more affordances includes at least one system-level affordance corresponding to at least one system-level functionality.

15. The method of claim 11, including:

after displaying the third set of one or more affordances on the touch-sensitive secondary display;

detecting a user input selecting the first portion on the first user interface; and

, in response to detecting the user input;

ceasing to display the third set of one or more affordances on the touch-sensitive secondary display, wherein the third set of one or more affordances corresponds to the second portion of the application; and

displaying the second set of one or more affordances, wherein the second set of one or more affordances corresponds to the first portion of the application.

16. The method of claim 11, further comprising:

in accordance with the determination that the swipe gesture was performed in the second direction substantially perpendicular to the first direction, ceasing to display the second set of one or more affordances on the touch-sensitive secondary display.

17. The method of claim 16, wherein while the second set of affordances is displayed on the touch-sensitive secondary display, representations of the second set of affordances are displayed within the first user interface for the application, and the method further comprises:

in accordance with the determination that the swipe gesture was performed in the second direction substantially perpendicular to the first direction, ceasing to display on the primary display the representations of the second set of affordances and displaying on the primary display representations of the third set of affordances.

18. The method of claim 11, wherein the first direction is substantially parallel to a major dimension of the touch-sensitive secondary display.

19. The method of claim 11, wherein the first direction is substantially perpendicular to a major dimension of the touch-sensitive secondary display.

20. The method of claim 11, wherein the first portion is one of a menu, tab, folder, tool set, or toolbar of the application, and

wherein the second portion is one of a menu, tab, folder, tool set, or toolbar of the application.

21. A computing system, comprising:

one or more processors;

a first housing that includes a primary display;

a second housing at least partially containing (i) a physical keyboard and (ii) a touch-sensitive secondary display that is distinct from the primary display;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying, on the primary display, a first user interface for an application executed by the computing system;

displaying a second user interface on the touch-sensitive secondary display, the second user interface comprising a first set of one or more affordances corresponding to the application, wherein the first set of one or more affordances corresponds to a first portion of the application;

detecting a swipe gesture on the touch-sensitive secondary display;

in accordance with a determination that the swipe gesture was performed in a first direction, displaying a second set of one or more affordances corresponding to the application on the touch-sensitive secondary display, wherein at least one affordance in the second set of one or more affordances is distinct from the first set of one or more affordances, and wherein the second set of one or more affordances also corresponds to the first portion of the application; and

,

in accordance with a determination that the swipe gesture was performed in a second direction substantially perpendicular to the first direction, displaying a third set of one or more affordances corresponding to the application on the touch-sensitive secondary display, wherein the third set of one or more affordances is distinct from the second set of one or more affordances, and wherein the third set of one or more affordances corresponds to a second portion of the application that is distinct from the first portion of the application.

22. The computing system of claim 21, wherein the second portion is displayed on the primary display in a compact view within the first user interface prior to detecting the swipe gesture, and the one or more programs include instructions for:

displaying the second portion on the primary display in an expanded view within the first user interface in accordance with the determination that the swipe gesture was performed in the second direction substantially perpendicular to the first direction.

23. The computing system of claim 21, wherein the first user interface for the application executed by the computing system is displayed on the primary display in a full-screen mode, and

wherein the first set of one or more affordances displayed on the touch-sensitive secondary display includes controls corresponding to the full-screen mode.

24. The computing system of claim 21, wherein the second set of one or more affordances and the third set of one or more affordances includes at least one system-level affordance corresponding to at least one system-level functionality.

25. The computing system of claim 21, wherein the one or more programs include instructions for:

after displaying the third set of one or more affordances on the touch-sensitive secondary display;

detecting a user input selecting the first portion on the first user interface; and

,

in response to detecting the user input;

ceasing to display the third set of one or more affordances on the touch-sensitive secondary display, wherein the third set of one or more affordances corresponds to the second portion of the application; and

displaying the second set of one or more affordances, wherein the second set of one or more affordances corresponds to the first portion of the application.

26. The computing system of claim 21, wherein the one or more programs also include instructions for:

in accordance with the determination that the swipe gesture was performed in the second direction substantially perpendicular to the first direction, cease to display the second set of one or more affordances on the touch-sensitive secondary display.

27. The computing system of claim 26, wherein while the second set of affordances is displayed on the touch-sensitive secondary display, representations of the second set of affordances are displayed within the first user interface for the application, and the one or more programs also include instructions for:

in accordance with the determination that the swipe gesture was performed in the second direction substantially perpendicular to the first direction, ceasing to display on the primary display the representations of the second set of affordances and displaying on the primary display representations of the third set of affordances.

28. The computing system of claim 21, wherein the first direction is substantially parallel to a major dimension of the touch-sensitive secondary display.

29. The computing system of claim 21, wherein the first direction is substantially perpendicular to a major dimension of the touch-sensitive secondary display.

30. The computing system of claim 21, wherein the first portion is one of a menu, tab, folder, tool set, or toolbar of the application, and

wherein the second portion is one of a menu, tab, folder, tool set, or toolbar of the application.