Dynamic function row management

• US 10,394,449 B2
• Filed: 02/17/2017
• Issued: 08/27/2019
• Est. Priority Date: 09/23/2016
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Louch, John O., Van Vechten, Kevin J.
• Primary Examiner(s): Choi, David E
• Application Number:
  US15/436,338
• Publication Number:
  US 20180088799A1
• Time in Patent Office: 921 Days
• CPC Class Codes: G06F 1/1662 Details related to the integrated keyboard
• CPC Class Codes: G06F 3/0238 Programmable keyboards key guide holders G06F3/0224
• CPC Class Codes: G06F 3/0489 using dedicated keyboard keys or combinations thereof

Abstract

A device may include a dynamic function row (DFR) comprising a touchscreen. A device processor may operate a DFR agent controlling the DFR. The DFR agent may generate and/or select images to display on the DFR based on rules and/or contexts, and the DFR may display the images.

Claims

1. A method comprising:

instantiating, by at least one processor of a device comprising a keyboard having a dynamic function row (DFR), a DFR agent, wherein the DFR comprises a touchscreen distinct from a main display of the device;

receiving, at the DFR agent, a plurality of registrations from at least one application running on the device, each registration specifying image data for at least one registered element configured to be displayed on the DFR from an application;

registering, by the DFR agent, the plurality of registrations by storing, in a memory of the device, the image data for each registered element in association with indication of a corresponding application;

selecting, by the DFR agent, one or more registered elements from the at least one application running on the device that are relevant to a current state of the device;

arranging, by the DFR agent, the selected one or more registered elements into an interface;

generating, by the DFR agent, an image of the interface; and

displaying, by the DFR, the image.

2. The method of claim 1, wherein a first of the selected one or more registered elements are registered by a front most application that is currently active on the main display of the device.

3. The method of claim 2, wherein a second of the selected one or more registered elements are registered by an application other than the front most application.

4. The method of claim 3, wherein the selecting the one or more registered elements comprises determining the selected one or more registered elements that are registered by an application other than the front most application based on an application priority.

5. The method of claim 1, wherein at least one of the selected one or more registered elements are registered by an application that is currently processing an event that has been predetermined to be a system priority event.

6. The method of claim 1, further comprising sending, by the DFR agent, sizing information for elements to be displayed on the DFR to the at least one application prior to receiving the plurality of registrations, wherein the DFR agent, rather than the at least one application, determines sizing and placement of the selected one or more registered elements in generating the image.

7. The method of claim 1, further comprising:

displaying a user interface configured to receive user input to customize a default image for display on the DFR;

receiving the user input via the user interface to customize the default image for display on the DFR when a current state of the device is a default state; and

determining that the current state of the device is the default state,

and

wherein the image comprises the default image in response to a determination that the current state of the device is the default state.

8. The method of claim 1, wherein the current state of the device is based on a predefined event, wherein the image comprises a predefined image associated with the predefined event and wherein the predefined image provides one or more registered DFR elements configured to address the predefined event prior to continuing use of an application associated with the predefined event.

9. The method of claim 1, further comprising:

detecting, at the DFR agent, a new state of the device;

determining, by the DFR agent, that the new state of the device necessitates display of a new image on the DFR;

generating, by the DFR agent, the new image to display on the DFR based on the new state of the device; and

displaying, by the DFR, the new image.

10. The method of claim 1, wherein the DFR agent receives more than one distinct element for display on the DFR from the at least one application, and wherein the selected one or more registered elements include the more than one distinct element of the at least one application.

11. The method of claim 1, wherein presentation of the selected one or more registered elements within the image is further based on a user preference.

12. The method of claim 1, further comprising:

defining, by the DFR agent, at least one region of the image, the at least one region corresponding to an application command;

receiving, by the DFR, a touch input at an area of the touchscreen corresponding to the at least one region;

detecting, by the DFR agent, the application command based on the touch input; and

sending, by the DFR agent, the application command to at least one application.

13. A device comprising:

a keyboard having a dynamic function row (DFR) comprising a touchscreen;

a main display distinct from the DFR; and

at least one processor configured to;

instantiate a DFR agent;

receive a plurality of registrations from at least one application running on the device, each registration specifying image data for at least one registered element configured to be displayed on the DFR from an application;

register the plurality of registrations by storing, in a memory of the device, the image data for each registered element in association with indication of a corresponding application;

select one or more registered elements from the at least one application running on the device that are relevant to a current state of the device;

arrange the selected one or more registered elements into an interface;

generate an image of the interface; and

display the image on the DFR.

14. The device of claim 13, wherein a first of the selected one or more registered elements are registered by a front most application that is currently active on the main display of the device.

15. The device of claim 14, wherein a second of the selected one or more registered elements are registered by an application other than the front most application.

16. The device of claim 15, wherein selecting the one or more registered elements comprises determining the selected one or more registered elements that are registered by an application other than the front most application based on an application priority.

17. The device of claim 13, wherein at least one of the selected one or more registered elements are registered by an application that is currently processing an event that has been predetermined to be a system priority event.

18. The device of claim 13, wherein the at least one processor is further configured to send sizing information for elements to be displayed on the DFR to the at least one application prior to receiving the plurality of registrations, and wherein the DFR agent, rather than the at least one application, determines sizing and placement of the selected one or more registered elements in generating the image.

19. The device of claim 13, wherein the current state of the device is a default state, and wherein the image comprises a default image.

20. The device of claim 13, wherein the current state of the device is based on a predefined event, and wherein the image comprises a predefined image associated with the predefined event, and wherein the predefined image provides one or more registered DFR elements configured to address the predefined event prior to continuing use of an application associated with the predefined event.

21. The device of claim 13, wherein the at least one processor is further configured to:

detect a new state of the device;

determine that the new state of the device necessitates display of a new image on the DFR;

generate the new image to display on the DFR based on the new state of the device; and

display the new image on the DFR.

22. The device of claim 13, wherein the at least one processor receives more than one distinct element for display on the DFR from the at least one application, and wherein the selected one or more registered elements include the more than one distinct element of the at least one application.

23. The device of claim 13, wherein presentation of the selected one or more registered elements within the image is further based on a user preference.

24. The device of claim 13, wherein the processor is further configured to define, by the DFR agent, at least one region of the image, the at least one region corresponding to an application command,

wherein the DFR is further configured to receive a touch input at an area of the touchscreen corresponding to the at least one region, and

wherein the processor is further configured to:

detect, by the DFR agent, the application command based on the touch input; and

send, by the DFR agent, the application command to at least one application.