AUTOMATED GRAPHICAL USER INTERFACE CONFIGURATION

• US 20200133473A1
• Filed: 12/24/2019
• Published: 04/30/2020
• Est. Priority Date: 04/21/2016
• Status: Active Grant

• Current Assignee: Aveva Software LLC (Schneider Electric SE)
• Original Assignee: Aveva Software LLC (Schneider Electric SE)
• Inventors: Coble, Robert Christopher, Weinrich, Steven Michael, Kambach, Julius Robert, Krajewski, III, John Joseph, Singh, Manoranjan Kumar, Tran, Dave, Kumar, Raju Uthu, Kane, Douglas Paul
• Granted Patent: US 11,175,931 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 8/38 for implementing user interfaces
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces

Abstract

Automated configuration of graphical user interface screens of industrial software applications. An application executing on a computing device utilizes a navigation model representing hierarchies of navigation items to automate placement of graphical components in appropriate locations on the graphical user interface.

Claims

1-20. -20. (canceled)

21. A hierarchical display system for automated graphical user interface configuration comprising:

a processor and a non-transitory computer readable medium;

the non-transitory computer readable medium comprising computer executable instructions for creating;

a navigational model;

a plurality of navigational items;

a GUI profile;

one or more GUIs; and

a plurality of layouts;

wherein the navigational model comprises a multi-level hierarchy comprising the plurality of navigational items;

wherein each of the navigational items is one of a current node, a parent node, or a child node within the multi-level hierarchy;

wherein the current node comprises a current navigational item configured for selection by a user, the parent node comprises a parent navigational item in the multi-level hierarchy, and the child node comprises a child navigational item in the multi-level hierarchy;

wherein each of the plurality of navigational items comprises a GUI profile, the GUI profile representing the one or more GUIs within a runtime environment, the GUI profile configured and arranged to allow a user to assign a layout selection of one of the plurality of layouts to each of the one or more GUIs;

the executable instructions configured and arranged to cause the processor to;

determine the number of GUIs present in the runtime environment;

query the current node to determine a number of GUIs specified by a current GUI profile;

apply the layout selection from the current GUI profile to each of the specified GUIs;

wherein when the number of number GUIs specified by the GUI profile is less than the number of GUIs present in the runtime environment, the instructions are further configured and arranged to;

query one of the parent node or child node to determine if a parent GUI profile or child GUI profile specifies a layout selection for one or more of the remaining GUIs; and

apply the layout selection from the parent GUI profile or the child GUI profile to one or more of the remaining GUIs.

22. The hierarchical display system of claim 21,

wherein each layout selection comprises one or more panes;

wherein each of the one or more panes comprise a pre-existing content pane and/or a content type pane;

the computer executable instructions further configured and arranged to cause the processor to;

display the pre-existing content of the layout selection for a given node in a pre-existing content GUI pane;

or, for panes that do not have pre-existing content,

determine a content to display in one or more content type GUI panes based on a content type.

23. The hierarchical display system of claim 22,

wherein to determine a content to display, the computer executable instructions are further configured and arranged to cause the processor to:

query the current node to determine the content type for each pane of the current layout selection;

apply content from a pane in the current node that matches the content type into an available content type GUI pane;

wherein when one or more pane in the current node does not have a matching content type, the instructions are further configured and arranged to cause the processor to;

query the parent and/or child node to determine a content type for each pane of the parent and/or child layout selection;

apply content from a pane in the parent and/or child node that matches the content type into an available content type GUI pane.

24. The hierarchical display system of claim 23,

wherein if the content type pane is a multiple content type pane configured to host multiple content, the computer executable instructions are further configured and arranged to cause the processor to:

apply content from a pane in the current node that matches the content type content type into the multiple content type pane;

query the parent and/or child node to determine a content type for each pane of the parent and/or child layout selection;

apply content from a pane in the parent and/or child node that matches the content type into the multiple content type pane; and

continue the query until the multiple content type pane is full.

25. The hierarchical display system of claim 23,

where querying the parent and/or child node comprises using a path string that describes the multi-level hierarchy.

26. The hierarchical display system of claim 23,

further comprising one or more hierarchy aware controls,

wherein each hierarchy aware control controls how many current, parent and/or child nodes to display in the runtime environment.

27. The hierarchical display system of claim 26,

wherein each of the one or more hierarchy aware controls can be linked together to provide advanced behaviors in the runtime environment.

28. The hierarchical display system of claim 27,

wherein achieving advanced behaviors comprises one or more nodes in the second hierarchy aware control to be accessed by the first hierarchy aware control.

29. A hierarchical display system for automated graphical user interface configuration comprising:

a processor and a non-transitory computer readable medium, the non-transitory computer readable medium comprising instruction configured and arranged to cause the processor to;

generate a plurality of GUIs in a runtime environment, at least one of the plurality of GUIs comprising a navigational model comprising a hierarchy of navigational items, each navigational item located in one level of a plurality of levels of the hierarchy;

accept a user selection of one of the of the navigational items, where the user selected navigational item is a current navigational item;

determine a number of GUIs specified by a GUI profile associated with the current navigational item;

determine a layout for each of the number of GUIs as specified by the GUI profile;

display the layout in each of the number of GUIs as specified by the GUI profile;

determine if the number GUIs as specified by the GUI profile is less than the number of available GUIs;

query one or more levels of the hierarchy to determine if a GUI profile associated with the respective level has a layout specified for one or more of the remaining GUIs;

apply the layout from the level to the corresponding GUI;

repeat the query until all of the number of GUIs have layouts applied or until all levels have been queried.

30. The hierarchical display system of claim 29,

wherein each layout contains one or more panes;

wherein the content displayed in the one or more panes are controlled by an auto-fill pane algorithm;

wherein the auto-fill pane algorithm executes according to a fill mode.

31. The hierarchical display system of claim 30,

wherein a fill mode is a fill from current mode;

wherein a fill from current mode comprises filling the one or more panes with only content from a navigational item selected by the user.

32. The hierarchical display system of claim 30,

wherein a fill mode is a fill from current and look up mode;

wherein is a fill from current and look up mode comprises;

filling the one or more panes with content a navigational item selected by the user;

for any panes that are still empty, querying the next higher level of the hierarch for additional commands or content to apply to the empty panes;

applying the content to the panes;

continuing to the next higher level of the hierarchy and applying a content until all panes are filled or the root of navigation model is reached.

33. The hierarchical display system of claim 30,

wherein a fill mode is a fill from current and look up then down mode;

wherein is a fill from current and look up mode comprises;

filling the one or more panes with content a navigational item selected by the user;

for any panes that are still empty, querying the next higher level of the hierarch for additional commands or content to apply to the empty panes;

applying the content to the panes;

continuing to the next higher level of the hierarchy and applying a content until all panes are filled or the root of navigation model is reached;

if the root is reached and any of the one or more panes remain empty, querying the next lower level of the hierarch for additional commands or content to apply to the empty panes;

applying the content to the panes; and

continuing to the next lower level of the hierarchy and applying a content from that level until all panes are filled or a leaf of navigation model is reached.

34. The hierarchical display system of claim 30,

wherein the auto-fill pane algorithm uses explicit actions to determine how to fill panes;

wherein explicit actions force the content of a pane within the layout to be displayed on a corresponding pane of a target GUI;

wherein explicit actions are triggered by the presence of a pane name on a GUI for placement;

wherein regardless of what layout is applied the GUI, the auto-fill pane algorithm will use an explicit action on any level of the navigation model if a pane name specified in the layout is present on a target GUI and the pane is available to receive the content.

35. The hierarchical display system of claim 30,

wherein the auto-fill pane algorithm uses implicit actions to determine how to fill panes;

wherein implicit actions allow a content type of a pane within the layout to be assigned to a corresponding pane of a target GUI;

wherein the auto-fill pane algorithm will use an implicit action to use a content on any level of the navigation model to fill a pane if the content type of the content on any level matches the content type of the target GUI.

36. The hierarchical display system of claim 30,

wherein the fill mode queries the current navigational item and fills the panes of a target GUI with content from the current navigational item that matches a content name or a content type.

37. A hierarchical display method for automated graphical user interface configuration comprising:

providing a processor and a non-transitory computer readable medium;

the non-transitory computer readable medium comprising computer executable instructions for creating;

a navigational model;

a plurality of navigational items;

a GUI profile;

one or more GUIs; and

a plurality of layouts;

wherein the navigational model comprises a multi-level hierarchy comprising the plurality of navigational items;

wherein each of the navigational items is one of a current node, a parent node, or a child node within the multi-level hierarchy;

wherein the current node comprises a current navigational item configured for selection by a user, the parent node comprises a parent navigational item in the multi-level hierarchy, and the child node comprises a child navigational item in with the multi-level hierarchy;

wherein each of the plurality of navigational items comprises a GUI profile, the GUI profile representing the one or more GUIs within the runtime environment, the GUI profile configured and arranged to allow a user to assign a layout selection of one of the plurality of layouts to each of the one or more GUIs;

the executable instructions configured and arranged to cause the processor to execute the method steps of;

determining the number of GUIs present in the runtime environment;

querying the current node to determine a number GUIs specified by a current GUI profile;

applying the layout selection from the current GUI profile to each of the specified GUIs;

wherein when the number of number GUIs specified by the GUI profile is less than the number of GUIs present in the runtime environment, the instructions are further configured and arranged to execute the method steps of;

querying one of the parent node or child node to determine if a parent GUI profile or child GUI profile specifies a layout selection for one or more of the remaining GUIs; and

applying the layout selection from the parent GUI profile or the child GUI profile to one or more of the remaining GUIs.

38. The hierarchical display method of claim 37,

wherein each layout selection comprises one or more panes;

wherein each of the one or more panes comprise a pre-existing content pane and/or a content type pane;

the computer executable instructions further configured and arranged to cause the processor to execute the method steps of;

displaying the pre-existing content of the layout selection for a given node in a pre-existing content GUI pane;

or, for panes that do not have pre-existing content,

determining a content to display in one or more content type GUI panes.

39. The hierarchical display system of claim 38,

wherein to determine a content to display, the computer executable instructions are further configured and arranged to cause the processor to execute the method steps of:

querying the current node to determine a content type for each pane of the current layout selection;

applying content from a pane in the current node that matches the content type into an available content type GUI pane;

wherein when one or more pane in the current node does not have a matching content type, the instructions are further configured and arranged to cause the processor to;

query the parent and/or child node to determine a content type for each pane of the parent and/or child layout selection;

apply content from a pane in the parent and/or child node that matches the content type into an available content type GUI pane.

40. The hierarchical display system of claim 39,

wherein if the content type pane is a multiple content type pane configured to host multiple content, and the current node only has a single content type pane, the computer executable instructions are further configured and arranged to cause the processor to execute the method steps of:

querying the current, parent and/or child node to determine a content type for each pane of the parent and/or child layout selection;

applying content from a pane in the parent and/or child node that matches the content type into the multiple content type pane;

continuing the query until the multiple content type pane is full.