Dynamically generating visualizations in industrial automation environment as a function of context and state information

• US 8,191,005 B2
• Filed: 09/27/2007
• Issued: 05/29/2012
• Est. Priority Date: 09/27/2007
• Status: Active Grant

• Current Assignee: Rockwell Automation Technologies Incorporated (Allen-Bradley Co., Inc.)
• Original Assignee: Rockwell Automation Technologies Incorporated (Allen-Bradley Co., Inc.)
• Inventors: Baier, John Joseph, Bromley, Clifton Harold, Hobbs, Mark, Schouten, Teunis Hendrik, Reichard, Douglas James, Gordon, Kevin George, Jasper, Taryl Jon, McGreevy, Robert Joseph, Fuller, Bruce Gordan
• Primary Examiner(s): Augustine, Nicholas
• Application Number:
  US11/863,144
• Publication Number:
  US 20090089709A1
• Time in Patent Office: 1,706 Days
• Field of Search: 715/763, 715/771, 715/772, 715/775, 715/817, 715/818, 715/825, 715/839, 715/862
• US Class Current: 715/771
• CPC Class Codes: G05B 19/409 characterised by using manual data input [MDI] or by using control panel, e.g. controlling functions with the panel; characterised by control panel details or by setting parameters G05B19/408, G05B19/4093 take precedence
• CPC Class Codes: G05B 2219/36133 MMI, HMI: man machine interface, communication
• CPC Class Codes: Y02P 90/80 Management or planning

Abstract

A visualization system that generates customized visualization(s) in an industrial automation environment includes an interface component that receives input concerning displayed objects and information, a context component that can detect, infer or determine context information regarding an entity, and a visualization component that dynamically generates a visualization from a set of display object to present to the entity that is a function of the received information and inferred or determined entity context.

Claims

1. A visualization system that generates customized visualization(s) in an industrial automation environment, comprising:

a visualization component configured to present data relating to an industrial automation environment as a first data visualization wherein the first data visualization comprises a first display object subset;

an interface component configured to receive input concerning the presentation of the data in the first data visualization; and

a context component configured to capture context information regarding the first data visualization,

wherein, based upon the context information, the visualization component is further configured to

determine a second display object subset to facilitate the presentation of the data as a function of the context information, wherein the first display object subset and second display object subset comprise at least one display object selected from a set of display objects and the first display object subset and the second display object subset are disjoint, and

dynamically update the first data visualization with a second data visualization to display the data with the second display object subset.

2. The system of claim 1, wherein the context information is a function of an identity of an entity, a role, a logical location, a physical location, a current activity, a similar interaction with an automation device, a previous interaction with an automation device, or context data pertaining to at least one automation device including control systems, devices or associated equipment.

3. The system of claim 2, wherein the context data comprises logical location data of the automation device, physical location data of the automation device or operating status of the automation device.

4. The system of claim 1, further comprising an artificial intelligence (AI) component configured to automatically take action based on an inference.

5. The system of claim 4, wherein the AI component is configured to automatically take the action based on a utility-based analysis, wherein an expected cost of taking the action is compared to an expected benefit of taking the action.

6. The system of claim 1, further comprising a data store configured to store at least one of user profiles, historical data, or rules in connection with generating at least one of the first data visualization or the second data visualization.

7. The system of claim 1, wherein the visualization component is further configured to generate at least one of the first data visualization or the second data visualization as a function of cognitive load of the entity.

8. The system of claim 1, wherein the visualization component is further configured to generate at least one of the first data visualization or the second data visualization as a function of a current or future activity of an entity with regard to at least one of:

entity role, entity access rights, entity state, capacity of the entity to consume information, entity preferences, entity goals, or entity intent.

9. The system of claim 1, wherein the visualization component is further configured to reformat the data to be presented to an entity as a function of at least one of:

entity role, entity access rights, entity state, capacity of the entity to consume information, entity preferences, entity goals, or entity intent.

10. The system of claim 1, wherein the visualization component is further configured to modify at least one of the first data visualization or the second data visualization as a function of environmental conditions or use conditions associated with a rendering device on which the visualization is rendered.

11. The system of claim 10, wherein the visualization component is further configured to modify at least one of the first data visualization or the second data visualization as a function of lighting conditions, display constraints of a device presenting the visualization, or vision capabilities of the entity.

12. A computer-implemented method for presenting customized visualization in an industrial automation environment, comprising:

determining data relating to an industrial automation environment in connection with presenting a first data visualization, including the data, on a first display device, wherein the first data visualization comprises a first display object subset;

capturing context information pertaining to the first data visualization;

determining a second display object subset facilitating presenting of the data as a function of the context information, wherein the first display object subset and second display object subset comprise at least one display object selected from a set of display objects and the first display object subset and the second display object subset are non-overlapping;

selecting the second display object subset; and

updating, dynamically, the first data visualization with a second data visualization displaying the data with the second display object subset.

13. The method of claim 12, wherein the capturing includes capturing context information based on at least one of content of information, context of a sending entity or context of a recipient entity.

14. The method of claim 12, further comprising reformatting the data in response to the data being in a format incompatible for display by the second display object subset.

15. The method of claim 12, further comprising capturing at least one of:

a role of an entity, entity access rights, prior interactions by the entity, a current entity state, entity preferences, or historical data in connection with inferring or determining a current or future intent of the entity.

16. The method of claim 14 further comprising reformatting the data as a function of at least one of rendering device capabilities, entity rights, entity roles, or entity preferences.

17. The method of claim 12, further comprising authenticating an entity, and customizing at least one of the first data visualization or the second data visualization as a function of the authenticating.

18. The method claim 12, further comprising updating the first visualization with the second visualization as a function of change in interest of the data facilitating the presenting of the data in accord with the change in interest.

19. A computer-implemented system for presenting customized visualization in an industrial automation environment, comprising:

means for determining data relating to an industrial automation environment for presenting with a first data visualization, wherein the first data visualization comprises a first display object subset;

means for presenting the first data visualization on a first display device;

means for capturing context information regarding the data; and

means for determining a second display object subset facilitating presenting of the data as a function of the context information, wherein the first display object subset and second display object subset comprise at least one display object selected from a set of display objects and the first display object subset and the second display object subset have no common display object;

means for selecting the second display object subset; and

means for updating, dynamically, the first visualization with a second data visualization displaying the data with the second display object subset.

20. A computer-readable medium having computer-executable instructions for:

performing a presentation, on a display device, of a customized visualization in an industrial automation environment, comprising further instructions for;

determining data relating to an industrial automation environment in connection with presenting a first data visualization, including the data, on a first display device, wherein the first data visualization comprises a first display object subset;

capturing context information pertaining to the first data visualization;

determining a second display object subset facilitating presenting of the data as a function of the context information, wherein the first display object subset and second display object subset comprise at least one display object selected from a set of display objects and the first display object subset and the second display object subset are non-overlapping;

selecting the second display object subset;

and updating, dynamically, the first data visualization with a second data visualization displaying the data with the second display object subset.

21. The computer-readable medium of claim 20, wherein the capturing includes capturing context information based on at least one of content of information, context of a sending entity or context of a recipient entity.

22. The computer-readable medium of claim 20, further comprising reformatting data in response to the data being in a format incompatible for display by the second display object subset.

23. The computer-readable medium of claim 20, further comprising capturing at least one of:

a role of an entity, entity access rights, prior interactions by the entity, a current entity state, entity preferences, or historical data in connection with inferring or determining a current or future intent of the entity.

24. The computer-readable medium of claim 22 further comprising reformatting the data as a function of at least one of rendering device capabilities, entity rights, entity roles, or entity preferences.

25. The computer-readable medium of claim 20, further comprising authenticating an entity, and customizing at least one of the first data visualization or the second data visualization as a function of the authenticating.