Systems and methods for interactive virtual reality process control and simulation

• US 6,289,299 B1
• Filed: 02/17/1999
• Issued: 09/11/2001
• Est. Priority Date: 02/17/1999
• Status: Expired due to Fees

• Current Assignee: United States Department of Energy
• Original Assignee: Westinghouse Savannah River Company
• Inventors: Whitney, Michael A., Daniel, William E. Jr.
• Primary Examiner(s): Teska, Kevin J.
• Assistant Examiner(s): JONES, HUGH M
• Application Number:
  US09/250,850
• Time in Patent Office: 937 Days
• Field of Search: 703/21, 703/6, 703/2, 345/419
• US Class Current: 703/21
• CPC Class Codes: G05B 23/0216 Human interface functionality, e.g. monitoring system providing help to the user in the selection of tests or in its configuration
• CPC Class Codes: G05B 23/0267 Fault communication, e.g. human machine interface [HMI]

Abstract

A system for visualizing, controlling and managing information includes a data analysis unit for interpreting and classifying raw data using analytical techniques. A data flow coordination unit routes data from its source to other components within the system. A data preparation unit handles the graphical preparation of the data and a data rendering unit presents the data in a three-dimensional interactive environment where the user can observe, interact with, and interpret the data. A user can view the information on various levels, from a high overall process level view, to a view illustrating linkage between variables, to view the hard data itself, or to view results of an analysis of the data. The system allows a user to monitor a physical process in real-time and further allows the user to manage and control the information in a manner not previously possible.

Claims

1. A method of computer generation of an interactive virtual reality world for monitoring, controlling, and simulating a process, comprising:

constructing a first group of one or more related screen displays associated with the operation of a process, which screen displays, called raw data views, are analog representations or alphanumeric equivalents of outputs from at least two signal interfaces of equipment or of variables in the process that is to be monitored, controlled, and simulated;

constructing a second group of one or more related screen displays associated with the operation of a process, which screen displays, called derived views, include graphical representations, called output objects, of one or more processing variables or of one or more units of processing equipment in the process that is to be monitored, controlled, and simulated, which output objects are derived from outputs from analog or digital signal output, or from analog or digital sensor interfaces of equipment or of variables in the process that is to be monitored, controlled, and simulated;

constructing in the derived views one or more graphical representations, called input objects, of controllable elements in the process that is to be monitored, controlled, and simulated, which input objects include graphical representations of adjustable parameters, called control elements, associated with an analog or digital signal input interface of a controllable element of a unit of equipment or of a computational module in the process that is to be monitored, controlled, and simulated;

interfacing the input objects, including the control elements thereof, with the corresponding inputs of signal interfaces of equipment or of variables in the process that is to be monitored, controlled, and simulated so that changing the control elements through manipulation by mouse, keyboard command, or by other input device associated with the computer displaying a derived view, a value or state of a control element in an input object causes a corresponding change in the analog or digital signal presented at the corresponding signal input interface of a unit of equipment or of a computational module in the process that is to be monitored, controlled, and simulated;

controlling a unit of equipment or a computational module in the process through manipulation of the control elements; and

interfacing through communications circuits or network one or more interactive virtual worlds with a user of the one or more interactive virtual worlds.

2. The method of claim 1, wherein the interactive virtual reality world further comprises enabling the user of one or more interactive virtual reality worlds to select a raw data view or a derived view from among two or more such views and from among two or more virtual reality worlds.

3. The method of claim 1, wherein each output object in a series of derived views corresponds to at least one piece of equipment, computational module, or variable of interest in the process that is to be monitored, controlled, and simulated, and wherein the collection of such derived views, called herein a process overview world, further comprises displaying output objects related to each other according to a chronologically based sequence, such as the sequence in which a workpiece is handled, a feedstream is processed, a computational process is executed, or a customer is serviced.

4. The method of claims 1, 2, or 3, wherein each control element of an input object corresponds to a single processing variable in the process that is to be monitored, controlled, and simulated.

5. The method of claims 1, 2, or 3, wherein each control element of an input object corresponds to at least two processing variables in the process that is to be monitored, controlled, and simulated.

6. The method of claims 1, 2, or 3, wherein the computer displaying an interactive virtual reality world, or a computer interfaced over a communications network with the computer displaying an interactive virtual reality world, renders the derived views in two dimensions.

7. The method of claims 1, 2, or 3, wherein the computer displaying an interactive virtual reality world, or a computer interfaced over a communications network with the computer displaying an interactive virtual reality world, renders the derived views in three dimensions.

8. The method of claims 1, 2, or 3, wherein the computer displaying an interactive virtual reality world, or a computer interfaced over a communications network with the computer displaying a process overview world, renders the derived views in three dimensions, and wherein the user can navigate the user'"'"'s point of observation to any point within the coordinate space of the interactive virtual reality world and obtain a display of a three-dimensional perspective view from such point of observation.

9. The method of claims 1, 2, or 3, wherein the computer displaying an interactive virtual reality world, or a computer interfaced over a communications network with the computer displaying an interactive virtual reality world, renders the derived views in the interactive virtual reality world in three dimensions, and wherein the perspectives in the derived views can be moved by the user through a unit of equipment, a workpiece being handled, a feedstream being processed, or a computational process being executed, i.e., navigated through a rendering of the unit of equipment, workpiece, feedstream, or computational process to display an “

x-ray vision”

view of the internal aspects of a unit of equipment, of a workpiece being handled, of a feedstream being processed, or of a computational process being executed.

10. The method of claim 3, wherein the computer displaying a process overview world, or a computer interfaced over a communications network with the computer displaying a process overview world, stores limit values of parameters of a signal output interface, monitors one or more parameters of a signal output interface associated with an output object, detects whenever a parameter has exceeded one or more limit values, and during periods a parameter of a signal output interface associated with an output object has exceeded one or more limit values, displays a notice, called an alarm window, that describes each parameter and parameter value that has exceeded one or more limit values, wherein such display is adjacent to the relevant output object in a user'"'"'s display screen or in another part of the user'"'"'s display screen and is a graphical representation or alphanumeric data.

11. The method of claim 10, wherein the computer displaying a process overview world, or a computer interfaced over a communications network with the computer displaying a process overview world, computes, stores, and displays one or more root cause analysis maps and reports of one or more parameters exceeding limit values, and during periods a parameter of a signal output interface associated with an output object has exceeded one or more limit values, such root cause analysis maps and reports pertaining to a parameter of a signal output interface associated with an output object that has exceeded one or more limit values are displayed as graphical representations or as alphanumeric data in the alarm window, adjacent to the associated output object, or in another area of the user'"'"'s display screen.

12. The method of claim 10, wherein the computer displaying a process overview world, or a computer interfaced over a communications network with the computer displaying a process overview world, includes a database containing information about each root cause analysis that is performed and upon request from the user to display additional information about the result of a root cause analysis, displays more detailed root cause analysis maps or reports corresponding to the request.

13. The method of claim 3, wherein the computer displaying a process overview world, or a computer interfaced over a communications network with the computer displaying a process overview world, calculates a prediction that parameters of one or more units of equipment or of computational modules associated with an output object have reached a threshold probability of exceeding limit values, wherein such computer stores and displays the identity of the parameters and the results of the prediction as a graphical representation or as alphanumeric data in an area, called a prediction window, adjacent to the associated output object displayed in a user'"'"'s display screen, or in another area of the user'"'"'s display screen.

14. The method of claim 3, wherein the computer displaying a process overview world, or a computer interfaced over a communications network with the computer displaying a process overview world, determines unused capacity (the ability of a process to do more processing without violating some prescribed physical or operating limits) of one or more units of equipment or of computational modules associated with an output object, and stores the results of the determination, wherein such computer stores and displays the identity of the parameters involved and the results of the determination as a graphical representation or as alphanumeric data in an area, called a capacity window, adjacent to the associated output object displayed in a user'"'"'s display screen, or in another area of the user'"'"'s display screen.

15. The method of claim 3, wherein the computer displaying a process overview world, or a computer interfaced over a communications network with the computer displaying a process overview world, determines how existing capacity (the ability of a process to do processing without violating some prescribed physical or operating limits) of one or more units of equipment might be used more efficiently, wherein such computer stores and displays the results of the determination as a graphical representation or as alphanumeric data in an area, called an efficiency window, adjacent to the associated output object displayed in a user'"'"'s display screen, or in another area of the user'"'"'s display screen.

16. The method of claim 1, wherein a series of derived views, called herein a variable interaction world, further comprises output objects, input objects, and views in which the output objects and input objects are included and graphically linked in a given view based on relationships between the dependent and the independent variables associated with the output objects and input objects in the given view.

17. The method of claim 16, wherein the variable interaction world further comprises:

rendering the derived views in three dimensions, and wherein the user can navigate the user'"'"'s point of observation to any point within the coordinate space of the variable interaction world and obtain a display of a three-dimensional perspective view from such point of observation;

computing and displaying relationships between the dependent and the independent variables associated with the output objects and input objects in a given view;

displaying graphical representations or alphanumeric data that show the relationships between the dependent and the independent variables;

storing limit values of parameters of a signal output interface, and detecting and displaying that a parameter of a signal output interface associated with an output object has exceeded one or more limit values, and during periods a parameter of a signal output interface associated with an output object has exceeded one or more limit values, displaying a notice, called an alarm window, that describes each parameter and parameter value that has exceeded one or more limit values, wherein such display is adjacent to the relevant output object in user'"'"'s display screen or in another part of the user'"'"'s display screen and is a graphical representation or alphanumeric data; and

may include

predicting that parameters of one or more variables in the variable interaction world have reached a threshold probability of exceeding limit values, and displaying the identity of the variables and the results of the prediction as a graphical representation or as alphanumeric data in an area, called a prediction window, adjacent to the associated output object displayed in a user'"'"'s display screen, or in another area of the user'"'"'s display screen.

18. The method of claim 16, wherein the output objects and input objects in a view within the variable interaction world are included in a given view based on the criticality of the variables represented by the output objects and input objects in the process that is to be monitored, controlled, and simulated.

19. The method of claim 1, wherein one series of derived views, called herein a detailed derivation world, includes output objects and input objects and further comprises:

rendering the derived views in three dimensions, and wherein the user can navigate the user'"'"'s point of observation to any point within the coordinate space of the detailed derivation world and obtain a display of a three-dimensional perspective view from such point of observation;

displaying views in which the output objects and input objects are included in a given view based on the relationships between the dependent and the independent variables that the output objects and input objects represent;

computing and displaying a calculation or other derivation of the variables associated with the output objects and input objects;

displaying graphical representations or alphanumeric data that show the calculation or other derivation of the variables associated with the output objects and input objects;

storing limit values of parameters of a signal output interface, detecting and displaying that a parameter of a signal output interface associated with an output object has exceeded one or more limit values, and during periods a parameter of a signal output interface associated with an output object has exceeded one or more limit values, displaying a notice, called an alarm window, that describes each parameter and parameter value that has exceeded one or more limit values, wherein such display is adjacent to the relevant output object in user'"'"'s display screen or in another part of the user'"'"'s display screen and is a graphical representation or alphanumeric data; and

may include

predicting that parameters of one or more variables in the detailed derivation world have reached a threshold probability of exceeding limit values, and displaying the identity of the variables and the results of the prediction as a graphical representation or as alphanumeric data in an area, called a prediction window, adjacent to the associated output object displayed in a user'"'"'s display screen, or in another area of the user'"'"'s display screen.

20. A method of computer generation of related interactive virtual reality worlds for monitoring controlling, and simulating a process, comprising:

constructing a raw data world displaying at least one view of raw data sourced from sensors monitoring a process;

constructing a process overview world displaying at least one view of a process involving a feedstream, workpiece, or unit of equipment, wherein outputs of each feedstream, workpiece, or unit of equipment are each represented and displayed as an output object, inputs to each feedstream, workpiece, or unit of equipment are each represented and displayed as an input object, and adjustable parameters associated with an analog or digital signal input interface of a controllable element of a feedstream, workpiece, or unit of equipment are each represented and displayed as a control element;

constructing a variable interaction world displaying at least one view of the interaction of variables related to an output object or to an input object;

constructing a detailed derivation world displaying at least one view of the derivation of at least one variable related to an output object or to an input object;

providing a user with a means of navigating the above-described collection of virtual reality worlds by selecting an output object and following the output object'"'"'s links to other worlds, or by selecting an input object and following the input object'"'"'s links to other worlds;

displaying the views in the above-described virtual reality worlds that result from the navigation performed by the user;

enabling the user to drill through the views of the above-described virtual reality worlds, that is, as the user navigates the links between objects in the virtual reality worlds, displays of graphical representations or of alphanumeric data of raw data, process overview, variable interaction, or derivation of variables associated with an output object or input object selected by the user are presented to the user in each view;

interfacing the input objects, including the control elements thereof, with the corresponding inputs of signal interfaces of equipment or of variables in the process that is to be monitored, controlled, and simulated so that changing the control elements through manipulation by mouse, keyboard command, or by other input device associated with the computer displaying a view, a value or state of a control element in an input object causes a corresponding change in the analog or digital signal presented at the corresponding signal input interface of a unit of equipment process that is to be monitored, controlled, and simulated;

controlling a feedstream, workpiece, or unit of equipment in the process through manipulation of the control elements; and

interfacing through communications circuits or network one or more interactive virtual worlds with a user of the one or more interactive virtual worlds.

21. A method for conveying information to a user through a computer-generated display of a plurality of interactive, three-dimensional, virtual reality world for monitoring, controlling, and simulating a process, comprising:

constructing a raw data world displaying at least one view of raw data sourced from sensors monitoring a process;

constructing a process overview world displaying at least one view of a process involving a feedstream, workpiece, or unit of equipment, wherein outputs of each feedstream, workpiece, or unit of equipment are each represented and displayed as an output object, inputs to each feedstream, workpiece, or unit of equipment are each represented and displayed as an input object, and adjustable parameters associated with an analog or digital signal input interface of a controllable element of a feedstream, workpiece, or unit of equipment are each represented and displayed as a control element;

constructing a variable interaction world displaying at least one view of the interaction of variables related to an output object or to an input object;

constructing a detailed derivation world displaying at least one view of the derivation of at least one variable related to an output object or to an input object;

providing a user with a means of navigating the virtual reality worlds by selecting an output object and following the output object'"'"'s links to other worlds, or by selecting an input object and following the input object'"'"'s links to other worlds;

displaying the views in the virtual reality worlds that result from the navigation performed by the user;

enabling the user to drill through the views of the virtual reality worlds, that is, as the user navigates the links between objects in the virtual reality worlds, that is, displays of graphical representations or of alphanumeric data, of raw data process overview, variable interaction, or derivation of variables associated with an output object or input object selected by the user are presented to the user in each view;

enabling the user to navigate through the feedstream, workpiece, unit of equipment, or computational process to display an “

x-ray vision”

view of the internal aspects of a feedstream being processed, of a workpiece being handled, of a unit of equipment, or of a computational process being executed based on data from the feedstream, workpiece, unit of equipment, or computational process;

interfacing the input objects, including the control elements thereof, with the corresponding inputs of signal interfaces of equipment or of variables in the process that is to be monitored, controlled, and simulated so that changing the control elements through manipulation by mouse, keyboard command, or by other input device associated with the computer displaying a view, a value or state of a control element in an input object causes a corresponding change in the analog or digital signal presented at the corresponding signal input interface of the process that is to be monitored, controlled, and simulated;

controlling a feedstream, workpiece, unit of equipment, or computational process through manipulation of the control elements; and

interfacing through communications circuits or network one or more interactive virtual worlds with a user of the one or more interactive virtual worlds.

22. A system for the computer generation of an interactive virtual reality world for process control comprising:

a means for constructing a first group of one or more related screen displays associated with the operation of a process, which screen displays, called raw data views, are analog representations or alphanumeric equivalents of outputs from at least two signal interfaces of equipment or of variables in the process that is to be monitored, controlled, and simulated;

a means for constructing a second group of one or more related screen displays associated with the operation of a process, which screen displays, called derived views, include graphical representations, called output objects, of one or more processing variables or of one or more units of processing equipment in the process that is to be monitored, controlled, and simulated, which output objects are derived from outputs from analog or digital signal output, or from analog or digital sensor interfaces of equipment or of variables in the process that is to be monitored, controlled, and simulated;

a means for constructing in the derived views one or more graphical representations, called input objects, of controllable elements in the process that is to be monitored, controlled and simulated, which input objects include graphical representations of adjustable parameters, called control elements, associated with an analog or digital signal input interface of a controllable element of a unit of equipment or of a computational module in the process that is to be monitored, controlled, and simulated;

a means for interfacing the input objects, including the control elements thereof, with the corresponding inputs of signal interfaces of equipment or of variables in the process that is to be monitored, controlled, and simulated so that changing the control elements through manipulation by mouse, keyboard command, or by other input device associated with the computer displaying a derived view, a value or state of a control element in an input object causes a corresponding change in the analog or digital signal presented at the corresponding signal input interface of a unit of equipment or of a computational module in the process that is to be monitored, controlled, and simulated;

a means for controlling a unit of equipment or a computational module in the process through manipulation of the control elements; and

one or more communications circuits or networks that interface one or more interactive virtual worlds with a user of the one or more interactive virtual worlds.

23. The system of claim 22 that includes a means for the user'"'"'s selecting what output objects or input objects to display in a view.

24. The system of claim 22, wherein each output object in a series of derived views corresponds to a specific piece of equipment, a specific computational module, or a variable of interest in the process that is to be monitored, controlled, and simulated, and wherein the collection of such derived views, called herein a process overview world, shows output objects related to each other according to a chronologically based sequence, such as the sequence in which a workpiece is handled, a feedstream is processed, a computational process is executed, or a customer is serviced.

25. The system of claims 22, 23, or 24, wherein the computer displaying an interactive virtual reality world, or a computer interfaced over a communications network with the computer displaying a interactive virtual reality world, includes a means for rendering the derived views in two dimensions.

26. The system of claims 22, 23, or 24, wherein the computer displaying an interactive virtual reality world, or a computer interfaced over a communications network with the computer displaying a interactive virtual reality world, includes a means for rendering the derived views in three dimensions.

27. The system of claims 22, 23, or 24, wherein the computer displaying an interactive virtual reality world, or a computer interfaced over a communications network with the computer displaying an interactive virtual reality world, includes a means for rendering the derived views in three dimensions, and wherein the user can navigate the user'"'"'s point of observation to any point within the coordinate space of the interactive virtual reality world and obtain a display of a three-dimensional perspective view from such point of observation.

28. The system of claims 22, 23, or 24, wherein the computer displaying an interactive virtual reality world, or a computer interfaced over a communications network with the computer displaying an interactive virtual reality world, includes a means for rendering the derived views in the interactive virtual reality world in three dimensions, and wherein the perspectives in the derived views can be moved by the user through a unit of equipment, a workpiece being handled, a feedstream being processed, or a computational process being executed, i.e., navigated through a rendering of the unit of equipment, workpiece, feedstream, or computational process to display an “

x-ray vision”

view of the internal aspects of a unit of equipment, of a workpiece being handled, of a feedstream being processed, or of a computational process being executed.

29. The system of claim 24, wherein the computer displaying a process overview world, or a computer interfaced over a communications network with the computer displaying a process overview world, includes a means for storing limit values of parameters of a signal output interface, of monitoring one or more parameter of a signal output interface associated with an output object, of detecting whenever a parameter has exceeded one or more limit values, and during periods a parameter of a signal output interface associated with an output object has exceeded one or more limit values, of displaying a notice, called an alarm window, that describes each parameter and parameter value that has exceeded one or more limit values, wherein such display is adjacent to the relevant output object in a user'"'"'s display screen or in another part of the user'"'"'s display screen and is a graphical representation, or alphanumeric data.

30. The system of claim 24, wherein the computer displaying a process overview world, or a computer interfaced over a communications network with the computer displaying a process overview world, includes a means for computing, and for storing and displaying, the results of one or more root cause analysis maps and reports of one or more parameters exceeding limit values, and during periods a parameter of a signal output interface associated with an output object has exceeded one or more limit values, such root cause analysis maps and reports pertaining to a parameter of a signal output interface associated with an output object that has exceeded one or more limit values are displayed as graphical representations or as alphanumeric data in the alarm window, adjacent to the associated output object, or in another area of the user'"'"'s display screen.

31. The system of claim 24, wherein the computer displaying a process overview world, or a computer interfaced over a communications network with the computer displaying a process overview world, includes a database containing information about each root cause analysis that is performed and includes a means for displaying a graphical representation or alphanumeric data to a user of the computer displaying a process overview world, and upon request from the user to display additional information about the result of a root cause analysis, displays more detailed root cause analysis maps or reports corresponding to the request.

32. The system of claim 24, wherein the computer displaying a process overview world, or a computer interfaced over a communications network with the computer displaying a process overview world, includes a means for predicting that parameters of one or more units of equipment or of computational modules associated with an output object have reached a threshold probability of exceeding limit values, wherein such computer stores and displays the identity of the parameters and the results of the prediction as a graphical representation or as alphanumeric data in an area, called a prediction window, adjacent to the associated output object displayed in a user'"'"'s display screen, or in another area of the user'"'"'s display screen.

33. The system of claim 24, wherein the computer displaying a process overview world, or a computer interfaced over a communications network with the computer displaying a process overview world, includes a means for determining unused capacity (the ability of a process to do more processing without violating some prescribed physical or operating limits) of one or more units of equipment or of computational modules associated with an output object, and of storing the results of the determination, wherein such computer stores and displays the identity of the parameters involved and the results of the determination as a graphical representation or as alphanumeric data in an area, called a capacity window, adjacent to the associated output object displayed in a user'"'"'s display screen, or in another area of the user'"'"'s display screen.

34. The system of claim 24, wherein the computer displaying a process overview world, or a computer interfaced over a communications network with the computer displaying a process overview world, includes a means for determining how existing capacity (the ability of a process to do processing without violating some prescribed physical or operating limits) of one or more units of equipment or of computational modules might be used more efficiently, wherein such computer stores and displays the results of the determination as a graphical representation or as alphanumeric data in an area, called an efficiency window, adjacent to the associated output object displayed in a user'"'"'s display screen, or in another area of the user'"'"'s display screen.

35. The system of claim 22, wherein a series of derived views, called herein a variable interaction world, further comprises output objects and views in which the output objects are included and graphically linked in a given view based on relationships between the dependent and the independent variables associated with the output objects and input objects in the given view.

36. The system of claim 35, wherein the variable interaction world further comprises:

a means for rendering the derived views in three dimensions, and wherein the user can navigate the user'"'"'s point of observation to any point within the coordinate space of the variable interaction world and obtain a display of a three-dimensional perspective view from such point of observation;

a means for of computing and displaying relationships between the dependent and the independent variables associated with the output objects and input objects in a given view;

graphical representations in schematic form, in symbolic form, or as alphanumeric data that show the relationships between the dependent and the independent variables;

a means for storing limit values of parameters of a signal output interface, and of detecting and displaying that a parameter of a signal output interface associated with an output object has exceeded one or more limit values, and during periods a parameter of a signal output interface associated with an output object has exceeded one or more limit values, displaying a notice, called an alarm window, that describes each parameter and parameter value that has exceeded one or more limit values, wherein such display is adjacent to the relevant output object in user'"'"'s display screen or in another part of the user'"'"'s display screen and is a graphical representation or alphanumeric data; and

may include

a means for predicting that parameters of one or more variables in the variable interaction world have reached a threshold probability of exceeding limit values, and for display of the identity of the variables and the results of the prediction as a graphical representation or as alphanumeric data in an area, called a prediction window, adjacent to the associated output object displayed in a user'"'"'s display screen, or in another area of the user'"'"'s display screen.

37. The system of claim 35, wherein the output objects in a view within the variable interaction world are included in a given view based on the criticality of the variables represented by the output objects in the process that is to be monitored, controlled, and simulated.

38. The system of claim 22, wherein one series of derived views, called herein a detailed derivation world, includes output objects and input objects and further comprises:

a means for rendering the derived views in three dimensions, and wherein the user can navigate the user'"'"'s point of observation to any point within the coordinate space of the detailed derivation world and obtain a display of a three-dimensional perspective view from such point of observation;

views in which the output objects are included in a given view based on the relationships between the dependent and the independent variables that the output objects and input objects represent;

a means of computing and displaying a calculation or other derivation of the variables associated with the output objects;

graphical representations or alphanumeric data that show the calculation or other derivation of the variables associated with the output objects and input objects;

a means for storing limit values of parameters of a signal output interface, and of detecting and displaying that a parameter of a signal output interface associated with an output object has exceeded one or more limit values, and during periods a parameter of a signal output interface associated with an output object has exceeded one or more limit values, displaying a notice, called an alarm window, that describes each parameter and parameter value that has exceeded one or more limit values, wherein such display is adjacent to the relevant output object in user'"'"'s display screen or in another part of the user'"'"'s display screen and is a graphical representation, or alphanumeric data; and

may include

a means for predicting that parameters of one or more variables in the detailed derivation world have reached a threshold probability of exceeding limit values, and for display of the identity of the variables and the results of the prediction as a graphical representation or as alphanumeric data in an area, called a prediction window, adjacent to the associated output object displayed in a user'"'"'s display screen, or in another area of the user'"'"'s display screen.

39. The system of claim 22, wherein the system includes:

a data flow coordinator unit for receiving data from at least two data sources;

a data preparation unit for transforming the data into output objects, input objects, and views;

a data rendering unit for presenting each output object, input object, and view in two or three dimensions, as selected by a user, to the user;

a data analysis unit for receiving data from at least one of the data sources and for generating graphical representations and summarized alphanumeric data based on received data; and

wherein the data preparation unit varies a characteristic of each output object in response to changes in the corresponding data sourced from signal output interfaces of equipment or of variables in the process that is to be monitored, controlled, and simulated.

40. The system of claim 39, wherein the data flow coordinator unit receives data from a source selected from the group consisting of real time data, temporarily stored data, archived data, or fabricated data.

41. The system of claim 39, wherein the data analysis unit scales the data from a data source and transmits the scaled data to the data flow coordinator for distribution to the data preparation unit.

42. The system of claim 39, wherein the data preparation unit alters a scalar size of at least one output object in proportion to a magnitude of the data from its data source.

43. The system of claim 39, wherein the data preparation unit alters a color of at least one output object in proportion to with a magnitude of the data from its data source.

44. The system of claim 39, wherein the data flow coordinator unit receives data from a plurality of sources, and the data is ultimately received by the data preparation unit, which transforms data from the plurality of sources into a plurality of output objects, and the data rendering unit presents the plurality of output objects in views of at least one virtual reality world.

45. The system of claim 39, wherein the data analysis unit calculates the values of dependent variables based on the values of one or more independent variables from which a given dependent variable depends the relationships and provides such values for presentation in the variable interaction world.

46. The system of claim 39, wherein the data analysis unit calculates limits, and the data and limit information are relayed through the data flow coordinator to the data preparation unit, which places one or more limits upon at least one output object, and the data rendering unit displays one or more limits with one or more relevant output objects.

47. The system of claim 39, wherein in response to a selection of one output object by the user, the data preparation unit obtains data from the data flow coordinator for the selected output object and the data rendering unit displays the data.

48. The system of claim 47, wherein the data rendering unit displays, in addition to a graphic representation of the data, values of the data received from the data preparation unit.

49. The system of claim 47, wherein the data analysis unit receives from the data flow coordinator the data associated with the output object and returns analyzed data to the data flow coordinator, which forwards the data to the data preparation unit for display by the data rendering unit.

50. The system of claim 39, wherein in response to a selection by the user of one of the output objects, the data rendering unit displays at least one linkage between the selected output object and at least one other output object.

51. The system of claim 39, wherein the data flow coordinator unit receives the data from at least one of the data sources over a communications link.

52. The system of claim 39, wherein the data flow coordinator unit receives the data from at least one of the data sources over a network.

53. The system of claim 39, wherein the system is for use with a monitored process that is to be controlled and wherein the system further comprises a device for sending a signal to the process to be controlled in response to a user input.

54. The system of claim 39, wherein the system is for use with a monitored process and wherein the data rendering unit provides a three-dimensional representative view of the monitored process.

55. The system of claim 39, wherein the data analysis unit alters a scalar size of at least one output object in proportion to a magnitude of the data from its data source.

56. The system of claim 39, wherein the data analysis unit alters a color of at least one output object in proportion to a magnitude of the data from its data source.

57. The system of claim 39, wherein the data analysis unit links a given output object associated with a dependent variable to output objects associated with other variables upon which such given output object depends.

58. The system of claim 39, wherein the data analysis unit determines the relationships between dependent and independent variables associated with a given output object and also associated with one or more input objects and other output objects, and returns the data and relationship, or “

linkage,”

information to the data flow coordinator for forwarding to the data preparation unit and then to the data rendering unit for display of the output object and of the associated linkage information.

59. The system of claim 39, wherein the data analysis unit receives from the data flow coordinator the data associated with a given output object and returns variable limit information to the data flow coordinator, which forwards the data and limit information to the data preparation unit for display by the data rendering unit of at least one output object and the limits associated with each such output object.

60. The system of claim 39, wherein the system is for use with a monitored process and wherein the data rendering unit provides a three-dimensional representative view of the monitored process.

61. The system of claim 39, wherein in response to a selection of a given output object by the user, the data preparation unit obtains data received from the data flow coordinator for such given output object and the data rendering unit displays the data.

62. The system of claim 39, wherein the data rendering unit displays values of the data from the data source associated with the output object.

63. A method of computer generation of an interactive virtual reality world for monitoring a process comprising:

constructing a first group of one or more related screen displays associated with the operation of a process, which screen displays, called raw data views, are analog representations or alphanumeric equivalents of outputs from at least two signal interfaces of equipment or of variables in the process that is to be monitored;

constructing a second group of one or more related screen displays associated with the operation of a process, which screen displays, called derived views, include graphical representations, called output objects, of one or more processing variables or of one or more units of processing equipment in the process that is to be monitored, which output objects are derived from outputs from analog or digital signal output, or from analog or digital sensor interfaces of equipment or of variables in the process that is to be monitored;

constructing in the derived views one or more graphical representations associated with at least one piece of equipment, computational module, or variable of interest in the process that is to be monitored, wherein the collection of such derived views, called herein a process overview world, further comprises displaying output objects related to each other according to a chronologically based sequence, such as the sequence in which a workpiece is handled, a feedstream is processed, a computational process is executed, or a customer is serviced;

interfacing through communications circuits or network one or more interactive virtual worlds with a user of the one or more interactive virtual worlds;

enabling the user of one or more interactive virtual reality worlds to select a raw data view or a derived view from among two or more such views and from among two or more virtual reality worlds; and

rendering the derived views in the interactive virtual reality world in three dimensions, and wherein the perspectives in the derived views can be moved by the user through a unit of equipment, a workpiece being handled, a feedstream being processed, or a computational process being executed, i.e., navigated through a rendering of the unit of equipment, workpiece, feedstream, or computational process to display an “

x-ray vision”

view of the internal aspects of a unit of equipment, of a workpiece being handled, of a feedstream being processed, or of a computational process being executed.

64. A method of computer generation of an interactive virtual reality world for controlling a process comprising:

constructing a first group of one or more related screen displays associated with the operation of a process, which screen displays, called raw data views, are analog representations or alphanumeric equivalents of outputs from at least two signal interfaces of equipment or of variables in the process that is to be controlled;

constructing a second group of one or more related screen displays associated with the operation of a process, which screen displays, called derived views, include graphical representations, called output objects, of one or more processing variables or of one or more units of processing equipment in the process that is to be controlled, which output objects arc derived from outputs from analog or digital signal output, or from analog or digital sensor interfaces of equipment or of variables in the process that is to be controlled;

constructing in the derived views one or more graphical representations associated with at least one piece of equipment, computational module, or variable of interest in the process that is to be controlled, wherein the collection of such derived views, called herein a process overview world, further comprises displaying output objects related to each other according to a chronologically based sequence, such as the sequence in which a workpiece is handled, a feedstream is processed, a computational process is executed, or a customer is serviced;

interfacing through communications circuits or network one or more interactive virtual worlds with a user of one or more interactive virtual worlds;

enabling the user of one or more interactive virtual reality worlds to select a raw data view or a derived view from among two or more such views and from among two or more virtual reality worlds; and

rendering the derived views in the interactive virtual reality world in three dimensions, and wherein the perspectives in the derived views can be moved by the user through a unit of equipment, a workpiece being handled, a feedstream being processed, or a computational process being executed, i.e., navigated through a rendering of the unit of equipment, workpiece, feedstream, or computational process to display an “

x-ray vision”

view of the internal aspects of a unit of equipment, a workpiece being handled, o a feedstream being processed, or of a computational process being executed.

67. The method of claims 64, 65 or 66 further comprising displaying in a derived view movable windows, also known as floating palettes, that contain alphanumeric data associated with the user'"'"'s point of perspective within the derived view being navigated by the user.

65. A method of computer generation of an interactive virtual reality world for controlling a process comprising:

constructing a first group of one or more related screen displays assocated with the operation of a process, which screen displays, called raw data views, are analog representations or alphanumeric equivalents of outputs from at least two signal interfaces of equipment or of variables in the process that is to be controlled;

constructing a second group of one or more related screen displays associated with the operation of a process, which screen displays, called derived views, include graphical representations, called output objects, of one or more processing variables or of one or more units of processing equipment in the process that is to be controlled, which output objects are derived from outputs from analog or digital signal output, or from analog or digital sensor interfaces of equipment or of variables in the process that is to be controlled;

constructing in the derived views one or more graphical representations associated with at least one piece of equipment, computational module, or variable of interest in the process that is to be controlled, wherein the collection of such derived views, called herein a process overview world, further comprises displaying output objects related to each other according to a chronologically based sequence, such as the sequence in which a workpiece is handled, a feedstream is processed, a computational process is executed, or a customer is serviced;

constructing in the derived views one or more graphical representations, called input objects, of controllable elements in the process that is to be controlled, which input objects include graphical representations of adjustable parameters, called control elements, associated with an analog or digital signal input interface of a controllable element of a unit of equipment or of a computational module in the process that is to be controlled;

interfacing the input objects, including the control elements thereof, with the corresponding inputs of signal interfaces of equipment or of variables in the process that is to be controlled, so that changing the control elements through manipulation by mouse, keyboard command, or by other input device associated with the computer displaying a derived view, a value or state of a control element in an input object causes a corresponding change in the analog or digital signal presented at the corresponding signal input interface of a unit of equipment or of a computational module in the process that is to be controlled;

controlling a unit of equipment or a computational module in the process through manipulation of the control elements, interfacing through communications circuits or network one or more interactive virtual worlds with a user of the one or more interactive virtual worlds;

enabling the user of one or more interactive virtual reality worlds to select a raw data view or a derived view from among two or more such views and from among two or more virtual reality worlds; and

rendering the derived views in the interactive virtual reality world in three dimensions, and wherein the perspectives in the derived views can be moved by the user through a unit of equipment, a workpiece being handled, a feedstream being processed, or a computational process being executed, i.e., navigated through a rendering of the unit of equipment, workpiece, feedstream, or computational process to display an “

x-ray vision”

view of the internal aspects of a unit of equipment, of a workpiece being handled, of a feedstream being processed, or of a computational process being executed.

66. A method of computer generation of an interactive virtual reality world for simulating a process comprising:

constructing a first group of one or more related screen displays associated with the operation of a process, which screen displays, called raw data views, are analog representations or alphanumeric equivalents of outputs from at least two signal interfaces of equipment or of variables in the process that is to be simulated;

constructing a second group of one or more related screen displays associated with the operation of a process, which screen displays, called derived views, include graphical representations, called output objects, of one or more processing variables or of one or more units of processing equipment in the process that is to be simulated, which output objects are derived from outputs from analog or digital signal output, or from analog or digital sensor interfaces of equipment or of variables in the process that is to be simulated;

constructing in the derived views one or more graphical representations associated with at least one piece of equipment, computational module, or variable of interest in the process that is to be simulated, wherein the collection of such derived views, called herein a process overview world, further comprises displaying output objects related to each other according to a chronologically based sequence, such as the sequence in which a workpiece is handled, a feedstream is processed, a computational process is executed, or a customer is serviced;

constructing in the derived views one or more graphical representations, called input objects, of controllable elements in the process that is to be simulated, which input objects include graphical representations of adjustable parameters, called control elements, associated with an analog or digital signal input interface of a controllable element of a unit of equipment or of a computational module in the process that is to be simulated;

interfacing the input objects, including the control elements thereof, with the corresponding inputs of signal interfaces of equipment or of variables in the process that is to be simulated, so that changing the control elements through manipulation by mouse, keyboard command, or by other input device associated with the computer displaying a derived view, a value or state of a control element in an input object causes a corresponding change in the analog or digital signal presented at the corresponding signal input interface of a unit of equipment or of a computational module in the process that is to be simulated;

controlling a simulated unit of equipment or a computational module in the process through manipulation of the control elements, interfacing through communications circuits or network one or more interactive virtual worlds with a user of the one or more interactive virtual worlds;

enabling the user of one or more interactive virtual reality worlds to select a raw data view or a derived view from among two or more such views and from among two or more virtual reality worlds; and

rendering the derived views in the interactive virtual reality world in three dimensions, and wherein the perspectives in the derived views can be moved by the user through a unit of equipment, a workpiece being handled, a feedstream being processed, or a computational process being executed, i.e., navigated through a rendering of the unit of equipment, workpiece, feedstream, or computational process to display an “

x-ray vision”

view of the internal aspects of a unit of equipment, of a workpiece being handled, of a feedstream being processed, or of a computational process being executed.