System and Method for Energy Management Information System Reliability Assurance

• US 20140006398A1
• Filed: 06/29/2012
• Published: 01/02/2014
• Est. Priority Date: 06/29/2012
• Status: Active Grant

• Current Assignee: Schneider Electric USA, Inc. (Schneider Electric SE)
• Original Assignee: Schneider Electric USA, Inc. (Schneider Electric SE)
• Inventors: Johnson, Jeffrey Wayne
• Granted Patent: US 11,063,998 B2
• Time in Patent Office: Days
• US Class Current: 707/736
• CPC Class Codes: G06Q 50/06 Energy or water supply
• CPC Class Codes: H02J 13/00017 using optical fiber
• CPC Class Codes: H02J 13/00022 using wireless data transmission
• CPC Class Codes: H02J 13/00034 the elements or equipment being or involving an electric power substation
• CPC Class Codes: H02J 3/00 Circuit arrangements for ac mains or ac distribution networks
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: Y02E 60/00 Enabling technologies; Technologies with a potential or indirect contribution to GHG emissions mitigation
• CPC Class Codes: Y04S 10/18 using switches, relays or circuit breakers, e.g. intelligent electronic devices [IED]
• CPC Class Codes: Y04S 10/50 Systems or methods supporting the power network operation or management, involving a certain degree of interaction with the load-side end user applications
• CPC Class Codes: Y04S 40/124 using wired telecommunication networks or data transmission busses
• CPC Class Codes: Y04S 40/126 using wireless data transmission

Abstract

Systems and methods for monitoring, logging, and managing data transformations and data streams of energy management (EM) data energy data sources.

Claims

1. An extension component comprising:

a module for generating a data transformation record of a data transformation of data by a data transformation component of an Energy Management (EM) information system, the data transformation record comprising a unique identifier for a data stream and a time range for the data being transformed; and

an output for sending the data transformation record to a logging database component,

wherein the extension component is operatively connected to a data transformation component of the EM information system.

2. The extension component of claim 1, further comprising:

an interface configured receive a request to regenerate a data stream of a recorded data transformation; and

regenerate the requested data stream.

3. The extension component of claim 2 further comprising:

the interface configured to output a new data stream.

4. The extension component of claim 1, further comprising:

an interface configured to accept user input and enable a user to modify a data transformation performed by the data transformation component.

5. The extension component of claim 4, further comprising:

the interface being configured to enable a user to reconfigure the data transformation component.

6. The extension component of claim 4, further comprising:

the interface being configured to enable a user to edit the data transformed by the data transformation component.

7. The extension component of claim 1, further comprising:

the interface being configured to respond to a request regarding operational activity of the data transformation component.

8. The extension component of claim 2, further comprising:

the interface being configured to respond to a request for at least one of (1) the name of the data transformation component (2) the purpose of the data transformation component, (3) software information, (4) diagnostic information, and (5) status information.

9. A data transformation logging component comprising:

a processing component including at least one interface operatively connected to a data transformation component of an Energy Management (EM) system including an extension component, the data transformation logging component configured to receive and log a data transformation record of a data transformation, the data transformation record comprising a unique identifier for a data stream and a time range for the transformation of the data stream;

a log database for storing a log record of the data transformation record; and

a processing component configured to process the log record of the data transformations of each data stream.

10. The logging component of claim 9, further comprising:

the processing component configured to consolidate sequential operations the each data stream into a single record, wherein the single record is configured for use for a data stream trace.

11. The logging component of claim 9, further comprising:

the log record comprising a log record format includes fields for a stream id, a time range, component id, an operation id; and

a field for tracing one or more data streams, where component id is the unique identifier that describes a component that transforms data.

12. The logging component of claim 9, further comprising:

an interface configured to generate responses to requests about data transformations.

13. The logging component of claim 12, further comprising:

the interface being configured to generate the response to a request comprising a unique identifier for the data stream and a time range for the data stream.

14. The logging component of claim 13, further comprising:

the interface being configured to generate the response comprising a list of components that performed operations on the data stream within the time range and a description of the at least one transformation.

15. The logging component of claim 14, wherein the transformation comprises the transformation of one or more standard system outputs, including at least one of:

a VEE (Validation, Estimation and Editing)/data cleansing operation transformation;

an aggregation/disaggregation transformation;

an arithmetic and logical transformation;

a manual modification transformation;

a reclassification transformation;

a packaging-related transformation;

a data-management transformation;

a transformation output identified after system deployment,

a transformation by a custom component, and

a transformation by an external system or component.

16. A data trace ID generator and decoder component comprising:

an interface configured to generate a reference ID configured to be used as an input to request data trace comprising;

a unique identifier of an EM component producing a system output;

a unique name identifier that represents a content of the system output;

the time the content was produced; and

at least one data stream and time range for data processed by the EM component.

17. The data trace ID generator and decoder of claim 16, comprising:

a decoder for decoding the reference ID into the inputs to build a data stream trace.

18. A system for adding metadata to an EM data stream including:

a component for adding metadata to a data stream, wherein the metadata provides information about at least one of;

data origin, data quality, data processing, and a data storage rule.

19. A system of claim 18, wherein the metadata comprises at least one of:

a quality flag;

a device communication parameter;

a data origin;

a source algorithm; and

stream meta-data.

20. A system of claim 19, wherein the metadata comprises at least one of:

stream metadata added to augment a presentation for a data path trace visualization tool.

21. A computer system including at least one computer processor and computer readable storage medium or media including computer code and at least one storage device in which is stored Energy Management (EM) data for a plurality of EM devices, the system comprising:

a memory including an EM database including records of a data transformations transmitted from a plurality of data transformation components of EM devices; and

one or more processors programmed at least to

receive and log the data transformation record EM transformation data transmitted from the plurality of EM devices;

store, in the memory operatively coupled to at least one of the processors, the EM log data;

provide, for a graphic user interface, an interactive display configured to display a graphic representation of a data stream trace based on the EM log data.

22. The system of claim 21, wherein the system comprises:

a first visualization tool to show the data stream trace;

at least one second tool configured to be accessible from the first visualization tool.

23. The system of claim 21, wherein the system comprises:

an EM information system graphic user interface; and

wherein the first visualization tool is configured to be launched from the EM information system graphic user interface.

24. The system of claim 23, wherein the system comprises at least one of:

an interface for user input of a reference ID to load information about a previous output and launch of visualization and editing tools;

interface configured to regenerate at least one data output and display the data output along with a previous data output;

an interface displaying a visualization of a selected EM data output for editing;

and an interface for responding to request for information about transformation logic associated with a selected output.

25. The system of claim 21, wherein the first visualization tool is a stand-alone tool.

26. The system of claim 21 wherein the graphic user interface is configured to include an interface comprising:

a Reference ID input generated by a Reference ID generator, wherein the Reference ID input is configured to access the data stream trace.

27. The system of claim 21 at least one second visualization tool is configured to at least provide additional details on a data stream, allow modifications to a data transformation, or both.

28. The system of claim 21 wherein the system is configured to display information about the data stream trace, comprising at least one of:

general EM data about a data stream through an EM system, and

EM data for at least one specific transformation of EM data.

29. The system of claim 28 wherein the system is configured to display at least one of:

a data source of the data;

storage location data; and

data processing information.

30. The system of claim 21, wherein the system is configured include an interface for modification of the configuration of at least one data processing step.

31. The system of claim 21, wherein the modification includes at least one of:

altering data stream metadata;

modifying a data cleansing function;

modifying a data processing calculation;

selecting an algorithm selection;

modifying a data storage parameter; and

modifying a data processing parameter.

32. The system of claim 31, wherein the system is configured to allow an update to a visualization based on the modification.

33. A method implemented by at least one computer upon executing programming code stored on at least one non-transitory computer-readable medium, the method comprising:

logging each data transformation of an energy management (EM) data stream, wherein the log of the transformation event includes a unique identifier for the data stream;

classifying the data transformation event according to a classification scheme;

storing the data transformation log in a log database,

wherein the log database comprises logs of each data transformation of the data stream, the logs being configured such that the logs can be used for a data stream trace.

40. The method of claim 33, further comprising:

responding to a request regarding operational activity of the data transformation component.

34. A method for processing data with an extension component, comprising:

generating, with an extension component, a data transformation record of a data transformation of data by a data transformation component of an Energy Management (EM) information system, the data transformation record comprising a unique identifier for a data stream and a time range for the data being transformed; and

sending the data transformation record to a logging database component,

wherein the extension component is operatively connected to a data transformation component of the EM information system.

35. The method of claim 34, further comprising:

receiving a request to regenerate a data stream of a recorded data transformation; and

regenerating the requested data stream.

36. The method of claim 35 further comprising:

outputting a new data stream.

37. The method of claim 34, further comprising:

accepting a user input and enabling a user to modify a data transformation performed by the data transformation component.

38. The method of claim 37, further comprising:

enabling a user to reconfigure the data transformation component.

39. The method of claim 37, further comprising:

enabling a user to edit the data transformed by the data transformation component.

41. The method of claim 34, further comprising:

responding to a request for at least one of (1) the name of the data transformation component (2) the purpose of the data transformation component, (3) software information, (4) diagnostic information, and (5) status information.

42. A method for processing data by a data transformation logging component, the processing component including at least one interface operatively connected to a data transformation component of an Energy Management (EM) system including an extension component, the method comprising:

receiving a data transformation record of a data transformation, the data transformation record comprising a unique identifier for a data stream and a time range for the transformation of the data stream;

logging the data transformation record;

storing a log record of the data transformation record; and

processing the log record of the data transformations of each data stream.

43. The method of claim 42, further comprising:

consolidating sequential operations the each data stream into a single record, wherein the single record is configured for use for a data stream trace.

44. The method of claim 42, wherein the log record comprises a log record format including fields for a stream id, a time range, component id, an operation id;

and a field for tracing one or more data streams, and

wherein the component id is the unique identifier that describes a component that transforms data.

45. The method of claim 42, further comprising:

an interface configured to generate responses to requests about data transformations.

46. The method of claim 45, further comprising:

generating the response to a request comprising a unique identifier for the data stream and a time range for the data stream.

47. The method of claim 46, further comprising:

generating the response comprising a list of components that performed operations on the data stream within the time range and a description of the at least one transformation.

48. The method of claim 47, wherein the transformation comprises the transformation of one or more standard system outputs, including at least one of:

a VEE (Validation, Estimation and Editing)/data cleansing operation transformation;

an aggregation/disaggregation transformation;

an arithmetic and logical transformation;

a manual modification transformation;

a reclassification transformation;

a packaging-related transformation;

a data-management transformation;

a transformation output identified after system deployment,

a transformation by a custom component, and

a transformation by an external system or component.

49. A method comprising:

generating a reference ID configured to be used as an input to request a data trace comprising;

a unique identifier of an EM component producing a system output;

a unique name identifier that represents a content of the system output;

the time the content was produced; and

at least one data stream and time range for data processed by the EM component.

50. The method of claim 49, further comprising:

decoding the reference ID into the inputs to build a data stream trace.

51. A method comprising:

adding metadata to an EM data stream, wherein the metadata provides information about at least one of;

data origin, data quality, data processing, and a data storage rule.

52. A method of claim 51, wherein the metadata comprises at least one of:

a quality flag;

a device communication parameter;

a data origin;

a source algorithm; and

stream metadata.

53. A method of claim 52, wherein the method comprises:

adding stream metadata to augment a presentation for a data path trace visualization tool.

54. A method implemented by computer system including at least one computer processor and computer readable storage medium or media including computer code and at least one storage device in which is stored Energy Management (EM) data for a plurality of EM devices, the system comprising a memory including an EM database including records of a data transformations transmitted from a plurality of data transformation components of EM devices, and one or more processors programmed at least to carry out the method comprising:

receiving a data transformation record EM transformation data transmitted from the plurality of EM devices;

logging the data transformation record,

storing, in the memory operatively coupled to at least one of the processors, the EM log data;

providing, for a graphic user interface, an interactive display configured to display a graphic representation of a data stream trace based on the EM log data.

55. The method of claim 54, wherein the method further comprises:

providing a first visualization tool to show the data stream trace;

providing at least one second tool configured to be accessible from the first visualization tool.

56. The method claim 54, wherein the method comprises:

configuring the first visualization to be launched from the EM information system graphic user interface.

57. The method of claim 56, wherein the method comprises:

providing an interface for user input of a reference ID to load information about a previous output and launch of visualization and editing tools;

regenerating at least one data output and display the data output along with a previous data output;

displaying a visualization of a selected EM data output for editing; and

responding to request for information about transformation logic associated with a selected output.

58. The method of claim 54, wherein the first visualization tool is a stand-alone tool.

59. The method of claim 54 wherein the graphic user interface is configured to include an interface comprising:

a Reference ID input generated by a Reference ID generator, wherein the Reference ID input is configured to access the data stream trace.

60. The method of claim 54 wherein the at least one second visualization tool is configured to at least provide additional details on a data stream, allow modifications to a data transformation, or both.

61. The method of claim 54 wherein the method further comprises displaying information about the data stream trace, comprising displaying at least one of:

general EM data about a data stream through an EM system, and

EM data for at least one specific transformation of EM data.

62. The method of claim 61 wherein the method further comprises displaying at least one of:

a data source of the data;

storage location data; and

data processing information.

63. The method of claim 54, wherein the method comprises:

providing an interface for modification of the configuration of at least one data processing step.

64. The method of claim 54, wherein the modification includes at least one of:

altering data stream metadata;

modifying a data cleansing function;

modifying a data processing calculation;

selecting an algorithm selection;

modifying a data storage parameter; and

modifying a data processing parameter.

65. The method of claim 64, wherein the method further comprises:

updating a visualization based on the modification.