System and method of high volume import, validation and estimation of meter data

• US 9,273,983 B2
• Filed: 03/24/2014
• Issued: 03/01/2016
• Est. Priority Date: 11/11/2008
• Status: Active Grant

• Current Assignee: Itron, Inc.
• Original Assignee: Itron, Inc.
• Inventors: Sonderegger, Robert C.
• Primary Examiner(s): Tran, Thienvu
• Assistant Examiner(s): THOMAS, LUCY M
• Application Number:
  US14/223,467
• Publication Number:
  US 20140257757A1
• Time in Patent Office: 708 Days
• Field of Search: 340/870.02, 340/870.11
• US Class Current: 1/1
• CPC Class Codes: G01D 4/02 Details
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling

Abstract

A meter data management system includes one or more application servers configured to receive, validate and estimate received meter data. The one or more application servers may include various memory/media elements for storing raw and transformed meter data as well as software in the form of computer-executable instructions, which are executed by a processor to implement a variety of functions, including establishing a mapping between the plurality of external devices and a plurality of preconfigured processing workbins (e.g., collections of meter channels in the same time zones), transforming the received meter data into a plurality of data files identified by timing parameter and workbin, validating data provided in each data file, estimating missing or invalid data, and automatically writing validated (and optionally estimated) data as import files to a database server. Such clean data files are then imported to one or more dedicated databases installed on the database server.

Claims

1. A method for importing, validating, and estimating high volume meter data, the method comprising:

receiving meter data from a plurality of external devices, each external device being assigned to one of a plurality of device groupings;

sorting the meter data into a plurality of workbins respectively associated with the plurality of device groupings;

compressing the meter data contained in each workbin into a plurality of data files, each data file being identifiable by workbin;

importing, for one workbin at a time, all data files associated with such workbin;

storing historic data associated with each workbin;

validating the meter data contained within the data files against the historic data, by comparing such meter data with historic data from comparable prior periods of time during a plurality of processing windows;

using stored historic data for a given workbin to estimate replacement values for meter data that is determined to be invalid or missing for such given workbin during the plurality of processing windows;

forming the validated and estimated meter data into a plurality of port files; and

storing the plurality of import files;

wherein each processing window corresponds to one of the plurality of workbins such that all data files associated with a workbin are processed as a batch.

2. The method of claim 1, further comprising:

establishing a mapping between each of the plurality of external devices and the plurality of workbins, the mapping corresponding to a grouping of external devices provided within the same time zone.

3. The method of claim 1, further comprising:

identifying each data file by at least one timing parameter associated with the date on which the selected portions of meter data was read by an external device.

4. The method of claim 1, further comprising:

before validating the meter data, identifying data readiness corresponding to when all meter data corresponding to a predefined twenty-four hour period has been received from one or more groupings of external devices.

5. The method of claim 1, wherein receiving the meter data from the plurality of external devices includes receiving the meter data in XML format;

and wherein compressing the meter data contained in each workbin into a plurality of data files includes forming compressed binary files.

6. The method of claim 1, further comprising revalidating estimated meter data that was previously found to be invalid before it is formed to import files.

7. The method of claim 1, further comprising:

characterizing each data file compressed by a predetermined file size, and

monitoring the file size and population time for data files processed in each workbin to ensure file efficiency.

8. The method of claim 1, further comprising:

structuring each imported data file to provide metadata indicative of one or more factors selected from;

an indication of what meter readings have been received based on external device identifiers, when each meter reading has been received based on one or more timing parameters, what continuous records of data exist for one or more external devices, what meter readings have been processed by said data management method, and historic data identifying prior consumption levels for selected external devices.