Data validation using signatures and sampling

• US 7,966,279 B2
• Filed: 01/23/2009
• Issued: 06/21/2011
• Est. Priority Date: 05/28/2003
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Rajasekaran, Kulothungan, Garg, Neeraj, Carter, Cale D., Martin, Deuane J., Singh, Pankaj K.
• Primary Examiner(s): Gaffin; Jeffrey A
• Assistant Examiner(s): Kennedy; Adrian L
• Application Number:
  US12/358,666
• Publication Number:
  US 20090132461A1
• Time in Patent Office: 879 Days
• Field of Search: None
• US Class Current: 706/54
• CPC Class Codes: H04L 2209/30 Compression, e.g. Merkle-Damgard construction
• CPC Class Codes: H04L 2209/56 Financial cryptography, e.g. electronic payment or e-cash
• CPC Class Codes: H04L 2209/80 Wireless network architectures or network communication protocols for wireless network security H04W12/00
• CPC Class Codes: H04L 9/3247 involving digital signatures

Abstract

Architecture that facilitates validation of a data mapping of data from a data source to a data target. There is included a signature generation component that generates a source signature of all or a portion of the data source and a target signature of all or a corresponding portion of the data target, and a sampling component that obtains a sample of the source data a corresponding sample of the target data. The data signatures and data samples are compared respectively and processed with a processing component to determine the status of the validation process.

Claims

1. A method that is at least partially executed upon a processor for facilitating validation of a mapping of data between a raw data source and a raw data target, comprising:

determining at least one of a type of data or amount of the data of the raw data source to utilize for validation;

determining at least one of a sampling rate or an amount of compression of the data for the raw data source and the raw data target;

generating a source data signature of the raw data source and a target data signature of the raw data target utilizing the sampling rate, the amount of compression, or a combination thereof;

obtaining respective data samples of the raw data source and the raw data target;

processing the data samples and data signatures to determine status of a validation process through comparison of the sample the raw source data against corresponding raw target data as well as comparison of the source data signature against the target data signature; and

transforming the signature compare result and the sample compare result into a construct in a logical manner.

2. The method of claim 1, further comprising determining one of a type of record that is used to obtain the data sample of the data source.

3. The method of claim 1, further comprising determining at least one of a type of the data or amount of the data of the data source to utilize for validation.

4. The method of claim 3, further comprising determining a weighting of at least a portion of the data source to determine which data source of a plurality of data sources should be used for validation or which portions of the selected data source will be used for validation.

5. The method of claim 1, wherein generating a source data signature of the raw data source comprises utilizing all of the data of the raw data source.