DATA VALIDATION USING SIGNATURES AND SAMPLING

• US 20090125623A1
• Filed: 01/23/2009
• Published: 05/14/2009
• Est. Priority Date: 05/28/2003
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Rajasekaran, Kulothungan, Garg, Neeraj, Carter, Cale D., Martin, Deuane J., Singh, Pankaj K.
• Granted Patent: US 8,122,253 B2
• Time in Patent Office: Days
• US Class Current: 709/224
• CPC Class Codes: H04L 2209/30 Compression, e.g. Merkle-Damgard construction
• CPC Class Codes: H04L 2209/56 Financial cryptography, e.g. electronic payment or e-cash
• CPC Class Codes: H04L 2209/80 Wireless network architectures or network communication protocols for wireless network security H04W12/00
• CPC Class Codes: H04L 9/3247 involving digital signatures

Abstract

Architecture that facilitates validation of a data mapping of data from a data source to a data target. There is included a signature generation component that generates a source signature of all or a portion of the data source and a target signature of all or a corresponding portion of the data target, and a sampling component that obtains a sample of the source data a corresponding sample of the target data. The data signatures and data samples are compared respectively and processed with a processing component to determine the status of the validation process.

Claims

1. A system for validating a mapping of data between a raw data source and a raw data target, comprising:

means for generating respective data signatures of the raw data source and the raw data target;

means for sampling the raw data source and the raw data target to obtain respective data samples;

means for processing the data samples and data signatures to determine the status of the validation process; and

means for combining a result of the sample comparison with a result of signature comparison in a logical manner based upon the determined status.

2. The system of claim 1, the source signature and the target signature are compared logically as part of operation of the means for processing to arrive at an equivalence value that indicates a level of equivalence of the raw source data and the raw target data.

3. The system of claim 1, further comprising means for determining at least one of a type of data or an amount of the data to sample, a result of the determination is used by the means for sampling and by the means for generating in operation.

4. The system of claim 1, the means for generating and the means for sampling are modular such that each is disposed separately on a network, and in communication via the network.

5. The system of claim 1, further comprising means for facilitating data validation of data migration from one version of an application to another version of the same application.

6. The system of claim 1, further comprising means for comparing the sample of the raw source data against corresponding sample raw target data.

7. The system of claim 1, further comprising means for comparing the signature of the raw source data against corresponding sample target data

8. The system of claim 1, the means for sampling operates upon a record.

9. The system of claim 8, further comprising means for choosing a record upon which to sample, the means for sampling operates upon the chosen record.

11. The method of claim 9, the data source signature is generated and one or more data source samples are sampled from the raw data source, the raw data source spans multiple networked locations.

12. The method of claim 9, the data target signature is generated and one or more data target samples are sampled from the raw data target, the data target spans multiple networked locations.

13. The method of claim 9, further comprising sampling the raw data source and the raw data target to obtain respective data samples used in the processing.

14. The method of claim 13, further comprising:

comparing the sample of the raw source data against corresponding sample target data; and

comparing the signature of the raw source data against corresponding sample target data.

15. The method of claim 14, further comprising combining a result of the sample comparison with a result of the signature comparison.

16. The method of claim 13, the data samples sampled are in response to the data signatures comparing unfavorably.

17. The method of claim 13, further comprising transmitting the sampled data and generated signatures.

18. The method of claim 13, the sampling occurs upon a record.

19. The method of claim 18, further comprising choosing a record upon which to sample, sampling occurs upon the chosen record.

10. A method for validating a mapping of data between a raw data source and a raw data target, comprising:

generating respective data signatures of the raw data source and the raw data target; and

processing the data signatures and data samples to determine the status of the validation process, the validation process having associate therewith a level of confidence, the level of confidence increases by performing at least one of increasing a number of the data signatures or decreasing level of compression, the level of compression associates with of at least one of the data source and data target.

20. A system for validating a mapping of data between a data source and a data target, comprising:

means for generating respective data signatures of the data source and the data target;

means for sampling the data source and the data target to obtain respective data samples, the data source and data target are raw;

means for processing the data samples and data signatures to determine the status of the validation process;

means for comparing the sample of the source data against corresponding sample target data;

means for comparing the signature of the source data against corresponding sample target data; and

means for combining a result of the sample comparison with a result of the signature comparison in a logical manner.