Data validation using signatures and sampling

• US 8,122,253 B2
• Filed: 01/23/2009
• Issued: 02/21/2012
• Est. Priority Date: 05/28/2003
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Garg, Neeraj, Carter, Cale D., Rajasekaran, Kulothungan, Martin, Deuane J., Singh, Pankaj K.
• Primary Examiner(s): Truong, Thanhnga B
• Application Number:
  US12/358,686
• Publication Number:
  US 20090125623A1
• Time in Patent Office: 1,124 Days
• Field of Search: 713/170, 713175-177, 713/180, 309/109, 309/181, 382/109, 382/181, 709/224
• US Class Current: 713/170
• CPC Class Codes: H04L 2209/30 Compression, e.g. Merkle-Damgard construction
• CPC Class Codes: H04L 2209/56 Financial cryptography, e.g. electronic payment or e-cash
• CPC Class Codes: H04L 2209/80 Wireless network architectures or network communication protocols for wireless network security H04W12/00
• CPC Class Codes: H04L 9/3247 involving digital signatures

Abstract

Architecture that facilitates validation of a data mapping of data from a data source to a data target. There is included a signature generation component that generates a source signature of all or a portion of the data source and a target signature of all or a corresponding portion of the data target, and a sampling component that obtains a sample of the source data a corresponding sample of the target data. The data signatures and data samples are compared respectively and processed with a processing component to determine the status of the validation process.

Claims

1. A computer system for validating a mapping of data between a raw data source and a raw data target, the computer system comprising:

a processor coupled to a computer storage medium;

the computer storage medium that stores thereon a plurality of computer software components executable by the processor;

a signature generation component that generates respective data signatures of the raw data source and the raw data target;

a sampling component that samples the raw data source and the raw data target to obtain respective data samples; and

a processing component that processes the data samples and data signatures to determine the status of the validation process,

the processing component combining a result of the sample comparison with a result of signature comparison in a logical manner based upon the determined status.

2. The system of claim 1, wherein the source signature and the target signature are compared logically by the processing component to arrive at an equivalence value that indicates a level of equivalence of the raw source data and the raw target data.

3. The system of claim 1, wherein the sampling component further determines at least one of a type of data or an amount of the data to sample, and wherein a result of the determination is used by the sampling component and by the signature generation component in operation.

4. The system of claim 1, wherein the signature generation component and the sampling component are modular such that each is disposed separately on a network, and in communication via the network.

5. The system of claim 1, further comprising a facilitation component that facilitates data validation of data migration from one version of an application to another version of the same application.

6. The system of claim 1, further comprising a comparison component that compares the sample of the raw source data against the corresponding sample raw target data.

7. The system of claim 1, further comprising a comparison component that compares the signature of the raw source data against the corresponding sample target data.

8. The system of claim 1, wherein the sampling component operates upon a record.

9. The system of claim 8, wherein the sampling component further chooses a record upon which to sample.

11. The computer-readable media of claim 9, wherein the data source signature is generated and one or more data source samples are sampled from the raw data source, and wherein the raw data source spans multiple networked locations.

12. The computer-readable media of claim 9, wherein the data target signature is generated and one or more data target samples are sampled from the raw data target, and wherein the data target spans multiple networked locations.

13. The computer-readable media of claim 9, further comprising sampling the raw data source and the raw data target to obtain respective data samples used in the processing.

14. The computer-readable media of claim 13, further comprising:

comparing the sample of the raw source data against the corresponding sample target data; and

comparing the signature of the raw source data against corresponding sample target data.

15. The computer-readable media of claim 14, further comprising combining a result of the sample comparison with a result of the signature comparison.

16. The computer-readable media of claim 13, wherein the data samples sampled are in response to the data signatures comparing unfavorably.

17. The computer-readable media of claim 13, further comprising transmitting the sampled data and generated signatures.

18. The computer-readable media of claim 13, wherein the sampling occurs upon a record.

19. The computer-readable media of claim 18, further comprising choosing the record upon which to sample, wherein sampling occurs upon the chosen record.

10. One or more computer-readable media storing computer-useable instructions that, when used by one or more computing devices, cause the one or more computer devices to perform a process for validating a mapping of data between a raw data source and a raw data target, the process comprising:

generating respective data signatures of the raw data source and the raw data target; and

processing the data signatures and data samples of each of the raw data source and the raw data target to determine the status of the validation process, the validation process having associated therewith a level of confidence, wherein the level of confidence increases by performing at least one of increasing a number of the data signatures or decreasing a level of compression, and wherein the level of compression is associated with at least one of the raw data source and the raw data target.

20. A computer system for validating a mapping of data between a data source and a data target, the computer system comprising:

a processor coupled to a computer storage medium;

the computer storage medium that stores thereon a plurality of computer software components executable by the processor;

a signature generation component that generates respective data signatures of the data source and the data target;

a sampling component that samples the data source and the data target to obtain respective data samples, wherein the data source and data target are raw;

a processing component that processes the data samples and data signatures to determine the status of the validation process;

a first comparison component that compares the sample of the source data against the corresponding sample target data; and

a second comparison component that compares the signature of the source data against the corresponding sample target data,

the processing component combining a result of the sample comparison with a result of the signature comparison in a logical manner.