Data migration validation

• US 11,281,655 B2
• Filed: 06/21/2019
• Issued: 03/22/2022
• Est. Priority Date: 09/25/2015
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Singh, Jaskaran, Hakami, Sina, Madejczyk, Szymon
• Primary Examiner(s): Wong, Leslie
• Application Number:
  US16/448,785
• Publication Number:
  US 20190310973A1
• Time in Patent Office: 1,005 Days
• CPC Class Codes: G06F 16/116 Details of conversion of file system types or formats
• CPC Class Codes: G06F 16/214 Database migration support
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques

Abstract

A system for validating data migrated from a first data store with source data to a second data store for destination data. A comparator is configured to access entity data for a particular entity which has been migrated from a first data store to a second data store. The comparator queries the first data store to a first set of comparison data from the first data store and obtains a second set of comparison data from the second data store. It then compares the first set of data with the second set of data to validate the migration of the data from the first to the second data store.

Claims

1. A computer system comprising:

one or more processors; and

one or more computer-readable hardware storage media having stored thereon instructions that are executable by the one or more processors and that, when executed, cause the computer system to at least;

migrate entity data for a particular entity from a first data store to a second data store;

identify a first comparison data set corresponding to entity data being migrated from a first data store to a second data store, the first comparison data set being generated from a plurality of first queries run on the first data store, each first query of the plurality of first queries being made by a different client emulator in a first plurality of client emulators that differ from each other;

identify a second comparison data set corresponding to the entity data, the second comparison data set being generated from a plurality of second queries run on the second data store, each second query of the plurality of second queries being made by a different client emulator in a second plurality of client emulators that differ from each other; and

present the first comparison data set along with the second comparison data set in a discrepancy resolution interface along with a resolution control that includes a plurality of separate selectable controls for resolving any discrepancies between the first comparison data set and the second comparison data set.

2. The computer system of claim 1, wherein the instructions are also executable to cause the computer system to select a discrepancy in response to input directed at one or more entry in either of the first comparison data set or the second comparison data set.

3. The computer system of claim 2, wherein the instructions are also executable to cause the computer system to apply a discrepancy resolution process for resolving the discrepancy in response to input directed at a particular resolution control included in the plurality of separate selectable controls from the resolution control subsequent to the discrepancy being selected.

4. The computer system of claim 3, wherein the particular resolution control comprises a control for copying a missing record or field into the first comparison data set or the second comparison data set.

5. The computer system of claim 3, wherein the particular resolution control comprises a control for deleting a record or field in the first comparison data set or the second comparison data set.

6. The computer system of claim 3, wherein the particular resolution control comprises a control for selecting a version of a record or field in at least one of the first comparison data set or the second comparison data set.

7. The computer system of claim 3, wherein the instructions are also executable to cause the computer system to present a cancel control button which, when selected, causes any user selected resolutions to be abandoned.

8. The computer system of claim 3, wherein the instructions are also executable to cause the computer system to present a finish control button which, when selected, causes a signal to be generated for completing the discrepancy resolution process.

9. The computer system of claim 3, the instructions are also executable to cause the computer system to identify one or more patterns of resolution based on a user resolving discrepancies with the discrepancy resolution process, and wherein the one or more patterns of resolution are used to modify one or more subsequent migrations between the first data store and the second data store, such that the one or more subsequent migrations produce fewer discrepancies in subsequent comparison data sets for the one or more subsequent migrations.

10. The computer system of claim 1, wherein at least one of the plurality of first queries is performed using a first data protocol that is different than a second data protocol used for at least one of the plurality of second queries.

11. In a computing environment, a method comprising:

migrating entity data for a particular entity from a first data store to a second data store;

identifying a first comparison data set corresponding to entity data being migrated from a first data store to a second data store, the first comparison data set being generated from a plurality of first queries run on the first data store, each first query of the plurality of first queries being made by a different client emulator in a first plurality of client emulators that differ from each other;

identifying a second comparison data set corresponding to the entity data, the second comparison data set being generated from a plurality of second queries run on the second data store, each second query of the plurality of second queries being made by a different client emulator in a second plurality of client emulators that differ from each other; and

presenting the first comparison data set along with the second comparison data set in a discrepancy resolution interface along with a resolution control that includes a plurality of separate selectable controls for resolving any discrepancies between the first comparison data set and the second comparison data set.

12. The method of claim 11, wherein the method further includes selecting a discrepancy in response to input directed at one or more entry in either of the first comparison data set or the second comparison data set.

13. The method of claim 12, wherein the method further includes applying a discrepancy resolution process for resolving the discrepancy in response to input directed at a particular resolution control included in the plurality of separate selectable controls from the resolution control subsequent to the discrepancy being selected.

14. The method of claim 13, wherein the particular resolution control comprises a control for copying a missing record or field into the first comparison data set or the second comparison data set.

15. The method of claim 13, wherein the particular resolution control comprises a control for deleting a record or field in the first comparison data set or the second comparison data set.

16. The method of claim 13, wherein the particular resolution control comprises a control for selecting a version of a record or field in the first comparison data set or the second comparison data set.

17. The method of claim 13, wherein the method further includes:

presenting a cancel control button which, when selected, causes any user selected resolutions to be abandoned; and

presenting a finish control button which, when selected, causes a signal to be generated for completing the discrepancy resolution process.

18. The method of claim 13, the method further comprising identifying one or more patterns of resolution based on a user resolving discrepancies with the discrepancy resolution process, and wherein the one or more patterns of resolution are used to modify one or more subsequent migrations between the first data store and the second data store, such that the one or more subsequent migrations produce fewer discrepancies in subsequent comparison data sets for the one or more subsequent migrations.

19. The method of claim 13, wherein at least one of the plurality of first queries is performed using a first data protocol that is different than a second data protocol used for at least one of the plurality of second queries.

20. A physical computer-readable storage medium having stored thereon instructions that are executable by one or more processors and that, when executed, cause a computer system to at least:

migrate entity data for a particular entity from a first data store to a second data store;

identify a first comparison data set corresponding to entity data being migrated from a first data store to a second data store, the first comparison data set being generated from a plurality of first queries run on the first data store, each first query of the plurality of first queries being made by a different client emulator in a first plurality of client emulators that differ from each other;

identify a second comparison data set corresponding to the entity data, the second comparison data set being generated from a plurality of second queries run on the second data store, each second query of the plurality of second queries being made by a different client emulator in a second plurality of client emulators that differ from each other; and

present the first comparison data set along with the second comparison data set in a discrepancy resolution interface along with a resolution control that includes a plurality of separate selectable controls for resolving any discrepancies between the first comparison data set and the second comparison data set.