Automated database migration architecture

• US 9,996,562 B2
• Filed: 07/09/2013
• Issued: 06/12/2018
• Est. Priority Date: 07/09/2013
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Higginson, Antony, Masterson, John, Fitzpatrick, Sean, Robertshaw, Peter, Spiegelberg, Elmar, Buhne, Stephan, Weick, Michael, Balch, Nick, Popescu, Florin
• Primary Examiner(s): OBERLY, VAN HONG
• Application Number:
  US13/937,868
• Publication Number:
  US 20150019488A1
• Time in Patent Office: 1,799 Days
• Field of Search: 707602
• CPC Class Codes: G06F 16/214 Database migration support

Abstract

A method of migrating data from one or more source databases to one or more target databases may include generating a pre-migration analysis for a plurality of objects stored in the one or more source databases, and generating a plurality of migration scripts that transfer the plurality of objects from the one or more source databases to the one or more target databases. The method may also include generating a migration plan that defines an execution order for the plurality of migration scripts, and migrating the plurality of objects from the one or more source databases to one or more target databases according to the migration plan. The method may further include validating the plurality of objects on the one or more target databases.

Claims

1. A method of migrating data from one or more source databases to one or more target databases, the method comprising:

receiving, from a cloud-based database modeling service, data relating to the one or more source databases and the one or more target databases, wherein the cloud-based database modeling service is located remotely from the source databases and from the target databases, and is configured to collect and analyze data from the source databases and from the target databases;

generating a pre-migration analysis for the plurality of objects stored in the one or more source databases, based on the data received from the cloud-based database modeling service;

generating a plurality of migration scripts that transfer the plurality of objects from the one or more source databases to the one or more target databases, based on the pre-migration analysis;

generating a migration plan that defines;

an order in which the plurality of migration scripts will be executed during migration to minimize downtime during migration of the one or more source databases;

timing constraints that dictate when each of the plurality of migration scripts can be executed; and

indications of which of the plurality of migration scripts can be executed in parallel;

migrating the plurality of objects from the one or more source databases to one or more target databases according to the migration plan;

while migrating the plurality of objects, executing a number of migration scripts in parallel, according to the migration plan;

while migrating the plurality of objects, periodically determining an amount of available system resources;

while migrating the plurality of objects, dynamically adjusting an amount of parallel processing during the migration by scaling up or down a number of migration scripts executed in parallel based on the determined amount of available system resources; and

after migrating the plurality of objects, validating the plurality of objects on the one or more target databases.

2. The method of claim 1 wherein:

the one or more target databases comprise a single target database;

the one or more source databases comprise a plurality of source databases; and

the plurality of source databases are migrated to the single target database.

3. The method of claim 1, further comprising presenting a real-time migration report in a portal display of the cloud service, wherein the real-time migration report indicates progress while migrating the plurality of objects from the one or more source databases to one or more target databases according to the migration plan.

4. The method of claim 1 further comprising:

receiving one or more manual parameter adjustments during migration; and

altering the migration plan during the migration according to the one or more manual parameter adjustments.

5. The method of claim 1 wherein the pre-migration analysis comprises:

classifying the of plurality objects, identifying installed database options, and identifying complex objects that require special handling during the migration; and

reconfiguring the complex objects such that a number of instances where the complex objects are unavailable is reduced.

6. The method of claim 1 wherein generating the migration plan comprises determining, based on the data received from the cloud-based database modeling service, which of the plurality of migration scripts can be executed in parallel during migration.

7. The method of claim 1 wherein the migration plan further defines an execution timing for the plurality of migration scripts.

8. The method of claim 1, wherein the data received from the cloud-based database modeling service includes a recommendation that two or more particular databases within the source databases should be combined into a single target database.

9. The method of claim 1, wherein the data received from the cloud-based database modeling service includes a recommendation that a particular database table within the source databases should be subdivided into multiple database tables within the target databases.

10. The method of claim 1, wherein the generated migration plan specifies that the source databases are to remain online during the migration, and wherein migrating the plurality of objects comprises copying a plurality of database objects from the source databases while the source databases are online.

11. The method of claim 1, further comprising:

determining, based on the pre-migration analysis, that one or more index files for the source databases should not be copied to the target databases; and

based on the determination, instructing one or more of the target databases to generate new index files corresponding to the one or more index files not copied from the source databases.

12. The method of claim 1, wherein the migration of the plurality of objects from the source databases to the target databases is performed in response to a customer request for data migration, and

wherein the pre-migration analysis and the migration plan are generated preemptively, prior to the customer request for data migration, based on the data received from the cloud-based database modeling service.

13. A non-transitory computer-readable memory comprising a sequence of instructions which, when executed by one or more processors, causes the one or more processors to migrate data from one or more source databases to one or more target databases by:

receiving, from a cloud-based database modeling service, data relating to the one or more source databases and the one or more target databases, wherein the cloud-based database modeling service is located remotely from the source databases and from the target databases, and is configured to collect and analyze data from the source databases and from the target databases;

generating a pre-migration analysis for the plurality of objects stored in the one or more source databases, based on the data received from the cloud-based database modeling service;

generating a plurality of migration scripts that transfer the plurality of objects from the one or more source databases to the one or more target databases, based on the pre-migration analysis;

generating a migration plan that defines;

an order in which the plurality of migration scripts will be executed during migration to minimize downtime during migration of the one or more source databases;

timing constraints that dictate when each of the plurality of migration scripts can be executed; and

indications of which of the plurality of migration scripts can be executed in parallel;

migrating the plurality of objects from the one or more source databases to one or more target databases according to the migration plan;

while migrating the plurality of objects, executing a number of migration scripts in parallel, according to the migration plan;

while migrating the plurality of objects, periodically determining an amount of available system resources;

while migrating the plurality of objects, dynamically adjusting an amount of parallel processing during the migration by scaling up or down a number of migration scripts executed in parallel based on the determined amount of available system resources; and

after migrating the plurality of objects, validating the plurality of objects on the one or more target databases.

14. The non-transitory computer-readable memory according to claim 13 wherein the instructions further cause the one or more processors to migrate data from one or more source databases to one or more target databases by presenting the pre-migration analysis in a portal display of a cloud service that is remotely located from the one or more source databases and the one or more target databases.

15. The non-transitory computer-readable memory according to claim 14 wherein the instructions further cause the one or more processors to migrate data from one or more source databases to one or more target databases by presenting a post-migration report in a portal display of a cloud service that is remotely located from the one or more source databases and the one or more target databases, wherein the post-migration report comprises data resulting from the validating of the plurality of objects on the one or more target databases.

16. The non-transitory computer-readable memory according to claim 15 wherein the instructions further cause the one or more processors to migrate data from one or more source databases to one or more target databases by presenting a real-time migration report in the portal display of the cloud service, wherein the real-time migration report indicates progress while migrating the plurality of objects from the one or more source databases to one or more target databases according to the migration plan.

17. A system comprising:

one or more processors; and

a memory communicatively coupled with and readable by the one or more processors and comprising a sequence of instructions which, when executed by the one or more processors, cause the one or more processors to migrate data from one or more source databases to one or more target databases by;

receiving, from a cloud-based database modeling service, data relating to the one or more source databases and the one or more target databases, wherein the cloud-based database modeling service is located remotely from the source databases and from the target databases, and is configured to collect and analyze data from the source databases and from the target databases;

generating a pre-migration analysis for the plurality of objects stored in the one or more source databases, based on the data received from the cloud-based database modeling service;

generating a plurality of migration scripts that transfer the plurality of objects from the one or more source databases to the one or more target databases, based on the pre-migration analysis;

generating a migration plan that defines;

an order in which the plurality of migration scripts will be executed during migration to minimize downtime during migration of the one or more source databases;

timing constraints that dictate when each of the plurality of migration scripts can be executed; and

indications of which of the plurality of migration scripts can be executed in parallel;

migrating the plurality of objects from the one or more source databases to one or more target databases according to the migration plan;

while migrating the plurality of objects, executing a number of migration scripts in parallel, according to the migration plan;

while migrating the plurality of objects, periodically determining an amount of available system resources;

while migrating the plurality of objects, dynamically adjusting an amount of parallel processing during the migration by scaling up or down a number of migration scripts executed in parallel based on the determined amount of available system resources; and

after migrating the plurality of objects, validating the plurality of objects on the one or more target databases.

18. The system of claim 17 wherein the instructions further cause the one or more processors to migrate data from one or more source databases to one or more target databases by:

receiving one or more manual parameter adjustments during migration; and

altering the migration plan during the migration according to the one or more manual parameter adjustments.

19. The system of claim 17 wherein the pre-migration analysis comprises:

classifying the plurality of objects, identifying installed database options, and identifying complex objects that require special handling during the migration; and

reconfiguring the complex objects such that a number of instances where the complex objects are unavailable is reduced.