Distribution of metadata for importation

• US 10,223,473 B2
• Filed: 03/31/2015
• Issued: 03/05/2019
• Est. Priority Date: 03/31/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Madugundu, Satya Vara Prasad S.
• Primary Examiner(s): Aspinwall, Evan
• Application Number:
  US14/673,940
• Publication Number:
  US 20160292301A1
• Time in Patent Office: 1,435 Days
• Field of Search: 707798
• CPC Class Codes: G06F 16/24573 using data annotations, e.g. user-defined metadata
• CPC Class Codes: G06F 16/9024 Graphs; Linked lists G06F16/9027 takes precedence

Abstract

A computer-implemented method for importing portions of an object metadata graph. In an embodiment, the method includes receiving an object metadata graph to store in a metadata repository. The method identifying two portions of the object metadata graph. The method creating a first linkage point between two portions of the object metadata, wherein the first linkage point represents a first portion of the object metadata graph referencing a second portion of the object metadata graph. The method sending the first portion and the second portion of the object metadata graph to the metadata repository based at least on the first linkage point.

Claims

1. A method for importing portions of an object metadata graph, the method comprising:

receiving, by a processor of a computing device, an object metadata graph to store in a metadata repository;

preparing, by the processor of the computing device, a division of the object metadata graph into a plurality of portions for importing into the metadata repository, wherein preparing the division of the object metadata graph is based on a portion size for each of the plurality of portions to avoid an out of memory error from the metadata repository;

identifying, by the processor of the computing device, a first reference for a first object metadata portion of the object metadata graph referencing a second object metadata portion of the object metadata graph;

identifying, by the processor of the computing device, a second reference for the second object metadata portion referencing the first object metadata portion, wherein the first reference and the second reference form a circular reference;

identifying, by the processor of the computing device, a third reference for a third object metadata portion of the object metadata graph referencing the first object metadata portion, wherein the third reference is a non-circular reference;

creating, by the processor of the computing device, a plurality of linkage points for each of the first reference, the second reference, and a third reference, wherein the first object metadata portion has at least two linkage points and the second object metadata potion has at least one linkage point;

determining, by the processor of the computing device, an order to send the first object metadata portion, the second object metadata portion, and the third object metadata portion to the metadata repository, wherein the order is based on a descending amount of linkages points between the plurality of portions; and

sending, by the processor of the computing device, to the metadata repository, the first object metadata portion, the second object metadata portion, and the third object metadata portion based on the order, wherein the plurality of linkage points allow for the metadata repository to reconstruct the metadata graph from the first object metadata portion, the second object metadata portion, and the third object metadata portion to avoid the out of memory error and to avoid a signal that the first object metadata portion for the third reference does not exist.

2. The method of claim 1, wherein sending to the metadata repository, the first object metadata portion, the second object metadata portion, and the third object metadata portion, further comprises:

sending, by one or more processors, the third object metadata portion of the object metadata graph to the metadata repository, wherein the third object metadata portion is not a source reference; and

subsequent to sending the third object metadata portion, sending, by one or more processors, the first object metadata portion and the second object metadata portion of the object metadata graph to the metadata repository.

3. The method of claim 1, wherein sending to the metadata repository the first object metadata portion, the second object metadata portion, and the third object metadata portion, further comprises:

sending, by one or more processors, the first object metadata portion of the object metadata graph to the metadata repository; and

subsequent to sending the first object metadata portion, sending, by one or more processors, the second object metadata portion and the third object metadata portion of the object metadata graph to the metadata repository.

4. The method of claim 3, wherein sending the second object metadata portion, and the third object metadata portion, further comprises:

sending, by one or more processors, the second object metadata portion of the object metadata graph to the metadata repository; and

subsequent to sending the second object metadata portion, sending, by one or more processors, the third object metadata portion of the object metadata graph to the metadata repository.

5. A computer program product for importing portions of an object metadata graph, the computer program product comprising:

one or more computer readable tangible storage media and program instructions stored on at least one of the one or more storage media, the program instructions comprising;

program instructions to receive an object metadata graph to store in a metadata repository;

program instructions to prepare a division of the object metadata graph into a plurality of portions for importing into the metadata repository, wherein preparing the division of the object metadata graph is based on a portion size for each of the plurality of portions to avoid an out of memory error from the metadata repository;

program instructions to identify a first reference for a first object metadata portion of the object metadata graph referencing a second object metadata portion of the object metadata graph;

program instructions to identify a second reference for the second object metadata portion referencing the first object metadata portion, wherein the first reference and the second reference form a circular reference;

program instructions to identify a third reference for a third object metadata portion of the object metadata graph referencing the first object metadata portion, wherein the third reference is a non-circular reference;

program instructions to create a plurality of linkage points for each of the first reference, the second reference, and a third reference, wherein the first object metadata portion has at least two linkage points and the second object metadata potion has at least one linkage point;

program instructions to determine an order to send the first object metadata portion, the second object metadata portion, and the third object metadata portion to the metadata repository, wherein the order is based on a descending amount of linkages points between the plurality of portions; and

program instructions to send to the metadata repository, the first object metadata portion, the second object metadata portion, and the third object metadata portion based on the order, wherein the plurality of linkage points allow for the metadata repository to reconstruct the metadata graph from the first object metadata portion, the second object metadata portion, and the third object metadata portion to avoid the out of memory error and to avoid a signal that the first object metadata portion for the third reference does not exist.

6. The computer program product of claim 5, wherein program instructions to send to the metadata repository, the first object metadata portion, the second object metadata portion, and the third metadata portion, further comprises program instructions, stored on the one or more computer readable storage media, which when executed by a processor, cause the processor to:

send the third object metadata portion of the object metadata graph to the metadata repository, wherein the third object metadata portion is not a source reference; and

subsequent to sending the third object metadata portion, send the first object metadata portion and the second object metadata portion of the object metadata graph to the metadata repository.

7. The computer program product of claim 5, wherein program instructions to send to the metadata repository, the first object metadata portion, the second object metadata portion, and the third object metadata portion, further comprises program instructions, stored on the one or more computer readable storage media, which when executed by a processor, cause the processor to:

send the first object metadata portion of the object metadata graph to the metadata repository; and

subsequent to sending the first object metadata portion, send the second object metadata portion and the third object metadata portion of the object metadata graph to the metadata repository.

8. The computer program product of claim 7, wherein program instructions to send the first object metadata portion, send the second object metadata portion, and the third object metadata portion, further comprises program instructions, stored on the one or more computer readable storage media, which when executed by a processor, cause the processor to:

send the second object metadata portion of the object metadata graph to the metadata repository; and

subsequent to sending the second object metadata portion, send the third object metadata portion of the object metadata graph to the metadata repository.

9. A computer system for importing portions of an object metadata graph, the computer system comprising:

one or more computer processors;

one or more computer readable storage media; and

program instructions stored on the computer readable storage media for execution by at least one of the one or more computer processors, the program instructions comprising;

program instructions to receive an object metadata graph to store in a metadata repository;

program instructions to prepare a division of the object metadata graph into a plurality of portions for importing into the metadata repository, wherein preparing the division of the object metadata graph is based on a portion size for each of the plurality of portions to avoid an out of memory error from the metadata repository;

program instructions to identify a first reference for a first object metadata portion of the object metadata graph referencing a second object metadata portion of the object metadata graph;

program instructions to identify a second reference for the second object metadata portion referencing the first object metadata portion, wherein the first reference and the second reference form a circular reference;

program instructions to identify a third reference for a third object metadata portion of the object metadata graph referencing the first object metadata portion, wherein the third reference is a non-circular reference;

program instructions to create a plurality of linkage points for each of the first reference, the second reference, and a third reference, wherein the first object metadata portion has at least two linkage points and the second object metadata potion has at least one linkage point;

program instructions to determine an order to send the first object metadata portion, the second object metadata portion, and the third object metadata portion to the metadata repository, wherein the order is based on a descending amount of linkages points between the plurality of portions; and

program instructions to send to the metadata repository, the first object metadata portion, the second object metadata portion, and the third object metadata portion based on the order, wherein the plurality of linkage points allow for the metadata repository to reconstruct the metadata graph from the first object metadata portion, the second object metadata portion, and the third object metadata portion to avoid the out of memory error and to avoid a signal that the first object metadata portion for the third reference does not exist.

10. The computer system of claim 9, wherein program instructions to send to the metadata repository, the first object metadata portion, the second object metadata portion, and the third metadata portion, further comprises program instructions, stored on the one or more computer readable storage media, which when executed by a processor, cause the processor to:

send the third object metadata portion of the object metadata graph to the metadata repository, wherein the third object metadata portion is not a source reference; and

subsequent to sending the third object metadata portion, send the first object metadata portion and the second object metadata portion of the object metadata graph to the metadata repository.

11. The computer system of claim 9, wherein program instructions to send to the metadata repository, the first object metadata portion, the second object metadata portion, and the third object metadata portion, further comprises program instructions, stored on the one or more computer readable storage media, which when executed by a processor, cause the processor to:

send the first object metadata portion of the object metadata graph to the metadata repository; and

subsequent to sending the first object metadata portion, send the first second object metadata portion and the third object metadata portion of the object metadata graph to the metadata repository.

12. The computer system of claim 11, wherein program instructions to send the first object metadata portion, send the second object metadata portion, and the third object metadata portion, further comprises program instructions, stored on the one or more computer readable storage media, which when executed by a processor, cause the processor to:

send the second object metadata portion of the object metadata graph to the metadata repository; and

subsequent to sending the second object metadata portion, send the third object metadata portion of the object metadata graph to the metadata repository.