Object processing

• US 10,346,424 B2
• Filed: 12/01/2015
• Issued: 07/09/2019
• Est. Priority Date: 12/01/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Fang, Min
• Primary Examiner(s): Chau, Dung K
• Application Number:
  US14/955,422
• Publication Number:
  US 20170154090A1
• Time in Patent Office: 1,316 Days
• Field of Search: 707620, 707626, 707609, 707752, 707999001
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes

Abstract

A computer-implemented method comprises composing a plurality of objects and a metadata object into a complex object at a first node. The metadata object refers to the plurality of objects in the complex object. The method further comprises transmitting the complex object to a second node.

Claims

1. A computer-implemented method, comprising:

receiving, at a first computing device, a plurality of data objects, with each data object being made up of a plurality of N blocks, and with the objects being made up of data collected in a cache as a log structure;

receiving an access history data set including information indicative of a heat rank for each data object, with the heat rank of a given data object being indicative of how often the given data object has been accessed;

grouping the data objects into a plurality of object groups such that all objects in each object group has the same heat rank; and

for each given object group;

generating complex object metadata including information identifying the data objects making up the given object group,

composing, at a first node, a complex object including the data objects of the given object group and the complex object metadata associated with the given object group;

determining a cold rank complex object subset of the complex objects such that each complex object of the subset is made up of a plurality of data objects having a heat rank that is below a predetermined threshold; and

transmitting, from the first computing to a second computing device, the complex objects of the cold rank complex object subset.

2. The computer-implemented method according to claim 1 wherein the plurality of N blocks making up each data object have consecutive Logical Block Addresses.

3. The computer-implemented method according to claim 2 wherein N is equal to four.

4. The computer-implemented method according to claim 1, wherein each given data object'"'"'s heat rank is the number of accesses to which the given data object has been subject.

5. The computer-implemented method according to claim 1 further comprising:

receiving, by the second computing device, over a communication network and from the first computing device, the complex objects of the cold rank complex object subset; and

for each given complex object of the cold rank complex object subset;

decomposing, by the second computing device, the given complex object into its constituent plurality of data objects, and

storing the constituent plurality of data objects.

6. A computer program product (CPP) comprising:

a non-transitory machine readable storage device; and

computer code stored on the machine readable storage device, with the computer code including instructions for causing a processor(s) set to perform operations including the following;

receiving, at a first computing device, a plurality of data objects, with each data object being made up of a plurality of N blocks, and with the objects being made up of data collected in a cache as a log structure,

receiving an access history data set including information indicative of a heat rank for each data object, with the heat rank of a given data object being indicative of how often the given data object has been accessed,

grouping the data objects into a plurality of object groups such that all objects in each object group has the same heat rank, and

for each given object group;

generating complex object metadata including information identifying the data objects making up the given object group,

composing, at a first node, a complex object including the data objects of the given object group and the complex object metadata associated with the given object group,

determining a cold rank complex object subset of the complex objects such that each complex object of the subset is made up of a plurality of data objects having a heat rank that is below a predetermined threshold, and

transmitting, from the first computing to a second computing device, the complex objects of the cold rank complex object subset.

7. The CPP according to claim 6 wherein the plurality of N blocks making up each data object have consecutive Logical Block Addresses.

8. The CPP according to claim 7 wherein N is equal to four.

9. The CPP according to claim 6, wherein each given data object'"'"'s heat rank is the number of accesses to which the given data object has been subject.

10. The CPP according to claim 6 wherein the computer code further includes instructions for causing the processor(s) set to perform the following operations:

receiving, by the second computing device, over a communication network and from the first computing device, the complex objects of the cold rank complex object subset; and

for each given complex object of the cold rank complex object subset;

decomposing, by the second computing device, the given complex object into its constituent plurality of data objects, and

storing the constituent plurality of data objects.

11. A computer system (CS) comprising:

a processor(s) set;

a machine readable storage device; and

computer code stored on the machine readable storage device, with the computer code including instructions for causing the processor(s) set to perform operations including the following;

receiving, at a first computing device, a plurality of data objects, with each data object being made up of a plurality of N blocks, and with the objects being made up of data collected in a cache as a log structure,

receiving an access history data set including information indicative of a heat rank for each data object, with the heat rank of a given data object being indicative of how often the given data object has been accessed,

grouping the data objects into a plurality of object groups such that all objects in each object group has the same heat rank, and

for each given object group;

generating complex object metadata including information identifying the data objects making up the given object group,

composing, at a first node, a complex object including the data objects of the given object group and the complex object metadata associated with the given object group,

determining a cold rank complex object subset of the complex objects such that each complex object of the subset is made up of a plurality of data objects having a heat rank that is below a predetermined threshold, and

transmitting, from the first computing to a second computing device, the complex objects of the cold rank complex object subset.

12. The CS according to claim 11 wherein the plurality of N blocks making up each data object have consecutive Logical Block Addresses.

13. The CS according to claim 12 wherein N is equal to four.

14. The CS according to claim 11, wherein each given data object'"'"'s heat rank is the number of accesses to which the given data object has been subject.

15. The CS according to claim 11 wherein the computer code further includes instructions for causing the processor(s) set to perform the following operations:

receiving, by the second computing device, over a communication network and from the first computing device, the complex objects of the cold rank complex object subset; and

for each given complex object of the cold rank complex object subset;

decomposing, by the second computing device, the given complex object into its constituent plurality of data objects, and

storing the constituent plurality of data objects.