Compacting change logs using file content location identifiers

• US 10,025,808 B2
• Filed: 03/19/2014
• Issued: 07/17/2018
• Est. Priority Date: 03/19/2014
• Status: Active Grant

• Current Assignee: Red Hat, Inc. (International Business Machines Corporation)
• Original Assignee: Red Hat, Inc. (International Business Machines Corporation)
• Inventors: Avati, Anand
• Primary Examiner(s): CHANNAVAJJALA, SRIRAMA T
• Application Number:
  US14/219,251
• Publication Number:
  US 20150269213A1
• Time in Patent Office: 1,581 Days
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: G06F 16/116 Details of conversion of file system types or formats
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/2322 using timestamps
• CPC Class Codes: G06F 16/2358 Change logging, detection, and notification replication G06F16/27
• CPC Class Codes: G06F 16/9017 using directory or table look-up use of a directory or look-up table in file systems G06F16/13
• CPC Class Codes: G06F 16/907 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques

Abstract

Systems and methods for compacting change logs using file content location identifiers. An example method may comprise: identifying a first change log record comprising an identifier of a first data structure referencing a first physical location of contents of a file before a first file system operation, the first change log record further comprising an identifier of a second data structure referencing a second physical location of the contents of the file after the file first system operation; identifying a second change log record comprising the identifier of the second data structure referencing the second physical location of the contents of the file before a second file system operation, the second change log record further comprising an identifier of a third data structure referencing a third physical location of the contents of the file after the second file system operation; and replacing the first change log record and the second change log record with a third change log record comprising the identifier of the first data structure and the identifier of the third data structure.

Claims

1. A method, comprising:

identifying, by a processing device, a first change log record comprising;

an identifier of a first data structure, an identifier of a second data structure, and an identifier of a first parent object, wherein the first data structure references a first physical location of contents of a file before a first file system operation, the second data structure references a second physical location of the contents of the file after the file first system operation, and the first parent object represents a first file system object comprising the file;

identifying, by the processing device, a second change log record comprising;

the identifier of the second data structure, an identifier of a third data structure, and an identifier of a second parent object, wherein the third data structure references a third physical location of the contents of the file after a second file system operation, and the second parent object represents a second file system object comprising the file;

responsive to determining that the first parent object identifier matches the second parent object identifier, merging, by the processing device, the first change log record and the second change log record to produce a third change log record comprising the identifier of the first data structure and the identifier of the third data structure;

responsive to determining that the identifier of the first data structure matches the identifier of the third data structure, discarding the third change log record;

constructing a file name alias by appending the identifier of the third data structure to an identifier of a pre-defined directory; and

performing, using the file name alias, a third file system operation specified by the third change log record.

2. The method of claim 1, further comprising:

receiving a change log file comprising a plurality of change log records.

3. The method of claim 1, wherein at least one of the first file system operation or the second file system operation comprises at least one of creating the file, copying the contents of the file, deleting the file, or renaming the file.

4. The method of claim 1, wherein at least one of the first data structure, the second data structure, or the third data structure is provided by an index node.

5. The method of claim 1, wherein at least one of the first change log record, the second change log record, or the third change log record further comprises a name of the file.

6. The method of claim 1, wherein at least one of the first change log record, the second change log record, or the third change log record further comprises a timestamp.

7. A system, comprising:

a memory; and

a processing device, operatively coupled to the memory, to;

identify a first change log record comprising;

an identifier of a first data structure, an identifier of a second data structure, and an identifier of a first parent object, wherein the first data structure references a first physical location of contents of a file before a first file system operation, the second data structure references a second physical location of the contents of the file after the file first system operation, and the first parent object represents a first file system object comprising the file;

identify a second change log record comprising;

the identifier of the second data structure, an identifier of a third data structure, and an identifier of a second parent object, wherein the third data structure references a third physical location of the contents of the file after a second file system operation, and the second parent object represents a second file system object comprising the file;

responsive to determining that the first parent object identifier matches the second parent object identifier, merge the first change log record and the second change log record to produce a third change log record comprising the identifier of the first data structure and the identifier of the third data structure;

responsive to determining that the identifier of the first data structure matches the identifier of the third data structure, discard the third change log record;

construct a file name alias by appending the identifier of the third data structure to an identifier of a pre-defined directory; and

perform, using the file name alias, a third file system operation specified by the third change log record.

8. The system of claim 7, wherein the processing device is further to:

receive a change log file comprising a plurality of change log records.

9. The system of claim 7, wherein to perform at least one of the first file system operation or the second file system operation, the processing device is to perform at least one of:

create the file, copy the contents of the file, delete the file, or rename the file.

10. The system of claim 7, wherein at least one of the first data structure, the second data structure, or the third data structure is provided by an index node.

11. The system of claim 7, wherein at least one of the first change log record, the second change log record, or the third change log record further comprises a name of the file.

12. The system of claim 7, wherein at least one of the first change log record, the second change log record, or the third change log record further comprises a timestamp.

13. A non-transitory computer-readable storage medium comprising executable instructions that, when executed by a processing device, cause the processing device to:

identify, by the processing device, a first change log record comprising;

an identifier of a first data structure, an identifier of a second data structure, and an identifier of a first parent object, wherein the first data structure references a first physical location of contents of a file before a first file system operation, the second data structure references a second physical location of the contents of the file after the file first system operation, and the first parent object represents a first file system object comprising the file;

identify, by the processing device, a second change log record comprising;

the identifier of the second data structure, an identifier of a third data structure, and an identifier of a second parent object, wherein the third data structure references a third physical location of the contents of the file after a second file system operation, and the second parent object represents a second file system object comprising the file;

responsive to determining that the first parent object identifier matches the second parent object identifier, merge, by the processing device, the first change log record and the second change log record to produce a third change log record comprising the identifier of the first data structure and the identifier of the third data structure;

responsive to determining that the identifier of the first data structure matches the identifier of the third data structure, discard the third change log record;

construct a file name alias by appending the identifier of the third data structure to an identifier of a pre-defined directory; and

perform, using the file name alias, a third file system operation specified by the third change log record.

14. The non-transitory computer-readable storage medium of claim 13, further comprising executable instructions to cause the processing device to:

receive a change log file comprising a plurality of change log records.

15. The non-transitory computer-readable storage medium of claim 13, further comprising executable instructions to cause the processing device to perform at least one of creating the file, copying the contents of the file, deleting the file, or renaming the file.

16. The non-transitory computer-readable storage medium of claim 13, wherein at least one of the first data structure, the second data structure, or the third data structure is provided by an index node.

17. The non-transitory computer-readable storage medium of claim 13, wherein at least one of the first change log record, the second change log record, or the third change log record further comprises a name of the file.

18. The non-transitory computer-readable storage medium of claim 13, wherein at least one of the first change log record, the second change log record, or the third change log record further comprises a timestamp.