COMPACTING CHANGE LOGS USING FILE CONTENT LOCATION IDENTIFIERS

• US 20150269213A1
• Filed: 03/19/2014
• Published: 09/24/2015
• Est. Priority Date: 03/19/2014
• Status: Active Grant

• Current Assignee: Red Hat, Inc. (International Business Machines Corporation)
• Original Assignee: Red Hat, Inc. (International Business Machines Corporation)
• Inventors: Avati, Anand
• Granted Patent: US 10,025,808 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: G06F 16/116 Details of conversion of file system types or formats
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/2322 using timestamps
• CPC Class Codes: G06F 16/2358 Change logging, detection, and notification replication G06F16/27
• CPC Class Codes: G06F 16/9017 using directory or table look-up use of a directory or look-up table in file systems G06F16/13
• CPC Class Codes: G06F 16/907 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques

Abstract

Systems and methods for compacting change logs using file content location identifiers. An example method may comprise: identifying a first change log record comprising an identifier of a first data structure referencing a first physical location of contents of a file before a first file system operation, the first change log record further comprising an identifier of a second data structure referencing a second physical location of the contents of the file after the file first system operation; identifying a second change log record comprising the identifier of the second data structure referencing the second physical location of the contents of the file before a second file system operation, the second change log record further comprising an identifier of a third data structure referencing a third physical location of the contents of the file after the second file system operation; and replacing the first change log record and the second change log record with a third change log record comprising the identifier of the first data structure and the identifier of the third data structure.

Claims

1. A method, comprising:

identifying, by a computer system, a first change log record comprising an identifier of a first data structure referencing a first physical location of contents of a file before a first file system operation, the first change log record further comprising an identifier of a second data structure referencing a second physical location of the contents of the file after the file first system operation;

identifying a second change log record comprising the identifier of the second data structure referencing the second physical location of the contents of the file before a second file system operation, the second change log record further comprising an identifier of a third data structure referencing a third physical location of the contents of the file after the second file system operation; and

replacing the first change log record and the second change log record with a third change log record comprising the identifier of the first data structure and the identifier of the third data structure.

2. The method of claim 1, further comprising:

receiving a change log file comprising a plurality of change log records.

3. The method of claim 1, wherein at least one of the first file system operation or the second file system operation comprises at least one of creating the file, copying the contents of the file, deleting the file, or renaming the file.

4. The method of claim 1, wherein at least one of the first data structure, the second data structure, or the third data structure is provided by an index node.

5. The method of claim 1, wherein at least one of the first change log record, the second change log record, or the third change log record further comprises a name of the file.

6. The method of claim 1, wherein at least one of the first change log record, the second change log record, or the third change log record further comprises a timestamp.

7. The method of claim 1, further comprising:

responsive to determining that the identifier of the first data structure matches the identifier of the third data structure, discarding the third change log record.

8. A system, comprising:

a memory; and

one or more processors, coupled to the memory, to;

identify a first change log record comprising an identifier of a first data structure referencing a first physical location of contents of a file before a first file system operation, the first change log record further comprising an identifier of a second data structure referencing a second physical location of the contents of the file after the file first system operation;

identify a second change log record comprising the identifier of the second data structure referencing the second physical location of the contents of the file before a second file system operation, the second change log record further comprising an identifier of a third data structure referencing a third physical location of the contents of the file after the second file system operation; and

replace the first change log record and the second change log record with a third change log record comprising the identifier of the first data structure and the identifier of the third data structure.

9. The system of claim 8, wherein the processors are further to:

receive a change log file comprising a plurality of change log records.

10. The system of claim 8, wherein at least one of the first file system operation or the second file system operation comprises at least one of creating the file, copying the contents of the file, deleting the file, or renaming the file.

11. The system of claim 8, wherein at least one of the first data structure, the second data structure, or the third data structure is provided by an index node.

12. The system of claim 8, wherein at least one of the first change log record, the second change log record, or the third change log record further comprises a name of the file.

13. The system of claim 8, wherein at least one of the first change log record, the second change log record, or the third change log record further comprises a timestamp.

14. A non-transitory computer-readable storage medium comprising executable instructions that, when executed by a processing device of a file system server, cause the processing device to perform operations, comprising:

identifying a first change log record comprising an identifier of a first data structure referencing a first physical location of contents of a file before a first file system operation, the first change log record further comprising an identifier of a second data structure referencing a second physical location of the contents of the file after the file first system operation;

identifying a second change log record comprising the identifier of the second data structure referencing the second physical location of the contents of the file before a second file system operation, the second change log record further comprising an identifier of a third data structure referencing a third physical location of the contents of the file after the second file system operation; and

replacing the first change log record and the second change log record with a third change log record comprising the identifier of the first data structure and the identifier of the third data structure.

15. The non-transitory computer-readable storage medium of claim 14, further comprising executable instructions causing the processing device to:

receive a change log file comprising a plurality of change log records.

16. The non-transitory computer-readable storage medium of claim 14, wherein at least one of the first file system operation or the second file system operation comprises at least one of creating the file, copying the contents of the file, deleting the file, or renaming the file.

17. The non-transitory computer-readable storage medium of claim 14, wherein at least one of the first data structure, the second data structure, or the third data structure is provided by an index node.

18. The non-transitory computer-readable storage medium of claim 14, wherein at least one of the first change log record, the second change log record, or the third change log record further comprises a name of the file.

19. The non-transitory computer-readable storage medium of claim 14, wherein at least one of the first change log record, the second change log record, or the third change log record further comprises a timestamp.

20. The non-transitory computer-readable storage medium of claim 14, further comprising executable instructions causing the processing device to:

responsive to determining that the identifier of the first data structure matches the identifier of the third data structure, discard the third change log record.