Multi-tier file system with transparent holes

• US 10,203,889 B2
• Filed: 05/31/2016
• Issued: 02/12/2019
• Est. Priority Date: 04/01/2016
• Status: Active Grant

• Current Assignee: Salesforce.com, Inc.
• Original Assignee: Salesforce.com, Inc.
• Inventors: Manasse, Mark
• Primary Examiner(s): Brown, Anthony D
• Application Number:
  US15/168,870
• Publication Number:
  US 20170285978A1
• Time in Patent Office: 987 Days
• Field of Search: 713165
• CPC Class Codes: G06F 12/1408 by using cryptography for digital transmission H04L9/00
• CPC Class Codes: G06F 16/11 File system administration, e.g. details of archiving or snapshots file system backup G06F11/14
• CPC Class Codes: G06F 21/6218 to a system of files or objects, e.g. local or distributed file system or database
• CPC Class Codes: G06F 21/86 Secure or tamper-resistant housings
• CPC Class Codes: G06F 2212/1052 Security improvement
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0623 in relation to content
• CPC Class Codes: G06F 3/0649 Lifecycle management
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0685 Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays

Abstract

The technology disclosed includes access to content and encryption key rotation in a multi-generational file system that has a first tier file, and automatically initializes a second tier file accessible using a same path and file name as the first tier file. The disclosed technology includes copying forward blocks of data from the first tier file to the second tier file, and prior to completion of the copying forward, responding to an access request by accessing the second tier file by providing data available from the second tier file that has been copied forward and by following links associated with the holes to access blocks in the first tier file to provide data from the first tier file. The first tier files are encrypted using a first encryption key; and applying a second encryption key to encrypt data in the second tier files during the copying forward and write access.

Claims

1. A method of access to content in a multi-tier file system including a first tier file and a second tier file stored in a persistent memory, the method comprising:

initializing, by one or more processors, the second tier file in the persistent memory, wherein the second tier file is accessible using a same path and file name as the first tier file, and the second tier file has a second tier hole as a placeholder for data in the first tier file, the second tier hole having a second tier link that refers read access to a block in the first tier file;

copying, by the one or more processors, forward blocks of data from the first tier file to the second tier file based on a scheduled copy forward or an authorized write access to a particular block of the second tier file; and

responding, by the one or more processors, to an access request by providing data available from the second tier file that has been copied forward and by following the second tier link associated with the second tier hole to access the block in the first tier file to provide data from the first tier file,

wherein the responding is prior to completion of the copying forward.

2. The method of claim 1, further including:

initializing, by the one or more processors, a third tier file in the persistent memory, wherein the third tier file is accessible using a same path and file name as the second tier file, and the third tier file has a third tier hole as a placeholder for data in the second tier file, the third tier hole having a third tier link that refers read access to a block in an earlier tier of the third tier file; and

applying the copying and the responding to the access request, wherein the access request corresponds to the third tier file.

3. The method of claim 2, wherein the block in the earlier tier of the third tier file is a block in the second tier file, and

prior to completion of copying forward of data from the second tier file to the third tier file, the file system following the third tier link associated with the third tier hole to access the block in the second tier file to provide data from the second tier file.

4. The method of claim 1, further including:

encrypting the first tier file and other files of the first tier using a first encryption key; and

applying a second encryption key to encrypt data in the second tier file and other files of the second tier during the copying forward and write access.

5. The method of claim 4, further including:

applying a third encryption key to encrypt data in a third tier file and other files of the third tier during the copying forward and write access.

6. The method of claim 1, wherein:

the second tier hole is implemented using a block index and a physical location that is either null or specifies an address on disk of the block in the earlier tier of the second tier file pointed to by the block index; and

for the physical location that is null, diverting read access to blocks of data in one or more earlier tiers of the second tier file.

7. The method of claim 1, further including providing data from a combination of the second tier file and first tier file during the copying forward from the first tier file to the second tier file.

8. The method of claim 1, further including writing update data to the second tier file as an update to the data provided from the first tier file during the copying forward from the first tier file to the second tier file.

9. The method of claim 4, further including writing update data to the second tier file using the second encryption key as an update to the data provided from the first tier file during the copying forward from the first tier file to the second tier file.

10. A device that provides access to content in a multi-tier file system, the device including:

a processor, memory coupled to the processor, and computer instructions loaded into the memory that, when executed, cause the processor to implement a process that includes;

using a file system having a first tier file in persistent memory, and the file system running on a hardware processor;

the file system automatically initializing a second tier file in the persistent memory, wherein the second tier file is accessible using a same path and file name as the first tier file, and the second tier file has a second tier hole as a placeholder for data in the first tier file, the hole having a second tier link that refers read access to a block in an earlier tier of the second tier file;

copying forward blocks of data from the first tier file to the second tier file based on a scheduled copy forward or an authorized write access to a particular block of the second tier file; and

prior to completion of the copying forward, the file system-responding to an access request by accessing the second tier file by providing data available from the second tier file that has been copied forward and by following the second tier link associated with the second tier hole to access the block in the first tier file to provide data from the first tier file.

11. The device of claim 10, further including

the file system automatically initializing a third tier file, wherein the third tier file is accessible using a same path and file name as the second tier file, and the third tier file has a third tier hole as placeholder for data in the second tier file, the third tier hole having a third tier link that refers read access to a block in an earlier tier of the third tier file;

and

applying the copying and the responding to an access request for the third tier file.

12. The device of claim 11, wherein the block in the earlier tier of the third tier file is a block in the second tier file, and:

prior to completion of copying forward of data from the second tier file to the third tier file, the file system following the third tier link associated with the third tier hole to access the block in the second tier file to provide data from the second tier file.

13. The device of claim 10, further including:

encrypting the first tier file and other files of the first tier using a first encryption key; and

applying a second encryption key to encrypt data in the second tier file and other files of the second tier during the copying forward and write access.

14. The device of claim 13, further including:

applying a third encryption key to encrypt data in a third tier file and other files of the third tier during the copying forward and write access.

15. The device of claim 10, wherein:

the second tier hole is implemented using a block index and a physical location that is either null or specifies an address on disk of the block in the earlier tier of the second tier file pointed to by the block index; and

for the physical location that is null, diverting read access to blocks of data in one or more earlier tiers of the second tier file.

16. The device of claim 10, further including providing data from a combination of the second and first tier files during the copying forward from the first tier file to the second tier file.

17. The device of claim 10, further including writing update data to the second tier file as an update to data provided from the first tier file during the copying forward from the first tier file to the second tier file.

18. The device of claim 13, further including writing update data to the second tier file using the second encryption key, as an update to data provided from the first tier file during the copying forward from the first tier file to the second tier file.

19. A non-transitory computer readable storage medium that stores program instructions that, when executed, cause a computer to implement a method of access to content in a multi-tier file system, the implementation including:

using a file system having a first tier file in persistent memory, and the file system running on a hardware processor;

the file system automatically initializing a second tier file in the persistent memory, wherein the second tier file is accessible using a same path and file name as the first tier file, and the second tier file has a second tier hole as a placeholder for data in the first tier file, the second tier hole having a second tier link that refers read access to a block in an earlier tier of the second tier file;

copying forward blocks of data from the first tier file to the second tier file based on a scheduled copy or an authorized write access to a particular block of the second tier file; and

prior to completion of the copying forward, the file system responding to an access request by accessing the second tier file by providing data available from the second tier file that has been copied forward and by following the second tier link associated with the second tier hole to access the block in the first tier file to provide data from the first tier file.

20. The non-transitory computer readable storage medium of claim 19, the implementation further including:

the file system automatically initializing a third tier file, wherein the third tier file is accessible using a same path and file name as the second tier file, and the third tier file has a third tier hole as placeholder for data in the second tier file, the third tier hole having a third tier link that refers read access to a block in an earlier tier of the third tier file; and

applying the copying and the responding to an access request for the third tier file.

21. The non-transitory computer readable storage medium of claim 19, the implementation further including:

encrypting the first tier file and other files of the first tier using a first encryption key; and

applying a second encryption key to encrypt data in the second tier file and other files of the second tier during the copying forward and write access.

22. The non-transitory computer readable storage medium of claim 21, the implementation further including:

applying a third encryption key to encrypt data in a third tier file and other files of the third tier during the copying forward and write access.

23. The non-transitory computer readable storage medium of claim 19, wherein:

the second tier hole is implemented using a block index and a physical location that is either null or specifies an address on disk of the block in the earlier tier of the second tier file pointed to by the block index; and

for the physical location that is null, diverting read access to blocks of data in one or more earlier tiers of the second tier file.

24. The non-transitory computer readable storage medium of claim 19, the implementation further including providing data from a combination of the second tier and first tier file during the copying forward from the first tier file to the second tier file.

25. The non-transitory computer readable storage medium of claim 22, the implementation further including writing update data to the second tier file using the second encryption key as an update to data provided from the first tier file during the copying forward from the first tier file to the second tier file.