Persistent cache layer in a distributed file system
First Claim
Patent Images
1. A method comprising:
- establishing at least two data streams for each file in a file system, wherein a first data stream is associated with a cache overlay layer and a second data stream is associated with a storage layer;
establishing a logical inode tree that at least maps each file in the file system to a cache overlay layer inode and a storage layer inode, wherein the cache overlay layer inode contains metadata identifying a chunk state for each chunk of file data, and wherein the storage layer inode is associated with a data augmentation group; and
processing file system operations received from a file system client using the cache overlay layer asynchronously from processing file system operations directed to the storage layer.
7 Assignments
0 Petitions
Accused Products
Abstract
Implementations are provided herein for having at least two data streams associated with each file in a file system. The first, a cache overlay layer, can store additional state information on a per block basis that details whether each individual block of file data within the cache overlay layer is clean, dirty, or indicates that a write back to the storage layer is in progress. The second, a storage layer, can be a use case defined repository that can transform data using data augmentation methods or store unmodified raw data in local storage. File system operations directed to the cache overlay layer can be processed asynchronously from file system operations directed to the storage layer.
-
Citations
20 Claims
-
1. A method comprising:
-
establishing at least two data streams for each file in a file system, wherein a first data stream is associated with a cache overlay layer and a second data stream is associated with a storage layer; establishing a logical inode tree that at least maps each file in the file system to a cache overlay layer inode and a storage layer inode, wherein the cache overlay layer inode contains metadata identifying a chunk state for each chunk of file data, and wherein the storage layer inode is associated with a data augmentation group; and processing file system operations received from a file system client using the cache overlay layer asynchronously from processing file system operations directed to the storage layer. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A system comprising at least one storage device and at least one hardware processor configured to:
-
establish at least two data streams for each file in a file system, wherein a first data stream is associated with a cache overlay layer and a second data stream is associated with a storage layer; establish a logical inode tree that at least maps each file in the file system to a cache overlay layer inode and a storage layer inode, wherein the cache overlay layer inode contains metadata identifying a chunk state for each chunk of file data, and wherein the storage layer inode is associated with a data augmentation group; and process file system operations received from a file system client using the cache overlay layer asynchronously from processing file system operations directed to the storage layer. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A non-transitory computer readable medium with program instructions stored thereon to perform the following acts:
-
establishing at least two data streams for each file in a file system, wherein a first data stream is associated with a cache overlay layer and a second data stream is associated with a storage layer; establishing a logical inode tree that at least maps each file in the file system to a cache overlay layer inode and a storage layer inode, wherein the cache overlay layer inode contains metadata identifying a chunk state for each chunk of file data, and wherein the storage layer inode is associated with a data augmentation group; and processing file system operations received from a file system client using the cache overlay layer asynchronously from processing file system operations directed to the storage layer. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification