Systems and methods for reading objects in a file system
First Claim
1. A method of traversing objects in a file system, comprising:
- traversing a portion of the file system to identify an object to be read and to determine a size representative of the object;
determining whether to represent the object in a data structure based at least in part on one or more factors including the size representative of the object and a cumulative size of objects currently represented in the data structure; and
prefetching at least a portion of the objects currently represented in the data structure.
12 Assignments
0 Petitions
Accused Products
Abstract
Embodiments of the disclosure relate generally to file systems. Specifically, certain embodiments include systems and methods for reading objects in a file system. In some embodiments, a first processing thread traverses a portion of a file system and represents file system objects in a data structure. A portion of the data and/or metadata associated with the represented objects may be prefetched to a memory. In some embodiments, a second processing thread consumes the objects represented in the queue. For example, in a file system backup embodiment, the second processing thread may transfer data and/or metadata associated with the objects to an archive target.
180 Citations
46 Claims
-
1. A method of traversing objects in a file system, comprising:
-
traversing a portion of the file system to identify an object to be read and to determine a size representative of the object; determining whether to represent the object in a data structure based at least in part on one or more factors including the size representative of the object and a cumulative size of objects currently represented in the data structure; and prefetching at least a portion of the objects currently represented in the data structure. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31)
-
-
32. A computer-readable medium having stored thereon executable instructions that, when executed by a processor, cause the processor to perform a method for traversing objects in a file system, the method comprising:
-
traversing a portion of the file system to identify an object to be read and to determine a size representative of the object; determining whether to represent the object in a data structure based at least in part on one or more factors including the size representative of the object and a cumulative size of objects currently represented in the data structure; and prefetching at least a portion of the objects currently represented in the data structure.
-
-
33. A system for managing reading of a portion of a file system, the system comprising:
-
a storage device capable of accessing a file system; a memory operably coupled to the storage device; and a processing module operably coupled to the memory and the storage device, the processing module comprising a prefetch module, a working module, and a data structure capable of representing files in the file system, wherein the prefetch module is configured to traverse data related to a portion of the file system and to represent a file in the data structure based at least in part on a size of the file and a cumulative size of files currently represented in the data structure, the prefetch module further configured to open the file and to prefetch at least a portion of the file; and wherein the working module is configured to read the files represented in the data structure so as to transfer the files from the storage device to the memory. - View Dependent Claims (34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46)
-
Specification