System and method for chunk-based indexing of file system content

• US 20060059171A1
• Filed: 08/25/2004
• Published: 03/16/2006
• Est. Priority Date: 08/25/2004
• Status: Active Grant

• Current Assignee: Veritas Technologies, LLC (Whitehouse Group Ltd.)
• Original Assignee: Symantec Corporation (NortonLifeLock Inc.)
• Inventors: Borthakur, Dhrubajyoti, Pashenkov, Serge
• Granted Patent: US 7,487,138 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: Y10S 707/99932 Access augmentation or optimizing
• CPC Class Codes: Y10S 707/99934 Query formulation, input preparation, or translation
• CPC Class Codes: Y10S 707/99935 Query augmenting and refining, e.g. inexact access
• CPC Class Codes: Y10S 707/99936 Pattern matching access
• CPC Class Codes: Y10S 707/99939 Privileged access

Abstract

A system and method for chunk-based indexing of file system content. In one embodiment, the system may include a storage device configured to store data and a file system configured to manage access to the storage device and to store file system content including a plurality of files. The system may further include a search engine configured to construct an index of the file system content. The file system may be further configured to partition a given one of the plurality of files into a plurality of logical chunks, and constructing an index may include generating respective index information associated with each of the plurality of logical chunks.

Claims

1. A system, comprising:

a storage device configured to store data; and

a file system configured to manage access to said storage device and to store file system content including a plurality of files; and

a search engine configured to construct an index of said file system content;

wherein said file system is further configured to partition a given one of said plurality of files into a plurality of logical chunks; and

wherein constructing said index includes generating respective index information associated with each of said plurality of logical chunks.

2. The system as recited in claim 1, wherein in response to detecting an operation to modify said given file, said file system is further configured to identify one or more modified logical chunks of said given file, and wherein said search engine is further configured to regenerate respective index information associated with each of said one or more modified logical chunks.

3. The system as recited in claim 2, wherein said file system is further configured to associate a respective modification identifier with each of said logical chunks and to assert said respective modification identifier in response to modifying a corresponding logical chunk of said given file, and wherein said search engine is further configured to regenerate respective index information associated with a given logical chunk dependent upon said respective modification identifier.

4. The system as recited in claim 2, wherein said file system is further configured to associate a respective last modification time with each of said logical chunks and to update said respective last modification time in response to modifying a corresponding logical chunk of said given file, and wherein said search engine is further configured to regenerate respective index information associated with a given logical chunk dependent upon said last modification time.

5. The system as recited in claim 4, wherein for said given logical chunk, said search engine is further configured to compare a last modification time included in said respective index information associated with said given logical chunk with said respective last modification time provided by said file system, and to regenerate said respective index information in response to determining that said respective last modification time provided by said file system is more recent than said last modification time included in said respective index information.

6. The system as recited in claim 1, wherein each of said logical chunks is of a fixed and uniform size.

7. The system as recited in claim 1, wherein said logical chunks vary in size.

8. The system as recited in claim 1, wherein said file system is further configured to partition said given file dependent upon content of said given file.

9. A method, comprising:

storing file system content including a plurality of files;

partitioning a given one of said plurality of files into a plurality of logical chunks;

and

generating respective index information associated with each of said plurality of logical chunks.

10. The method as recited in claim 9, further comprising:

in response to detecting an operation to modify said given file, identifying one or more modified logical chunks of said given file; and

regenerating respective index information associated with each of said one or more modified logical chunks.

11. The method as recited in claim 10, further comprising:

associating a respective modification identifier with each of said logical chunks;

asserting said respective modification identifier in response to modifying a corresponding logical chunk of said given file; and

regenerating respective index information associated with a given logical chunk dependent upon said respective modification identifier.

12. The method as recited in claim 10, further comprising:

associating a respective last modification time with each of said logical chunks;

updating said respective last modification time in response to modifying a corresponding logical chunk of said given file; and

regenerating respective index information associated with a given logical chunk dependent upon said last modification time.

13. The method as recited in claim 12, further comprising:

comparing a last modification time included in said respective index information associated with said given logical chunk with said respective last modification time associated with said given logical chunk; and

regenerating said respective index information in response to determining that said respective last modification time provided by said file system is more recent than said last modification time included in said respective index information.

14. The method as recited in claim 9, wherein each of said logical chunks is of a fixed and uniform size.

15. The method as recited in claim 9, wherein said logical chunks vary in size.

16. The method as recited in claim 9, wherein said partitioning of said given file is dependent upon content of said given file.

17. A computer-accessible medium comprising program instructions, wherein the program instructions are executable to:

store file system content including a plurality of files;

partition a given one of said plurality of files into a plurality of logical chunks;

and

generate respective index information associated with each of said plurality of logical chunks.

18. The computer-accessible medium as recited in claim 17, wherein the program instructions are further executable to:

in response to detecting an operation to modify said given file, identify one or more modified logical chunks of said given file; and

regenerate respective index information associated with each of said one or more modified logical chunks.

19. The computer-accessible medium as recited in claim 18, wherein the program instructions are further executable to:

associate a respective modification identifier with each of said logical chunks;

assert said respective modification identifier in response to modifying a corresponding logical chunk of said given file; and

regenerate respective index information associated with a given logical chunk dependent upon said respective modification identifier.

20. The computer-accessible medium as recited in claim 18, wherein the program instructions are further executable to:

associate a respective last modification time with each of said logical chunks;

update said respective last modification time in response to modifying a corresponding logical chunk of said given file; and

regenerate respective index information associated with a given logical chunk dependent upon said last modification time.

21. The computer-accessible medium as recited in claim 20, wherein the program instructions are further executable to:

compare a last modification time included in said respective index information associated with said given logical chunk with said respective last modification time associated with said given logical chunk; and

regenerate said respective index information in response to determining that said respective last modification time provided by said file system is more recent than said last modification time included in said respective index information.

22. The computer-accessible medium as recited in claim 17, wherein each of said logical chunks is of a fixed and uniform size.

23. The computer-accessible medium as recited in claim 17, wherein said logical chunks vary in size.

24. The computer-accessible medium as recited in claim 17, wherein said partitioning of said given file is dependent upon content of said given file.