System and method for updating a search engine index based on which files are identified in a file change log

• US 8,131,691 B1
• Filed: 08/31/2005
• Issued: 03/06/2012
• Est. Priority Date: 12/30/2002
• Status: Expired due to Fees

• Current Assignee: Veritas Technologies, LLC (Whitehouse Group Ltd.)
• Original Assignee: Symantec Operating Corporation (Gen Digital Inc.)
• Inventors: Nagaralu, Sree Hari, Maionchi, Joseph M., Harmer, Craig K., Kumar, N. Sunder Phani, Dharmarajan, Shyamshankar
• Primary Examiner(s): Hicks, Michael
• Application Number:
  US11/216,221
• Time in Patent Office: 2,379 Days
• Field of Search: None
• US Class Current: 707/696
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06

Abstract

Various methods and systems for updating a search engine index based on a file change log are disclosed. One method involves accessing a file, which stores a file change log maintained by a file system. The file change log identifies one or more recently modified files. The method also involves updating an index, based on a recently-modified file identified in the file change log. The index is used to search files maintained by the file system. An application external to the file system accesses the file storing the file change log and updates the index.

Claims

1. A method comprising:

accessing a file, wherein

the file stores a file change log maintained by a file system,

the file change log identifies one or more recently modified files; and

updating an index, based on a recently modified file identified in the file change log, wherein

the index is used to search files maintained by the file system,

the updating comprises accessing a recently modified portion of the recently modified file, not accessing an unmodified portion of the recently modified file, and updating a portion of the index that corresponds to the recently modified portion of the recently modified file, and

the accessing and the updating are performed by an application external to the file system.

2. The method of claim 1, wherein

an updated portion of the index includes indexing information associated with a keyword, and

the keyword is included in the file.

3. The method of claim 1, wherein

the file change log identifies a recently modified portion of a recently modified file by a file identifier, length and offset.

4. The method of claim 1, wherein the accessing the recently modified portion of the recently modified file comprises accessing an in-core copy of the recently modified portion of the recently modified file, without opening the recently modified file.

5. The method of claim 4, wherein the in-core copy of the recently modified portion of the recently modified file is stored in the file change log.

6. The method of claim 1, wherein

the application executes on a different computing node than the file system.

7. The method of claim 1, wherein

the accessing the recently modified file comprises scanning information stored in the file change log in reverse order,

the updating the portion of the index comprises updating the portion of the index a single time, and

the file change log identifies that the recently modified file has been modified two or more times.

8. A system comprising:

a processor; and

a memory coupled to the processor, wherein the memory stores computer readable instructions executable to implement;

a file system configured to maintain a file, wherein

the file stores a file change log, and

the file change log identifies one or more recently modified files; and

an indexing module coupled to the file system, wherein

the indexing module is configured to access the file and to update an index, based on a recently modified file identified in the file change log,

the indexing module is configured to update the index by accessing a recently modified portion of the recently modified file, not accessing an unmodified portion of the recently modified file, and updating a portion of the index that corresponds to the recently modified portion of the recently modified file, and

the index is used to search files maintained by the file system.

9. The system of claim 8, wherein

the file change log identifies a recently modified portion of a file by a file identifier, length and offset.

10. The system of claim 8, wherein

the indexing module is configured to access the recently modified portion of the recently modified file by accessing an in-core copy of the recently modified portion of the recently modified file, and

the in-core copy of the recently modified portion of the recently modified file is stored in the file change log.

11. The system of claim 8, wherein

the indexing module is implemented on a different computing node than the file system.

12. The system of claim 8, wherein

the indexing module is configured to access the recently modified file by scanning information stored in the file change log in reverse order,

the indexing module is configured to update the portion of the index by updating the portion of the index a single time, and

the file change log identifies that the recently modified file has been modified two or more times.

13. A system comprising:

interface means for accessing a file, wherein

the file stores a file change log maintained by a file system,

the file change log identifies one or more recently modified files; and

means for updating an index, based on a recently modified file identified in the file change log, wherein

the index is used to search files maintained by the file system,

updating the index comprises accessing a recently modified portion of the recently modified file, not accessing an unmodified portion of the recently modified file, and updating a portion of the index that corresponds to the recently modified portion of the recently modified file, and

the means for accessing and the means for updating are included in an application external to the file system.

14. The system of claim 13, wherein

an updated portion of the index includes indexing information associated with a keyword, and

the keyword is included in the file.

15. The system of claim 13, wherein

the file change log identifies a recently modified portion of a recently modified file by a file identifier, length and offset.

16. The system of claim 13, wherein

the accessing the recently modified portion of the recently modified file comprises accessing an in-core copy of the recently modified portion of the recently modified file, and

the in-core copy of the recently modified portion of the recently modified file is stored in the file change log.

17. The system of claim 13, wherein

accessing the recently modified file comprises scanning information stored in the file change log in reverse order,

updating the portion of the index comprises updating the portion of the index a single time, and

the file change log identifies that the recently modified file has been modified two or more times.

18. A computer readable storage medium comprising program instructions executable to:

access a file, wherein

the file stores a file change log maintained by a file system,

the file change log identifies one or more recently modified files; and

update an index, based on a recently modified file identified in the file change log, wherein

the program instructions are executable to update the index by accessing a recently modified portion of the recently modified file, not accessing an unmodified portion of the recently modified file, and updating a portion of the index that corresponds to the recently modified portion of the recently modified file, and

the index is used to search files maintained by the file system.

19. The computer readable storage medium of claim 18, wherein

an updated portion of the index includes indexing information associated with a keyword, and

the keyword is included in the file.

20. The computer readable storage medium of claim 18, wherein

the file change log identifies a recently modified portion of a recently modified file by a file identifier, length and offset.

21. The computer readable storage medium of claim 18, wherein

the program instructions are executable to access the recently modified portion of the recently modified file by accessing an in-core copy of the recently modified portion of the recently modified file, and

the in-core copy of the recently modified portion of the recently modified file is stored in the file change log.

22. The computer readable storage medium of claim 18, wherein

the program instructions are executable to access the recently modified file by scanning information stored in the file change log in reverse order,

the program instructions are executable to update the portion of the index by updating the portion of the index a single time, and

the file change log identifies that the recently modified file has been modified two or more times.