SYSTEMS AND METHODS TO UPDATE A CONTENT STORE ASSOCIATED WITH A SEARCH INDEX

• US 20120078859A1
• Filed: 09/27/2010
• Published: 03/29/2012
• Est. Priority Date: 09/27/2010
• Status: Active Grant

• Current Assignee: Business Objects Incorporated (SAP SE)
• Original Assignee: Business Objects Incorporated (SAP SE)
• Inventors: Bhattacharjee, Arindam, Vaitheeswaran, Ganesh, Bijjula, Raghavendra Reddy
• Granted Patent: US 8,527,556 B2
• Time in Patent Office: Days
• US Class Current: 707/693
• CPC Class Codes: G06F 16/313 Selection or weighting of terms for indexing
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques

Abstract

Some aspects include determination of second document identifiers added to a search index. The search index associates each of a plurality of words with at least one of a plurality of first document identifiers. For each of the second document identifiers, metadata of a document identified by the second document identifier is added to a content store storing metadata of each document identified by the plurality of first document identifiers.

In some aspects, the content store comprises at least one flat file, and the metadata is appended to an end of one or more of the at least one flat file.

Claims

1. A method implemented by a computer in response to execution of program code by a processor of said computer, the method comprising:

determining second document identifiers added to a search index associating each of a plurality of words with at least one of a plurality of first document identifiers; and

for each of the second document identifiers, adding metadata of a document identified by the second document identifier to a content store storing metadata of each document identified by the plurality of first document identifiers.

2. A method according to claim 1, wherein the content store comprises at least one flat file, and wherein adding metadata of a document identified by a second document identifier comprises:

appending the metadata to an end of one or more of the at least one flat file.

3. A method according to claim 1, further comprising:

determining at least one of the first document identifiers of the search index corresponding to a deleted document; and

removing metadata of the deleted document from the content store.

4. A method according to claim 1, further comprising:

determining that the search index has been defragmented to generate a plurality of third document identifiers; and

updating the content store to associate the metadata of the content store with the plurality of third document identifiers.

5. A method according to claim 1, further comprising:

defragmenting the content store.

6. A method according to claim 1, wherein determining the second identifiers comprises determining the second identifiers from an object in an update queue, the method further comprising:

deleting the object from the update queue after adding the metadata.

7. A method according to claim 6, wherein deleting the object comprises:

after adding the metadata, determining whether the object has been processed by all other content store processing nodes; and

deleting the object from the update queue if it is determined that the object has been processed by all other content store processing nodes.

8. A computer-readable medium having stored thereon program code, the program code executable by a computer to:

determine second document identifiers added to a search index associating each of a plurality of words with at least one of a plurality of first document identifiers; and

for each of the second document identifiers, add metadata of a document identified by the second document identifier to a content store storing metadata of each document identified by the plurality of first document identifiers.

9. A medium according to claim 8, wherein the content store comprises at least one flat file, and wherein addition of the metadata of the document identified by a second document identifier comprises:

appending of the metadata to an end of one or more of the at least one flat file.

10. A medium according to claim 8, the program code further executable by a computer to:

determine at least one of the first document identifiers of the search index corresponding to a deleted document; and

remove metadata of the deleted document from the content store.

11. A medium according to claim 8, the program code further executable by a computer to:

determine that the search index has been defragmented to generate a plurality of third document identifiers; and

update the content store to associate the metadata of the content store with the plurality of third document identifiers.

12. A medium according to claim 8, the program code further executable by a computer to:

defragment the content store.

13. A medium according to claim 8, wherein determination of the second identifiers comprises determination of the second identifiers from an object in an update queue, the program code further executable by a computer to:

delete the object from the update queue after adding the metadata.

14. A medium according to claim 13, wherein deletion of the object comprises:

after addition of the metadata, determination of whether the object has been processed by all other content store processing nodes; and

deletion of the object from the update queue if it is determined that the object has been processed by all other content store processing nodes.

15. A system comprising:

a first electronic storage element storing a search index associating each of a plurality of words with at least one of a plurality of first document identifiers;

a second electronic storage element storing a content store comprising metadata of each document identified by the plurality of first document identifiers; and

a device comprising a processor to;

determine second document identifiers added to the search index; and

for each of the second document identifiers, add metadata of a document identified by the second document identifier to the content store.

16. A system according to claim 15, wherein the content store comprises at least one flat file, and wherein adding metadata of a document identified by a second document identifier comprises:

appending the metadata to an end of one or more of the at least one flat file.

17. A system according to claim 15, the device further to:

determine at least one of the first document identifiers of the search index corresponding to a deleted document; and

remove metadata of the deleted document from the content store.

18. A system according to claim 15, the device further to:

determine that the search index has been defragmented to generate a plurality of third document identifiers; and

update the content store to associate the metadata of the content store with the plurality of third document identifiers.

19. A system according to claim 15, the device further to:

defragment the content store.

20. A system according to claim 15, wherein determining the second identifiers comprises determining the second identifiers from an object in an update queue, the device further to:

delete the object from the update queue after adding the metadata.

21. A system according to claim 20, wherein deleting the object comprises:

after adding the metadata, determining whether the object has been processed by all other content store processing nodes; and

deleting the object from the update queue if it is determined that the object has been processed by all other content store processing nodes.