INDEXING DATA UPDATES ASSOCIATED WITH AN ELECTRONIC CATALOG SYSTEM

• US 20150242413A1
• Filed: 04/28/2015
• Published: 08/27/2015
• Est. Priority Date: 10/20/2011
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Goo, Almann T., McInerny, Michael J.
• Granted Patent: US 9,846,697 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/113 Details of archiving lifecycle management in storage systems G06F3/0649; backup systems G06F11/1446
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/2272 Management thereof
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 2201/80 Database-specific techniques

Abstract

Systems and methods are provided for efficiently indexing archived objects in an archive data store to allow for efficient and quick access to the archived objects. The systems and methods provided also allow alleviate the strain on a live data store and enable a requester wishing to retrieve updates to do so without knowledge of the location of the stored update on a live or archive data store.

Claims

1. A computer-implemented method for managing update information associated with items of an electronic catalog, comprising:

under control of one or more computing devices;

obtaining, from an archive data store, updates associated with an indexing key, wherein the updates comprise a change associated with an item of an electronic catalog;

aggregating the updates into an object;

indexing the updates in a static index of the archive data store by associating a pointer to the object with the indexing key in the static index;

obtaining a request for update data associated with the electronic catalog; and

generating a response to the request based, at least in part, on the static index, wherein the response includes the pointer to the object.

2. The computer-implemented method of claim 1 further comprising purging at least a subset of updates associated with the indexing key from a live data store to the archive data store.

3. The computer-implemented method of claim 2, wherein the live data store is associated with a dynamic index that indexes the subset of the updates prior to purging the subset of updates to the archive data store.

4. The computer-implemented method of claim 3, wherein the generation of the response is further based on the dynamic index of the live data store.

5. The computer-implemented method of claim 4, wherein the response further includes at least an update indexed by the dynamic index after the purging of the subset of updates from the live data store to the archive data store.

6. The computer-implemented method of claim 1, wherein the request includes a request key.

7. The computer-implemented method of claim 6, wherein the request key corresponds to the indexing key.

8. The computer-implemented method of claim 6, wherein generating the response comprises comparing the request key against one or more keys included in the static index.

9. The computer-implemented method of claim 1 further comprising compressing the object.

10. A system comprising:

a data store configured to at least store computer-executable instructions; and

a hardware processor in communication with the data store, the hardware processor configured to execute the computer-executable instructions to at least;

aggregate updates associated with an indexing key into an object, wherein the updates are archived in an archive data store and comprise a change associated with an item of an electronic catalog;

index the updates in a static index of the archive data store by associating a pointer to the object with the indexing key in the static index;

obtain a request for data associated with the electronic catalog; and

generate a response to the request based, at least in part, on the static index, wherein the response includes the pointer to the object.

11. The system of claim 10, wherein the hardware processor is further configured to execute the computer-executable instructions to receive a query for the updates, wherein the query indicates the indexing key, the indexing key serving as a basis for creating the static index.

12. The system of claim 11, wherein the static index is created asynchronously with receiving the query for the updates.

13. The system of claim 10, wherein the static index is recreated if a threshold for index recreation has been exceeded.

14. The system of claim 13, wherein the threshold for index recreation is a time period.

15. The system of claim 10, wherein the static index is recreated periodically, aperiodically, or on an interrupt-driven basis.

16. The system of claim 10, wherein the pointer to the object references a location of the object in the archive data store.

17. A non-transitory computer readable storage medium storing computer executable instructions that when executed by a processor perform operations comprising:

aggregating updates associated with an indexing key into an object, wherein the updates are archived in an archive data store and comprise a change associated with an item of an electronic catalog;

indexing the updates in a static index of the archive data store by associating a pointer to the object with the indexing key in the static index;

obtaining a request for data associated with the electronic catalog; and

generating a response to the request based, at least in part, on the static index, wherein the response includes the pointer to the object.

18. The non-transitory computer-readable storage medium of claim 17, wherein the operations further comprise verifying if the static index comprises updates indexed by a dynamic index of a live data store, and, if so, purging such updates from the dynamic index.

19. The non-transitory computer-readable storage medium of claim 17, wherein the indexing key comprises a category associated with the updates.

20. The computer-implemented method of claim 20, wherein the category comprises at least one of a time period or a type of item in the electronic catalog.