Indexing data updates associated with an electronic catalog system

• US 9,846,697 B2
• Filed: 04/28/2015
• Issued: 12/19/2017
• Est. Priority Date: 10/20/2011
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Goo, Almann T., McInerny, Michael J.
• Primary Examiner(s): Hwa, Shyue Jiunn
• Application Number:
  US14/698,557
• Publication Number:
  US 20150242413A1
• Time in Patent Office: 966 Days
• CPC Class Codes: G06F 16/113 Details of archiving lifecycle management in storage systems G06F3/0649; backup systems G06F11/1446
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/2272 Management thereof
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 2201/80 Database-specific techniques

Abstract

Systems and methods are provided for efficiently indexing archived objects in an archive data store to allow for efficient and quick access to the archived objects. The systems and methods provided also allow alleviate the strain on a live data store and enable a requester wishing to retrieve updates to do so without knowledge of the location of the stored update on a live or archive data store.

Claims

1. A computer-implemented method for managing update information associated with items of an electronic catalog, comprising:

under control of one or more computing devices;

obtaining, from an archive data store, updates associated with an indexing key, wherein the updates comprise a change associated with an item of an electronic catalog, wherein at least a subset of the updates is purged from a live data store to the archive data store, and wherein the live data store is associated with a dynamic index that indexes the subset before the subset is purged;

aggregating the updates into an object;

indexing the updates in a static index of the archive data store by associating a pointer to the object with the indexing key in the static index;

obtaining a request for update data associated with the electronic catalog, wherein the request for update data includes a query key that is matched to determine whether the update can be obtained from the static index or the dynamic index; and

generating a response to the request based, at least in part, on a match to the indexing key on the static index, wherein the response includes the pointer to the object, wherein the pointer corresponds to the match to the indexing key.

2. The computer-implemented method of claim 1, wherein the generation of the response is further based on the dynamic index of the live data store.

3. The computer-implemented method of claim 2, wherein the response further includes at least an update indexed by the dynamic index after the purging of the subset of updates from the live data store to the archive data store.

4. The computer-implemented method of claim 1, wherein the request includes a request key.

5. The computer-implemented method of claim 4, wherein the request key corresponds to the indexing key.

6. The computer-implemented method of claim 4, wherein generating the response comprises comparing the request key against one or more keys included in the static index.

7. The computer-implemented method of claim 1 further comprising compressing the object.

8. A system comprising:

a data store configured to at least store computer-executable instructions; and

a hardware processor in communication with the data store, the hardware processor configured to execute the computer-executable instructions to at least;

aggregate updates associated with an indexing key into an object, wherein the updates are archived in an archive data store and comprise a change associated with an item of an electronic catalog, wherein at least a subset of the updates is purged from a live data store to the archive data store, and wherein the live data store is associated with a dynamic index that indexes the subset;

index the updates in a static index of the archive data store by associating a pointer to the object with the indexing key in the static index;

obtain a request for data associated with the electronic catalog, wherein the request for update data includes a query key that determines whether the update can be obtained from the static index or the dynamic index; and

generate a response to the request based, at least in part, on a match to the indexing key on the static index, wherein the response includes the pointer to the object, wherein the pointer corresponds to the match to the indexing key.

9. The system of claim 8, wherein the hardware processor is further configured to execute the computer-executable instructions to receive a query for the updates, wherein the query indicates the indexing key, the indexing key serving as a basis for creating the static index.

10. The system of claim 9, wherein the static index is created asynchronously with receiving the query for the updates.

11. The system of claim 8, wherein the static index is recreated when a threshold for index recreation has been exceeded.

12. The system of claim 11, wherein the threshold for index recreation is a time period.

13. The system of claim 8, wherein the static index is recreated periodically, aperiodically, or on an interrupt-driven basis.

14. The system of claim 8, wherein the pointer to the object references a location of the object in the archive data store.

15. A non-transitory computer:

readable storage medium storing computer executable instructions that when executed by a processor perform operations comprising;

aggregating updates associated with an indexing key into an object, wherein the updates are archived in an archive data store and comprise a change associated with an item of an electronic catalog;

indexing the updates in a static index of the archive data store by associating a pointer to the object with the indexing key in the static index;

in response to verifying that the static index comprises updates indexed by a dynamic index of a live data store, purging such updates from the dynamic index;

obtaining a request for data associated with the electronic catalog, wherein the request for update data includes a query key that is matched to determine whether the update can be obtained from the static index or the dynamic index; and

generating a response to the request based, at least in part, on a match to the indexing key on the static index, wherein the response includes the pointer to the object, wherein the pointer corresponds to the match to the indexing key.

16. The non-transitory computer-readable storage medium of claim 15, wherein the indexing key comprises a category associated with the updates.

17. The non-transitory computer-readable storage medium of claim 16, wherein the category comprises at least one of a time period or a type of item in the electronic catalog.