Data aggregation and caching

• US 9,703,793 B1
• Filed: 05/11/2015
• Issued: 07/11/2017
• Est. Priority Date: 02/04/2009
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Raden, II, Gary Paul, Kanawati, Antoun, Karnik, Mukul Vijay, Rajagopal, Roshith, Hunter, Jamie
• Primary Examiner(s): Pyo, Monica
• Application Number:
  US14/708,686
• Time in Patent Office: 792 Days
• Field of Search: 707802-805, 709203, 709207, 715733, 715764
• CPC Class Codes: G06F 16/172 Caching, prefetching or hoarding of files
• CPC Class Codes: G06F 16/9024 Graphs; Linked lists G06F16/9027 takes precedence
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9574 of access to content, e.g. by caching
• CPC Class Codes: G06F 16/958 Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking

Abstract

Systems and methods aggregate data and use caching techniques. In one implementation, a computer-implemented method aggregates data. A server receives a request for data that includes one or more identifiers. Based on at least one of the one or more identifiers, at least one template defining a view of the data is retrieved. One or more modules are identified based on the at least one template and one or more services are invoked to obtain the one or more modules. The one or more modules are received and processing by applying one or more business logic rules. At least a portion of the one or more processed modules are stored in a data store. The view of the data is generated based on the processed one or more modules and a response is transmitted to a client that includes the view of the data.

Claims

1. A computer-implemented method for aggregating data, comprising:

receiving, at a server computer, a request for data describing an item offered on a network site, the request including one or more identifiers corresponding to the data;

retrieving, at the server computer, based on at least one of the one or more identifiers, at least one template defining a view of the data;

identifying a plurality of modules of the view of the data, based on the at least one template, wherein a module includes a component of the view of the data;

determining, at the server computer, that at least one of the plurality of modules of the view of the data is currently available as a pre-processed module within a temporary cache of a data store of the server computer, wherein contents of the temporary cache are associated with a predetermined time period after which a respective piece of content is deleted from the temporary cache;

retrieving, by the server computer, the at least one of the plurality of modules from the temporary cache of the data store;

invoking at the server computer, one or more services to obtain remaining ones of the plurality of modules;

receiving, at the server computer, the remaining ones of the plurality of modules, wherein the view of the data is generated based on the remaining ones of the plurality of modules and the retrieved at least one of the plurality of modules;

processing, at the server computer, one or more of the plurality of modules by applying one or more business logic rules;

storing at least a portion of the processed one or more of the plurality of modules in the temporary cache of the data store in accordance with a respective predetermined time period associated with the portion of the processed one or more of the plurality of modules, wherein the one or more business logic rules specify different predetermined time periods for the temporary cache that are associated with different categories associated with the plurality of modules;

generating, at the server computer, the view of the data based on assembling the processed one or more of the plurality of modules and the retrieved at least one of the plurality of modules; and

transmitting a response to a client from the server computer, wherein the response includes the view of the data.

2. The computer-implemented method of claim 1, wherein the plurality of modules correspond to portions of a graph used to retrieve the data.

3. The computer-implemented method of claim 1, wherein one or more of identifying the plurality of modules, invoking the one or more services, receiving the remaining ones of the plurality of modules, processing the one or more of the plurality of modules, and storing the at least a portion of the processed one or more of the plurality of modules occur substantially in parallel.

4. The computer-implemented method of claim 1, wherein the one or more identifiers comprise a merchant ID, a marketplace ID, or a product ID.

5. The computer-implemented method of claim 1, wherein the at least one template includes or references one or more additional templates.

6. The computer-implemented method of claim 1, wherein the plurality of modules comprise information related to a product, a person, or a place.

7. The computer-implemented method of claim 1, wherein the view of the data is incorporated into a document.

8. The computer-implemented method of claim 7, wherein the document is a product detail document, a search results document, or a content document.

9. The computer-implemented method of claim 1, wherein the one or more business logic rules comprise rules specifying computations related to the plurality of modules.

10. The computer-implemented method of claim 1, wherein the predetermined time period is further based on a data frequency.

11. A computer-implemented method for aggregating data, comprising:

receiving, at a server computer, a request for data describing an item offered on a network site;

determining, at the server computer, that at least one of a plurality of modules of a view of the data is currently available as a pre-processed module within a temporary cache of a data store of the server computer, wherein contents of the temporary cache are associated with a predetermined time period after which a respective piece of content is deleted from the temporary cache, wherein a module includes a component of the view of the data;

retrieving, by the server computer, the at least one of the plurality of modules from the temporary cache of the data store;

invoking, at the server computer, one or more services to obtain remaining ones of the plurality of modules of the view of the data;

processing, at the server computer, one or more of the plurality of modules;

storing at least a portion of the processed one or more of the plurality of modules in the temporary cache of the data store in accordance with a respective predetermined time period associated with the portion of the processed one or more of the plurality of modules, wherein one or more business logic rules specify different predetermined time periods for the temporary cache that are associated with different categories associated with the plurality of modules;

generating, at the server computer, the view of the data based on the processed one or more of the plurality of modules; and

transmitting a response to a client from the server computer, the response including the view of the data.

12. The computer-implemented method of claim 11, wherein the request includes one or more identifiers, the computer-implemented method further comprising:

retrieving, based on at least one of the one or more identifiers, at least one template for generating the view of the data.

13. The computer-implemented method of claim 12, further comprising:

identifying the plurality of modules based on the at least one template.

14. The computer-implemented method of claim 13, wherein identifying the plurality of modules is further based on the one or more identifiers.

15. The computer-implemented method of claim 11, wherein processing the one or more of the plurality of modules comprises applying the one or more business logic rules to at least one of the plurality of modules.

16. The computer-implemented method of claim 15, wherein the one or more business logic rules specify computations related to the plurality of modules.

17. The computer-implemented method of claim 11, wherein the at least a portion of the processed one or more modules is stored in the data store included in the server computer.