Resource constraints for request processing

• US 9,148,329 B1
• Filed: 03/27/2012
• Issued: 09/29/2015
• Est. Priority Date: 11/30/2011
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Gay, David Edward, Fuller, Alfred R. K.
• Primary Examiner(s): Parry, Chris
• Assistant Examiner(s): Stiltner, Weiwei
• Application Number:
  US13/431,906
• Time in Patent Office: 1,281 Days
• Field of Search: 709/226
• US Class Current: 1/1
• CPC Class Codes: G06F 16/438 Presentation of query results
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

A server system having one or more processors and memory receives a first request from an application and processes at least a portion of the first request in accordance with a predefined set of resource constraints. In accordance with a determination that the predefined set of resource constraints has been met prior to completing processing the first request, the server system terminates processing of the first request prior to completing processing of the first request, generates a first intermediate result; and provides a response to the application. The response includes the first intermediate result, and request status information enabling the application to request resumption of the first request.

Claims

1. A method comprising:

at a respective server system having one or more processors and memory storing one or more programs that when executed by the one or more processors cause the respective server system to perform the method, the method comprising;

receiving a first request from an application;

processing at least a portion of the first request in accordance with a predefined set of resource constraints; and

in accordance with a determination that the predefined set of resource constraints has been met prior to completing processing the first request;

terminating processing of the first request prior to completing processing of the first request, wherein terminating processing of the first request includes generating detailed state information and approximate state information corresponding to a state of the first request at the time that it was terminated, and wherein the detailed state information includes additional processing state parameters in comparison with the approximate state information;

generating a first intermediate result; and

providing a response to the application including;

the first intermediate result; and

request status information enabling the application to request resumption of the first request, wherein the request status information includes;

a query handle that enables the server system to resume processing the first request in accordance with the detailed state information; and

a query cursor that enables the server system to resume processing the first request in accordance with the approximate state information;

receiving a second request to resume processing the first request, wherein the second request includes both the query handle and the query cursor;

in accordance with a determination that the detailed state information has not expired, utilizing the query handle to resume processing and forgoing utilizing the query cursor; and

in accordance with a determination that the detailed state information has expired, utilizing the query cursor to resume processing and forgoing utilizing the query handle.

2. The method of claim 1, wherein at least a portion of the request status information expires in accordance with predefined criteria selected from the set consisting of:

a predefined amount of time, expiration of an instance of the application from which the first request was received, a notification from the application that the first intermediate result was sufficient, and a determination that no more results are present.

3. The method of claim 1, wherein:

the detailed state information is stored at the server system; and

the query handle includes a unique identifier for the detailed state information.

4. The method of claim 1, wherein the query cursor includes the approximate state information.

5. The method of claim 2, wherein the at least a portion of the request status information is the detailed state information.

6. The method of claim 5, further comprising, after the detailed state information has expired:

receiving a second request to resume processing the first request; and

in accordance with a determination that the second request includes the query cursor, producing a second intermediate result in accordance with the approximate state information.

7. The method of claim 1, wherein the predefined set of resource constraints are selected from the set consisting of:

a number of retrieved results, a size of the retrieved results and a number of index entries examined.

8. The method of claim 1, wherein the predefined set of resource constraints are defined by the application from which the request was received.

9. The method of claim 1, wherein the first intermediate result is not empty;

wherein the approximate state information comprises information for a first processing state, the first processing state corresponding to the first intermediate result;

wherein the detailed state information comprises information for a second processing state, the second processing state being subsequent to the first processing state; and

wherein the query cursor enables the server system to resume processing at the first processing state and wherein the query handle enables the server system to resume processing at the second processing state.

10. A server system, comprising:

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

receiving a first request from an application;

processing at least a portion of the first request in accordance with a predefined set of resource constraints; and

in accordance with a determination that the predefined set of resource constraints has been met prior to completing processing the first request;

terminating processing of the first request prior to completing processing of the first request, wherein terminating processing of the first request includes generating detailed state information and approximate state information corresponding to a state of the first request at the time that it was terminated, and wherein the detailed state information includes additional processing state parameters in comparison with the approximate state information;

generating a first intermediate result; and

providing a response to the application including;

the first intermediate result; and

request status information enabling the application to request resumption of the first request, wherein the request status information includes;

 

a query handle that enables the server system to resume processing the first request in accordance with the detailed state information; and

 

a query cursor that enables the server system to resume processing the first request in accordance with the approximate state information;

receiving a second request to resume processing the first request, wherein the second request includes both the query handle and the query cursor;

in accordance with a determination that the detailed state information has not expired, utilizing the query handle to resume processing and forgoing utilizing the query cursor; and

in accordance with a determination that the detailed state information has expired, utilizing the query cursor to resume processing and forgoing utilizing the query handle.

11. The system of claim 10, wherein at least a portion of the request status information expires in accordance with predefined criteria selected from the set consisting of:

a predefined amount of time, expiration of an instance of the application from which the first request was received, a notification from the application that the first intermediate result was sufficient, and a determination that no more results are present.

12. The system of claim 10, wherein:

the detailed state information is stored at the server system; and

the query handle includes a unique identifier for the detailed state information.

13. The system of claim 10, wherein the query cursor includes the approximate state information.

14. The system of claim 11, wherein the at least a portion of the request status information is the detailed state information.

15. The system of claim 14, wherein the one or more programs further comprise instructions for, after the detailed state information has expired:

receiving a second request to resume processing the first request; and

in accordance with a determination that the second request includes the query cursor, producing a second intermediate result in accordance with the approximate state information.

16. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a computer system with one or more processors, cause the computer system to:

receive a first request from an application;

process at least a portion of the first request in accordance with a predefined set of resource constraints; and

in accordance with a determination that the predefined set of resource constraints has been met prior to completing processing the first request;

terminate processing of the first request prior to completing processing of the first request, wherein terminating processing of the first request includes generating detailed state information and approximate state information corresponding to a state of the first request at the time that it was terminated, and wherein the detailed state information includes additional processing state parameters in comparison with the approximate state information;

generate a first intermediate result; and

provide a response to the application including;

the first intermediate result; and

request status information enabling the application to request resumption of the first request, wherein the request status information includes;

a query handle that enables the server system to resume processing the first request in accordance with the detailed state information; and

a query cursor that enables the server system to resume processing the first request in accordance with the approximate state information;

receive a second request to resume processing the first request, wherein the second request includes both the query handle and the query cursor;

in accordance with a determination that the detailed state information has not expired, utilize the query handle to resume processing and forgo utilizing the query cursor; and

in accordance with a determination that the detailed state information has expired, utilize the query cursor to resume processing and forgo utilizing the query handle.

17. The non-transitory computer readable storage medium of claim 16, wherein at least a portion of the request status information expires in accordance with predefined criteria selected from the set consisting of:

a predefined amount of time, expiration of an instance of the application from which the first request was received, a notification from the application that the first intermediate result was sufficient, and a determination that no more results are present.

18. The non-transitory computer readable storage medium of claim 16, wherein:

the detailed state information is stored at the server system; and

the query handle includes a unique identifier for the detailed state information.

19. The non-transitory computer readable storage medium of claim 16, wherein the query cursor includes the approximate state information.

20. The non-transitory computer readable storage medium of claim 17, wherein the at least a portion of the request status information is the detailed state information.

21. The non-transitory computer readable storage medium of claim 20, wherein the one or more programs further comprise instructions to, after the detailed state information has expired:

receive a second request to resume processing the first request; and

in accordance with a determination that the second request includes the query cursor, produce a second intermediate result in accordance with the approximate state information.