Increased parallelism performance of batch requests

• US 9,495,411 B2
• Filed: 09/20/2013
• Issued: 11/15/2016
• Est. Priority Date: 09/24/2012
• Status: Active Grant

• Current Assignee: Salesforce.com, Inc.
• Original Assignee: Salesforce.com, Inc.
• Inventors: Sampathkumar, Jayaraman Vellore
• Primary Examiner(s): Brown, Sheree
• Application Number:
  US14/033,131
• Publication Number:
  US 20140089282A1
• Time in Patent Office: 1,152 Days
• Field of Search: 707/705
• US Class Current: 1/1
• CPC Class Codes: G06F 16/24 Querying
• CPC Class Codes: G06F 2209/548 Queue

Abstract

A system selectively dequeues journal requests instead of dequeuing on a first come, first served basis. A database system detects that a request for access from a client is a journal batch, which includes multiple journal requests. The system queues the journal batch in a queue with other journal batches for processing. The system selectively dequeues journal requests from the journal batch queue, including selecting at least one journal request from multiple different journal batches. Thus, the journal requests do not conflict for shared resources, and the system can improve parallelism in processing the journal batches.

Claims

1. A method comprising:

detecting, with one or more processors, that a request for access to a database system includes a journal batch to reverse previous journal transactions, wherein the journal transactions function to cause ledger entries within the database system;

queuing the journal batch to reverse previous journal transactions and the corresponding ledger entries in a journal batch queue with other journal batches, wherein the journal batch queue is part of the database system, wherein each journal batch request includes multiple journal requests, and wherein queuing the journal batch comprises submitting multiple concurrent journal requests for reversing a previous journal batch;

placing all received requests to reverse previous journal transactions on hold in conjunction with the requests to reverse previous journal transactions being placed in the queue;

removing the hold from one or more individual requests to reverse corresponding ledger entries from within the multiple different batches;

selectively dequeuing, with the one or more processors, journal requests that have been removed from hold from the journal batch queue, including selecting at least one journal request from multiple different journal batches; and

executing the selected journal requests on parallel hardware computing resources of the database system to reverse previous journal request transactions.

2. The method of claim 1, wherein the journal batch is a reverse journal batch that moves a database journal entry from one system to another.

3. The method of claim 1, wherein queuing the journal batch further comprises putting a hold on the journal batch, including its multiple journal requests.

4. The method of claim 1, wherein selectively dequeuing the journal requests further comprises unholding the selected journal requests.

5. The method of claim 1, wherein selectively dequeuing the journal requests further comprises selectively dequeuing based on historical data.

6. The method of claim 5, wherein selectively dequeuing the journal requests based on historical data further comprises selectively dequeuing based on an estimate of how long jobs from a particular journal batch take to process.

7. The method of claim 1, wherein selectively dequeuing the journal requests further comprises selectively dequeuing based on computing resource load.

8. An article of manufacture comprising a non-transitory computer readable storage medium having content stored thereon, which when executed, are configurable to cause a machine to perform operations including:

detecting, with one or more processors, that a request for access to a database system includes a journal batch to reverse previous journal transactions, wherein the journal transactions function to cause ledger entries within the database system;

queuing the journal batch to reverse previous journal transactions and the corresponding ledger entries in a journal batch queue with other journal batches, wherein the journal batch queue is part of the database system, wherein each journal batch request includes multiple journal requests, and wherein queuing the journal batch comprises submitting multiple concurrent journal requests for reversing a previous journal batch;

placing all received requests to reverse previous journal transactions on hold in conjunction with the requests to reverse previous journal transactions being placed in the queue;

removing the hold from one or more individual requests to reverse corresponding ledger entries from within the multiple different batches;

selectively dequeuing, with the one or more processors, journal requests that have been removed from hold from the journal batch queue, including selecting at least one journal request from multiple different journal batches; and

executing the selected journal requests on parallel hardware computing resources of the database system to reverse previous journal request transactions.

9. The article of manufacture of claim 8, wherein the journal batch is a reverse journal batch that moves a database journal entry from one system to another.

10. The article of manufacture of claim 8, wherein the content for queuing the journal batch further comprises content for putting a hold on the journal batch, including its multiple journal requests.

11. The article of manufacture of claim 8, wherein the content for selectively dequeuing the journal requests further comprises content for unholding the selected journal requests.

12. The article of manufacture of claim 8, wherein the content for selectively dequeuing the journal requests further comprises content for selectively dequeuing based on historical data.

13. The article of manufacture of claim 8, wherein the content for selectively dequeuing the journal requests based on historical data further comprises content for selectively dequeuing based on an estimate of how long jobs from a particular journal batch take to process.

14. The article of manufacture of claim 8, wherein the content for selectively dequeuing the journal requests further comprises content for selectively dequeuing based on computing resource load.

15. A computer system comprising:

network interface hardware to connect to a database system; and

one or more processors configured to execute a request processing application for the database system, further configurable to

detect, with one or more processors, that a request for access to a database system includes a journal batch to reverse previous journal transactions, wherein the journal transactions function to cause ledger entries within the database system;

queue the journal batch to reverse previous journal transactions and the corresponding ledger entries in a journal batch queue with other journal batches, wherein the journal batch queue is part of the database system, wherein each journal batch request includes multiple journal requests, and wherein queuing the journal batch comprises submitting multiple concurrent journal requests for reversing a previous journal batch;

place all received requests to reverse previous journal transactions on hold in conjunction with the requests to reverse previous journal transactions being placed in the queue;

remove the hold from one or more individual requests to reverse corresponding ledger entries from within the multiple different batches;

selectively dequeue, with the one or more processors, journal requests that have been removed from hold from the journal batch queue, including selecting at least one journal request from multiple different journal batches; and

execute the selected journal requests on parallel hardware computing resources of the database system to reverse previous journal request transactions.

16. The computer system of claim 15, wherein the journal batch is a reverse journal batch that moves a database journal entry from one system to another.

17. The computer system of claim 15, wherein to queue the journal batch further comprises to put a hold on the journal batch, including its multiple journal requests.

18. The computer system of claim 15, wherein to selectively dequeue the journal requests further comprises to unhold the selected journal requests.

19. The computer system of claim 15, wherein to selectively dequeue the journal requests further comprises to selectively dequeue based on historical data.

20. The computer system of claim 15, wherein to selectively dequeue the journal requests further comprises to selectively dequeue based on computing resource load.