Method and system for semi-synchronously exporting data

• US 9,979,587 B2
• Filed: 04/12/2013
• Issued: 05/22/2018
• Est. Priority Date: 06/19/2012
• Status: Active Grant

• Current Assignee: Salesforce.com, Inc.
• Original Assignee: Salesforce.com, Inc.
• Inventors: Tejomurtula, Venkata Muralidhar, Kolesnik, Oleksii, Nachnani, Pawan, Funk, Cassandra, Patel, MaryAnn, Singh, Atul
• Primary Examiner(s): Whipple, Brian
• Assistant Examiner(s): Rotolo, Anthony T
• Application Number:
  US13/862,193
• Publication Number:
  US 20130339490A1
• Time in Patent Office: 1,866 Days
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes

Abstract

Systems and methods are provided for semi-synchronously exporting data. A web server creates an export record in response to receiving a data request from a client computer. The web server sends a token to the client computer, wherein receipt of the token enables the client computer to be used for other purposes while waiting for receipt of requested data. At least one of multiple batch processing servers processes the data request in response to accessing the export record. At least one of the multiple batch processing servers updates the export record to reflect the processing of the data request. The web server exports the processed data request to the client computer in response to identifying an update of the export record.

Claims

1. An apparatus for semi-synchronously exporting data, the apparatus comprising:

a processor; and

one or more sequences of instructions stored in a non-transitory computer readable medium which, when executed by the processor, cause the processor to carry out the steps of;

receiving, by a web server, a request for data from a client computer;

synchronously exporting, by the web server, a portion of the requested data, accessed from a database, to the client computer in response to receiving the data request from the client computer;

creating, by the web server, an export record after receiving the request for data from the client computer and after synchronously exporting the portion of the requested data;

asynchronously exporting, by the web server, a remainder portion of the requested data to the client computer subsequent to the web server synchronously exporting the portion of the requested data to the client computer, the asynchronous exporting comprising;

sending, by the web server, a token to the client computer, a receipt of the token enables the client computer to be used for other purposes while waiting for receipt of the remainder of the requested data, the token enabling the client computer to execute a process in the background of the client computer to periodically poll the web server;

processing, by at least one of a plurality of batch processing servers, the requested data, by accessing the database, in response to accessing the export record;

updating, by the at least one of the plurality of batch processing servers, the export record to reflect the processing of the data request; and

exporting, by the web server, the remainder of the requested data to the client computer in response to identifying an update of the export record.

2. The apparatus of claim 1, wherein the steps further comprise:

determining, by the web server, whether an account associated with the client computer has sufficient credit for receiving the requested data, in response to receiving the data request from the client computer; and

sending, by the web server, options to the client computer in response to a determination that the account does not have sufficient credit for receiving the requested data, wherein the options comprise adding all of the requested data to a cart for later use, using available credit to purchase a portion of the requested data, and modifying the data request.

3. The apparatus of claim 1, wherein the synchronously exporting, by the web server, a portion of the requested data is performed until an export of the portion of the requested data reaches a threshold.

4. The apparatus of claim 1, wherein the polling of the web server enables the client computer to determine when the data request has been processed.

5. The apparatus of claim 1, wherein the steps further comprise notifying, by the web server, the client computer that the data request has been processed.

6. A non-transitory computer readable medium carrying one or more sequences of instructions for semi-synchronously exporting data, which instructions, when executed by one or more processors, cause the one or more processors to carry out the steps of:

receiving, by a web server, a request for data from a client computer;

synchronously exporting, by the web server, a portion of the requested data, accessed from a database, to the client computer in response to receiving the data request from the client computer;

creating, by the web server, an export record after receiving the request for data from the client computer and after synchronously exporting the portion of the requested data;

asynchronously exporting, by the web server, a remainder portion of the requested data to the client computer subsequent to the web server synchronously exporting the portion of the requested data to the client computer, the asynchronous exporting comprising;

sending, by the web server, a token to the client computer, a receipt of the token enables the client computer to be used for other purposes while waiting for receipt of the remainder of the requested data, the token enabling the client computer to execute a process in the background of the client computer to periodically poll the web server;

processing, by at least one of a plurality of batch processing servers, the requested data, by accessing the database, in response to accessing the export record;

updating, by the at least one of the plurality of batch processing servers, the export record to reflect the processing of the data request; and

exporting, by the web server, the remainder of the requested data to the client computer in response to identifying an update of the export record.

7. The non-transitory computer readable medium of claim 6, wherein the steps further comprise:

determining, by the web server, whether an account associated with the client computer has sufficient credit for receiving the requested data, in response to receiving the data request from the client computer; and

sending, by the web server, options to the client computer in response to a determination that the account does not have sufficient credit for receiving the requested data, wherein the options comprise adding all of the requested data to a cart for later use, using available credit to purchase a portion of the requested data, and modifying the data request.

8. The non-transitory computer readable medium of claim 6, wherein the synchronously exporting, by the web server, a portion of the requested data is performed until an export of the portion of the requested data reaches a threshold.

9. The non-transitory computer readable medium of claim 6, wherein the polling of the web server enables the client computer to determine when the data request has been processed.

10. The non-transitory computer readable medium of claim 6, wherein the steps further comprise notifying, by the web server, the client computer that the data request has been processed.

11. A method for semi-synchronously exporting data, the method comprising:

receiving, by a web server, a request for data from a client computer;

synchronously exporting, by the web server, a portion of the requested data, accessed from a database, to the client computer in response to receiving the data request from the client computer;

creating, by the web server, an export record after receiving the request for data from the client computer and after synchronously exporting the portion of the requested data;

asynchronously exporting, by the web server, a remainder portion of the requested data to the client computer subsequent to the web server synchronously exporting the portion of the requested data to the client computer, the asynchronous exporting comprising;

sending, by the web server, a token to the client computer, a receipt of the token enables the client computer to be used for other purposes while waiting for receipt of the remainder of the requested data, the token enabling the client computer to execute a process in the background of the client computer to periodically poll the web server;

processing, by at least one of a plurality of batch processing servers, the requested data, by accessing the database, in response to accessing the export record;

updating, by the at least one of the plurality of batch processing servers, the export record to reflect the processing of the data request; and

exporting, by the web server, the remainder of the requested data to the client computer in response to identifying an update of the export record.

12. The method of claim 11, further comprising:

determining, by the web server, whether an account associated with the client computer has sufficient credit for receiving the requested data, in response to receiving the data request from the client computer; and

sending, by the web server, options to the client computer in response to a determination that the account does not have sufficient credit for receiving the requested data, wherein the options comprise adding all of the requested data to a cart for later use, using available credit to purchase a portion of the requested data, and modifying the data request.

13. The method of claim 11, wherein the synchronously exporting, by the web server, a portion of the requested data is performed until an export of the portion of the requested data reaches a threshold.

14. The method of claim 11, wherein the polling of the web server enables the client computer to determine when the data request has been processed.

15. The method of claim 11, further comprising notifying, by the web server, the client computer that the data request has been processed.

16. A method for transmitting code for semi-synchronously exporting data on a transmission medium, the method comprising:

transmitting code to receive, by a web server, a request for data from a client computer;

transmitting code to synchronously exporting, by the web server, a portion of the requested data, accessed from a database, to the client computer in response to receiving the data request from the client computer;

transmitting code to create, by the web server, an export record after receiving the request for data from the client computer and after synchronously exporting the portion of the requested data;

transmitting code to asynchronously exporting, by the web server, a remainder portion of the requested data to the client computer subsequent to the web server synchronously exporting the portion of the requested data to the client computer, the asynchronous exporting comprising;

transmitting code to send, by the web server, a token to the client computer, a receipt of the token enables the client computer to be used for other purposes while waiting for receipt of the remainder of the requested data, the token enabling the client computer to execute a process in the background of the client computer to periodically poll the web server;

transmitting code to process, by at least one of a plurality of batch processing servers, the requested data, by accessing the database, in response to accessing the export record;

transmitting code to update, by the at least one of the plurality of batch processing servers, the export record to reflect the processing of the data request; and

transmitting code to export, by the web server, the remainder of the requested data to the client computer in response to identifying an update of the export record.

17. The method for transmitting code of claim 16, further comprising:

transmitting code to determine, by the web server, whether an account associated with the client computer has sufficient credit for receiving the requested data, in response to receiving the data request from the client computer; and

transmitting code to send, by the web server, options to the client computer in response to a determination that the account does not have sufficient credit for receiving the requested data, wherein the options comprise adding all of the requested data to a cart for later use, using available credit to purchase a portion of the requested data, and modifying the data request.

18. The method for transmitting code of claim 16, wherein the transmitting code to synchronously export, by the web server, a portion of the requested data is performed until an export of the portion of the requested data reaches a threshold.

19. The method for transmitting code of claim 16, wherein the polling of the web server enables the client computer to determine when the data request has been processed.

20. The method for transmitting code of claim 16, further comprising transmitting code to notify, by the web server, the client computer that the data request has been processed.