Adaptive data transfer optimization

• US 10,582,012 B2
• Filed: 05/18/2016
• Issued: 03/03/2020
• Est. Priority Date: 10/16/2015
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Davis, Edmund A., Rowles, Brian C.
• Primary Examiner(s): Whipple, Brian
• Application Number:
  US15/157,758
• Publication Number:
  US 20170111477A1
• Time in Patent Office: 1,385 Days
• Field of Search: None
• CPC Class Codes: H04L 43/0864 Round trip delays
• CPC Class Codes: H04L 43/16 Threshold monitoring
• CPC Class Codes: H04L 47/36 by determining packet size, e.g. maximum transfer unit [MTU]
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/34 involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416

Abstract

A system transfers data for an application. The system determines a per request data size, and sends a data transfer request for transferring a portion of the data from a client to a server according to the per request data size, where the server is configured to host the application. The system then receives a response from the server for the data transfer request, and adjusts the per request data size based on a measure of the data transfer request and the response. The adjusted per request data size is configured to be used for sending other portions of the data from the client to the server.

Claims

1. A non-transitory computer readable medium having instructions stored thereon that, when executed by a processor, cause the processor to transfer data for an application, the transferring comprising:

determining a first per request data size, wherein the data comprises a database table of a database comprising a plurality of rows, and the first per request data size comprises a first number of the plurality of the rows;

sending a first data transfer request of a plurality of data transfer requests for transferring a first portion of the data from a client to a server according to the first per request data size, each of the plurality of data transfer requests comprising transferring a portion of the data from the client to the server and the server committing the transferred data, the committing comprising storing the first number of rows into the database, the first portion having the first per request data size;

receiving a response from the server for the first data transfer request, the response indicating a completion of a data transfer request and indicating both that the first number of rows are received by the server and the first number of rows are stored in the database; and

adjusting the first per request data size based on a measure of the data transfer request and the response to generate a second per request data size that is different than the first per request data size, the second per request data size comprises a second number of the plurality of rows, the measure comprising a time duration between the data transfer request and the response, wherein the second per request data size is configured to be used for sending other portions of the data from the client to the server;

sending a second data transfer request for transferring a second portion of the data from a client to a server according to the second per request data size, the second data transfer request comprising transferring a second portion of the data, the second portion having the second per request data size.

2. The computer readable medium of claim 1, wherein the application is developed on the client and implements the data.

3. The computer readable medium of claim 1, wherein the application is executed on the client and updates the data.

4. The computer readable medium of claim 1, wherein the application is integrated with a native application at the client, wherein the data is configured by the native application.

5. The computer readable medium of claim 4, wherein the native application is a desktop based application.

6. The computer readable medium of claim 4, wherein the native application is Microsoft Excel, wherein the data is configured in a spreadsheet.

7. The computer readable medium of claim 1, wherein the data transfer request is configured to persist changes in a model of the data at the server.

8. The computer readable medium of claim 1, wherein the data transfer request comprises one or more upload or download requests.

9. The computer readable medium of claim 1, wherein the first per request data size is reduced when the time duration indicates that a network latency is above a threshold value or above a previously measured latency value.

10. The computer readable medium of claim 1, wherein the first per request data size is increased when the time duration indicates that a network latency is below a threshold value or below a previously measured latency value.

11. The computer readable medium of claim 1, wherein the portion is a batch of data, wherein the first per request data size indicates a batch size for the batch of data, wherein the data is split into batches of the batch size.

12. The computer readable medium of claim 11, wherein the first data transfer request implements multi-sync functionality to upload or download multiple batches of data in a single request.

13. The computer readable medium of claim 12, wherein the multi-sync functionality is implemented by an application programming interface that includes multiple upload or download requests and multiple commit requests.

14. A method of transferring data for an application, comprising:

determining a first per request data size, wherein the data comprises a database table of a database comprising a plurality of rows, and the first per request data size comprises a first number of the plurality of the rows;

sending a first data transfer request of a plurality of data transfer requests for transferring a first portion of the data from a client to a server according to the first per request data size, each of the plurality of data transfer requests comprising transferring a portion of the data from the client to the server and the server committing the transferred data, the committing comprising storing the first number of rows into the database, the first portion having the first per request data size;

receiving a response from the server for the first data transfer request, the response indicating a completion of a data transfer request and indicating both that the first number of rows are received by the server and the first number of rows are stored in the database; and

adjusting the first per request data size based on a measure of the data transfer request and the response to generate a second per request data size that is different than the first per request data size, the second per request data size comprises a second number of the plurality of rows, the measure comprising a time duration between the data transfer request and the response, wherein the second per request data size is configured to be used for sending other portions of the data from the client to the server;

sending a second data transfer request for transferring a second portion of the data from a client to a server according to the second per request data size, the second data transfer request comprising transferring a second portion of the data, the second portion having the second per request data size.

15. The method of claim 14, wherein the application is developed on the client and implements the data.

16. The method of claim 14, wherein the application is executed on the client and updates the data.

17. The method of claim 14, wherein the data transfer request implements multi-sync functionality to upload or download multiple batches of data in a single request.

18. The method of claim 14, wherein the multi-sync functionality is implemented by an application programming interface that includes multiple upload or download requests and multiple commit requests.

19. A system for transferring data for an application, comprising:

one or more processors that execute stored instructions to implement a plurality of modules, the modules comprising;

a determining module that determines a first per request data size, wherein the data comprises a database table of a database comprising a plurality of rows, and the first per request data size comprises a first number of the plurality of the rows;

a sending module that sends a first data transfer request of a plurality of data transfer requests for transferring a first portion of the data from a client to a server according to the first per request data size, each of the plurality of data transfer requests comprising transferring a portion of the data from the client to the server and the server committing the transferred data, the committing comprising storing the first number of rows into the database, the first portion having the first per request data size;

a receiving module that receives a response from the server for the first data transfer request, the response indicating a completion of a data transfer request and indicating both that the first number of rows are received by the server and the first number of rows are stored in the database; and

an adjusting module that adjusts the first per request data size based on a measure of the data transfer request and the response to generate a second per request data size that is different than the first per request data size, the second per request data size comprises a second number of the plurality of rows, the measure comprising a time duration between the data transfer request and the response, wherein the second per request data size is configured to be used for sending other portions of the data from the client to the server;

the adjusting module further sending a second data transfer request for transferring a second portion of the data from a client to a server according to the second per request data size, the second data transfer request comprising transferring a second portion of the data, the second portion having the second per request data size.

20. The system of claim 19, wherein the data transfer request implements multi-sync functionality to upload or download multiple batches of data in a single request.