SYSTEMS, METHODS, AND APPARATUSES FOR IMPLEMENTING A STREAMING PLATFORM IO PUMP AND REGULATOR

• US 20130268807A1
• Filed: 03/15/2013
• Published: 10/10/2013
• Est. Priority Date: 10/10/2011
• Status: Active Grant

• Current Assignee: Salesforce.com, Inc.
• Original Assignee: Salesforce.com, Inc.
• Inventors: Spencer, Barry, Egemberger, Jeremy
• Granted Patent: US 9,183,090 B2
• Time in Patent Office: Days
• US Class Current: 714/18
• CPC Class Codes: G06F 11/1415 at system level
• CPC Class Codes: G06F 11/1443 Transmit or communication errors
• CPC Class Codes: H04L 43/0882 Utilisation of link capacity
• CPC Class Codes: H04L 65/401 wherein the services involve a main real-time session and one or more additional parallel real-time or time sensitive sessions, e.g. white board sharing or spawning of a subconference
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 69/16 Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]

Abstract

In accordance with disclosed embodiments, there are provided methods, systems, and apparatuses for implementing a streaming platform IO pump and regulator including, for example, means for executing an application at the computing device; requesting data for the application from a second computing device communicably interfaced with the first computing device via a public Internet; calculating an estimated arrival time for the data to be returned from the second computing device; determining the data fails to arrive within the estimated arrival time calculated; initiating a new connection to the second computing device; and re-sending the request for the data for the application to the second computing device via the new connection. Other related embodiments are disclosed.

Claims

1. A method at a computing device, the method comprising:

executing an application at the computing device;

requesting data for the application from a second computing device communicably interfaced with the first computing device via a public Internet;

calculating an estimated arrival time for the data to be returned from the second computing device;

determining the data fails to arrive within the estimated arrival time calculated;

initiating a new connection to the second computing device; and

re-sending the request for the data for the application to the second computing device via the new connection.

2. The method of claim 1, wherein requesting data from a second computing device communicably interfaced with the first computing device via a public Internet comprises:

initiating a Transmission Control Protocol (TCP) connection exclusively for the application between the first computing device and the second computing device via the public Internet.

3. The method of claim 2, wherein initiating the new connection to the second computing device comprises initiating a second TCP connection exclusively for the application between the first computing device and the second computing device via the public Internet.

4. The method of claim 2, wherein initiating the TCP connection comprises:

selecting the TCP connection from a plurality of multiple simultaneous TCP connections in a connection pool exclusively allocated to the application; and

initiating the selected TCP connection.

5. The method of claim 1, further comprising:

determining the data arrives on the new connection responsive to re-sending the request for the data to the second computing device via the new connection within the estimated arrival time calculated;

consuming the data at the first computing device via the application; and

sending an acknowledgement to the second computing device via the new connection.

6. The method of claim 5, further comprising:

receiving a second copy of the data via an original connection subsequent to the data arriving initially on the new connection; and

discarding the second copy of the data as waste.

7. The method of claim 1, further comprising:

receiving the data via an original connection subsequent to re-sending the request for the data to the second computing device via the new connection;

consuming the data at the first computing device via the application;

sending an acknowledgement to the second computing device via the new connection;

receiving a second copy of the data via the new connection subsequent to receiving a first copy of the data via the original connection, the second copy of the data being sent by the second computing device responsive to the first computing device re-sending the request for the data to the second computing device via the new connection; and

discarding the second copy of the data as waste.

8. The method of claim 1, wherein the application comprises a desktop sharing application requiring a lossless low-latency connection.

9. The method of claim 8, wherein the desktop sharing application exchanges I-Frames an P-Frames with the second computing device as part of a video stream for the desktop sharing application.

10. The method of claim 8:

wherein the first computing device is a presenter computing device for the desktop sharing application; and

wherein the second computing device is one of;

(a) a cloud services platform operating at a host organization remote from the first computing device, wherein the cloud services platform accepts a video stream for the desktop sharing application from the presenter computing device and distributes the video stream to one or more other remote computing devices on behalf of the presenter computing device,

(b) a server remote from the first computing device, wherein the server accepts the video stream for the desktop sharing application from the presenter computing device and distributes the video stream to one or more other remote computing devices on behalf of the presenter computing device, and

(c) a peer computing device operating as a viewer computing device, wherein the viewer computing device accepts the video stream for the desktop sharing application from the presenter computing device and consumes the video stream by presenting the video stream at a display of the viewer computing device.

11. The method of claim 1, further comprising:

monitoring open connections in a connection pool;

determining an original connection over which the data was initially requested remains open and has exceeded an open connection timeout; and

forcibly killing a thread associated with the original connection to terminate the connection and release the terminated connection back into the connection pool.

12. The method of claim 1, wherein calculating the estimated arrival time is based at least in part on the following:

latency for the requested data to be transmitted from the first computing device to the second computing device;

latency for the second computing device to process the request for the data from the first computing device;

latency for the requested data to be transmitted from the second computing device to the first computing device; and

a grace period to accommodate connection variance.

13. The method of claim 12, wherein the estimated arrival time is based further on a packet size corresponding to one or both of the data requested by the first computing device and the data returned from the second computing device.

14. The method of claim 1, wherein calculating the estimated arrival time, comprises:

iteratively adjusting the estimated arrival time for data packets communicated in support of the application between the computing device and the second computing device based at least in part on observed latency between the computing device and the remote computing device.

15. The method of claim 1, further comprising:

determining a nominal packet size for the application;

wherein requesting the data from the second computing device comprises generating a request packet having a size proportional to the nominal packet size for the application; and

adjusting the nominal packet size upwards responsive to low latency observed for communications on behalf of the application and downwards responsive to high latency and packet loss observed for the communications on behalf of the application.

16. The method of claim 15, further comprising:

forcing a reduction to bandwidth communicated for the application when the data fails to arrive within the estimated arrival time calculated.

17. Non-transitory computer readable storage media having instructions stored thereon that, when executed by a processor in a computing device, the instructions cause the computing device to perform operations comprising:

executing an application at the computing device;

requesting data for the application from a second computing device communicably interfaced with the first computing device via a public Internet;

calculating an estimated arrival time for the data to be returned from the second computing device;

determining the data fails to arrive within the estimated arrival time calculated;

initiating a new connection to the second computing device; and

re-sending the request for the data for the application to the second computing device via the new connection.

18. The non-transitory computer readable storage media of claim 17, wherein the operations further comprise:

determining the data arrives on the new connection responsive to re-sending the request for the data to the second computing device via the new connection within the estimated arrival time calculated;

consuming the data at the first computing device via the application; and

sending an acknowledgement to the second computing device via the new connection.

19. A computing device comprising:

a processor to execute an application, the application being operable to communicate with a second computing device over a public Internet;

an Input/Output (I/O) pump to allocate multiple simultaneous Transmission Control Protocol (TCP) connections in support of the application; and

the Input/Output (I/O) pump to further request data for the application from the second computing device communicably interfaced with the first computing device via a public Internet on a first one of the multiple simultaneous TCP connections;

a regulator module to calculate an estimated arrival time for the data to be returned from the second computing device via the first one of the multiple simultaneous TCP connections;

the Input/Output (I/O) pump to determine the data has failed to arrive within the estimated arrival time calculated;

the Input/Output (I/O) pump to initiate a new TCP connection to the second computing device from among the multiple simultaneous TCP connections; and

the Input/Output (I/O) pump to re-send the request for the data for the application to the second computing device via the new TCP connection.

20. The computing device of claim 19, wherein the I/O pump is to allocate the multiple simultaneous TCP connections in support of the application, wherein a connection pool of the I/O pump is to maintain the multiple simultaneous TCP connections exclusively on behalf of the application.

21. A method at a computing device, the method comprising:

receiving at the computing device, a request for data from a second computing device communicatively interfaced via a public Internet;

retrieving or generating the data requested;

buffering the data requested into a queue;

sending the data requested to the second computing device;

receiving a new request for the data from the second computing device via a new connection;

forwarding the requested data to the second computing device from the queue via the new connection without re-retrieving or re-generating the requested data;

receiving an acknowledgement for the requested data from the second computing device via the new connection; and

releasing the requested data from the queue.

22. The method of claim 21:

wherein receiving the request for the data from the second computing device communicatively interfaced via the public Internet comprises receiving the request via a Transmission Control Protocol (TCP) connection between the first computing device and the second computing device via the public Internet; and

wherein receiving the new request for the data from the second computing device via the new connection comprises receiving the new request via a second TCP connection different than the first TCP connection.

23. The method of claim 21:

wherein the second computing device is a presenter computing device for a desktop sharing application executing at the second computing device; and

wherein the first computing device is one of;

(a) a cloud services platform operating at a host organization remote from the second computing device, wherein the cloud services platform accepts a video stream for the desktop sharing application from the presenter computing device and distributes the video stream to one or more other remote computing devices on behalf of the presenter computing device,

(b) a server remote from the second computing device, wherein the server accepts the video stream for the desktop sharing application from the presenter computing device and distributes the video stream to one or more other remote computing devices on behalf of the presenter computing device, and

(c) a peer computing device operating as a viewer computing device, wherein the viewer computing device accepts the video stream for the desktop sharing application from the presenter computing device and consumes the video stream by presenting the video stream at a display of the viewer computing device.