Systems, methods, and apparatuses for implementing a streaming platform IO pump and regulator

• US 9,712,572 B2
• Filed: 11/10/2015
• Issued: 07/18/2017
• Est. Priority Date: 10/10/2011
• Status: Active Grant

• Current Assignee: Salesforce.com, Inc.
• Original Assignee: Salesforce.com, Inc.
• Inventors: Spencer, Barry, Egenberger, Jeremy
• Primary Examiner(s): Chan, Wing F
• Assistant Examiner(s): WOO, ANDREW M
• Application Number:
  US14/937,677
• Publication Number:
  US 20160065631A1
• Time in Patent Office: 616 Days
• Field of Search: 709223, 709226
• CPC Class Codes: G06F 11/1415 at system level
• CPC Class Codes: G06F 11/1443 Transmit or communication errors
• CPC Class Codes: H04L 43/0882 Utilisation of link capacity
• CPC Class Codes: H04L 65/401 wherein the services involve a main real-time session and one or more additional parallel real-time or time sensitive sessions, e.g. white board sharing or spawning of a subconference
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 69/16 Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]

Abstract

In accordance with disclosed embodiments, there are provided methods, systems, and apparatuses for implementing a streaming platform IO pump and regulator including, for example, means for executing an application at the computing device; requesting data for the application from a second computing device communicably interfaced with the first computing device via a public Internet; calculating an estimated arrival time for the data to be returned from the second computing device; determining the data fails to arrive within the estimated arrival time calculated; initiating a new connection to the second computing device; and re-sending the request for the data for the application to the second computing device via the new connection. Other related embodiments are disclosed.

Claims

1. A method at a first computing device, the method comprising:

initiating an original connection from the first computing device to a second computing device via a public Internet;

requesting data from the second computing device via the original connection;

wherein the second computing device is to receive the request and process the request to generate the data requested and buffer the generated data into a queue at the second computing device until an acknowledgement is received for the data from the first computing device;

determining, at the first computing device, the data fails to arrive from the second computing device by an anticipated arrival time;

initiating a new connection from the first computing device to the second computing device;

re-sending the request for the data to the second computing device via the new connection;

wherein the second computing device is to receive the request for the data resent by the first computing device via the new connection and further wherein the second computing device is to pull a buffered copy of the generated data from the queue at the second computing device and re-send the buffered copy of the data requested to the first computing device;

receiving the data requested at the first computing device via the original connection after the anticipated arrival time; and

sending the acknowledgement from the first computing device for the data requested to the second computing device via the original connection prior to receiving the data requested via the new connection.

2. The method of claim 1, wherein the requesting data from the second computing device communicably interfaced with the first computing device via the public Internet comprises:

initiating a Transmission Control Protocol (TCP) connection exclusively for an application executing at the first computing device, the TCP connection initiated between the first computing device and the second computing device via the public Internet.

3. The method of claim 2, wherein initiating the new connection to the second computing device comprises initiating a second TCP connection exclusively for the application between the first computing device and the second computing device via the public Internet.

4. The method of claim 2, wherein initiating the TCP connection comprises:

selecting the TCP connection from a plurality of multiple simultaneous TCP connections in a connection pool exclusively allocated to the application; and

initiating the selected TCP connection.

5. The method of claim 1, further comprising:

determining the data arrives on the new connection responsive to re-sending the request for the data to the second computing device via the new connection by the anticipated arrival time for the data on the new connection;

consuming the data at the first computing device via an application executing at the first computing device; and

sending the acknowledgement from the first computing device to the second computing device via the new connection.

6. The method of claim 1:

wherein the initiating the new connection to the second computing device comprises initiating the new connection from a connection pool at the first computing device; and

wherein the method further comprises the connection pool issuing an abort for a specific transaction corresponding to the request for data from the second computing device having failed to arrive by the anticipated arrival time, wherein the connection pool triggers the abort after a threshold abort time configured for the connection pool.

7. The method of claim 1, further comprising:

receiving the data via the original connection subsequent to re-sending the request for the data to the second computing device via the new connection;

consuming the data at the first computing device via an application executing at the first computing device;

sending the acknowledgement from the first computing device to the second computing device via the new connection;

receiving a second copy of the data via the new connection subsequent to receiving a first copy of the data via the original connection, the second copy of the data being sent by the second computing device responsive to the first computing device resending the request for the data to the second computing device via the new connection; and

discarding the second copy of the data as waste.

8. The method of claim 1, wherein an application executing at the first computing device comprises a desktop sharing application requiring a lossless low-latency connection.

9. The method of claim 8, wherein the desktop sharing application exchanges I-Frames and P-Frames with the second computing device as part of a video stream for the desktop sharing application.

10. The method of claim 8:

wherein the first computing device is a presenter computing device for the desktop sharing application; and

wherein the second computing device is one of;

(a) a cloud services platform operating at a host organization remote from the first computing device, wherein the cloud services platform accepts a video stream for the desktop sharing application from the presenter computing device and distributes the video stream to one or more other remote computing devices on behalf of the presenter computing device,

(b) a server which is remote from the first computing device, wherein the server accepts the video stream for the desktop sharing application from the presenter computing device and distributes the video stream to the one or more other remote computing devices on behalf of the presenter computing device, and

(c) a peer computing device operating as a viewer computing device, wherein the viewer computing device accepts the video stream for the desktop sharing application from the presenter computing device and consumes the video stream bt presenting the video stream at a display of the viewer computing device.

11. The method of claim 1, wherein the method further comprises:

receiving the data within a response packet via the new connection;

wherein requesting data from the second computing device comprises both (i) sending the request from the data and (ii) sending a value specifying a requested packet size for the requested data to the second computing device; and

wherein receiving the data within the response packet comprises receiving the response packet having a packet size corresponding to the requested packet size sent with the request received by the second computing device.

12. The method of claim 1, wherein the second computing device to re-send the buffered copy of the generated data to the first computing device comprises the second computing device to re-send the buffered copy of the generated data without removing the buffered copy of the generated data from the queue.

13. The method of claim 1, wherein the second computing device is to pull the buffered copy of the generated data from the queue at the second computing device comprises the second computing device to process the request bypassing the generation of the data requested and to pull the buffered copy of the generated data from the queue.

14. The method of claim 1, further comprising:

receiving the data requested at the first computing device via the new connection; and

sending the acknowledgement for the data requested to the second computing device via the new connection.

15. The method of claim 14:

wherein the second computing device is receive the acknowledgement for the data requested from the first computing device; and

wherein the second computing device is to remove the buffered copy of the generated data from the queue at the second computing device responsive to receiving the acknowledgement.

16. The method of claim 1:

wherein receiving the data requested at the first computing device via the original connection after the anticipated arrival time comprises receiving the data requested at the first computing device via the original connection after initiating the new connection and after re-sending the request for the data via the new connection and prior to receiving the data requested via the new connection; and

wherein the second computing device is to remove the buffered copy of the generated data from the queue at the second computing device responsive to receiving the acknowledgement via the original connection.

17. The method of claim 16, further comprising:

receiving the data requested via the new connection subsequent to receiving the data requested via the original connection and subsequent to having sent the acknowledgement for the data requested; and

discarding the data requested and received via the new connection as waste without sending another acknowledgment of the data requested to the second computing device; and

wherein the second computing device no longer has the buffered copy of the generated data in the queue subsequent to removal of the buffered copy of the generated data from the queue responsive to the acknowledgement received from the first computing device via the original connection.

18. Non-transitory computer readable storage media having instructions stored thereupon that, when executed by a processor of a first computing device, the instructions cause the first computing device to perform operations comprising:

initiating an original connection from the first computing device to a second computing device via a public Internet;

requesting data from the second computing device via the original connection;

wherein the second computing device is to receive the request and process the request to generate the data requested and buffer the generated data into a queue at the second computing device until an acknowledgement is received for the data from the first computing device;

determining, at the first computing device, the data fails to arrive from the second computing device by an anticipated arrival time;

initiating a new connection from the first computing device to the second computing device;

re-sending the request for the data to the second computing device via the new connection;

wherein the second computing device is to receive the request for the data re-sent by the first computing device via the new connection and further wherein the second computing device is to pull a buffered copy of the generated data from the queue at the second computing device and re-send the buffered copy of the data requested to the first computing device;

receiving the data requested at the first computing device via the original connection after the anticipated arrival time; and

sending the acknowledgement from the first computing device for the data requested to the second computing device via the original connection prior to receiving the data requested via the new connection.

19. The non-transitory computer readable storage media of claim 18:

wherein receiving the data requested at the first computing device via the original connection after the anticipated arrival time comprises receiving the data requested at the first computing device via the original connection after initiating the new connection and after re-sending the request for the data via the new connection and prior to receiving the data requested via the new connection; and

wherein the seco nd computing device is to remove the buffered copy of the generated data from the queue at the second computing device responsive to receiving the acknowledgement via the original connection.

20. A first computing device communicably interfaced with a second computing device over a public Internet, wherein the first computing device comprises:

a processor and a memory to execute instructions at the first computing device;

a network interface to initiate an original connection from the first computing device to the second computing device via a public Internet;

the network interface to further request data from the second computing device via the original connection;

wherein the second computing device is to receive the request and process the request to generate the data requested and buffer the generated data into a queue at the second computing device until an acknowledgement is received for the data from the first computing device;

an Input/Output Pump (IO Pump) to determine the data fails to arrive from the second computing device by an anticipated arrival time;

the IO pump to initiate a new connection from the first computing device to the second computing device;

the network interface to re-send the request for the data to the second computing device via the new connection;

wherein the second computing device is to receive the request for the data resent by the first computing device via the new connection and further wherein the second computing device is to pull a buffered copy of the generated data from the queue at the second computing device and re-send the buffered copy of the data requested to the first computing device;

the network interface to receive the data requested via the original connection after the anticipated arrival time; and

the IO pump to send the acknowledgement from the first computing device for the data requested to the second computing device via the original connection prior to receiving the data requested via the new connection.