Non-blocking buffered inter-machine data transfer with acknowledgement

• US 7,103,890 B2
• Filed: 03/24/2003
• Issued: 09/05/2006
• Est. Priority Date: 03/24/2003
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Bush, Eric N.
• Primary Examiner(s): Thomson, William
• Assistant Examiner(s): Hoang, Phuong N.
• Application Number:
  US10/396,870
• Publication Number:
  US 20040194113A1
• Time in Patent Office: 1,261 Days
• Field of Search: 719/318, 718/101
• US Class Current: 719/318
• CPC Class Codes: G06F 9/544 Buffers; Shared memory; Pipes
• CPC Class Codes: H04L 67/60 Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources admission control or resource allocation H04L47/70

Abstract

A system, method and data structures for transmitting batched data over a network in asynchronous, non-blocking operations, with acknowledgements returned to the senders. Each machine includes a sender subsystem and a receiver subsystem. Transmission items corresponding to data to be sent are buffered until a send is triggered, at which time the transmission items are sorted according to their destinations and sent as a GUID-identified batch to each destination by a send thread. At each receiver, a receiving thread adds descriptions of the data to a receive list, which a transfer thread processes when triggered. The transfer thread sends the corresponding data to a recipient program, and sends GUID-identified acknowledgements corresponding to each GUID back to the originating senders. An acknowledge thread at each originating sender buffers the acknowledgements, and when triggered, a cleanup thread uses the GUID to identify which batched transmissions were received.

Claims

1. In a computing environment, a system comprising:

a sender subsystem of a first machine, the sender subsystem maintaining a data structure of transmission items to send, and a send mechanism that sends data;

a receiver subsystem of a second machine configured to receive data from the sender subsystem of the first machine, the receiver subsystem maintaining a receive data structure of information corresponding to data sent by the sender subsystem;

the sender subsystem configured to detect a send trigger event and to process the transmission items into per-destination data items, the send mechanism sending the per-destination data items and corresponding data to destination machines, including a selected data item and its corresponding data to the receiver subsystem of the second machine;

wherein the receiver subsystem of the second machine receives the selected per-destination data item and its corresponding data, returns an acknowledgement corresponding to the received per-destination data item to the first machine, and includes a receive mechanism that places information corresponding to the received data in a receive data structure; and

a data transfer mechanism that accesses the receive data structure on a receive handling trigger event to pass data corresponding to the per-destination data items to a data handler and sends an acknowledgement for each per-destination data item received in a transmission.

2. The system of claim 1 wherein the transmission items are tracked by the sender subsystem in a transmission item list.

3. The system of claim 1 wherein the transmission item list is closed when the sender subsystem detects the trigger event, and further comprising a new transmission item list for tracking subsequently submitted transmission items.

4. The system of claim 1 further comprising a data item destination buffer at the first machine, and wherein the sender subsystem maintains the per-destination data items in the data item destination buffer.

5. The system of claim 1 wherein each transmission item specifies at least one destination machine and at least one set of data to send to each destination machine.

6. The system of claim 5 wherein in at least one transmission item, each set of data is specified via a data pointer and size information.

7. The system of claim 1 wherein at least two transmission items are submitted to the sender subsystem in a single call from a data generator.

8. The system of claim 1 wherein the send subsystem comprises a process having a send thread that detects the send trigger event.

9. The system of claim 1 wherein the send trigger event corresponds to a time limit being reached.

10. The system of claim 1 wherein the send trigger event corresponds to a threshold amount of data being achieved.

11. The system of claim 1 wherein the send trigger event corresponds to a priority level being detected.

12. The system of claim 1 wherein each per-destination data item has a unique identifier associated therewith.

13. The system of claim 12 wherein the receiver subsystem returns an acknowledgement corresponding to the received per-destination data item to the sender subsystem, the acknowledgement including the unique identifier.

14. The system of claim 1 wherein the receiver subsystem returns an acknowledgement corresponding to the received per-destination data item to the sender subsystem, and further comprising an acknowledgement handler that places data corresponding to the returned acknowledgement into an acknowledgement data structure.

15. The system of claim 14 wherein the send mechanism corresponds to one thread and the acknowledgement handler corresponds to another thread.

16. The system of claim 14 further comprising a cleanup mechanism, wherein the cleanup mechanism accesses the acknowledgement data structure to determine which per-destination data items have been successfully received by a destination.

17. The system of claim 16 wherein acknowledgements in the acknowledgement data structure are tracked in a unique identifier list.

18. The system of claim 16 wherein the cleanup mechanism corresponds to one thread and the acknowledgement handler corresponds to another thread.

19. The system of claim 1 wherein each per-destination data item has a unique identifier associated therewith, wherein the receiver subsystem returns an acknowledgement including the unique identifier that corresponds to the received per-destination data item to the sender subsystem, and further comprising an acknowledgement handler that places each unique identifier corresponding to a returned acknowledgement into an acknowledgement data structure.

20. The system of claim 19 further comprising a cleanup mechanism, wherein the cleanup mechanism accesses the acknowledgement data structure to determine which per-destination data items have been successfully received by a destination.

21. The system of claim 20 wherein the acknowledgements in the acknowledgement data structure are tracked in a unique identifier list, wherein the unique identifier list is closed when the cleanup mechanism detects a cleanup trigger event, and further comprising a new unique identifier list for tracking subsequently returned acknowledgements.

22. The system of claim 21 wherein the cleanup trigger event corresponds to a time limit being reached.

23. The system of claim 21 wherein the cleanup trigger event corresponds to a threshold amount of data being achieved.

24. The system of claim 21 wherein the cleanup trigger event corresponds to a priority level being detected.

25. The system of claim 1 wherein the receive data structure of the transmission items is tracked by a per-destination data item list and an origin and unique identifier list, wherein the per-destination data item list and origin and unique identifier list are closed when the data transfer mechanism detects the receive handling trigger event, and further comprising a new per-destination data item list and a new origin and unique identifier list for tracking per-destination data items received in subsequent transmission.

26. The system of claim 1 wherein the receive handling trigger event corresponds to a time limit being reached.

27. The system of claim 1 wherein the receive handling trigger event corresponds to a threshold amount of data being achieved.

28. The system of claim 1 wherein the receive handling trigger event corresponds to a priority level being detected.

29. In a computing environment, a method comprising:

accumulating transmission items to send, each transmission item specifying at least one destination machine and at least one set of data to send to each destination machine;

detecting a send trigger event, and in response, processing the transmission items into per-destination data items, each per-destination data item identifying each set of data to send to a destination machine;

associating a unique identifier with each per-destination data item;

sending a transmission for each per-destination data item to the destination machine identified in that per-destination data item, the transmission comprising the unique identifier associated with that per-destination data item and each set of data corresponding to that per-destination data item;

receiving an acknowledgement from each destination machine that received the transmission send thereto, the acknowledgment comprising the unique identifier;

at a specified destination machine, receiving a data transmission from the sender, and placing information corresponding to the transmission into a receive data structure; and

accessing the receive data structure on a receive handling trigger event, and passing data corresponding to the per-destination data item to a data handler.

30. The method of claim 29 further comprising, tracking the accumulated the transmission items in a transmission item list.

31. The method of claim 30 further comprising, closing the transmission item list in response to detecting the send trigger event, and tracking subsequently submitted transmission items in a new transmission item list.

32. The method of claim 29 wherein in at least one transmission item, each set of data is specified via a data item comprising a pointer and size information.

33. The method of claim 29 further comprising receiving at least two transmission items in a single call from a data generator.

34. The method of claim 29 wherein detecting the send trigger event includes testing for the send trigger event.

35. The method of claim 34 wherein testing for the send trigger event comprises determining whether a time limit is reached.

36. The method of claim 34 wherein testing for the send trigger event comprises determining whether a threshold amount of data is achieved.

37. The method of claim 34 wherein testing for the send trigger event comprises determining whether a transmission item indicates that at least part of its corresponding data comprises high-priority data.

38. The method of claim 29 further comprising, placing data corresponding to returned acknowledgements into an acknowledgement data structure.

39. The method of claim 38 further comprising, accessing the acknowledgement data structure to determine which per-destination data items have been successfully received by a destination.

40. The method of claim 39 further comprising, locating a unique identifier corresponding to a selected acknowledgement in the acknowledgement data structure, and freeing data based on the unique identifier.

41. The method of claim 39 further comprising, tracking the acknowledgements in the acknowledgement data structure, closing the acknowledgement data structure on a cleanup trigger event, and providing a new acknowledgement data structure for tracking subsequently returned acknowledgements.

42. The method of claim 41 further comprising detecting the cleanup trigger event upon a time limit being reached.

43. The method of claim 41 further comprising detecting the cleanup trigger event upon a threshold amount of data being achieved.

44. The method of claim 41 further comprising detecting the cleanup trigger event upon a a priority level being detected.

45. The method of claim 29 further comprising, detecting the receive handling trigger upon a time limit being reached.

46. The method of claim 29 further comprising, detecting the receive handling trigger upon a threshold amount of data being achieved.

47. The method of claim 29 further comprising, detecting the receive handling trigger upon a priority level being detected.

48. A computer-readable storage medium having computer-executable instructions which when executed perform steps, comprising:

accumulating transmission items to send, each transmission item specifying at least one destination machine and at least one set of data to send to each destination machine;

detecting a send trigger event, including testing for the send trigger event, comprising determining at least one of;

whether a time limit is reached, whether a threshold amount of data is achieved and whether a transmission item indicates that at least part of its corresponding data comprises high-priority data, and in response, processing the transmission items into per-destination data items, each per-destination data item identifying each set of data to send to a destination machine;

associating a unique identifier with each per-destination data item;

sending a transmission for each per-destination data item to the destination machine identified in that per-destination data item, the transmission comprising the unique identifier associated with that per-destination data item and each set of data corresponding to that per-destination data item;

receiving an acknowledgement from each destination machine that received the transmission send thereto, the acknowledgement comprising the unique identifier.

49. In a computing environment, a method comprising:

accumulating transmission items to send, each transmission item specifying at least one destination machine and at least one set of data to send to each destination machine;

at a first thread of a source machine;

in response to a send trigger event, processing the transmission items into per-destination data items, each per-destination data item identifying each set of data to send to a destination machine;

associating a unique identifier with each per-destination data item; and

sending a transmission for each per-destination data item to the destination machine identified in that per-destination data item, the transmission comprising the unique identifier associated with that per-destination data item and each set of data corresponding to that per-destination data item;

at a second thread of a specified destination machine;

receiving a transmission from the source machine, and

placing information corresponding to the transmission into a receive data structure;

at a third thread of the specified destination machine;

in response to a receive handling trigger event, accessing the receive data structure to

a) return data corresponding to the transmission to a recipient program, and

b) return an acknowledgement including the unique identifier to the source machine;

at a fourth thread of the source machine;

receiving the acknowledgement from the specified machine, and

placing information corresponding to the acknowledgement into an acknowledgment data structure; and

at a fifth thread of the source machine, accessing the acknowledgment data structure to determine that the specified destination received the transmission sent thereto.

50. A computer-readable storage medium having computer-executable instructions which when executed perform steps, comprising:

accumulating transmission items to send, each transmission item specifying at least one destination machine and at least one set of data to send to each destination machine;

at a first thread of a source machine;

in response to a send trigger event, processing the transmission items into per-destination data items, each per-destination data item identifying each set of data to send to a destination machine;

associating a unigue identifier with each per-destination data item; and

sending a transmission for each per-destination data item to the destination machine identified in that per-destination data item, the transmission comprising the unique identifier associated with that per-destination data item and each set of data corresponding to that per-destination data item;

at a second thread of a specified destination machine;

receiving a transmission from the source machine, and

placing information corresponding to the transmission into a receive data structure;

at a third thread of the specified destination machine;

in resoonse to a receive handling trigger event, accessing the receive data structure to

a) return data corresponding to the transmission to a recipient program, and

b) return an acknowledgement including the unique identifier to the source machine;

at a fourth thread of the source machine;

receiving the acknowledgement from the specified machine, and

placing information corresponding to the acknowledgement into an acknowledgement data structure; and

at a fifth thread of the source machine, accessing the acknowledgement data structure to determine that the specified destination received the transmission sent thereto.

51. In a computing environment, a system comprising:

a sender subsystem of a first machine, the sender subsystem maintaining a data structure of transmission items to send, and a send mechanism that sends data;

a receiver subsystem of a second machine configured to receive data from the sender subsystem of the first machine, the receiver subsystem maintaining a receive data structure of information corresponding to data sent by the sender subsystem;

the sender subsystem configured to detect a send trigger event and to process the transmission items into per-destination data items, the send mechanism sending the per-destination data items and corresponding data to destination machines, including a selected data item and its corresponding data to the receiver subsystem of the second machine;

wherein each per-destination data item has a unique identifier associated therewith, and the receiver subsystem returns an acknowledgement including the unique identifier that corresponds to the received per-destination data item to the sender subsystem;

an acknowledgement handler that places each unique identifier corresponding to a returned acknowledgement into an acknowledgement data structure; and

a cleanup mechanism, wherein the cleanup mechanism accesses the acknowledgement data structure to determine which per-destination data items have been successfully received by a destination.

52. In a computing environment, a method comprising:

accumulating transmission items to send, each transmission item specifying at least one destination machine and at least one set of data to send to each destination machine;

detecting a send trigger event, and in response, processing the transmission items into per-destination data items, each per-destination data item identifying each set of data to send to a destination machine;

associating a unique identifier with each per-destination data item;

sending a transmission for each per-destination data item to the destination machine identified in that per-destination data item, the transmission comprising the unique identifier associated with that per-destination data item and each set of data corresponding to that per-destination data item;

receiving an acknowledgement from each destination machine that received the transmission send thereto, the acknowledgment comprising the unique identifier;

placing data corresponding to returned acknowledgements into an acknowledgement data structure;

accessing the acknowledgement data structure to determine which per-destination data items have been successfully received by a destination; and

locating a unique identifier corresponding to a selected acknowledgement in the acknowledgement data structure, and freeing data based on the unique identifier.

53. In a computing environment, a method comprising:

accumulating transmission items to send, each transmission item specifying at least one destination machine and at least one set of data to send to each destination machine;

detecting a send trigger event, and in response, processing the transmission items into per-destination data items, each per-destination data item identifying each set of data to send to a destination machine;

associating a unique identifier with each per-destination data item;

sending a transmission for each per-destination data item to the destination machine identified in that per-destination data item, the transmission comprising the unique identifier associated with that per-destination data item and each set of data corresponding to that per-destination data item;

receiving an acknowledgement from each destination machine that received the transmission send thereto, the acknowledgment comprising the unique identifier;

placing data corresponding to returned acknowledgements into an acknowledgement data structure;

accessing the acknowledgement data structure to determine which per-destination data items have been successfully received by a destination;

tracking the acknowledgements in the acknowledgement data structure;

closing the acknowledgement data structure on a cleanup trigger event; and

providing a new acknowledgement data structure for tracking subsequently returned acknowledgements.