System and method for providing a flexible buffer management interface in a distributed data grid

• US 8,874,811 B2
• Filed: 11/07/2012
• Issued: 10/28/2014
• Est. Priority Date: 10/15/2012
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Helin, Charlie, Falco, Mark
• Primary Examiner(s): TSENG, CHENG YUAN
• Application Number:
  US13/671,441
• Publication Number:
  US 20140108681A1
• Time in Patent Office: 720 Days
• Field of Search: None
• US Class Current: 710/56
• CPC Class Codes: G06F 11/16 Error detection or correction of the data by redundancy in hardware
• CPC Class Codes: G06F 11/2041 with more than one idle spare processing component
• CPC Class Codes: G06F 11/2048 where the redundant components share neither address space nor persistent storage
• CPC Class Codes: G06F 11/2097 maintaining the standby controller/processing unit updated initialisation or re-synchronisation thereof G06F11/1658 and subgroups
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 2201/82 Solving problems relating to consistency ensuring consistency in mirrored systems G06F11/2064
• CPC Class Codes: H04L 41/0668 by dynamic selection of recovery network elements, e.g. replacement by the most appropriate element after failure
• CPC Class Codes: H04L 43/0811 by checking connectivity
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes

Abstract

A system and method can provide a flexible buffer management interface in a distributed data grid. The buffer manager in the distributed data grid can receive a request from a requester for a buffer in the distributed data grid, wherein the request contains at least one parameter that provides an indication on the size of the requested buffer. Then, the buffer manager can allocate a buffer based on the indication in the request and provide the allocated buffer to the requester, wherein an actual size of the buffer is determined by the buffer manager.

Claims

1. A method for providing a flexible buffer management interface in a distributed data grid, comprising:

providing a buffer manager operating on a distributed data grid;

providing a flexible buffer management interface for said buffer manager, wherein the flexible buffer management interface defines a plurality of different buffer acquisition methods, wherein said plurality of different buffer acquisition methods include,

a minimum buffer size method having a parameter which defines a minimum size of the requested buffer,

a preferred buffer size method having a parameter which defines a preferred size of the requested buffer, and

a running total buffer size method having a parameter which defines a total size of a previously acquired buffer;

receiving, with said buffer manager, a request from a requester for a buffer in the distributed data grid, wherein the request comprises a particular buffer acquisition method of said plurality of different buffer acquisition methods and a particular parameter that provides an indication on a size of the buffer;

allocating a buffer to the requestor based on the particular buffer acquisition method and the particular parameter, wherein

if the particular buffer acquisition method is the minimum buffer size method, said buffer manager allocates an allocated buffer having a size not less than the minimum size specified by the particular parameter,

if the particular buffer acquisition method is the preferred buffer size method, said buffer manager allocates an allocated buffer having a size which may be less than the preferred size defined by the particular parameter, and

if the particular buffer acquisition method is the running total buffer size method, said buffer manager allocates an allocated buffer having a size determined based on the total size of a previously acquired buffer defined by the particular parameter, wherein if said buffer manager determines that said requestor has made a plurality of previous related buffer requests, the buffer manager allocates an allocated buffer at least twice as large as the size of a previously acquired buffer defined by the particular parameter; and

providing the allocated buffer to the requester.

2. The method according to claim 1, wherein the plurality of different buffer acquisition methods further includes a pre-set buffer acquisition method in response to which said buffer manager can allocated a plurality of allocated buffers which allocated buffers are chained together by the requestor to satisfy a large memory request.

3. The method according to claim 1, wherein:

the plurality of different buffer acquisition methods further includes a truncate buffer acquisition method having a parameter which defines a used size of a previously allocated buffer; and

wherein if the particular buffer acquisition method is the truncate buffer acquisition method, said buffer manager allocates an allocated buffer having a size not less than the used size of a previously allocated buffer specified by the particular parameter,

wherein the method further comprises automatically releasing the previously allocated buffer to the buffer manager.

4. The method according to claim 3, further comprising:

making a determination with the buffer manager whether the previously allocated buffer needs to be truncated based on an evaluation of a trade off between consumption of CPU time and buffer memory availability.

5. The method according to claim 1, further comprising:

flexibly determining with the buffer manager an allocated buffer size in response to a request in order to satisfy the request and optimize management of available buffer memory.

6. The method according to claim 1, wherein the flexible buffer management interface can be utilized by requestors to support network input/output.

7. The method according to claim 1, wherein the flexible buffer management interface can be utilized by requestors to support object serialization.

8. The method according to claim 1, wherein the distributed data grid comprises a buffer pool comprising a plurality of buffers and wherein said buffer manager allocates available buffers from the buffer pool.

9. The method according to claim 1, wherein the requestor is an application operating in said distributed data grid.

10. A system for providing a flexible buffer management interface in a distributed data grid, comprising:

a buffer manager operating on a distributed data grid;

a flexible buffer management interface for said buffer manager, wherein the flexible buffer management interface defines a plurality of different buffer acquisition methods, wherein said plurality of different buffer acquisition methods include,

a minimum buffer size method having a parameter which defines a minimum size of the requested buffer,

a preferred buffer size method having a parameter which defines a preferred size of the requested buffer, and

a running total buffer size method having a parameter which defines a total size of a previously acquired buffer;

wherein said buffer manager is configured to receive a request from a requester for a buffer in the distributed data grid, wherein the request comprises a particular buffer acquisition method of said plurality of different buffer acquisition methods and a particular parameter that provides an indication on a size of the buffer;

wherein said buffer manager is configured, in response to receiving a request, to allocate a buffer to the requestor based on the particular buffer acquisition method and the particular parameter, and provide an allocated buffer to the requestor, wherein

if the particular buffer acquisition method is the minimum buffer size method, said buffer manager allocates an allocated buffer having a size not less than the minimum size specified by the particular parameter,

if the particular buffer acquisition method is the preferred buffer size method, said buffer manager allocates an allocated buffer having a size which may be less than the preferred size defined by the particular parameter, and

if the particular buffer acquisition method is the running total buffer size method, said buffer manager allocates an allocated buffer having a size determined based on the total size of a previously acquired buffer defined by the particular parameter, wherein if said buffer manager determines that said requestor has made a plurality of previous related buffer requests, the buffer manager allocates an allocated buffer at least twice as large as the size of a previously acquired buffer defined by the particular parameter.

11. The system according to claim 10, wherein the plurality of different buffer acquisition methods further includes a pre-set buffer acquisition method in response to which said buffer manager can allocate a plurality of allocated buffers which allocated buffers are chained together by the requestor to satisfy a large memory request.

12. The system according to claim 10, wherein:

the plurality of different buffer acquisition methods further includes a truncate buffer acquisition method having a parameter which defines a used size of a previously allocated buffer; and

wherein if the particular buffer acquisition method is the truncate buffer acquisition method, said buffer manager allocates an allocated buffer having a size not less than the used size of a previously allocated buffer specified by the particular parameter and wherein the previously allocated buffer is automatically releasing to the buffer manager.

13. The system according to claim 12, wherein:

the buffer manager is configured to determine with whether the previously allocated buffer needs to be truncated based on an evaluation of a trade off between consumption of CPU time and buffer memory availability.

14. The system according to claim 10, wherein:

the buffer manager is configured to flexibly determine an allocated buffer size in response to a request in order to satisfy the request and optimize management of available buffer memory.

15. The system according to claim 10, wherein the flexible buffer management interface is configured to be utilized by requestors to support network input/output.

16. The system according to claim 10, wherein the flexible buffer management interface is configured to be utilized by requestors to support object serialization.

17. The method according to claim 10, wherein the distributed data grid comprises a buffer pool comprising a plurality of buffers and wherein said buffer manager allocates available buffers from the buffer pool.

18. A non-transitory computer readable storage medium having instructions stored thereon that when executed by one or more processor cause said one or more processor to perform the steps of:

providing a buffer manager operating on a distributed data grid;

providing a flexible buffer management interface for said buffer manager, wherein the flexible buffer management interface defines a plurality of different buffer acquisition methods, wherein said plurality of different buffer acquisition methods include,

a minimum buffer size method having a parameter which defines a minimum size of the requested buffer,

a preferred buffer size method having a parameter which defines a preferred size of the requested buffer, and

a running total buffer size method having a parameter which defines a total size of a previously acquired buffer;

receiving, with said buffer manager, a request from a requester for a buffer in the distributed data grid, wherein the request comprises a particular buffer acquisition method of said plurality of different buffer acquisition methods and a particular parameter that provides an indication on a size of the buffer; and

allocating a buffer to the requestor based on the particular buffer acquisition method and the particular parameter, wherein

if the particular buffer acquisition method is the minimum buffer size method, said buffer manager allocates an allocated buffer having a size not less than the minimum size specified by the particular parameter,

if the particular buffer acquisition method is the preferred buffer size method, said buffer manager allocates an allocated buffer having a size which may be less than the preferred size defined by the particular parameter, and

if the particular buffer acquisition method is the running total buffer size method, said buffer manager allocates an allocated buffer having a size determined based on the total size of a previously acquired buffer defined by the particular parameter, wherein if said buffer manager determines that said requestor has made a plurality of previous related buffer requests, the buffer manager allocates an allocated buffer at least twice as large as the size of a previously acquired buffer defined by the particular parameter; and

providing the allocated buffer to the requester.