Apparatus, system, and method for efficiently sharing data between processes

• US 10,642,667 B1
• Filed: 03/18/2018
• Issued: 05/05/2020
• Est. Priority Date: 03/18/2018
• Status: Active Grant

• Current Assignee: Juniper Networks Incorporated
• Original Assignee: Juniper Networks Incorporated
• Inventors: Babu, Thilak Raj Surendra, Sakarwala, Abbas Y., Hemakumar, Adithya
• Primary Examiner(s): Wathen, Brian W
• Application Number:
  US15/924,256
• Time in Patent Office: 779 Days
• CPC Class Codes: G06F 12/02 Addressing or allocation; Relocation program address sequencing G06F9/00; arrangements for selecting an address in a digital store G11C8/00
• CPC Class Codes: G06F 9/541 via adapters, e.g. between incompatible applications
• CPC Class Codes: G06F 9/544 Buffers; Shared memory; Pipes

Abstract

The disclosed method may include (1) identifying a data object that (A) was generated by a producer process running on a computing device and (B) is to be accessed by a consumer process running on the computing device, (2) determining at least one structural characteristic of the data object that indicates how data is stored within the data object, (3) storing the data object and the structural characteristic of the data object within a portion of shared memory on the computing device that is accessible to both the producer process and the consumer process, and then (4) disclosing, to the consumer process, locations of both the data object and the structural characteristic of the data object within the shared memory such that the consumer process is able to extract the data in the data object from the shared memory. Various other methods, systems, and apparatuses are also disclosed.

Claims

1. A method comprising:

identifying a data object that;

was generated by a producer process running on a computing device; and

is to be accessed by a consumer process running on the computing device;

determining at least one structural characteristic of the data object that indicates how data is stored within the data object;

storing, within a portion of shared memory on the computing device that is accessible to both the producer process and the consumer process;

the data object; and

the structural characteristic of the data object;

disclosing, to the consumer process, locations of both the data object and the structural characteristic of the data object within the shared memory such that the consumer process is able to extract the data in the data object from the shared memory; and

accessing, by the consumer process, the data in the data object by extracting the data object from the shared memory, wherein extracting the data object from the shared memory comprises receiving the data in the data object via an application program interface that operates as part of the data object within the shared memory.

2. The method of claim 1, wherein determining the structural characteristic of the data object comprises extracting a layout of binary data within the data object.

3. The method of claim 1, wherein storing the structural characteristic of the data object within the portion of shared memory comprises:

storing the structural characteristic within a catalog file; and

associating the catalog file with the data object stored in the shared memory.

4. The method of claim 1, wherein disclosing the location of the data object to the consumer process comprises creating, within a lookup table accessible to the consumer process, a table entry that maps an identifier of the data object to a memory address of the data object within the shared memory.

5. The method of claim 1, wherein storing the data object within the shared memory comprises storing the data object within the shared memory without serializing the data within the data object.

6. The method of claim 1, wherein accessing, by the consumer process, the data in the data object comprises:

identifying the structural characteristic of the data object within the shared memory; and

parsing the data in the data object based on the structural characteristic.

7. The method of claim 1, wherein accessing the data in the data object comprises periodically polling, by the consumer process, the shared memory to detect when the data is available to be accessed by the consumer process.

8. The method of claim 7, wherein polling the shared memory comprises sending, to the shared memory, an agnostic request for the data that is independent of a programming language used to generate the producer process.

9. A system comprising:

an identification module, stored in memory, that identifies a data object that;

was generated by a producer process running on a computing device; and

is to be accessed by a consumer process running on the computing device;

a determination module, stored in memory, that determines at least one structural characteristic of the data object that indicates how data is stored within the data object;

a storing module, stored in memory, that stores, within a portion of shared memory on the computing device that is accessible to both the producer process and the consumer process;

the data object; and

the structural characteristic of the data object;

a disclosure module, stored in memory, that discloses, to the consumer process, locations of both the data object and the structural characteristic of the data object within the shared memory such that the consumer process is able to extract the data in the data object from the shared memory;

an access module, stored in memory, that accesses, as part of the consumer process, the data in the data object by extracting the data object from the shared memory, wherein extracting the data object from the shared memory comprises receiving the data in the data object via an application program interface that operates as part of the data object within the shared memory; and

at least one hardware processor configured to execute the identification module, the determination module, the storing module, the disclosure module, and the access module.

10. The system of claim 9, wherein the determination module determines the structural characteristic of the data object by extracting a layout of binary data within the data object.

11. The system of claim 9, wherein the storing module stores the structural characteristic of the data object within the portion of shared memory by:

storing the structural characteristic within a catalog file; and

associating the catalog file with the data object stored in the shared memory.

12. The system of claim 9, wherein the disclosure module discloses the location of the data object to the consumer process by creating, within a lookup table accessible to the consumer process, a table entry that maps an identifier of the data object to a memory address of the data object within the shared memory.

13. The system of claim 9, wherein the storing module stores the data object within the shared memory by storing the data object within the shared memory without serializing the data within the data object.

14. The system of claim 9, wherein the access module accesses the data in the data object by:

identifying the structural characteristic of the data object within the shared memory; and

parsing the data in the data object based on the structural characteristic.

15. The system of claim 9, wherein the access module accesses the data in the data object by periodically polling the shared memory to detect when the data is available to be accessed by the consumer process.

16. The system of claim 15, wherein the access module polls the shared memory by sending, to the shared memory, an agnostic request for the data that is independent of a programming language used to generate the producer process.

17. An apparatus comprising:

at least one storage device that contains shared memory accessible to a plurality of processes running on a computing device; and

at least one physical processing device communicatively coupled to the storage device, wherein the physical processing device;

identifies a data object that;

was generated by a producer process running on the computing device; and

is to be accessed by a consumer process running on the computing device;

determines at least one structural characteristic of the data object that indicates how data is stored within the data object;

stores, within a portion of the shared memory that is accessible to both the producer process and the consumer process;

the data object; and

the structural characteristic of the data object;

discloses, to the consumer process, locations of both the data object and the structural characteristic of the data object within the shared memory such that the consumer process is able to extract the data in the data object from the shared memory; and

accesses, as part of the consumer process, the data in the data object by extracting the data object from the shared memory, wherein extracting the data object from the shared memory comprises receiving the data in the data object via an application program interface that operates as part of the data object within the shared memory.

18. The apparatus of claim 17, wherein the physical processing device discloses the location of the data object to the consumer process by creating, within a lookup table accessible to the consumer process, a table entry that maps an identifier of the data object to a memory address of the data object within the shared memory.