Near-cache distribution of manifest among peer applications in in-memory data grid (IMDG) non structured query language (NO-SQL) environments

• US 9,858,195 B2
• Filed: 12/10/2014
• Issued: 01/02/2018
• Est. Priority Date: 12/10/2014
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Bhogal, Kulvir S., Gaur, Nitin, Johnson, Christopher D.
• Primary Examiner(s): GHAFFARI, ABU Z
• Application Number:
  US14/566,277
• Publication Number:
  US 20160170783A1
• Time in Patent Office: 1,119 Days
• Field of Search: None
• CPC Class Codes: G06F 11/3037 where the computing system component is a memory, e.g. virtual memory, cache accessing, addressing or allocating within memory systems or architectures G06F12/00; checking stores for correct operation G11C29/00
• CPC Class Codes: G06F 12/0806 Multiuser, multiprocessor or multiprocessing cache systems
• CPC Class Codes: G06F 12/0888 using selective caching, e.g. bypass
• CPC Class Codes: G06F 2212/657 Virtual address space management
• CPC Class Codes: G06F 9/45504 Abstract machines for programme code execution, e.g. Java virtual machine [JVM], interpreters, emulators
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: G06F 9/5072 Grid computing
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching

Abstract

Near cache distribution in in-memory data grid environment that utilizes manifest of keys may be provided. An application instance may be initialized that utilizes an in-memory data grid caching infrastructure with a near cache in a virtual machine running on hardware processor. The near cache for the application instance may be activated. Logic of the near cache associated with the application instance may request a manifest of keys from one or more peer applications utilizing the in-memory data grid caching infrastructure, and receive the manifest of keys. The logic of the near cache associated with the application instance may send the manifest of keys to a grid cache of the in-memory data grid caching infrastructure. The logic of the near cache associated with the application instance may receive at least some of the data objects from the grid cache.

Claims

1. A computer readable storage medium storing a program of instructions executable by a machine to perform a method of near cache distribution, the method comprising:

initiating an application instance of an application with a near cache in a virtual machine running on hardware processor, the application that utilizes an in-memory data grid caching infrastructure comprising one or more in-memory data grid servers;

activating the near cache for the application instance on the virtual machine;

requesting a manifest of keys from at least one peer application utilizing the in-memory data grid caching infrastructure, the requesting performed by a logic of the near cache associated with the application instance, the at least one peer application running on a different application server than the virtual machine executing the application instance and different from the one or more in-memory data grid servers, wherein the virtual machine and the different application server are a part of a cluster of application servers, the at least one peer application being another instance of the application that started on the different application server before the application instance and operating on the data objects needed by the application instance, the different application server running on another virtual machine different from the virtual machine;

receiving, by the logic of the near cache associated with the application instance in the virtual machine, the manifest of keys from the at least one peer application;

sending, by the logic of the near cache associated with the application instance in the virtual machine, the manifest of keys to a grid cache of the in-memory data grid caching infrastructure; and

receiving, by the logic of the near cache associated with the application instance in the virtual machine, at least one of the data objects specified in the manifest of keys from the grid cache,

wherein a manifest file representing the manifest of keys stores, in the near cache, a mapping of a given application, a given set of objects the given application needs, and given application servers requesting at least one of the given set of objects.

2. The computer readable storage medium of claim 1, further comprising:

receiving at least one of the data objects from said at least one peer application'"'"'s near cache.

3. The computer readable storage medium of claim 1, further comprising:

receiving a request for a data object from the application instance by the virtual machine; and

broadcasting the request for the data object specified by a key to said at least one peer application.

4. The computer readable storage medium of claim 1, wherein the application instance and the at least one peer application each has the manifest of keys listing at least data object to key mappings.

5. The computer readable storage medium of claim 4, wherein the manifest of keys further comprises a list of applications using the data object, a list of virtual machines interested in the data object.

6. The computer readable storage medium of claim 5, wherein responsive to the sending the manifest of keys to the grid cache of the in-memory data grid caching infrastructure by the logic of the near cache associated with the application instance, said at least one peer application automatically receives said at least one of the data objects.

7. The computer readable storage medium of claim 1, further comprising modifying the manifest of keys prior to the sending the manifest of keys to the grid cache of the in-memory data grid caching infrastructure.

8. A system for near cache distribution, comprising:

at least one hardware processor;

an application server operable to run on at least one hardware processor as a member of a cluster of application servers and utilizing an in-memory data grid caching infrastructure comprising one or more in-memory data grid servers, wherein the application servers are different from the one or more in-memory data grid servers;

a near cache comprising logic and allocated memory in the application server; and

a manifest file associated with the application server,

wherein responsive to initiating an application instance of an application hosted on the application server, the near cache is activated for the application instance, the application server operable to request a manifest of keys from at least one peer application server in the cluster utilizing the in-memory data grid caching infrastructure, the application server further operable to receive the manifest of keys from the at least one peer application server, the at least one peer application being another instance of the application that started on a different application server before the application instance and operating on the data objects needed by the application instance, and send the manifest of keys to a grid cache of the in-memory data grid caching infrastructure, the application server further operable to receive at least one of the data objects specified in the manifest of keys from the grid cache,

wherein the application server and the at least one peer application server are different application servers running different instances of a same application,

wherein the manifest file representing the manifest of keys stores a mapping of a given application, a given set of objects the given application needs, and given application servers requesting at least one of the given set of objects,

wherein the manifest file is stored in the near cache.

9. The system of claim 8, wherein the manifest of keys comprises data object to key mappings, a list of applications using the data object, and a list of virtual machines interested in the data object.

10. The system of claim 9, wherein responsive to the application server sending the manifest of keys to the grid cache, said at least one peer application server automatically receives at least one of the data objects from the grid cache.

11. The system of claim 8, wherein the application servers comprise virtual machines running on one or more physical machines.

12. The system of claim 8, wherein each of the application servers in the cluster has an associated manifest of keys.