CACHE AND NON-CACHE USAGE IN A DISTRIBUTED STORAGE SYSTEM

• US 20160274806A1
• Filed: 12/11/2013
• Published: 09/22/2016
• Est. Priority Date: 12/11/2013
• Status: Abandoned Application

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Barnes, Thomas J.
• Application Number:
  US15/023,942
• Publication Number:
  US 20160274806A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 12/0813 with a network or matrix configuration
• CPC Class Codes: G06F 12/0868 Data transfer between cache memory and other subsystems, e.g. storage devices or host systems
• CPC Class Codes: G06F 12/0888 using selective caching, e.g. bypass
• CPC Class Codes: G06F 12/0893 Caches characterised by their organisation or structure
• CPC Class Codes: G06F 16/24552 Database cache management
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 2212/1041 Resource optimization
• CPC Class Codes: G06F 2212/1044 Space efficiency improvement
• CPC Class Codes: G06F 2212/214 Solid state disk
• CPC Class Codes: G06F 2212/284 being distributed
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/0653 Monitoring storage devices or systems
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

According to one configuration, upon receiving data, a respective node in a distributed storage system produces metadata based on the received data. The generated metadata indicates whether or not to bypass storage of the received data in the cache storage resource and store the received data in the non-cache storage resource of the repository. Data storage control logic uses the metadata to control how the received data is stored. A state of the metadata can indicate to prevent storage of the received data in a corresponding cache resource associated with the respective storage node. Thus, the generated metadata can provide guidance to corresponding data storage control logic whether to store the received data in a cache storage resource or non-cache storage resource.

Claims

1. A method for storing data in a distributed storage system including multiple nodes that collectively manage data storage, the method comprising:

receiving data at a particular node in the distributed storage system, the particular node in communication with data storage control logic having access to a repository including a non-volatile cache storage resource and a non-volatile non-cache storage resource;

producing metadata based on the received data; and

providing notification of the received data and the metadata to the data storage control logic, the metadata controlling storage of the received data in the repository at the particular node.

2. The method as in claim 1, wherein an access time of the non-volatile cache resource is substantially shorter than an access time of the non-volatile non-cache resource;

and

wherein producing the metadata includes;

generating the metadata to indicate to the data storage control logic to bypass storage of the received data in the non-volatile cache storage resource and store the received data in the non-volatile non-cache storage resource of the repository.

3. The method as in claim 1, wherein the non-volatile cache storage resource is non-volatile memory;

wherein the non-volatile non-cache storage resource is a disk drive storage resource; and

wherein generating the metadata includes;

generating the metadata to bypass storage of the received data in the non-volatile cache storage resource in response to detecting that a copy of the received data is available from a node other than the particular node in the distributed storage system

4. The method as in claim 1, wherein producing the notification includes:

generating the metadata to indicate to the data storage control logic of the particular node that data is eligible for storage in the non-volatile cache storage resource of the repository.

5. The method as in claim 4, wherein the received data is first data;

wherein the particular node is a first node;

wherein the metadata is first metadata, the method further comprising;

receiving second data at the first node, the second data being a replica of data stored at a second node in the distributed storage system;

generating second metadata, the second metadata indicating to the data storage control logic of the first node to bypass storage of the received second data in the non-volatile cache storage resource and store the received second data in the non-volatile non-cache storage resource; and

forwarding the second data and the second metadata to the data storage control logic of the first node.

6. The method as in claim 1, wherein the received data represents a replica of data stored at a failed node in the distributed storage system, a failure at the failed node preventing access to data managed by the failed node, the method further comprising:

in response to detecting that the received data is a copy of data stored in the failed node, generating the metadata to indicate to the data storage control logic to bypass storage of the received data in the non-volatile cache storage resource and store the received data in the non-volatile non-cache storage resource of the repository.

7. The method as in claim 6 further comprising:

producing the replica of data stored at the failed node based on data stored in a non-failing node of the distributed storage system, the particular node being a first storage node in the distributed storage system, the failed node being a second storage node in the distributed storage system, the non-failing node being a third storage node in the distributed storage system.

8. The method as in claim 1, wherein the received data is first data;

wherein the particular node is a first node;

wherein the metadata is first metadata indicating to store the first data in the non-volatile cache storage resource, the method further comprising;

receiving second data at the first node, the second data being a replica of data stored at a second node in the distributed storage system;

generating second metadata at the first node, the second metadata indicating to the data storage control logic to bypass storage of the received second data in the non-volatile cache storage resource and store the received data in the non-volatile non-cache storage resource of the repository; and

forwarding the second data and the second metadata to the data storage control logic at the first node.

9. The method as in claim 1 further comprising:

generating the metadata to indicate to the data storage control logic to bypass storage of the received data in the non-volatile cache storage resource and store the received data in the non-volatile non-cache storage resource of the repository;

generating replica data, the replica data being a replica of the received data; and

forwarding the replica data to a second node in the distributed storage system.

10. The method as in claim 9 further comprising:

receiving the replica data at the second node in the distributed storage system, the second node generating metadata indicating to store the replica data in a non-volatile non-cache storage resource associated with the second node; and

at the second node, forwarding the replica data and the metadata for storage of the replica data in a non-volatile non-cache storage resource associated with the second node.

11. A distributed storage system comprising:

multiple interconnected nodes that collectively manage data storage, the multiple interconnected nodes including a particular node operable to;

receive data from a resource in communication with the distributed storage system, the particular node in communication with data storage control logic having access to a repository including a non-volatile cache storage resource and a non-volatile non-cache storage resource;

produce metadata based on the received data; and

provide notification of the received data and the metadata to the data storage control logic, the metadata controlling storage of the received data in the repository.

12. The distributed storage system as in claim 11, wherein the particular node generates the metadata to indicate to the data storage control logic to bypass storage of the received data in the non-volatile cache storage resource and store the received data in the non-volatile non-cache storage resource of the repository.

13. The distributed storage system as in claim 12, wherein the cache storage resource is non-volatile memory;

wherein the non-volatile non-cache storage resource is a disk drive storage resource; and

wherein the particular node generates the metadata to bypass storage of the received data in the non-volatile cache storage resource in response to detecting that a copy of the received data is available from a node other than the particular node in the distributed storage system

14. The distributed storage system as in claim 11, wherein the particular node generates the metadata to indicate to the data storage control logic that the received data is eligible for storage in the non-volatile cache storage resource of the repository.

15. The distributed storage system as in claim 14, wherein the received data is first data;

wherein the particular node is a first node;

wherein the metadata is first metadata; and

wherein the particular node is further operable to;

receive second data at the first node, the second data being a replica of data stored at a second node in the distributed storage system;

generate second metadata, the second metadata indicating to the data storage control logic to bypass storage of the received second data in the non-volatile cache storage resource and store the received second data in the non-volatile non-cache storage resource; and

forward the second data and the second metadata to the data storage control logic of the first node.

16. The distributed storage system as in claim 11, wherein the received data represents a replica of data stored at a failed node in the distributed storage system, a corresponding failure at the failed node preventing access to data managed by the failed node, the particular node further operable to:

in response to detecting that the received data is a copy of data stored in the failed node, generating the metadata to indicate to the data storage control logic to bypass storage of the received data in the non-volatile cache storage resource and store the received data in the non-volatile non-cache storage resource of the repository.

17. The distributed storage system as in claim 16, wherein the particular node is a first node in the distributed storage system;

wherein the failed node is a second node in the distributed storage system; and

the distributed storage system further comprising;

a third node, the third node producing the replica of data stored at the failed node based on data stored at the third node.

18. The distributed storage system as in claim 11, wherein the received data is first data;

wherein the particular node is a first node;

wherein the metadata is first metadata indicating to store the first data in the non-volatile cache storage resource, the particular node further operable to;

receive second data, the second data being a replica of data stored at a second node in the distributed storage system;

generate second metadata, the second metadata indicating to the data storage control logic to bypass storage of the received second data in the non-volatile cache storage resource and store the received second data in the non-volatile non-cache storage resource of the repository; and

forward the second data and the second metadata to the data storage control logic.

19. The distributed storage system as in claim 11, wherein the particular node is further operable to:

generate the metadata to indicate to the data storage control logic to bypass storage of the received data in the non-volatile cache storage resource and store the received data in the non-volatile non-cache storage resource of the repository;

generate replica data, the replica data being a replica of the received data; and

forward the replica data to a second node in the distributed storage system.

20. The distributed storage system as in claim 19, wherein the second node is operable to:

receive the replica data;

generate metadata indicating to store the replica data in a non-volatile non-cache storage resource associated with the second node; and

forward the replica data and the generated metadata for storage of the replica data in a non-volatile non-cache storage resource associated with the second node.

21. A computer system having access to the distributed storage system as in claim 11, the computer system including a display screen on which to render an image based at least in part on the data received by the particular node of the distributed storage system.

22. Computer-readable storage hardware having instructions stored thereon, the instructions, when carried out by computer processor hardware, cause the computer processor hardware to perform operations of:

receiving data at a particular node in a distributed storage system, the particular node being one of multiple nodes in the distributed storage system, the particular node in communication with data storage control logic having access to a repository including a non-volatile cache storage resource and a non-volatile non-cache storage resource;

producing metadata based on the received data; and

providing notification of the received data and the metadata to the data storage control logic, the metadata controlling storage of the received data in the repository at the particular node.

25. The computer-readable storage hardware as in claim 22, wherein the received data represents a replica of data stored at a failed node in the distributed storage system, a failure at the failed node preventing access to data managed by the failed node;

and

wherein the instructions further cause the computer processor hardware to perform operations of;

in response to detecting that the received data is a copy of data stored in the failed node, generating the metadata to indicate to the data storage control logic to bypass storage of the received data in the non-volatile cache storage resource and store the received data in the non-volatile non-cache storage resource of the repository.

23. The computer-readable storage hardware as in claim 23, wherein the instructions further cause the computer processor hardware to perform operations of:

generating the metadata to indicate to the data storage control logic to bypass storage of the received data in the non-volatile cache storage resource and store the received data in the non-volatile non-cache storage resource of the repository.

24. The computer-readable storage hardware as in claim 23, wherein the instructions further cause the computer processor hardware to perform operations of:

generating the metadata in response to detecting that a copy of the received data is available from a node other than the particular node in the distributed storage system.