Systems, methods, and interfaces for adaptive persistence

• US 10,359,972 B2
• Filed: 03/14/2013
• Issued: 07/23/2019
• Est. Priority Date: 08/31/2012
• Status: Active Grant

• Current Assignee: SanDisk Technologies LLC (Western Digital Corporation)
• Original Assignee: SanDisk Technologies LLC (Western Digital Corporation)
• Inventors: Joshi, Vikram, Flynn, David, Luan, Yang, Brown, Michael F.
• Primary Examiner(s): Warren, Tracy A
• Application Number:
  US13/829,835
• Publication Number:
  US 20140068183A1
• Time in Patent Office: 2,322 Days
• Field of Search: 711118, 711135
• CPC Class Codes: G06F 12/0804 with main memory updating G06F12/0806 takes precedence
• CPC Class Codes: G06F 12/0842 for multiprocessing or multitasking
• CPC Class Codes: G06F 12/0866 for peripheral storage systems, e.g. disk cache
• CPC Class Codes: G06F 12/0877 Cache access modes
• CPC Class Codes: G06F 12/0888 using selective caching, e.g. bypass
• CPC Class Codes: G06F 2212/151 Emulated environment, e.g. virtual machine
• CPC Class Codes: G06F 2212/6042 Allocation of cache space to multiple users or processors
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/0662 Virtualisation aspects
• CPC Class Codes: G06F 3/0664 at device level, e.g. emulation of a storage device or system
• CPC Class Codes: G06F 3/0671 In-line storage system
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

A storage module may be configured to service I/O requests according to different persistence levels. The persistence level of an I/O request may relate to the storage resource(s) used to service the I/O request, the configuration of the storage resource(s), the storage mode of the resources, and so on. In some embodiments, a persistence level may relate to a cache mode of an I/O request. I/O requests pertaining to temporary or disposable data may be serviced using an ephemeral cache mode. An ephemeral cache mode may comprise storing I/O request data in cache storage without writing the data through (or back) to primary storage. Ephemeral cache data may be transferred between hosts in response to virtual machine migration.

Claims

1. A method, comprising:

selecting levels of persistence for input/output (I/O) requests to service by use of a storage system comprising an I/O stack and a plurality of storage devices, the storage devices including persistent storage devices accessed via the I/O stack and a designated storage device accessed outside of the I/O stack, separate from the persistent storage devices, wherein the levels of persistence are selected from a plurality of levels of persistence, including a first level of persistence corresponding to a limited storage duration without redundancy in the storage system; and

servicing the I/O requests at the storage system in accordance with the selected levels of persistence, wherein servicing particular I/O requests pertaining to a particular file in accordance with the first level of persistence comprises;

writing data of the particular file to the designated storage device via a fast path outside the I/O stack and without accessing the I/O stack, wherein the data of the particular file is written to the designated storage device without writing the data to any of the persistent storage devices, and the data of the particular file is evicted from the storage system without accessing any of the persistent storage devices of the storage system.

2. The method of claim 1, wherein:

a second one of the plurality of levels of persistence corresponds to one or more of the persistent storage devices; and

servicing an I/O request to write specified data to the storage system in accordance with the second level of persistence comprises writing the specified data to the one or more of the persistent storage devices utilizing a slow path within the I/O stack.

3. The method of claim 2, wherein:

the second level of persistence specifies a configuration for the one or more of the persistent storage devices; and

servicing the I/O requests in accordance with the second level of persistence comprises configuring the one or more of the persistent storage devices to store the specified data in the specified configuration.

4. The method of claim 2, wherein:

the second level of persistence specifies a storage mode for the one or more of the persistent storage devices; and

servicing the I/O requests in accordance with the second level of persistence comprises configuring the one or more of the persistent storage devices to the specified data in the specified storage mode.

5. The method of claim 2, wherein:

the second level of persistence specifies redundant storage of the I/O request data on two or more of the persistent storage devices; and

servicing the I/O request in accordance with the second level of persistence comprises storing the specified data redundantly on the two or more of the persistent storage devices.

6. The method of claim 1, wherein the data of the particular file is evicted from the designated storage device via one or more of a reboot, a restart, and a shutdown of a client associated with the particular file.

7. The method of claim 1, further comprising monitoring I/O requests in a storage stack to identify the I/O requests.

8. An apparatus comprising:

means for receiving storage requests to implement by use of a storage system comprising an input/output (I/O) stack and a plurality of storage resources, the storage resources including persistent storage resources accessed via the I/O stack and a temporary storage resource accessed outside of the I/O stack, separate from the persistent storage resources;

means for assigning respective persistence levels to the storage requests based on one or more characteristics of the storage requests, each persistence level corresponding to one or more of the storage resources of the storage system, the persistence levels including a first persistence level corresponding to a limited storage duration without redundancy in the storage system; and

means for implementing the storage requests on selected storage resources of the storage system, wherein the storage resources are selected based on the persistence levels assigned to the storage requests, implementing particular storage requests pertain to a particular data set, and assigning the first persistence level comprises;

writing data of the particular data set to the temporary storage resource via a fast path outside the I/O stack, separate from the plurality of persistent storage resources and without accessing the I/O stack, and

evicting the data of the particular data set from the temporary storage resource using one or more of a reboot, a restart, and a shutdown of a client and without writing the data of the particular data set to the persistent storage resources of the storage system, such that the data of the particular data set is written to the temporary storage resource via the fast path outside of the I/O stack and evicted from the storage system without accessing the I/O stack and the persistent storage resources of the storage system.

9. The apparatus of claim 8, wherein:

a second one of the persistence levels specifies a write-through caching mode, and

storing a data unit within the storage system in response to a write request assigned the second persistence level comprises writing the data unit to the temporary storage resource and to one or more of the persistent storage resources utilizing a slow path within the I/O stack.

10. The apparatus of claim 8, further comprising means for assigning the first persistence level to the storage requests pertaining to the particular data set in response to determining that the data of the particular data set does not need to be retained within the storage system after one or more of a reboot, a restart, and a shutdown of the client.

11. The apparatus of claim 8, wherein:

writing the data of the particular data set to the temporary storage resource comprises admitting the data of the particular data set into a cache on the temporary storage resource, and

evicting the data of the particular data set from the storage system comprises evicting the data from the cache without writing the data of the particular data set to any of the persistent storage resources of the storage system.

12. The apparatus of claim 8, wherein

a second one of the persistence levels comprises caching data on the temporary storage resource in one or more of a write-back cache mode and a write-through cache mode and the apparatus further comprises:

means for implementing a write request to store a data unit within the storage system, the write request assigned the second persistence level, by;

caching the data unit on the temporary storage resource; and

writing the data unit to one or more of the persistence storage resources before an eviction of the data unit from the temporary storage resource.

13. The apparatus of claim 8, further comprising means for acknowledging completion of a storage request to write a data unit to the particular data set in response to storing the data unit on the temporary storage resource and without storing the data unit on any of the persistent storage resources of the storage system.

14. The apparatus of claim 8, wherein:

the first persistence level specifies a first error-correction code encoding; and

a second one of the persistence levels specifies a second, different error-correction code encoding.

15. An apparatus, comprising:

a request receiver configured to receive storage requests; and

a storage controller configured to;

interface with a plurality of storage resources of a storage system, the storage resources of the storage system comprising an input/output (I/O) stack, persistent storage devices accessed via the I/O stack, and a separate storage device accessed outside of the I/O stack,

assign persistence levels to the storage requests based on characteristics of the storage requests, the persistence levels including a first persistence level to assign to storage requests pertaining to data for temporary storage within the storage system without redundancy, and

store data within the storage system in response to the storage requests and according to the persistence levels assigned to the storage requests, wherein storing data within the storage system in response to particular storage requests assigned the first persistence level and pertaining to a specified data, comprises;

storing the specified data on the separate storage device via a fast path outside of the I/O stack without accessing the persistent storage devices of the storage system and without accessing the I/O stack, and

evicting the specified data from the separate storage device without writing the specified data to the persistent storage devices of the storage system via the I/O stack, such that the specified data is stored on the separate storage device without accessing the I/O stack and is evicted from the storage system without accessing the persistent storage devices of the storage system and without accessing the I/O stack.

16. The apparatus of claim 15, wherein the storage controller is further configured to cache the specified data in a write-never cache mode.

17. The apparatus of claim 15, wherein:

a second one of the persistence levels comprises storing data in a first redundant array of inexpensive disks (RAID) configuration; and

a third one of the persistence levels comprises storing data in a second RAID configuration that is different from the first RAID configuration.

18. The apparatus of claim 15, wherein the storage controller is configured to evict the specified data from the separate storage device via one or more of a reboot, a restart, and a shutdown of a client.

19. The apparatus of claim 18, wherein the client comprises a virtual machine operating on a host computing device.

20. The apparatus of claim 15, wherein the storage controller is configured to assign persistence levels to storage requests in response to comparing files associated with the storage requests to persistence levels.