Unified datapath processing with virtualized storage processors

• US 10,447,524 B1
• Filed: 03/14/2013
• Issued: 10/15/2019
• Est. Priority Date: 03/14/2013
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Bono, Jean-Pierre, Corniquet, Frederic, de Forest, Miles A., Tummala, Himabindu, Forrester, Walter C.
• Primary Examiner(s): Survillo, Oleg
• Assistant Examiner(s): Boustany, Jihad K
• Application Number:
  US13/828,294
• Time in Patent Office: 2,406 Days
• CPC Class Codes: G06F 16/11 File system administration, e.g. details of archiving or snapshots file system backup G06F11/14
• CPC Class Codes: G06F 3/0607 by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
• CPC Class Codes: G06F 3/0635 by changing the path, e.g. traffic rerouting, path reconfiguration
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 9/5077 Logical partitioning of resources; Management or configuration of virtualized resources specific details on emulation or internal functioning of virtual machines G06F9/455
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A technique for managing host data in a data storage apparatus having a storage processor (SP) provides virtualized storage processors (VSPs) as substantially self-describing and independent entities. Each VSP has its own namespace, independent of the namespace of any other VSP. Each VSP also has its own network address. Hosts may thus access VSPs directly, without having to include path information relative to the SP on which the VSP is operated. VSPs can thus be moved from one physical SP to another with little or no disruption to hosts, which may continue to access the VSPs on the new SPs using the same paths as were used when the VSPs were running on the original SPs.

Claims

1. A method of managing host data on a data storage apparatus connected to a network, comprising:

storing a network address and a set of host data objects that are accessible within a namespace of a virtualized storage processor (VSP) operated by a physical storage processor of the data storage apparatus, the namespace including only names of objects that are specific to the VSP;

receiving, by the physical storage processor, a transmission over the network from a host computing device, the transmission directed to a network address and including an IO request designating a pathname to a host data object to be written or read;

identifying the host data object designated by the IO request by (i) matching the network address to which the transmission is directed with the network address stored for the VSP, to identify the VSP as the recipient of the IO request, and (ii) locating the host data object within the namespace of the VSP using the pathname; and

processing the IO request to complete the requested read or write operation on the identified host data object,

wherein the method further comprises;

running a container within an operating system of the physical storage processor, the container executing over a kernel of the operating system and providing an isolated userspace instance;

operating the VSP within the container; and

storing a set of configuration files accessible within the namespace of the VSP, the configuration files defining VSP-specific configuration settings, the configuration settings including a set of domain name system (DNS) definitions providing a host name of the VSP, a domain name of the VSP, and the identity of a DNS server to be used by the VSP to resolve host names,

wherein the configuration settings further include settings for configuring a set of network protocol servers running on the physical storage processor to perform network protocol operations on behalf of the VSP,

wherein the VSP includes a root file system, the root file system including a set of directories having;

a first mount point on which a first host-accessible file system is mounted within the namespace of the VSP;

a second mount point on which a second host-accessible file system is mounted within the namespace of the VSP; and

a third mount point on which a configuration file system is mounted within the namespace of the VSP, the configuration file system storing the set of configuration files, and

wherein the method further comprises exporting on the network the first host-accessible file system and the second host-accessible file system as respective folders.

2. The method of claim 1, wherein the set of network protocol servers include at least one Common Internet File System (CIFS) server.

3. The method of claim 1, wherein the set of network protocol servers include at least one Network File System (NFS) server.

4. The method of claim 1, wherein the configuration settings further include settings for specifying Network Information Service (NIS) and Lightweight Directory Access Protocol (LDAP) settings of the VSP.

5. The method of claim 1, further comprising storing each of the set of host file systems in the form of a lower-deck file of a set of lower-deck file systems, each lower-deck file providing a file representation of the respective host file system.

6. The method of claim 5, wherein storing each of the set of host file systems in the form of a lower-deck file includes storing lower-deck files for different host file systems in different lower-deck file systems.

7. The method of claim 5, further comprising storing the root file system and the configuration file system in the form of respective lower-deck files of a second set of lower-deck file systems, the lower-deck file for the root file system providing a file representation of the root file system and the lower-deck file for the configuration file system providing a file representation of the configuration file system.

14. The method of claim 1, wherein the storage processor operates multiple VSPs, each VSP having its own network address and its own namespace, the namespace of each VSP being independent of the namespace of the storage processor, the network address of each VSP being an IP (Internet Protocol) address.

15. The method of claim 14, wherein the namespace of each VSP is independent of the namespace of each of the other VSPs, and wherein each VSP includes multiple file systems within its respective namespace, and wherein each of the multiple VSPs has its own respective root file system that includes mount points to which the multiple file systems are mounted.

16. The method of claim 1, wherein physical storage processor operates multiple VSPs, each VSP storing a respective set of configuration files within the namespace of the respective VSP, the set of configuration files for each VSP storing a maximum number of threads that are allowed to be used by the physical storage processor for VSP-specific processing for the respective VSP.

17. The method of claim 1, further comprising realizing the root file system and the configuration file system within respective files of a single lower-deck file system.

18. The method of claim 17, further comprising storing a host-accessible LUN (Logical Unit Number) within a file system of the VSP.

8. A data storage apparatus for managing host data, comprising:

a physical storage processor including control circuitry, memory accessible by the control circuitry, and a set of network interfaces arranged to connect to a set of host computing devices over a network to enable the set of host computing devices to access host data stored on the data storage apparatus;

wherein the memory stores instructions which, when carried out by the control circuitry, cause the control circuitry to;

store, for each of multiple virtualized storage processors (VSPs) on the physical storage processor, a network address and a set of host data objects accessible within a namespace of the VSP, the namespace including only names of objects that are specific to the VSP;

receive, by the set of network interfaces of the physical storage processor, a transmission over the network from a host computing device, the transmission directed to a network address and including an IO request designating a pathname to a host data object to be written to or read;

identify the host data object designated by the IO request by (i) matching the network address to which the transmission is directed with the network address stored for one of the VSPs, to identify that VSP as the recipient of the IO request, and (ii) to locate the host data object within the namespace of the identified VSP using the pathname; and

process the IO request to complete the requested read or write operation on the identified host data object,

wherein the instructions further cause the control circuitry to store a set of configuration files accessible within the namespace of each VSP, the configuration files defining VSP-specific configuration settings, the configuration settings including a set of domain name system (DNS) definitions providing a host name of the respective VSP, a domain name of the respective VSP, and the identity of a DNS server to be used by the respective VSP to resolve host names,

wherein each of the VSP includes a respective root file system, each root file system including a set of directories including;

a first mount point on which a first host-accessible file system is mounted within the namespace of the respective VSP;

a second mount point on which a second host-accessible file system is mounted within the namespace of the respective VSP; and

a third mount point on which a configuration file system is mounted within the namespace of the respective VSP, the configuration file system storing the respective set of configuration files, and

wherein the instructions further cause the control circuitry to export on the network each of the first and second host-accessible file systems of each VSP as a respective folder.

9. The data storage apparatus of claim 8, wherein the instructions, when carried out by the control circuitry, further cause the control circuitry to:

run a container within an operating system of the physical storage processor, the container executing over a kernel of the operating system to provide an isolated userspace instance; and

operate the VSPs within the container.

10. The data storage apparatus of claim 8, wherein, for each VSP, the data storage apparatus stores the set of host data objects in a set of host file systems, and wherein each of the set of host file systems is stored in the form of a lower-deck file of a set of lower-deck file systems, each lower-deck file providing a file representation of the respective host file system.

11. The data storage apparatus of claim 10, wherein, for each VSP, the data storage apparatus stores a root file system, the root file system including a set of directories having mount points on which each of the set of host file systems for the respective VSP are mounted, wherein each of the set of host file systems is exported on the network as a respective folder.

12. The data storage apparatus of claim 8, further comprising a respective storage pool for storing the data objects accessible within the namespace of each of the VSPs, such that the set of file objects of any VSP is stored in a different pool from the set of file objects of any other VSP.

13. A computer program product having a non-transitory computer readable medium including instructions which, when executed by control circuitry of a data storage apparatus, cause the control circuitry to perform a method of managing host data on a data storage apparatus connected to a network, the method comprising:

storing a network address and a set of host data objects accessible within a namespace of a virtualized storage processor (VSP) operated by a physical storage processor of the data storage apparatus, the namespace including only names of objects that are specific to the VSP;

receiving, by the physical storage processor, a transmission over the network from a host computing device, the transmission directed to a network address and including an IO request designating a pathname to a host data object to be written or read;

identifying the host data object designated by the IO request by (i) matching the network address to which the transmission is directed with the network address stored for the VSP, to identify the VSP as the recipient of the IO request, and (ii) locating the host data object within the namespace of the VSP using the pathname; and

processing the IO request to complete the requested read or write operation on the identified host data object,

wherein the method further comprises storing a set of configuration files accessible within the namespace of the VSP, the configuration files defining VSP-specific configuration settings, the configuration settings including a set of domain name system (DNS) definitions providing a host name of the VSP, a domain name of the VSP, and the identity of a DNS server to be used by the VSP to resolve host names,

wherein the VSP includes a root file system, the root file system including a set of directories having;

a first mount point on which a first host-accessible file system is mounted within the namespace of the VSP;

a second mount point on which a second host-accessible file system is mounted within the namespace of the VSP; and

a third mount point on which a configuration file system is mounted within the namespace of the VSP, the configuration file system storing the set of configuration files, and

wherein the method further comprises exporting on the network the first host-accessible file system and the second host-accessible file system as respective folders.