In-line policy management with multi-level object handle

• US 10,467,188 B2
• Filed: 11/22/2016
• Issued: 11/05/2019
• Est. Priority Date: 12/08/2009
• Status: Active Grant

• Current Assignee: NetApp, Inc.
• Original Assignee: NetApp, Inc.
• Inventors: Goodson, Garth Richard, Pasupathy, Shankar, Voruganti, Kaladhar, Kavuri, Ravi Kumar, Srinivasan, Sudhir
• Primary Examiner(s): Morrison, Jay A
• Application Number:
  US15/359,249
• Publication Number:
  US 20170075909A1
• Time in Patent Office: 1,078 Days
• CPC Class Codes: G06F 16/122 using management policies backup systems G06F11/1446; file migration policies for HSM systems G06F16/185
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/14 Details of searching files based on file metadata
• CPC Class Codes: G06F 16/1827 Management specifically adapted to NAS management of storage area networks [SAN] G06F3/067
• CPC Class Codes: G06F 16/183 Provision of network file services by network file servers, e.g. by using NFS, CIFS network file access protocols H04L67/1097

Abstract

A distributed object store in a network storage system uses location-independent global object identifiers (IDs) for stored data objects. The global object ID enables a data object to be seamlessly moved from one location to another without affecting clients of the storage system, i.e., “transparent migration”. The global object ID can be part of a multilevel object handle, which also can include a location ID indicating the specific location at which the data object is stored, and a policy ID identifying a set of data management policies associated with the data object. The policy ID may be associated with the data object by a client of the storage system, for example when the client creates the object, thus allowing “inline” policy management. An object location subsystem (OLS) can be used to locate an object when a client request does not contain a valid location ID for the object.

Claims

1. A method comprising:

determining, by a computing device, a first policy identifier within a first object handle based on a client request to access a first data object;

determining, by the computing device, a first object identifier from the first object handle and resolving the determined first object identifier to a second policy identifier upon determining that the determined first policy identifier is invalid for the first data object;

accessing, by the computing device, a policy store to determine a set of policies identified by the second policy identifier; and

providing, by the computing device, a response to the client request based on the determined set of policies.

2. The method of claim 1 further comprising:

locating, by the computing device, the first data object based, at least in part, on a second location identifier upon resolving the first object identifier when a first location identifier in the first object handle to access the first data object on receipt of the client request to access the first data object is determined to be invalid for the first data object.

3. The method of claim 2 further comprising:

determining, by the computing device, when the first location identifier is valid for the first data object and wherein the first location identifier is determined to be invalid based on an inode number and a generation counter upon resolving the first location identifier to an internal handle for the first data object, wherein the internal handle comprises the inode number for the first data object and the generation counter for the first data object.

4. The method of claim 3, wherein determining that the first location identifier is invalid further comprises receiving, by the computing device, an invalid indication in response to submitting the inode number and the generation counter to a storage subsystem.

5. The method of claim 2, wherein the first data object is a sub-volume data object and the first location identifier at least identifies a volume.

6. The method of claim 1 further comprising updating, by the computing device, the mapping structure to indicate the second policy identifier as a valid policy identifier for the first data object based, at least in part, on the first data object being moved prior to receipt of the client request.

7. The method of claim 5 further comprising indicating, by the computing device, in the mapping structure the first policy identifier as an invalid policy identifier for the first data object based, at least in part, on the first data object being moved.

8. The method of claim 1 further comprising:

generating, by the computing device, the first object identifier as a globally unique identifier for the first data object in response to a request to create the first data object and determining a first location identifier and the first policy identifier for the first data object, wherein the first object handle is formed for the first data object with the first object identifier, the first location identifier, and the first policy identifier, and wherein the first object handle is communicated to a requestor that requested creation of the first data object.

9. The method of claim 7 further comprising determining, by the computing device, the first policy identifier based on the request to create the first data object specifying a set of one or more policies.

10. The method of claim 1, wherein the first object handle comprises a first set of bits that constitute the first object identifier, a second set of bits that constitute the first policy identifier, and a third set of bits that constitute a location identifier of the data object.

11. A non-transitory machine-readable media comprising executable program code for transparent migration of data objects, the program code to:

determine validity of a first policy identifier within a first object handle based on a client request to access a first data object

access a first mapping structure to resolve a first object identifier within the first object handle to a valid policy identifier for the first data object upon determining that the determined first policy identifier is invalid for the first data object;

access a policy store to determine a set of policies identified by the valid policy identifier; and

provide a response to the client request based on the determined set of policies.

12. The non-transitory machine-readable media of claim 11, wherein the executable program code to determine validity of the first policy identifier comprises executable program code to determine validity of a first location identifier within the first object handle.

13. The non-transitory machine-readable media of claim 12, wherein the executable program code further comprises executable program code to:

access the first mapping structure to resolve the first object identifier to a valid location identifier for the first data object upon determining that the first location identifier is invalid for the first data object access, wherein the first mapping structure also maps object identifiers to valid location identifiers and the first data object is located based at least in part on the valid location identifier.

14. The non-transitory machine-readable media of claim 12, wherein the executable program code to determine validity of the first location identifier comprises executable program code to:

resolve the first location identifier to an internal handle for the first data object, wherein the internal handle comprises an inode number for the first data object and a generation counter for the first data object, wherein validity of the first location identifier is determined based on the inode number and the generation counter.

15. The non-transitory machine-readable media of claim 11, wherein the executable program code further comprises executable program code to update the first mapping structure based, at least in part, on the first data object being moved.

16. The non-transitory machine-readable media of claim 15, wherein the executable program code to update the first mapping structure comprises the executable program code to indicate the valid policy identifier in the first mapping structure for the first data object and to indicate the valid policy identifier as valid, and to indicate the first policy identifier as invalid for the first data object.

17. The non-transitory machine-readable media of claim 11 further comprising:

provide a response to the client request to access a second data object based, at least in part, on a valid location identifier of the second data object and a policy identified by the valid policy identifier for the second data object upon maintaining a second mapping structure that maps pathnames of data objects to object identifier and accessing the maintained second mapping structure to resolve a first pathname of a client request to access the second data object to a second object identifier of the second data object, and wherein the first mapping structure is accessed to resolve the second object identifier to a the valid location identifier for the second data object and to resolve the second object identifier to a valid policy identifier for the second data object.

18. The non-transitory machine-readable media of claim 11, wherein the first object handle comprises a first set of bits that constitute the first object identifier, a second set of bits that constitute the first policy identifier, and a third set of bits that constitute a location identifier of the first data object.

19. An apparatus comprising:

a processor;

a memory coupled to the processor which is configured to be capable of executing programmed instructions comprising and stored in the memory to;

determine validity of a first policy identifier within a first object handle based on a client request to access a first data object;

access a first mapping structure to resolve a first object identifier within the first object handle to a valid policy identifier for the first data object upon determining that the first policy identifier is invalid for the first data object, wherein the first mapping structure maps object identifiers of data objects to valid policy identifiers;

access a policy store to determine a set of policies identified by the valid policy identifier; and

provide a response via the network adapter to the client request based on the determined set of policies.

20. The apparatus of claim 19, wherein the executable program code to determine validity of the first policy identifier comprises executable program code to determine validity of a first location identifier within the first object handle, wherein the program code to determine validity of first location identifier comprises executable program code to resolve the first location identifier to an internal handle for the first data object and submit inode information of the internal handle to the storage adapter.