Generalized verification scheme for safe metadata modification

• US 10,380,100 B2
• Filed: 04/27/2016
• Issued: 08/13/2019
• Est. Priority Date: 04/27/2016
• Status: Active Grant

• Current Assignee: JP Morgan Chase Bank, N.A. (JP Morgan Chase & Co)
• Original Assignee: Western Digital Technologies Incorporated (Western Digital Corporation)
• Inventors: Dubeyko, Viacheslav, Manzanares, Adam
• Primary Examiner(s): Meng, Jau Shya
• Application Number:
  US15/140,241
• Publication Number:
  US 20170316047A1
• Time in Patent Office: 1,203 Days
• Field of Search: None
• CPC Class Codes: G06F 11/30 Monitoring
• CPC Class Codes: G06F 16/122 using management policies backup systems G06F11/1446; file migration policies for HSM systems G06F16/185
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 16/273 Asynchronous replication or reconciliation
• CPC Class Codes: G06F 3/06 Digital input from, or digital output to, record carriers , e.g. RAID, emulated record carriers or networked record carriers
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0644 Management of space entities, e.g. partitions, extents, pools
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling

Abstract

System and method of verifying validity of a metadata modification request to prevent improper metadata operations. During initialization of a volume in a storage device and once a metadata area is reserved for a metadata structure, information characterizing the metadata structure and metadata area is stored in the storage device, which may be in the form of an area legend composed of descriptors such as a magic signature, a node size, a clump size of reservation, and extent of the metadata area. Responsive to a request for operating on metadata, relevant information provided in the request is verified against the stored characteristic information. If the verification discovers an inconsistency between the information provided in the request and the stored characteristic information, the request modification is treated as invalid and blocked from operation.

Claims

1. A method of managing file system metadata with verification protection, said method comprising:

receiving, by a processor, a first indication to verify a write operation request associated with a prescribed category;

reserving a first plurality of metadata areas in a file system volume of a storage device, the first plurality of metadata areas configured to store a plurality of metadata records, wherein said plurality of metadata records comprises a first metadata record;

creating, in a namespace storage area of said storage device different than and outside of the file system volume, a namespace for said reserving responsive to said first indication, wherein said namespace comprises stored values associated with a set of descriptors for characterizing a respective metadata area of said first plurality of metadata areas;

receiving a first write operation request for performing a first write operation on said first metadata record in the file system volume; and

verifying, using verification logic before performing said first write operation in said file system volume, based on said first indication and in response to said first write operation request, said first write operation request based on comparing extracted information of said first write operation request to said stored values in said namespace storage area to determine whether to perform said first write operation in said file system volume.

2. The method of claim 1, wherein each write operation request associated with said prescribed category comprises a flag, and further comprising identifying said flag in said first write operation request prior to said verifying said first write operation request.

3. The method of claim 1, wherein said prescribed category comprises all write operation requests related to said metadata records.

4. The method of claim 1, further comprising:

receiving a second indication to disable verification for a write operation request in said file system;

receiving a second write operation request for a second write operation on a second metadata record; and

based on said second indication, performing said second write operation without verifying said second write operation request.

5. The method of claim 4, further comprising, responsive to said second indication, reserving a second plurality of metadata areas without creating a namespace associated therewith, wherein said second plurality of metadata areas comprises a metadata area for said second metadata record.

6. The method of claim 1, further comprising writing said namespace in a dedicated partition of a storage device, wherein said dedicated partition is separate from a partition in said storage device for storing said metadata records.

7. The method of claim 1, wherein said namespace is stored in a plain text format, a binary format, or Extensible Markup Language (XML) format.

8. The method of claim 1, further comprising writing said namespace in a dedicated non-volatile chip that is separate from a storage device for storing said metadata records.

9. The method of claim 8, wherein said writing comprises encrypting said namespace, and wherein said verifying comprises extracting a secret key from said first write operation request.

10. The method of claim 1, wherein write operation requests associated with a prescribed category are generated by a file system driver, and wherein said verifying said first write operation request is performed at a host server in a host-storage system.

11. The method of claim 10, further comprising said file system driver generating a corrected first write operation request based on said verifying.

12. The method of claim 1, wherein said verifying said first write operation request is performed at a storage device in a host-storage system.

13. The method of claim 1, wherein the information in said first write operation request comprises one or more of:

a predetermined signature;

node size;

clump size of reservation; and

extent.

14. A data storage system comprising:

one or more processors;

a storage device coupled to said one or more processors; and

memory coupled to said one or more processors and storing instructions that, when executed by said one or more processors, implement;

a file system creation utility configured to reserve a first plurality of metadata areas in a file system volume of said storage device, the first plurality of metadata areas configured to store a plurality of metadata records, wherein said plurality of metadata records comprises a first metadata record;

a namespace utility configured to create, in a namespace storage area of said storage device different than and outside of said file system volume, a namespace for said reserving responsive to a first indication, wherein said file system creation utility is further configured to generate values associated with a set of descriptors in said namespace for characterizing a respective metadata area of said first plurality of metadata areas, wherein said first indication indicates to verify a write operation request associated with a prescribed category with verification logic;

a file system driver configured to generate write operation requests related to said metadata areas; and

the verification logic configured to;

receive a first write operation request for performing a first write operation on said first metadata record in said file system volume; and

responsive to said first indication and said first write operation request, before performing said write operation in said file system volume, verifying said first write operation request based on comparing extracted information of said first write operation request to said stored values in said namespace storage area to determine whether to perform said first write operation in said file system volume.

15. The data storage system of claim 14, wherein each write operation request associated with said prescribed category comprises a flag, and further comprising identifying said flag in said first write operation request prior to said verifying said first write operation request.

16. The data storage system of claim 14, wherein said prescribed category comprises all write operation requests related to said metadata records.

17. The data storage system of claim 14, wherein said verification logic is further configured to:

receive a second indication to disable verification for a write operation request in said file system;

receive a second write operation request for a second write operation on a second metadata record; and

based on said second indication, perform said second write operation without verifying said second write operation request.

18. The data storage system of claim 17, wherein said namespace utility is further configured to, responsive to said second indication, omit to create a namespace associated therewith during reserving a second plurality of metadata areas, wherein said second plurality of metadata areas comprises a metadata area for said second metadata record.

19. The data storage system of claim 14, wherein said namespace is stored in a dedicated partition of said storage device, wherein said dedicated partition is separate from a partition in said storage device for storing said metadata records.

20. The data storage system of claim 14, wherein said verification logic is resident on a host of said data storage system.

21. The data storage system of claim 14, wherein said verification logic is resident on said storage device and implemented in hardware circuitry.

22. The data storage system of claim 14, wherein said file system driver is further configured to generate a corrected first write operation request based on said verifying.

23. A system comprising:

one or more processors;

a storage device coupled to said one or more processors; and

memory coupled to said one or more processors and storing instructions that, when executed by said one or more processors, cause said one or more processors to perform a method comprising;

receiving a first indication to verify a write operation request associated with a prescribed category;

reserving a first plurality of metadata areas in a file system volume, the first plurality of metadata areas configured to store a plurality of metadata records, wherein said plurality of metadata records comprises a first metadata record;

creating, in a namespace storage area of the storage device different than and outside of the file system volume, a namespace for said reserving responsive to said first indication, wherein said namespace comprises stored values associated with a set of descriptors for characterizing a respective metadata area of said first plurality of metadata areas, and wherein said set of descriptors comprises metadata structure;

receiving a first write operation request for a performing a first write operation on said first metadata record in the file system volume; and

verifying, using verification logic before performing said first write operation in said file system volume, based on said first indication and in response to said first write operation request, said first write operation request based on comparing extracted information of said first write operation request to said stored values in said namespace storage area to determine whether to perform said first write operation in said file system volume.

24. The system of claim 23, wherein said prescribed category comprises all write operation requests related to said metadata records or a selected set of write operation requests related to said metadata records.

25. The system of claim 23, wherein said method further comprises:

receiving a second indication to disable verification for a write operation request in said file system;

receiving a second write operation request for a second write operation on a second metadata record; and

based on said second indication, performing said second write operation without verifying said second write operation request.

26. The system of claim 23, wherein said method further comprises, responsive to said second indication, reserving a second plurality of metadata areas without creating a namespace associated therewith, wherein said second plurality of metadata areas comprises a metadata area for said second metadata record.

27. The system of claim 23, wherein said method further comprises generating a corrected first write operation request based on said verifying.