Synthetic View

• US 20120331021A1
• Filed: 06/12/2012
• Published: 12/27/2012
• Est. Priority Date: 06/24/2011
• Status: Active Grant

• Current Assignee: Quantum Corporation (Chi Ko Investment Co., Ltd.)
• Original Assignee: Quantum Corporation (Chi Ko Investment Co., Ltd.)
• Inventors: LORD, Stephen P.
• Granted Patent: US 9,020,996 B2
• Time in Patent Office: Days
• US Class Current: 707/826
• CPC Class Codes: G06F 16/174 Redundancy elimination performed by the file system management of the data involved in backup or backup restore using de-duplication of the data G06F11/14

Abstract

One example method presents a synthetic view of data stored by a shared device file system. The synthetic view provides a “fictional” single namespace for data stored by the shared device file system. The method includes accepting a command to access data stored by the shared device file system. The command may be native to a user requesting the access. The command addresses the data stored by the shared device file system using the single namespace provided by the synthetic view. The method includes creating a replacement command(s) for accessing data stored by the shared device file system using one or more actual namespaces different from the single fictional namespace provided by the synthetic view. With the replacement command(s) prepared, the method proceeds to access data stored by the shared device file system using the replacement command(s).

Claims

1. A non-transitory computer-readable medium storing computer-executable instructions that when executed by a computer cause the computer to perform a method, the method comprising:

presenting a synthetic view of data stored by a shared device file system, where the synthetic view provides a single namespace for data stored by the shared device file system;

accepting a command to access data stored by the shared device file system, where the command addresses data stored by the shared device file system based, at least in part, on the single namespace provided by the synthetic view;

creating one or more replacement commands to access data stored by the shared device file system, where the one or more replacement commands address data stored by the shared device file system based on one or more namespaces different from the single namespace provided by the synthetic view; and

accessing data stored by the shared device file system using the one or more replacement commands.

2. The non-transitory computer-readable medium of claim 1, where creating the one or more replacement commands comprises manipulating an inode that provides a generic mapping between a file offset and a storage device.

3. The non-transitory computer-readable medium of claim 2, where manipulating the inode comprises maintaining, in the inode, information concerning two or more copies of a file.

4. The non-transitory computer-readable medium of claim 1, where the shared device file system stores data on N devices, N being an integer greater than one, and where the method includes:

determining that N has changed due to one or more of, the addition of a device, and the removal of a device; and

manipulating the synthetic view to maintain the single namespace in light of the change in N.

5. The non-transitory computer-readable medium of claim 1, where the shared device file system stores data in M storage pools, M being an integer greater than one, and where the method includes:

determining that M has changed due to one or more of, the addition of a storage pool, and the removal of a storage pool; and

manipulating the synthetic view to maintain the single namespace in light of the change in M.

6. The non-transitory computer-readable medium of claim 1, where the shared device file system stores data using X different encodings, X being an integer greater than one, and where the method includes:

determining that X has changed; and

manipulating the synthetic view to maintain the single namespace in light of the change in X.

7. The non-transitory computer-readable medium of claim 1, where a first portion of the data stored by the shared device file system is stored in an expanded state and where a second portion of the data stored in the shared device file system is stored in a flattened state.

8. The non-transitory computer-readable medium of claim 7, the method comprising:

determining that a flattened-expanded state has changed for a portion of the data stored by the shared device file system, and

manipulating the synthetic view to maintain the single namespace in light of the change in the flattened-expanded state for the portion.

9. The non-transitory computer-readable medium of claim 8, the method comprising:

upon determining that an expansion threshold has been met by a selected flattened portion of the data stored by the shared device file system, selectively expanding the selected flattened portion; and

upon determining that a flattening threshold has been met by a selected expanded portion of the data stored by the shared device file system, selectively flattening the selected expanded portion.

10. The non-transitory computer-readable medium of claim 1, the method comprising:

upon determining that a migration threshold has been met by an item stored by the shared device file system, selectively moving the item from one of, a first device and a first storage pool to one of, a second device and a second storage pool; and

manipulating the synthetic view to maintain the single namespace in light of the moving.

11. The non-transitory computer-readable medium of claim 10, where moving the item comprises one or more of, moving the item from a device having a first access speed to a device having a second, different access speed, moving the item from a device having a first security level to a device having a second, different security level, moving the item from a device in a first geographic location to a device in a second, different geographic location, and moving the item from a first namespace to a second, different namespace.

12. The non-transitory computer-readable medium of claim 1, where providing the synthetic view comprises providing a hierarchical view that makes items stored by the shared device file system appear to be files in a tree of a local disk-based file system.

13. The non-transitory computer-readable medium of claim 1, where the command is native to one or more of, a file system associated with a user from which the command was received, and a utility associated with a user from which the command was received.

14. The non-transitory computer-readable medium of claim 1, where providing the synthetic view comprises providing simultaneous access to a file stored across heterogeneous platforms in the shared device file system.

15. The non-transitory computer-readable medium of claim 1, the method comprising encapsulating manipulation of a subset of items stored in the shared device file system to a single location, the single location being one of, a single data storage pool associated with a single storage device, and a single type of storage device, where the encapsulating is performed in a file system.

16. The non-transitory computer-readable medium of claim 1, where providing the synthetic view comprises accessing content from an internal storage pool, accessing content from an external storage pool, accessing content from an internal file system, and accessing content from an external file system, where an external storage pool can be located by a Universally Unique Identifier (UUID), and where an external storage pool can be located by a UUID.

17. The non-transitory computer-readable medium of claim 1, where providing the synthetic view comprises simultaneously maintaining more than one copy of an item, the item being one of, a file, and metadata about the file.

18. The non-transitory computer-readable medium of claim 1, the method comprising providing, through the synthetic view, application programming interface (API) based access to a selected item stored by the shared device file system, where the API based access is not file system based access.

19. The non-transitory computer-readable medium of claim 1, the method comprising:

managing a transient copy of an item stored by the shared device file system while maintaining an authoritative copy of the item, and

making one or more of, the transient copy of the item, and the authoritative copy of the item, visible in the single namespace.

20. The non-transitory computer-readable medium of claim 19, the method comprising:

defining the location of the transient item by mapping local knowledge concerning the transient item to global knowledge possessed by the shared device file system, and

defining the location of the authoritative copy of the item by mapping local knowledge concerning the authoritative copy of the item to global knowledge possessed by the shared device file system.

21. The non-transitory computer-readable medium of claim 1, the method comprising maintaining synchronization between information in a policy database associated with the shared device file system and metadata and content stored by the shared device file system.

22. The non-transitory computer-readable medium of claim 1,

where data in the shared device file system is stored using Y different tiers, Y being an integer greater than one, and where the method includes:

determining that Y has changed; and

manipulating the synthetic view to maintain the single namespace in light of the change in Y.

23. An apparatus, comprising:

a processor;

a memory;

a set of logics; and

an interface that connects the processor, the memory, and the set of logics;

the set of logics comprising;

a synthetic view logic configured to provide a shared storage device file system with a synthetic view that provides a single namespace for data stored across heterogeneous storage pools.

24. The apparatus of claim 23, the synthetic view logic being configured to manipulate an inode associated with the shared device file system, where manipulating the inode includes one or more of, manipulating a generic mapping between a file offset and a storage device, and manipulating, in the inode, information concerning two or more copies of a file.

25. The apparatus of claim 24, the synthetic view logic being configured to maintain the single namespace in response to, an addition of a device on which the shared device file system stores data, a removal of a device on which the shared device file system stores data, an addition of a storage pool on which the shared device file system stores data, a removal of a storage pool on which the shared device file system stores data, a flattening of a hierarchy stored by the shared device file system, an expanding of a hierarchy stored by the shared device file system, a migration between devices on which the shared device file system stores data, and a migration between storage pools on which the shared device file system stores data.

26. The apparatus of claim 25, the synthetic view logic being configured to accept a first command that addresses a piece of data stored by the shared device file system from the point of view of the single namespace and to create a replacement command that addresses the piece of data from a different point of view associated with a different namespace.

27. The apparatus of claim 26, the synthetic view logic being configured to simultaneously maintain two or more copies of an item in the shared device file system, to track a transient copy of the item, and to track an authoritative copy of the item.

28. A system, comprising:

means for reconciling a data address associated with a single namespace provided by a synthetic view and an actual file offset associated with a storage device, where the synthetic view presents the single namespace for data stored in a domain that spans across heterogeneous storage pools comprising disk storage, tape storage, solid state device storage, cloud storage, optical storage, and deduplication storage and where the single namespace accounts for data being stored in multiple data locations, data being stored using multiple data encodings, data being stored in multiple versions, and different portions of an item being stored on different devices.