IN-SITU CLOUD DATA MANAGEMENT SOLUTION

• US 20170177895A1
• Filed: 12/21/2016
• Published: 06/22/2017
• Est. Priority Date: 12/21/2015
• Status: Abandoned Application

• Current Assignee: Datanomix, Inc.
• Original Assignee: Datanomix, Inc.
• Inventors: McHale, Gregory J.
• Application Number:
  US15/386,008
• Publication Number:
  US 20170177895A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/122 using management policies backup systems G06F11/1446; file migration policies for HSM systems G06F16/185
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/1827 Management specifically adapted to NAS management of storage area networks [SAN] G06F3/067
• CPC Class Codes: G06F 21/604 Tools and structures for managing or administering access control systems
• CPC Class Codes: G06F 21/6218 to a system of files or objects, e.g. local or distributed file system or database
• CPC Class Codes: G06F 2221/2113 Multi-level security, e.g. mandatory access control

Abstract

A data management solution using data management nodes which in turn are connected to one or more data storage entities. Data management nodes receive access requests from software connector components that run in-situ on application or file servers, and store file system meta-data and custom defined meta-data that may include policies and requirements. An object store, which may be accessible via a database, associates said meta-data with files, file systems, users, application servers, file servers, and file data objects. Data objects containing file data are stored on one more of a heterogeneous set of external data storage entities which may be in the cloud. Requirements may be tracked over time by the data management node, and used to optimize data object placement. Data storage entities may be added or removed in a non-disruptive manner.

Claims

1. A method for operating a data management node comprising:

receiving an access request from a remote device;

interpreting the access request to determine how to handle the access request as a request to access one or more data objects;

forwarding the access request to one or more data storage entities that store data objects remotely from the data management node;

in a database local to the data management node, storing an object record that includes;

file system metadata associated with the access request;

an object signature and storage location descriptor for identifying and/or locating the one or more data objects in the one or more data storage entities;

at least one metadata attribute relating to at least one of management, policy enforcement, and/or service levels for the access request;

in a database local to the data management node, also storing, as one or more metadata structures;

information concerning users, groups of users, application servers, file servers, files, and/or file systems related to the access request;

at least one attribute relating to at least one of management, policy enforcement, and/or

service levels for the access request;

thereby enabling deployment of data storage entities that store data objects independently of other data management functionality.

2. The method of claim 1 additionally comprising:

keeping only a non-persistent copy of the data object on the data management node.

3. The method of claim 1 additionally comprising:

receiving a policy specifying an aspect of management of at least one of the data objects;

operating a policy engine for comparison of the at least one data object attribute against the policy; and

moving the at least one data object to a differently classified data storage entity based on the result of the comparison.

4. The method of claim 1 wherein the data access request is received from a software connector component resident in-situ within an operating system.

5. The method of claim 4 wherein the data access request is received as a result of a filtering operation performed by the software connector component.

6. The method of claim 1 wherein the data storage entities comprise one or more of physical storage, virtual storage, cloud storage, IaaS, regional cloud, JBOD, and/or a storage appliance.

7. The method of claim 1 wherein the storage location descriptor specifies a logical block address or volume identifier.

8. The method of claim 1 wherein the storage location descriptor specifies an object identifier.

9. The method of claim 1 additionally comprises the steps of, in a background process separate from receiving an access request from a remote device:

reading a data object from the selected one of the data storage entities;

writing the data object to a second selected one of the data storage entities;

updating an object record for the data object with a storage location identifier that points to the second selected one of the data storage entities; and

subsequently deleting the data object from the first selected one of the data storage entities.

10. The method of claim 1 additionally wherein:

the object record stores at least one attribute that characterizes the data storage entity that stores the data object.

11. The method of claim 10 wherein the at least one attribute is an access speed requirement.

12. The method of claim 1 wherein a user-defined policy specifies a data retention time for the data object.

13. The method of claim 1 wherein an attribute of the data storage entity includes one or more of performance, capacity, data optimization, disaster recovery, retention, disposal, security, cost, or a user-defined attribute.

14. The method of claim 1 wherein the policy specifies a storage optimization attribute.

15. The method of claim 9 where the storage optimization attribute is de-duplication.

16. The method of claim 1 wherein at least two data storage entities are of a different storage classification.

17. The method of claim 1 additionally comprising:

monitoring remaining capacity of at least one data storage entity over time;

automatically identifying at least one additional data storage entity when the remaining capacity reaches a predetermined amount; and

migrating one or more data objects to the additional data storage entity.

18. The method of claim 1 wherein the object record includes a user-defined attribute applicable to one or more objects and further comprising:

enforcing at least one data management policy according to the user-defined attribute.

19. The method of claim 1 wherein the connector component additionally performs the steps of:

receiving a command to assume responsibility for processing access requests to one or more data assets accessible to the remote device;

storing a persistent cookie associated with the one or more data assets;

upon subsequent processing of an access request related to a specific data asset,

if the persistent cookie is associated with the data asset,

then

forwarding the access request to the data management node;

else

processing the access request in the remote device without forwarding the access request to the data management node.

20. The method of claim 1 additionally comprising:

connecting to an other one of the data management nodes in a cluster;

receiving an instruction that a data asset is to be accessible through the other data management node in the cluster;

replicating meta-data relating to the data asset to the other data management node;

updating the metadata to indicate that the data asset is now accessible to the other data management node.

21. The method of claim 18 additionally comprising

instantiating a file system on another server accessible to the other management node without moving the data asset;

and

installing a connector on the other server accessible from the other management node.