Systems and methods for providing file access in a hybrid cloud storage system

• US 9,424,437 B1
• Filed: 10/14/2013
• Issued: 08/23/2016
• Est. Priority Date: 10/12/2012
• Status: Active Grant

• Current Assignee: Egnyte Incorporated
• Original Assignee: Egnyte Incorporated
• Inventors: Yalangi, Chandrasekhar, Kariyawasam Bodhitantri Wijayaratne, Ravi, Ancin, Hakan, Chen, Xi, Jassal, Amrit, Jung, Daniel H., Neustaetter, Gregory B., Puttergill, Sean H., Sundararaj, Ramakrishnan, Vedanthan, Sanjay, Kavasseri, Ramanathan, Sharma, Shishir
• Primary Examiner(s): Wong, Leslie
• Application Number:
  US14/053,253
• Time in Patent Office: 1,044 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 15/17331 Distributed shared memory [DSM], e.g. remote direct memory access [RDMA]
• CPC Class Codes: G06F 16/122 using management policies backup systems G06F11/1446; file migration policies for HSM systems G06F16/185
• CPC Class Codes: G06F 16/14 Details of searching files based on file metadata
• CPC Class Codes: G06F 16/178 Techniques for file synchronisation in file systems
• CPC Class Codes: G06F 16/1844 Management specifically adapted to replicated file systems
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 21/62 Protecting access to data via a platform, e.g. using keys or access control rules
• CPC Class Codes: G06F 21/6209 to a single file or object, e.g. in a secure envelope, encrypted and accessed using a key, or with access control rules appended to the object itself
• CPC Class Codes: G06F 21/6227 where protection concerns the structure of data, e.g. records, types, queries
• CPC Class Codes: H04L 63/08 for authentication of entities cryptographic mechanisms or cryptographic arrangements for entity authentication H04L9/32
• CPC Class Codes: H04L 63/10 for controlling access to devices or network resources
• CPC Class Codes: H04L 63/105 Multiple levels of security
• CPC Class Codes: H04L 63/20 for managing network security; network security policies in general filtering policies H04L63/0227
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]

Abstract

A method for providing access to objects associated with a particular client in a cloud storage system is disclosed. The method includes the steps of establishing a connection with a user, providing a client namespace associated with the client to the user, where the client namespace represents objects stored on the cloud storage system and objects stored on a private storage system apart from the cloud storage system, receiving a request from the user to access an object stored on the private storage system, and providing information to the user to facilitate access to the object stored on the private storage system by said user. Other systems and methods are also disclosed. Important advantages of the present invention are facilitated by separating the logic for user access (control plane) from the actual storage (Storage plane). Private file system access can still be managed from the cloud, while keeping the client data private.

Claims

1. A method for providing access to files via a cloud storage system, said method comprising:

accessing client metadata for each of a plurality of private data files stored on at least one off-site client storage system associated with a client;

combining said client metadata with attributes to generate cloud metadata for said private data files, at least some of said attributes specifying one or more off-site client storage systems having said private data files stored thereon;

storing said cloud metadata but not said plurality of private data files on said cloud storage system;

receiving a connection request from a user associated with said client;

establishing a connection with said user over a network;

providing a unified namespace associated with said client to said user based on said cloud metadata, said unified namespace including information representing said private data files stored only on said at least one client storage system and information representing data files stored on said cloud storage system;

receiving input from said user indicative of the selection of one of said private data files represented in said unified namespace; and

using said attributes to facilitate access to said selected private data file by said user.

2. The method of claim 1, wherein said attributes include connection information associated with said at least one off-site client storage system.

3. The method of claim 2, wherein said connection information includes HTTP(S) endpoint information.

4. The method of claim 1, wherein said attributes include search tags associated with at least some of said private data files.

5. The method of claim 1, wherein said attributes include access control information associated with at least some of said private data files.

6. The method of claim 1, wherein said attributes include replication policies associated with at least some of said private data files.

7. The method of claim 1, wherein said attributes include blobs associated with at least some of said private data files.

8. The method of claim 1, further comprising:

accessing said cloud metadata associated with said requested private data file for connection information associated with said at least one off-site client storage system; and

providing said connection information to said user.

9. The method of claim 8, wherein said connection information includes HTTP(S) endpoint information.

10. The method of claim 1, further comprising:

receiving a request from said user to access a private data file stored on multiple off-site client storage systems;

accessing said cloud metadata associated with said requested private data file for connection information associated with target ones of said off-site client storage systems having said requested private data file stored thereon; and

providing said connection information for said target ones of said off-site client storage systems to said user.

11. The method of claim 1, further comprising:

receiving a request from said user to access a plurality of private data files stored on multiple off-site client storage systems;

accessing said cloud metadata associated with each of said requested private data files for connection information associated with target ones of said off-site client storage systems having one or more of said requested private data files stored thereon; and

providing said connection information for said target ones of said off-site client storage systems to said user.

12. The method of claim 1, further comprising:

storing a cloud file system associated with said client on said cloud storage system, said cloud file system including a plurality of cloud objects and cloud metadata, said cloud metadata being associated with said cloud objects and private objects; and

wherein

said step of accessing client metadata includes accessing client metadata associated with each of a plurality of private objects of a private file system, said private objects including said private data files stored only on said at least one off-site client storage system;

said step of combining said client metadata with attributes includes combining at least some of said client metadata with attributes to generate cloud metadata for each of said private objects;

said step of storing said cloud metadata includes storing cloud metadata associated with each of said private objects, but not storing said private data files, on said cloud storage system;

said user is located remotely from said cloud storage system and said at least one client storage system; and

said unified namespace includes information representing said private objects, including said private data files stored only on said at least one off-site client storage system, and information representing said cloud objects, including said data files, stored on said cloud storage system.

13. A non-transitory, electronically-readable storage medium having code embodied thereon for causing an electronic device to perform a method for providing access to files via a cloud storage system, said code being configured to cause said electronic device to:

receive client metadata for each of a plurality of private data files stored on at least one off-site client storage system associated with a client;

combine said client metadata with attributes to generate cloud metadata for said private data files, at least some of said attributes specifying one or more off-site client storage systems having said private data files stored thereon;

store said cloud metadata but not said plurality of private data files on said cloud storage system;

receive a connection request from a user associated with said client;

establish a connection with said user over a network;

provide a unified namespace associated with said client to said user based on said cloud metadata, said unified namespace including information representing said private data files stored only on said at least one client storage system and information representing data files stored on said cloud storage system;

receive input from said user indicative of the selection of one of said private data files represented in said unified namespace; and

facilitating access to said selected private data file by said user.

14. A cloud storage system for providing access to files associated with a client, said cloud storage system comprising:

at least one network interface configured to establish a connection with a user associated with said client over a network in response to a request from said user;

at least one storage device for storing data and code; and

at least one processing unit for executing said code, said code including a namespace module being configured to

access client metadata for each of a plurality of private data files stored on at least one off-site client storage system associated with said client,

combine said client metadata with attributes to generate cloud metadata for said private data files, at least some of said attributes specifying one or more off-site client storage systems having said private data files stored thereon,

store said cloud metadata but not said plurality of private data files in said storage device, and

provide a unified namespace associated with said client to said user based on said cloud metadata, said unified namespace including information representing said private data files stored only on said at least one client storage system and information representing data files stored on said cloud storage system; and

wherein

responsive to receiving input from said user indicative of the selection of one of said private data files represented in said unified namespace, said namespace module is configured to facilitate access to said selected private data file by said user.

15. The system of claim 14, wherein said attributes include connection information associated with said at least one off-site client storage location.

16. The system of claim 15, wherein said connection information includes HTTP(S) endpoint information.

17. The system of claim 14, wherein said attributes include search tags associated with at least some of said private data files.

18. The system of claim 14, wherein said attributes include access control information associated with at least some of said private data files.

19. The system of claim 14, wherein said attributes include replication policies associated with at least some of said private data files.

20. The system of claim 14, wherein said attributes include blobs associated with at least some of said private data files.

21. The system of claim 14, wherein said namespace module is further configured to:

access said cloud metadata associated with said requested private data file for connection information associated with at least one off-site client storage system; and

provide said connection information to said user.

22. The system of claim 21, wherein said connection information includes HTTP(S) endpoint information.

23. The system of claim 14, wherein said namespace module is further configured to:

receive a request from said user to access a private data file stored on multiple ones of said off-site client storage systems;

access said cloud metadata associated with said requested private data file for connection information associated with target ones of said client storage systems having said requested private data file stored thereon; and

provide said connection information for said target ones of said client storage systems to said user.

24. The system of claim 14, wherein said namespace module is further configured to:

receive a request from said user to access a plurality of private data files stored on multiple ones of said off-site client storage systems;

access said cloud metadata associated with each of said requested private data files for connection information associated with target ones of said client storage systems having said requested private data files stored thereon; and

provide said connection information for said target ones of said client storage systems to said user.

25. A cloud storage system for providing access to files, said cloud storage system comprising:

at least one network interface configured to establish a connection with a user associated with a client over a network;

at least one storage device for storing data and code;

at least one processing unit;

means for associating client metadata with attributes specifying one or more off-site client storage systems having said private data files stored thereon, said client metadata being associated with a plurality of private data files stored on said one or more client storage systems but not on said cloud storage system; and

means for providing a unified namespace associated with said client to said user based on said client metadata and said attributes, said unified namespace including information representing said private data files stored only on said one or more client storage systems and information representing data files stored on said cloud storage system; and

wherein

responsive to receiving input from said user indicative of the selection of one of said private data files represented in said unified namespace, said means for providing a unified namespace is configured to facilitate access to said selected private data file by said user.

26. A method for accessing files in a distributed file system associated with a client, said method comprising:

establishing a connection with a cloud storage system;

accessing a unified namespace associated with said client via said cloud storage system, said unified namespace including information representing a plurality of client files stored on said cloud storage system and information representing a plurality of private client files stored only on one or more of a plurality of client storage systems located remotely from said cloud storage system;

requesting access to a private client file represented in said unified namespace but stored on multiple ones of said client storage systems;

receiving connection information associated with target ones of said client storage systems having said requested private client file stored thereon from said cloud storage system;

establishing connections with each of said target client storage systems; and

retrieving different parts of said requested private client file from different ones of said target client storage systems; and

wherein

said unified namespace is based on cloud metadata including client metadata and attributes specifying one or more of said plurality of client storage systems.

27. A method for accessing files in a distributed file system associated with a client, said method comprising:

establishing a connection with a cloud storage system;

accessing a unified namespace associated with said client via said cloud storage system, said unified namespace including information representing a plurality of client files stored on said cloud storage system and information representing a plurality of private client files stored only on one or more of a plurality of client storage systems located remotely from said cloud storage system;

requesting access to multiple ones of said private client files represented in said unified namespace and stored on multiple ones of said client storage systems;

receiving connection information associated with target ones of said client storage systems having said requested private client files stored thereon from said cloud storage system;

establishing connections with each of said target client storage systems; and

retrieving different ones of said requested private client files from different ones of said target client storage systems; and

wherein

said unified namespace is based on cloud metadata including client metadata and attributes specifying one or more of said plurality of client storage systems.