Automated Filer Technique for Use in Virtualized Appliances and Applications

• US 20110153697A1
• Filed: 06/05/2009
• Published: 06/23/2011
• Est. Priority Date: 09/15/2005
• Status: Active Grant

• Current Assignee: CA, Inc. (d/b/a CA Technologies) (Broadcom, Inc.)
• Original Assignee: Computer Associates Think Inc. (Broadcom, Inc.)
• Inventors: Tessler, Eric, Kalev, Leonid, Nickolov, Peter
• Granted Patent: US 8,364,638 B2
• Time in Patent Office: Days
• US Class Current: 707/827
• CPC Class Codes: G06F 16/1844 Management specifically adapted to replicated file systems
• CPC Class Codes: G06F 16/188 Virtual file systems
• CPC Class Codes: G06F 9/4856 resumption being on a different machine, e.g. task migration, virtual machine migration G06F9/5088 takes precedence
• CPC Class Codes: G06F 9/5072 Grid computing
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/101 based on network conditions
• CPC Class Codes: H04L 67/1014 based on the content of a request
• CPC Class Codes: H04L 67/1021 based on client or server locations
• CPC Class Codes: H04L 67/1029 using data related to the state of servers by a load balancer
• CPC Class Codes: H04L 67/1031 Controlling of the operation of servers by a load balancer, e.g. adding or removing servers that serve requests
• CPC Class Codes: H04L 67/34 involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416
• CPC Class Codes: H04L 69/32 Architecture of open systems interconnection [OSI] 7-layer type protocol stacks, e.g. the interfaces between the data link level and the physical level

Abstract

Various techniques are disclosed for facilitating manipulation of virtualized storage volumes and/or file systems of one or more different types of operating systems (OSs) implemented on distributed computer systems. According to different embodiments, various aspects may be directed to different embodiments of virtualized filer appliances and/or filer applications which may be used for facilitating manipulation of virtualized storage volumes and/or file systems of one or more different types of operating systems (OSs) implemented on distributed computer systems. In at least one embodiment, a filer appliance may be implemented as a virtual appliance that includes functionality for performing automated file-level and/or volume-level operations for a selected set of file systems. In one embodiment, a filer appliance may be implemented as a virtual machine which is configured or designed to handle managing of one or more volumes. In one embodiment, the filer appliance may include one or more virtual interfaces for interfacing with one or more virtual volumes and/or one or more other virtual appliances, virtual applications, etc. Various other techniques are disclosed herein for facilitating dynamic and automated configuration of virtual appliances implemented at distributed computing systems.

Claims

1. A system for facilitating manipulation of a file system on a virtual storage volume of a distributed computing network, the system comprising:

at least one processor;

at least one interface; and

memory;

a first plurality of virtual filer appliances including a first virtual filer appliance operable to perform at least one file system manipulation on at least one file system type;

the first virtual filer appliance including an image of an operating system (OS) operable to be loaded or booted in a first virtual machine to thereby enable a first running instance of the first virtual filer appliance to be created or instantiated at the distributed computing network;

the system being operable to;

identify, for performing a first file system manipulation, a first virtual storage volume having a first file system, the first file system corresponding to a first file system type;

identify, from the first plurality of virtual filer appliances, a selected virtual filer appliance that is suitable for performing the first file system manipulation at the first virtual storage volume;

automatically starting an instance of the selected virtual filer appliance; and

automatically providing the instance of the selected virtual filer appliance with access to the first virtual storage volume.

2. The system of claim 1 wherein the first file system type is selected from a group of file system types consisting of:

Linux-based file system types, Solaris-based file system types, and Windows-based file system types.

3. A method for facilitating manipulation of a file system on a virtual storage volume of a distributed computing system, the distributed computing system comprising a first plurality of virtual filer appliances including a first virtual filer appliance operable to perform at least one file system manipulation on at least one file system type, the method comprising:

identifying, for performing a first file system manipulation, a first virtual storage volume having a first file system, the first file system corresponding to a first file system type;

identifying, from the first plurality of virtual filer appliances, a selected virtual filer appliance that is suitable for performing the first file system manipulation at the first virtual storage volume, the first virtual filer appliance including an image of an operating system (OS) operable to be loaded or booted in a first virtual machine to thereby enable a first running instance of the first virtual filer appliance to be created or instantiated at the distributed computing system;

automatically starting an instance of the selected virtual filer appliance; and

automatically providing the instance of the selected virtual filer appliance with access to the first virtual storage volume.

4. A method for facilitating manipulation of a file system on a virtual storage volume of a distributed computing network, the method comprising:

identifying a first file system type for use in accessing files at a first virtual storage volume of the distributed computing network;

identifying, using the first file system type, a first virtual filer application suitable for manipulating a first file system at the first virtual storage volume corresponding to the first file system type, wherein the first virtual filer application includes at least one virtual appliance, the first virtual filer application including an image of an operating system (OS) operable to be loaded or booted in a first virtual machine to thereby enable a first running instance of the first virtual filer application to be created or instantiated at the distributed computing network;

identifying a first running instance of first virtual filer application for use in manipulating the first file system on the first virtual storage volume;

automatically providing the first instance of the first virtual filer application with access to the first virtual storage volume; and

automatically providing the first instance of the first virtual filer application with instructions for causing the first instance of the first virtual filer application to perform at least one file system operation at the first file system.

5. The method in claim 4 further comprising:

automatically creating the first running instance of the first virtual filer application at the distributed computing network.

6. The method in claim 4 further comprising:

automatically allocating an available running instance of the first virtual filer application from a pool of available filer applications at the distributed computing network.

7. A system for facilitating manipulation of a file system on a virtual storage volume of a distributed computing network, the system comprising:

at least one processor;

at least one interface; and

memory;

a first plurality of virtual filer appliances including a first virtual filer appliance operable to perform at least one file system manipulation on at least one file system type;

the first virtual filer appliance including an image of an operating system (OS) operable to be loaded or booted in a first virtual machine to thereby enable a first running instance of the first virtual filer appliance to be created or instantiated at the distributed computing network;

the system being operable to;

identify a first file system type for use in accessing files at a first virtual storage volume of the distributed computing network;

identify, using the first file system type, a first virtual filer application suitable for manipulating a first file system at the first virtual storage volume corresponding to the first file system type, wherein the first virtual filer application includes at least one virtual appliance;

identify a first running instance of first virtual filer application for use in manipulating the first file system on the first virtual storage volume;

automatically provide the first instance of the first virtual filer application with access to the first virtual storage volume; and

automatically provide the first instance of the first virtual filer application with instructions for causing the first instance of the first virtual filer application to perform at least one file system operation at the first file system.

8. The system in claim 7 being further operable to:

automatically create the first running instance of the first virtual filer application at the distributed computing network.

9. The system in claim 7 being further operable to:

automatically allocate an available running instance of the first virtual filer application from a pool of available filer applications at the distributed computing network.

10. The system of claim 7 wherein the first file system type is selected from a group of file system types consisting of:

Linux-based file system types, Solaris-based file system types, and Windows-based file system types.

11. A method for facilitating resizing of a virtual storage volume implemented at a distributed computing network, the method comprising:

identifying a first file system type for use in accessing files at a first virtual storage volume of the distributed computing network;

identifying, using the first file system type, a running instance of a first virtual filer application operable to read and write files in a file system of the first file system type, wherein the first virtual filer application includes at least one virtual appliance, the first virtual filer application including an image of an operating system (OS) and being instantiated at a first virtual machine of the distributed computing network;

performing, using the first virtual filer application, resizing operations for resizing the first virtual storage volume while preserving the first file system on the first virtual storage volume during the resizing operations, wherein the performing of the resizing operations includes;

providing the first virtual filer application with access to the first virtual storage volume and a second virtual storage volume, where the size of the second virtual storage volume differs from the size of the first storage volume; and

copying, using the first virtual filer application, a first plurality of files from the first virtual storage volume to the second virtual storage volume.

12. A system for facilitating resizing of a virtual storage volume implemented at a distributed computing network, the system comprising:

at least one processor;

at least one interface; and

memory;

a first plurality of virtual filer appliances including a first virtual filer appliance operable to perform at least one file system manipulation on at least one file system type;

the first virtual filer appliance including an image of an operating system (OS) operable to be loaded or booted in a first virtual machine to thereby enable a first running instance of the first virtual filer appliance to be created or instantiated at the distributed computing network;

the system being operable to;

identify a first file system type for use in accessing files at a first virtual storage volume of the distributed computing network;

identify, using the first file system type, a running instance of a first virtual filer application operable to read and write files in a file system of the first file system type;

perform, using the first virtual filer application, resizing operations for resizing the first virtual storage volume while preserving the first file system on the first virtual storage volume during the resizing operations, wherein the performing of the resizing operations includes;

providing the first virtual filer application with access to the first virtual storage volume and a second virtual storage volume, where the size of the second virtual storage volume differs from the size of the first storage volume; and

copying, using the first virtual filer application, a first plurality of files from the first virtual storage volume to the second virtual storage volume.

13. The system of claim 12 wherein the first file system type is selected from a group of file system types consisting of:

Linux based file system types, Solaris-based file system types, and Windows-based file system types.

14. A method for facilitating conversion of a file system of a virtual storage volume from a first file system type to a second file system type, the virtual storage volume being implemented at a distributed computing network, the method comprising:

identifying a first file system type of a first file system of a first virtual storage volume;

automatically identifying a first virtual filer appliance operable to read files from the first file system type, the first virtual filer appliance including an image of a first operating system (OS) loadable in a first virtual machine to thereby enable a running instance of the first virtual filer appliance to be created or instantiated at the distributed computing network;

automatically providing the first virtual filer appliance with access to the first virtual storage volume;

identifying a second file system type of a second file system of a second virtual storage volume;

automatically identifying a second virtual filer appliance operable to write files to the second file system type, the second virtual filer appliance including an image of a second operating system (OS) loadable in a second virtual machine to thereby enable a running instance of the second virtual filer appliance to be created or instantiated at the distributed computing network;

automatically providing the second virtual filer appliance with access to the second virtual storage volume;

providing a first communication link between the first virtual filer appliance and the second virtual filer appliance;

performing, using the first virtual filer appliance and second virtual filer appliance, file system conversion operations for converting the first file system from a first file system type to the second file system of the second file system type, wherein the performing of the file system conversion operations includes;

operating the first virtual filer appliance to read a first plurality of files from the first virtual storage volume;

sending, via use of the first communication link, file information relating to the first plurality of read files to the second virtual filer appliance;

operating the second virtual filer appliance to receive the file information via the first communication link; and

operating the second virtual filer appliance to write at least a portion of the received file information to the second virtual storage volume.

15. The method of claim 14 further comprising:

automatically creating, on demand, at least one running instance of at least one of;

the first virtual filer appliance and/or second virtual filer appliance in response to at least one condition or event.

16. The method of claim 14 further comprising:

automatically creating, on demand, at least one running instance of at least one of;

the first virtual filer appliance and/or second virtual filer appliance in response to at least one real-time condition or event.

17. The method of claim 14 further comprising:

dynamically generating, using the first file system type and the second file system type, a first virtual application template;

automatically creating, on demand, using the first virtual application template, running instances of the first virtual filer appliance and second virtual filer appliance.

18. The method of claim 14 further comprising:

dynamically generating, using the first file system type and the second file system type, a first virtual application template;

automatically and dynamically creating, on demand, using the first virtual application template, running instances of the first virtual filer appliance and second virtual filer appliance in response to at least one real-time condition or event.

19. The method of claim 14 further comprising:

automatically creating, on demand, using a first pre-configured application template, running instances the first virtual filer appliance and second virtual filer appliance in response to at least one condition or event;

wherein the first pre-configured application template is selected from a plurality of pre-configured application templates using information relating to the first file system type and the second file system type.

20. A system for facilitating conversion of a file system of a virtual storage volume from a first file system type to a second file system type, the virtual storage volume being implemented at a distributed computing network, the system comprising:

at least one processor;

at least one interface; and

memory;

the system being operable to;

identify a first file system type of a first file system of the virtual storage volume;

automatically identify a first virtual filer appliance operable to read files from the first file system type, the first virtual filer appliance including an image of a first operating system (OS) loadable in a first virtual machine to thereby enable a running instance of the first virtual filer appliance to be created or instantiated at the distributed computing network;

automatically provide the first virtual filer appliance with access to the first virtual storage volume;

identify a second file system type of a second file system of the virtual storage volume;

automatically identifying a second virtual filer appliance operable to write files to the second file system type, the second virtual filer appliance including an image of a second operating system (OS) loadable in a second virtual machine to thereby enable a running instance of the second virtual filer appliance to be created or instantiated at the distributed computing network;

automatically provide the second virtual filer appliance with access to the second virtual storage volume;

provide a first communication link between the first virtual filer appliance and the second virtual filer appliance; and

perform, using the first virtual filer appliance and second virtual filer appliance, file system conversion operations for converting the first file system from a first file system type to the second file system of the second file system type, wherein the performing of the file system conversion operations includes;

operate the first virtual filer appliance to read a first plurality of files from the first virtual storage volume;

send, via use of the first communication link, file information relating to the first plurality of read files to the second virtual filer appliance;

operate the second virtual filer appliance to receive the file information via the first communication link; and

operate the second virtual filer appliance to write at least a portion of the received file information to the second virtual storage volume.

21. The system of claim 20 being further operable to:

automatically create, on demand, at least one running instance of at least one of;

the first virtual filer appliance and/or second virtual filer appliance in response to at least one condition or event.

22. The system of claim 20 being further operable to:

automatically create, on demand, at least one running instance of at least one of;

the first virtual filer appliance and/or second virtual filer appliance in response to at least one real-time condition or event.

23. The system of claim 20 being further operable to:

dynamically generate, using the first file system type and the second file system type, a first virtual application template;

automatically create, on demand, using the first virtual application template, running instances of the first virtual filer appliance and second virtual filer appliance.

24. The system of claim 20 being further operable to:

dynamically generate, using the first file system type and the second file system type, a first virtual application template;

automatically and dynamically create, on demand, using the first virtual application template, running instances of the first virtual filer appliance and second virtual filer appliance in response to at least one real-time condition or event.

25. The system of claim 20 being further operable to:

automatically create, on demand, using a first pre-configured application template, running instances the first virtual filer appliance and second virtual filer appliance in response to at least one condition or event;

wherein the first pre-configured application template is selected from a plurality of pre-configured application templates using information relating to the first file system type and the second file system type.

26. The system of claim 20 wherein the first file system type is selected from a group of file system types consisting of:

Linux-based file system types, Solaris-based file system types, and Windows-based file system types.

27. A file access system for facilitating remote file access to remotely located virtual storage volumes of a distributed computing network, the system comprising:

at least one processor;

at least one interface; and

memory;

a first plurality of virtual filer applications including a first virtual filer application operable to perform at least one file system manipulation on at least one file system type;

the first virtual filer application including an image of an operating system (OS) loadable in a first virtual machine to thereby enable a first running instance of the first virtual filer application to be created or instantiated at the distributed computing network;

the first virtual filer application being operable to perform file system formatting operations, file read operations, and file write operations on at least one file system corresponding to a first file system type;

the system being operable to;

receive a first request to access a first remote virtual storage volume;

automatically identify a first type of file system at the first remote virtual storage volume;

automatically identify, using information relating to the first type of file system, a selected virtual filer application that is suitable for performing file system manipulations at the first remote virtual storage volume; and

remotely accessing, using the selected virtual filer application, one or more files at the first remote virtual storage volume.

28. A method for facilitating remote file access to remotely located virtual storage volumes of a distributed computing network, the distributed computing network including a first plurality of virtual filer applications including a first virtual filer application operable to perform at least one file system manipulation on at least one file system type, the method comprising:

receiving a first request to access a first remote virtual storage volume;

automatically identifying a first type of file system at the first remote virtual storage volume;

automatically identifying, using information relating to the first type of file system, a selected virtual filer application that is suitable for performing file system manipulations at the first remote virtual storage volume, the selected virtual filer application including an image of an operating method (OS) loadable in a first virtual machine to thereby enable a first running instance of the first virtual filer application to be created or instantiated at the distributed computing network; and

remotely accessing, using the selected virtual filer application, one or more files at the first remote virtual storage volume.

29. The method of claim 28 wherein the file system manipulations include at least one operation selected from a group consisting of:

file system formatting operations, file read operations, and file write operations.

30. A system for facilitating access to files on a first virtual storage volume of a distributed computing network, the system comprising:

at least one processor;

at least one interface; and

memory;

the system being operable to;

receive a first access request for performing a first file access operation at the first virtual storage volume;

determine whether the first virtual storage volume is currently in use, mounted or attached to a virtual machine;

in response to determining that the first virtual storage volume is currently in use, mounted or attached;

identify a first virtual machine which has current access to first virtual storage volume; and

forward the first access request to the first virtual machine to thereby cause the first virtual machine to perform at least one file access operation at the first virtual storage volume; and

in response to determining that the first virtual storage volume is not currently in use, mounted or attached;

automatically identify a first type of file system at the first virtual storage volume;

automatically identify, using information relating to the first type of file system, a selected virtual filer appliance that is suitable for performing file access operations at the first virtual storage volume;

automatically attach the first virtual storage volume to the selected virtual filer appliance for providing the selected virtual filer appliance with file access to the virtual storage volume; and

forward the first access request to the selected virtual appliance to thereby cause the selected virtual appliance to perform at least one file access operation at the first virtual storage volume.

31. The system of claim 30 being further operable to:

provide file access to at least one online virtual storage volume which is currently in use, mounted or attached to a first device of the distributed computing network; and

provide file access to at least one offline virtual storage volume which is not currently in use, mounted or attached to a any device in the distributed computing network.

32. The system of claim 30 wherein the first virtual machine is configured as a fast virtual appliance.

33. A method for facilitating access to files on a first virtual storage volume of a distributed computing network, the method comprising:

receiving a first access request for performing a first file access operation at the first virtual storage volume;

determining whether the first virtual storage volume is currently in use, mounted or attached to a virtual machine;

in response to determining that the first virtual storage volume is currently in use, mounted or attached;

identifying a first virtual machine which has current access to first virtual storage volume; and

forwarding the first access request to the first virtual machine to thereby cause the first virtual machine to perform at least one file access operation at the first virtual storage volume; and

in response to determining that the first virtual storage volume is not currently in use, mounted or attached;

automatically identifying a first type of file system at the first virtual storage volume;

automatically identifying, using information relating to the first type of file system, a selected virtual filer appliance that is suitable for performing file access operations at the first virtual storage volume;

automatically attaching the first virtual storage volume to the selected virtual filer appliance for providing the selected virtual filer appliance with file access to the virtual storage volume; and

forwarding the first access request to the selected virtual appliance to thereby cause the selected virtual appliance to perform at least one file access operation at the first virtual storage volume.

34. The method of claim 33 further comprising:

providing file access to at least one online virtual storage volume which is currently in use, mounted or attached to a first device of the distributed computing network; and

providing file access to at least one offline virtual storage volume which is not currently in use, mounted or attached to a any device in the distributed computing network.

35. The method of claim 33 wherein the first virtual machine is configured as a first virtual appliance.

36. A virtual appliance configuration system for configuring one or more virtual appliances in a distributed computing network, the system comprising:

a first virtual appliance including an image of an operating system (OS) operable to be loaded or booted in a first virtual machine to thereby enable a first running instance of the first virtual appliance to be created or instantiated at the distributed computing network;

a DHCP server, operable to provide at least one IP address to the first virtual appliance in response to a DHCP request received from the first virtual appliance;

an appliance configuration server, operable to facilitate access to a first appliance configuration file associated with the first virtual appliance an agent (or the appliance), operable to request the first appliance configuration file; and

a web server, operable to provide the first virtual appliance with access to the first appliance configuration file in response to a request received from the first virtual appliance.

37. The system of claim 36 wherein the first virtual appliance includes an appliance configurator operable to automatically and dynamically configure at least one network interface of the virtual appliance using information obtained from the first appliance configuration file.

38. The system of claim 36 wherein the first virtual appliance includes a network address map resolver operable to resolve host names to remote network hosts using information obtained from the first appliance configuration file.

39. The system of claim 36 wherein the first virtual appliance includes a configuration file manipulator operable to automatically update information in at least one appliance configuration file using information obtained from the first appliance configuration file.

40. The system of claim 36 wherein the first virtual appliance includes a property extractor operable to automatically extract individual configuration parameters from the first appliance configuration file, and operable to provide access to at least a portion of the configuration parameters as separate configuration parameters for use in configuration of software operating in the virtual appliance.

41. The system of claim 36 wherein the first virtual appliance includes a volume configurator operable to automatically mount at least one virtual storage volume into file system mountpoints using volume configuration information obtained from the first appliance configuration file.