Method of universal file access for a heterogeneous computing environment

• US 7,774,391 B1
• Filed: 03/30/2006
• Issued: 08/10/2010
• Est. Priority Date: 03/30/2006
• Status: Active Grant

• Current Assignee: Vmware LLC (Broadcom, Inc.)
• Original Assignee: VMware, Inc. (Broadcom, Inc.)
• Inventors: Deuel, Robert Frederick, Le, Bich Cau, Czezatke, Christian
• Primary Examiner(s): LEWIS, CHERYL RENEA
• Application Number:
  US11/395,081
• Time in Patent Office: 1,594 Days
• Field of Search: 707/822, 707/999.001
• US Class Current: 707/822
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/188 Virtual file systems
• CPC Class Codes: Y10S 707/99931 Database or file accessing

Abstract

An architecture and system are described that provide a unified file access service within in a managed computing environment composed of diverse networks, computing devices, and storage devices. The service provides mechanisms for remotely accessing the file systems of any managed computer or disk snapshot, independently of the computer'"'"'s current state (powered on, suspended or powered off), its location within the environment, its hardware type (virtual vs. physical), its operating system type, and its file system formats. The system isolates centralized FPAs from the details of clients, proxies and storage elements by providing a service that decomposes offloaded file system access into two steps. A FPA or a requester acting on behalf of the FPA first expresses the disk set or the computer containing the file systems it wishes to access, along with requirements and preferences about the access method. The service figures out an efficient data path satisfying the FPA'"'"'s needs; and then automatically configures a set of storage and computing resources to provide the data path. The service then replies with information about the resources and instructions for using them. The FPA then accesses the requested file systems using the returned information.

Claims

1. A method for performing offloaded file processing, the method comprising:

accessing a request for services from a requester, the request including information from which a disk set is derived and a command involving the disk set;

automatically determining volumes, volume formats of the volumes, file systems and file system formats of the file systems residing on the disk set;

automatically determining existence and a state of a client computer associated with the disk set, the determining the state includes determining if the client computer is powered-on or powered-off; and

executing the command, the executing includes accessing the disk set using information obtained from at least one of the volumes, the file systems, the volume formats, the file system formats and the state,

wherein if the client computer is determined to be existent and powered-on, then determining a mechanism for generating a snapshot of said disk set, taking a snapshot of the disk set using the mechanism, and determining a network address of the snapshot, wherein the executing the command accesses the snapshot, and if the client computer is determined to be non-existent or powered-off, then automatically determining a network address of the disk set.

2. The method as described in claim 1 wherein said requester is a File Processing Application (FPA).

3. The method as described in claim 1 wherein said requester is a subordinate application operating in conjunction with a File Processing Application (FPA).

4. The method as described in claim 3 wherein said FPA and said subordinate application reside on different computer systems.

5. The method as described in claim 1 further comprising, transparent to said requester, automatically determining a hardware type of said client computer and automatically determining a hardware type of said disk set.

6. The method as described in claim 5 wherein said hardware type is selected between physical and virtual.

7. The method as described in claim 1 wherein said request comprises an identifier familiar to said requester to identify said client computer and father comprising,

transparent to said requester, automatically determining a network address of said client computer based on said identifier familiar to said requester.

8. The method as described in claim 7 wherein said identifier familiar to said requester is a hardware address.

9. The method as described in claim 7 wherein said identifier familiar to said requester is a host name provided by network software.

10. The method as described in claim 7 wherein said client computer is a virtual machine and wherein further said identifier familiar to said requester is a name of said virtual machine provided by software managing said virtual machine.

11. The method as described in claim 1 wherein said offloaded file processing is performed independent of a computer system and software stack of said requester.

12. The method as described in claim 1 wherein said executing said command comprises:

transparent to said requester, selecting a slave system;

transparent to said requester, establishing, on said slave system, a network file system mapped to a file system of said disk set;

communicating a network address of said network file system to said requester; and

allowing said requester to manipulate said network file system using a file sharing protocol that is independent of said file system of said disk set.

13. The method as described in claim 12 wherein said slave system is compatible with a file system of said disk set.

14. The method as described in claim 12 wherein said selecting said slave system favors a lightly loaded slave system.

15. The method as described in claim 12 wherein said protocol is also independent of a protocol of a computer system of said requester.

16. The method as described in claim 1 wherein said request further comprises an operation to be performed on said disk set and wherein further said executing said command comprises:

selecting a slave system compatible with a file system of said disk set;

transparent to said requester, causing said slave system to perform said operation on said disk set; and

returning a message to said requester indicating a result of said operation.

17. The method as described in claim 16 wherein said selecting a slave system favors a lightly loaded slave system.

18. The method as described in claim 1 wherein said request further comprises an operation to be performed on said disk set and wherein further said executing said command comprises:

selecting a slave system compatible with a file system and an identified data file of said disk set;

transparent to said requester, causing said slave system to perform said operation on said data file on said disk set; and

returning a message to said requester indicating a result of said file operation.

19. The method as described in claim 18 wherein performing said file operation involves running a program compatible with the data format of the file.

20. The method as described in claim 1 wherein said request further comprises a location of a file processing application (FPA) and wherein further said executing said command comprises:

selecting a slave system compatible with both a file system of said disk set and a required environment for said FPA;

establishing said EPA on said slave system;

executing said FPA on said slave system which operates on said disk set; and

returning a message to said requester indicating a result of said executing said FPA.

21. The method as described in claim 1 wherein said information from which said disk set is derived is an identification of said disk set.

22. The method as described in claim 1 wherein said information from which said disk set is derived is an identification of said client computer.

23. A computer readable storage medium comprising instructions that when executed on a processor implement a method for performing offloaded file processing, said method comprising:

accessing a request for services from a requester, the request including information from which a disk set is derived and a command involving the disk set;

automatically determining volumes, volume formats of the volumes, file systems and file system formats of the file systems residing on the disk set;

automatically determining existence and a state of a client computer associated with the disk set, the determining the state includes determining if the client computer is powered-on or powered-off; and

executing the command, the executing includes accessing the disk set using information obtained from at least one of the volumes, the file systems, the volume formats, the file system formats and the state,

wherein if the client computer is determined to be existent and powered-on, then determining a mechanism for generating a snapshot of said disk set, taking a snapshot of the disk set using the mechanism, and determining a network address of the snapshot, wherein the executing the command accesses the snapshot, and if the client computer is determined to be non-existent or powered-off, then automatically determining a network address of the disk set.

24. The computer readable storage medium as described in claim 23 wherein said requester is a File Processing Application (FPA).

25. The computer readable storage medium as described in claim 23 wherein said method further comprises, transparent to said requester, automatically determining a hardware type of said client computer and automatically determining a hardware type of said disk set.

26. The computer readable storage medium as described in claim 23 wherein said request further comprises an identifier familiar to said requester to identify said client computer and wherein said method further comprises, transparent to said requester, automatically determining a network address of said client computer based on said identifier familiar to said requester.

27. The computer readable storage medium as described in claim 23 wherein said executing said command comprises:

transparent to said requester, selecting a slave system compatible with a file system of said disk set;

transparent to said requester, establishing, on said slave system, a network file system mapped to a file system of said disk set;

communicating a network address of said network file system to said requester; and

allowing said requester to manipulate said network file system using a file sharing protocol that is independent of said file system of said disk set.

28. The computer readable storage medium as described in claim 23 wherein said request further comprises an operation to be performed on said disk set and wherein further said executing said command comprises:

selecting a slave system compatible with a file system of said disk set;

transparent to said requester, causing said slave system to perform said operation on said disk set; and

returning a message to said requester indicating a result of said operation.

29. The computer readable storage medium as described in claim 23 wherein said request further comprises an operation to be performed on said disk set and wherein further said executing said command comprises:

selecting a slave system compatible with a file system and an identified data file of said disk set;

transparent to said requester, causing said slave system to perform said operation on said data file on said disk set; and

returning a message to said requester indicating a result of said file operation.

30. The computer readable storage medium as described in claim 23 wherein said request further comprises a location of a file processing application (FPA) and wherein further said executing said command comprises:

selecting a slave system compatible with a file system of said disk set and also compatible with a required environment for said FPA;

establishing said FPA on said slave system;

executing said FPA on said slave system which operates on said disk set; and

returning a message to said requester indicating a result of said executing said FPA.

31. The computer readable storage medium as described in claim 23 wherein said information from which said disk set is derived is an identification of said disk set.

32. The computer readable storage medium as described in claim 23 wherein said information from which said disk set is derived is an identification of said client computer.

33. A computer readable storage medium comprising instructions that when executed on a processor implement a method for performing offloaded file processing, said method comprising:

a) accessing a request for services from a requester, said request comprising;

information from which a disk set is derived; and

a command involving said disk set, wherein said requester is a File Processing Application (FPA);

b) transparent to said requester, automatically determining volumes and file systems residing on said disk set;

c) transparent to said requester, automatically determining volume formats and file system formats used by said volumes and file systems;

d) transparent to said requester, automatically determining existence and a state of a client computer associated with said disk set;

e) transparent to said requester, automatically determining a hardware type of said client computer and automatically determining a hardware type of said disk set;

f) transparent to said requester, automatically determining a network address of said client computer based on an identifier familiar to said requester;

g) in connection with an offloaded file processing, executing said command comprising accessing said disk set using information obtained from said b)-f),

wherein said determining a state of said client computer determines if said client computer is powered-on or powered-off and wherein said method further comprises;

if said client computer is determined to be existent and powered-on, then transparent to said requester;

determining a mechanism for generating a snapshot of said disk set;

taking a snapshot of said disk set using said mechanism; and

determining a network address of said snapshot, wherein said executing said command accesses said snapshot; and

if said client computer is determined to be non-existent or powered-off, then transparent to said requester, automatically determining a network address of said disk set.

34. The computer readable storage medium as described in claim 33 wherein said

executing said command comprises:

transparent to said requester, selecting a slave system compatible with a file system of said disk set;

transparent to said requester, establishing, on said slave system, a network file system mapped to a file system of said disk set;

communicating a network address of said network file system to said requester; and

allowing said requester to manipulate said network file system using a file sharing protocol that is independent of said file system of said disk set.

35. The computer readable medium as described in claim 33 wherein said request further comprises an operation to be performed on said disk set and wherein further said executing said command comprises:

selecting a slave system compatible with a file system of said disk set;

transparent to said requester, causing said slave system to perform said operation on said disk set; and

returning a message to said requester indicating a result of said operation.

36. The computer readable storage medium as described in claim 33 wherein said request further comprises an operation to be performed on said disk set and wherein further said executing said command comprises:

selecting a slave system compatible with a file system and an identified data file of said disk set;

transparent to said requester, causing said slave system to perform said operation on said data file on said disk set; and

returning a message to said requester indicating a result of said file operation.

37. The computer readable storage medium as described in claim 33 wherein said request further comprises a location of a file processing application (FPA) and wherein further said executing said command comprises:

selecting a slave system both compatible with a file system of said disk set and a required environment for said FPA;

establishing said FPA on said slave system;

executing said FPA on said slave system which operates on said disk set; and

returning a message to said requester indicating a result of said executing said FPA.