Method for backup and restore of a multi-lingual network file server

• US 6,714,952 B2
• Filed: 11/10/1999
• Issued: 03/30/2004
• Est. Priority Date: 11/10/1999
• Status: Expired due to Term

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Jain, Sanjay, Dunham, Scott, Mutalik, Madhav, Vahalia, Uresh, St. Pierre, Edgar, Lal, Puneet, Fiske, Rulian, Hansen, Hal
• Primary Examiner(s): Robinson, Greta
• Assistant Examiner(s): DODDS, HAROLD E
• Application Number:
  US09/438,137
• Publication Number:
  US 20020091710A1
• Time in Patent Office: 1,602 Days
• Field of Search: 707/1, 707/8, 707/10, 707/100, 707/104.1, 707/200-204, 709/203, 709/217-219, 709/223, 709/226, 711/161, 711/162, 714/1, 714/2, 714/4, 714/6, 714/11, 714/13, 714/15
• US Class Current: 707/645
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: Y10S 707/959 Network
• CPC Class Codes: Y10S 707/99955 Archiving or backup

Abstract

Described is a technique for a backup and restoration of data in a network that includes a multi-lingual file system and a multi-lingual network file server. Multiple meta data files are associated with a single data file in the network. Provided are services for packaging the metadata as a single parameter of an application programming interface (API) for a particular data file being backed up or restored over a network. These techniques may be used in both full and incremental backups and restores of data over a network.

Claims

1. A method executed in a computer system for providing a plurality of metadata files associated with a data file in a network comprising:

issuing a request by a client for said data file and said plurality of metadata files from a file storage area;

obtaining, by a multi-lingual file server, each of said plurality of metadata files describing said data file in accordance with a different file system in a multi-lingual file system, wherein said multi-lingual file server accesses files formatted for access by different operating systems; and

providing, in response to said request, to said client in a single response said plurality of metadata files;

and wherein said issuing, said obtaining and said providing are performed using remote procedure calls between said client and said multi-lingual file server.

2. The method of claim 1, wherein said metadata files are transferred using a network connection between said file storage area and said multi-lingual file server supplying the metadata files and said data file is transferred using a different connection that may be characterized as a higher-speed connection than said network connection.

3. The method of claim 2, wherein said data file is remotely transferred from said multi-lingual file server to said client using a second connection that is a direct connection between said file storage area and a requester requesting the data file.

4. The method of claim 3, wherein said metadata files include a first metadata file and a second metadata file, said first metadata file including attributes describing said data file in a first file system used by a first node in said network and said second metadata file including attributes describing said data file in a second file system used by a second node in said network.

5. The method of claim 4, wherein said first file system is a first type of network file system and said second file system is a second type of network file system.

6. The method of claim 4, further including:

storing said plurality of metadata files in a catalogue on a client node in said network which issued said request.

7. The method of claim 4, wherein said plurality of metadata files and said data file are transferred to a target node in said network different from a client node in said network which issued said request.

8. A method executed in a computer system for performing a backup data operation in a network comprising:

receiving a request at a backup server to backup data from a storage area;

transferring, in response to said request, a data file included in a multi-lingual file system to said backup server from a multi-lingual file server, wherein said multi-lingual file server accesses files formatted for access by different operating systems; and

transferring to said backup server, using a single remote procedure call, a plurality of metadata files corresponding to said data file and obtained by said multi-lingual file server, each of said metadata files describing said data file in a different file system included in said network.

9. The method of claim 8, wherein said receiving and said transferring a data file are performed using remote procedure calls.

10. The method of claim 8, wherein said plurality of metadata files are represented in a single parameter included as an output parameter from said single remote procedure calls executed by said multi-lingual file server.

11. The method of claim 8, further including:

storing said plurality of metadata files in a catalogue.

12. The method of claim 11, wherein said catalogue is located on a computer system issuing said request.

13. The method of claim 11, wherein said catalogue is located on another computer system other than a computer system issuing said request.

14. The method of claim 8 further including:

storing said data file on a backup storage device, and storing a portion of said one or more metadata files in a catalogue.

15. The method of claim 14 further including:

storing said plurality of metadata files on said backup storage device with said data file.

16. The method of claim 8, further including:

determining if said data file has been modified since commencing backup of said data file;

if said data file has been modified since commencing backup, performing said transferring said data file again; and

wherein said plurality of metadata files are not transferred until it has been determined that said data file has not been modified since commencing backup of said data file.

17. The method of claim 16, further including:

deallocating memory used as parameters for transferring said plurality of metadata files.

18. The method of claim 16, wherein said file server determines if said data file has been modified by comparing a first portion of said plurality of metadata files prior to commencing backup with a second portion of said plurality of metadata files after said data file has been transferred to said backup server.

19. The method of claim 18, wherein said data file is included in a directory being backed up.

20. The method of claim 19, wherein said data file is part of an incremental backup procedure.

21. The method of claim 19, wherein said data file is part of a full backup procedure.

22. The method of claim 18, wherein said data file is included in a file system being backed up.

23. The method of claim 8, wherein said metadata files are transferred using a network connection between said storage area and said multi-lingual file server supplying the metadata files and said data file is transferred using a different connection that may be characterized as a higher-speed connection than said network connection.

24. The method of claim 8, wherein said data file is remotely transferred from said multi-lingual file server to said client using a second connection that is a direct connection between said storage area and a backup server requesting the data file.

25. A method executed in a computer system for performing a data restoration operation in a network comprising:

receiving a request by a backup server for restoration of a data file from a backup storage area;

transferring said data file to said target location, said target location being at a network location different from said backup storage area; and

transferring a plurality of metadata files associated with said data file from said backup storage area in a single message using remote procedure calls to said target location, each of said plurality of metadata files describing said data file in accordance with a different file system and being previously sent to said backup server from a multi-lingual file server, said data file being included in a multi-lingual file system, wherein said multi-lingual file server accesses files formatted for access by different operating systems.

26. The method of claim 25 further including:

browsing a catalogue included on said backup server for selecting said data file for restoration.

27. The method of claim 25, wherein said request is issued by a first computer system and said target location is a second computer system in which said first and second computer systems are different nodes in said network.

28. The method of claim 25, wherein said request is issued by a first computer system and said target location is a second computer system in which said first and second computer systems are located at a same node in said network.

29. The method of claim 25, wherein said plurality of metadata files are represented as an output parameter included in a remote procedure call.

30. The method of claim 29, further including:

performing memory deallocation of said output parameter.

31. The method of claim 25, wherein said metadata files are transferred using a network connection between a backup server computer system and said multi-lingual file server controlling file access to a mass storage area accessed by multiple nodes included in the network and said data file is transferred using a different connection that may be characterized as a higher-speed connection than said network connection.

32. The method of claim 31, wherein said data file is remotely transferred from said backup server to said multi-lingual file server using a second connection that is a direct connection between a mass storage area accessed by multiple nodes included in the network and said backup server restoring said data file, said multi-lingual file server controlling file access to said mass storage area.

33. The method of claim 25, wherein said plurality of metadata files includes a first metadata file and a second metadata file, said first metadata file including attributes describing said data file in a first file system used by a first node in said network and said second metadata file including attributes describing said data file in a second file system used by a second node in said network.

34. A system for providing a plurality of metadata files associated with a data file in a network comprising:

machine executable code for issuing a request by a client for said data file and said plurality of metadata files from a file storage area;

machine executable code for obtaining, by a multi-lingual file server, each of said plurality of metadata files describing said data file in accordance with a different file system in a multi-lingual file system, wherein said multi-lingual file server accesses files formatted for access by different operating systems; and

machine executable code for providing to said client, in response to said request, in a single response each of said plurality of metadata files;

and wherein said machine executable code for issuing, obtaining and providing utilize remote procedure calls between said client and said multi-lingual file server.

35. The system of claim 34, wherein said metadata files are transferred using a network connection between said file storage area and said multi-lingual file server supplying the metadata files and said data file is transferred using a different connection that may be characterized as a higher-speed connection than said network connection.

36. The system of claim 35, wherein said data file is remotely transferred from said multi-lingual file server to said client using a second connection that is a direct connection between said file storage area and a requester requesting the data file.

37. The system of claim 36, wherein said metadata files include a first metadata file and a second metadata file, said first metadata file including attributes describing said data file in a first file system used by a first node in said network and said second metadata file including attributes describing said data file in a second file system used by a second node in said network.

38. The system of claim 37, further including:

machine executable code for storing said plurality of metadata files in a catalogue on a client node in said network which issued said request.

39. The system of claim 37, wherein said plurality of metadata files and said data file are transferred to a target node in said network different from a client node in said network which issued said request.

40. A system for performing a data backup operation in a network comprising:

machine executable code for receiving a request at a backup server to backup data from a storage area;

machine executable code for transferring, in response to said request, a data file included in a multi-lingual file system to said backup server from a multi-lingual file server, wherein said multi-lingual file server accesses files formatted for access by different operating systems; and

machine executable code for transferring to said backup server, using a single remote procedure call, a plurality of metadata files corresponding to said data file and obtained by said multi-lingual file server, each of said metadata files describing said data file in a different file system included in said network.

41. The system of claim 40, wherein said machine executable code for receiving and machine executable code for transferring a data file utilize remote procedure calls.

42. The system of claim 40, wherein said plurality of metadata file are represented in a single parameter included as an output parameter from said single remote procedure call executed by said multi-lingual file server.

43. The system of claim 40, further including:

machine executable code for storing said plurality of metadata files in a catalogue.

44. The system of claim 43, wherein said catalogue is located on a computer system issuing said request.

45. The system of claim 43, wherein said catalogue is located on another computer system other than a computer system issuing said request.

46. The system of claim 40 further including:

machine executable code for storing said data file on a backup storage device; and

machine executable code for storing a portion of said plurality of metadata files in a catalogue.

47. The system of claim 46 further including:

machine executable code for storing said plurality of metadata files on said backup storage device with said data file.

48. The system of claim 40, further including:

machine executable code for determining if said data file has been modified since commencing backup of said data file;

machine executable code for performing said transferring said data file again if said data file has been modified since commencing backup; and

wherein said plurality of metadata files are not transferred until it has been determined that said data file has not been modified since commencing backup of said data file.

49. The system of claim 48, further including:

machine executable code for deallocating memory used as parameters for transferring said plurality of metadata files.

50. The system of claim 48, wherein said file server includes said machine executable code for determining if said data file has been modified by comparing a first portion of said plurality of metadata files prior to commencing backup with a second portion of said plurality of metadata files after said data file has been transferred to said backup server.

51. The system of claim 50, wherein said data file is included in a directory being backed up.

52. The system of claim 51, wherein said data file is part of an incremental backup procedure.

53. The system of claim 51, wherein said data file is part of a full backup procedure.

54. The system of claim 50, wherein said data file is included in a file system being backed up.

55. The system of claim 40, wherein said metadata files are transferred using a network connection between said storage area and said multi-lingual file server supplying the metadata files and said data file is transferred using a different connection that may be characterized as a higher-speed connection than said network connection.

56. The system of claim 55, wherein said data file is remotely transferred from said multi-lingual file server to said client using a second connection that is a direct connection between said storage area and a backup server requesting the data file.

57. A system for performing a data restoration operation in a network comprising:

machine executable code for receiving a request by a backup server for restoration of a data file from a backup storage area;

machine executable code for transferring said data file to a target location, said target location being at a network location different from said backup storage area; and

machine executable code for transferring a plurality of metadata files associated with said data file from said backup storage area in a single message using remote procedure calls to said target location, each of said metadata files describing said data file in accordance with a different file system and being previously sent to said backup server from a multi-lingual file server, said data file being included in a multi-lingual file system, wherein said multi-lingual file server accesses files formatted for access by different operating systems.

58. The system of claim 57 further including:

machine executable code for browsing a catalogue included on said backup server for selecting said data file for restoration.

59. The system of claim 57, wherein said request is issued by a first computer system and said target location is a second computer system in which said first and second computer systems are different nodes in said network.

60. The system of claim 57, wherein said request is issued by a first computer system and said target location is a second computer system in which said first and second computer systems are located at a same node in said network.

61. The system of claim 57, wherein said plurality of metadata files are represented as a parameter included in a remote procedure call.

62. The system of claim 61, further including:

machine executable code for performing memory deallocation of said parameter.

63. The system of claim 57, wherein said metadata files are transferred using a network connection between a backup server computer system and said multi-lingual file server controlling file access to a mass storage area accessed by multiple nodes and said data file is transferred using a different connection that may be characterized as a higher-speed connection than said network connection.

64. The system of claim 63, wherein said data file is remotely transferred from said backup server to said multi-lingual file server using a second connection that is a direct connection between a mass storage area accessed by multiple nodes included in the network and said backup server restoring said data file, said multi-lingual file server controlling file access to said mass storage area.

65. The system of claim 57, wherein said plurality of metadata files includes a first metadata file and a second metadata file, said first metadata file including attributes describing said data file in a first file system used by a first node in said network and said second metadata file including attributes describing said data file in a second file system used by a second node in said network.

66. A system for performing a remote backup operation in a network comprising:

at least two computer systems included in said network, each of said computer systems having a different file system;

a backup computer system for performing backup data operations and having a backup storage device;

a backup agent included in said backup computer system for controlling data backup operations and issuing remote procedure call requests to obtain a data file included in a multi-lingual file system to be backed up to said backup storage device;

a file server system that includes the multi-lingual file system for providing data associated with a data file to be backed up to said backup computer system, wherein said file server system includes a multi-lingual file server that accesses files formatted for access by different operating systems;

a metadata service included in said file server system for responding using remote procedure calls to requests from said backup agent for metadata associated with the data file, said metadata service providing at least two metadata files for the data file being backed up as a parameter included in a first of said remote procedure calls, each of said two metadata files including file attributes corresponding to a different file system used by one of said at least two computer systems; and

a network connection between said backup agent and said metadata service for transmitting said at least two metadata files.

67. The system of claim 66 further comprising:

a catalogue storage device that includes a portion of said two metadata files.

68. The system of claim 66 further comprising:

a direct connection between said backup computer system and a storage area network in which said data file and said at least two metadata files are included in said storage area network.

69. The system of claim 66, wherein said direct connection is a fibre channel connection.

70. The system of claim 66, wherein said direct connection is a small computer system interface (SCSI) connection.

71. A system for performing a remote data restoration operation in a network comprising:

at least two computer systems included in said network, each of said computer systems having a different file system;

a backup computer system for performing data restoration operations and having a backup storage device;

a restore agent included in said backup computer system for controlling data restoration operations and issuing remote procedure calls to transmit a data file included in a multi-lingual file system to be restored to a target location, said restore agent providing at least two metadata files for said data file being restored as a parameter included in a first of said remote procedure calls, each of said two metadata files including file attributes corresponding to a different file system used by one of said at least two computer systems;

a multilingual file server that accesses said data file formatted for access by different operating systems;

a metadata service included in said target location for interfacing with said restore agent to receive data transmitted from said restore agent; and

a network connection between said restore agent and said metadata service for transmitting said at least two metadata files.

72. The system of claim 71 further comprising:

a catalogue storage device included in said backup computer system that includes a portion of said two metadata files and may be viewed in selecting data files to be restored from said backup storage device.

73. The system of claim 71 further comprising:

a direct connection between said backup computer system and said target location that is used for transmitting said data file to said target location from said backup computer system.

74. The system of claim 73, wherein said direct connection is a fibre channel connection.

75. The system of claim 73, wherein said direct connection is a small computer system interface (SCSI) connection.