File system for distributing content in a data network and related methods

• US 6,711,572 B2
• Filed: 01/10/2001
• Issued: 03/23/2004
• Est. Priority Date: 06/14/2000
• Status: Expired due to Term

• Current Assignee: Computer Associates Think Inc. (Broadcom, Inc.)
• Original Assignee: XOsoft Inc. (Broadcom, Inc.)
• Inventors: Kogan, Leonid, Barboy, Dmitri, Zakharov, Michael, Siitilman, Leonid, Usvyatsky, Ilya
• Primary Examiner(s): KINDRED, ALFORD W
• Application Number:
  US09/757,975
• Publication Number:
  US 20020059245A1
• Time in Patent Office: 1,168 Days
• Field of Search: 707/1, 707/100, 707/10, 707/203, 707/205, 707/511, 709/200-201, 709/220, 709/224, 717/170
• US Class Current: 707/655
• CPC Class Codes: G06F 16/1734 Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
• CPC Class Codes: G06F 16/184 implemented as replicated file system
• CPC Class Codes: G06F 16/1873 Versioning file systems, temporal file systems, e.g. file system supporting different historic versions of files
• CPC Class Codes: Y10S 707/959 Network
• CPC Class Codes: Y10S 707/99953 Recoverability

Abstract

A file system for distributing content in a data network, includes a file replication and transfer system and a replicated file receiver system. The file replication and transfer system includes an interface file system which looks for changes made to contents of a file created and stored in an associated work file system; and a file system monitor communicatively associated with the interface filing system for monitoring events occurring with the interface file system and causing copies of the new files to be transferred over the data network to the replicated file receiver system. The interface file system also looks for changes made to the contents of files already stored in the work file system and creates an update file in a mirror file system if a change to the contents of a file stored in the work file system is observed by the interface file system. A collector file system communicatively associated with the mirror file system is provided for temporarily storing a copy of the update file. The replicated file receiver system includes a file construction system for constructing a new version of the file from a copy of the file and the update file; a receiver collector file system for storing the new version of the file; and a receiver interface file system for enabling work to be conducted with an old copy of the file if an open request for the file has been made prior to the construction of the new version of the file, and for enabling work to be conducted with the new version of the file if an open request for the file has been made after the notification that the new version of the file has been constructed.

Claims

1. A method for distributing content in a data network, the method comprising the steps of:

receiving a request for a file stored in a work file system;

in response to the request, generating a system call to process the file request;

creating an update file;

monitoring the contents of the file stored in the work file system to track changes made to the contents;

recording changes made to the contents of the file in the update file;

generating a notification for each one of the changes made to the contents of the file stored in the work file system, the notification indicating that the update file reflects all the changes of a version of the file; and

at a predetermined time, distributing the update file over the data network to a receiver work file system.

2. The method according to claim 1, wherein the receiver work file system stores a copy of the file without the changes.

3. The method according to claim 1, wherein the update file is created in a mirror file system.

4. The method according to claim 3, wherein prior to the distributing step and in response to the generating step, further comprising the step of copying the update file from the mirror file system to a collector file system.

5. The method according to claim 1, wherein prior to the distributing step, further comprising the step of copying the update file to a spool directory.

6. The method according to claim 1, wherein prior to the distributing step, further comprising the step of compressing the update file.

7. The method according to claim 1, wherein prior to the distributing step, further comprising the step of generating a map of the update file and appending the map to the update file.

8. The method according to claim 2, further comprising the step of incorporating the changes provided by the update file into the copy of the file stored in the receiver work file system.

9. The method according to claim 8, wherein the incorporating step includes the step of constructing a new version of the file from the copy of the file and the update file.

10. The method according to claim 9, further comprising the step of working with the copy of the file if an open request for the copy of the file stored in the receiver work file system has been made prior to the construction of the new version of the file.

11. The method according to claim 9, further comprising the step of working with the new version of the file if an open request for the copy of the file stored in the receiver work file system has been made after the construction of the new version of the file.

12. The method according to claim 9, further comprising the steps of working with the copy of the file if an open request for the copy of the file stored in the receiver work file system has been made prior to the construction of the new version of the file;

and

working with the new version of the file if an open request for the copy of the file stored in the receiver work file system has been made after the construction of the new version of the file.

13. The method according to claim 9, wherein the incorporating step further includes storing the new version of the file in a receiver collector file system.

14. The method according to claim 1, wherein the monitoring and creating steps are performed in a kernel mode.

15. The method according to claim 1, wherein the notification generating step is performed by a interface file system.

16. The method according to claim 15, wherein the interface file system is mounted on the work file system.

17. The method according to claim 9, further comprising the step of generating a notification that the new version of the file has been constructed.

18. The method according to claim 17, wherein the steps of constructing a new version of the file and generating a notification that the new version of the file has been constructed is performed by a file construction system.

19. The method according to claim 18, further comprising the step of providing a receiver interface file system, which prior to the step of generating a notification that the new version of the file has been constructed, enables work to be conducted with the copy of the file if an open request for the copy of the file has been made prior to the construction of the new version of the file.

20. The method according to claim 19, wherein the receiver interface file system is mounted on the receiver work file system.

21. The method according to claim 18, further comprising the step of providing a receiver interface file system, which in response to the step of generating a notification that the new version of the file has been constructed, enables work to be conducted with the new version of the file if an open request for the copy of the file has been made after the notification that the new version of the file has been constructed.

22. The method according to claim 21, wherein the receiver interface file system is mounted on the receiver work file system.

23. The method according to claim 18, further comprising the step of providing a receiver interface file system, which prior to the step of generating a notification that the new version of the file has been constructed, enables work to be conducted with the copy of the file if an open request for the copy of the file has been made prior to the construction of the new version of the file, and which in response to the step of generating a notification that the new version of the file has been constructed, enables work to be conducted with the new version of the file if an open request for the copy of the file has been made after the notification that the new version of the file has been constructed.

24. The method according to claim 23, wherein the receiver interface file system is mounted on the receiver work file system.

25. A method for distributing content in a data network, the method comprising the steps of:

monitoring a work file system to determine if a file is created and stored in a work file system;

receiving a request to create a file in the work file system;

in response to the request, generating a system call to create the file;

creating and storing the file in the work file system;

generating a notification that the file has been created and stored in the work file system;

at a predetermined time, distributing a copy of the file over the data network to a receiver work file system;

monitoring the contents of the file to track changes made to the contents; and

at another predetermined time, distributing a cony of the file over the data network to the receiver work file system if a change to the contents of the file has been observed.

26. A file system for distributing content in a data network, the system comprising:

an interface file system for looking for changes made to contents of files already stored in the work file system;

a mirror file system communicatively associated with the interface file system, the mirror file system creates an update file when a request for a file stored in the work file system is made to record changes to the contents of a file stored in the work file system observed by the interface file system;

a file system monitor communicatively associated with the interface file system, that monitors events occurring with the interface file system and causes copies of the update file to be transferred over the data network at a predetermined time so that incremental changes to files can be transferred over the data network.

27. The file system according to claim 26, further comprising a collector file system communicatively associated with the mirror file system for temporarily storing a copy of the update file.

28. The file system according to claim 27, wherein the file system monitor causes the update file to be copied from the mirror file system to the collector file system prior to its transfer over the data network to the replicated file receiver system.

29. The file system according to claim 26, wherein the file system monitor includes a spool directory for temporarily storing copies of new files created in the work file system and update files created in the mirror file system that are waiting to be transferred.

30. The file system according to claim 26, wherein the file system monitor includes a spool directory for temporarily storing copies of new files created in the work file system that are waiting to be transferred.

31. The file system according to claim 26, wherein the replicated file receiver system includes a file construction system for constructing a new version of the file from a copy of the file and the update file.

32. The file system according to claim 31, wherein the replicated file receiver system further includes a receiver collector file system for storing the new version of the file.

33. The file system according to claim 31, wherein the replicated file receiver system further includes a receiver interface file system for enabling work to be conducted with the copy of the file if an open request for the copy of the file has been made prior to the construction of the new version of the file, and for enabling work to be conducted with the new version of the file if an open request for the copy of the file has been made after the notification that the new version of the file has been constructed.

34. The file system according to claim 33, wherein the receiver interface file system is mounted on the receiver work file system.

35. A file replication and transfer system for distributing content in a data network, the system comprising:

an interface file system for looking for new files created and stored in an associated work file system that generates a notification that a file has been created and stored in the work file system; and

a file system monitor communicatively associated with the interface filing system, for monitoring events occurring with the interface file system, and causing copies of the new files to be transferred over the data network at predetermined times after receiving a notification that the file has been created, monitoring the contents of the new files to track changes made to the contents of the new files, and, at another predetermined time, distributing a cony of one or more of the new files over the data network if changes to the contents of the one or more of the new files have been observed.

36. The file replication and transfer system according to claim 35, Wherein the file system monitor includes a spool directory for storing copies of new files created in the work file system that are waiting to be transferred.

37. A replicated file receiver system for distributing content in a data network, the system comprising:

a file construction system for receiving copies of new files, and update files transmitted thereto over the data network, each update file carrying information relating to changes to the contents of a file stored on an associated receiver work file system, the file construction system constructing a new version of the file stored on the associated work file system from the file stored on the associated work file system and the update file;

a receiver collector file system for storing the new version of the file; and

a receiver interface file system for enabling work to be conducted with the copy of the file if an open request for the copy of the file has been made prior to the construction of the new version of the file, and for enabling work to be conducted with the new version of the file if an open request for the copy of the file has been made after notification that the new version of the file has been constructed.

38. The replicated file receiver system according to claim 37, wherein the receiver interface file system is mounted on the receiver work file system.

39. A computer readable medium comprising a computer program for distributing content in a data network, by performing the steps of:

receiving a request for a file stored in a work file system;

in response to the request, generating a system call to process the file request;

creating an update file;

monitoring the contents of the file stored in the work file system to track changes made to the contents;

recording changes made to the contents of the file in the update file;

generating a notification for each one of the changes made to the contents of the file stored in the work file system, the notification indicating that the update file reflects all the changes of a version of the file; and

at a predetermined time, distributing the update file over the data network to a receiver work file system.

40. A computer readable medium comprising a computer program for distributing content in a data network, by performing the steps of:

monitoring a work file system to determine if a file is created and stored in a work file system;

receiving a request to create a file in the work file system;

in response to the receipt of the request, generating a system call to create the file;

creating and storing the file in the work file system;

generating a notification that the file has been created and stored in the work file system;

at a predetermined time, distributing a copy of the file over the data network to a receiver work file system;

monitoring the contents of the file to track changes made to the contents; and

at another predetermined time, distributing a copy of the file over the data network to the receiver work file system if a change to the contents of the file has been observed.