Data processing

• US 7,860,907 B2
• Filed: 06/29/2007
• Issued: 12/28/2010
• Est. Priority Date: 06/30/2006
• Status: Active Grant

• Current Assignee: Data Equation Limited
• Original Assignee: Data Equation Limited
• Inventors: Worrall, David Tom
• Primary Examiner(s): Wong; Don
• Assistant Examiner(s): Thai; Hanh B
• Application Number:
  US11/824,610
• Publication Number:
  US 20080005145A1
• Time in Patent Office: 1,278 Days
• Field of Search: 707/10, 707/200, 707821-822, 707827-831, 711/154, 386/95, 369/53.2
• US Class Current: 707/821
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 16/188 Virtual file systems

Abstract

Data streams are stored in a non-structured arrangement in which related data is defined by a reference in a first data stream identifying a data element in a second data stream. Instructions are received from a user to establish a virtual file system that provides a structure for a plurality of application files, wherein the information in each of the application files is contained in a plurality of data streams. The structure is defined by at least one hierarchical index, the nodes of said index being data streams. Instructions are received to write data to or read data from the virtual file system, and relevant data streams are modified to reflect instructed manipulations to data presented to a user via the virtual file system.

Claims

1. A method of storing data, comprising the steps of:

storing a plurality of data streams that are indexed by a first hierarchical index;

receiving instructions from a user to establish a virtual file system that defines a structure for a plurality of application files, each of which is either a virtual directory or a file, wherein;

the information in each of said application files is contained in at least one data stream,

the root directory of said virtual file system is defined by a first plurality of said data streams, said data streams forming a second hierarchical index,

at least one of said files is defined by a second plurality of said data streams, wherein said data streams form a tree-like structure in which each of a plurality of parent data streams references at least one child data stream,

said virtual file system is uniquely identified by the root node of said second hierarchical index, and

said first plurality of data streams and said second plurality of data streams are stored together;

receiving instructions to write data to or read data from said virtual file system; and

modifying relevant data streams to reflect instructed manipulations to data presented to a user via the virtual file system.

2. A method according to claim 1, wherein a first user defines a first virtual file system, a second user defines a second virtual file system and a shared pool of data streams are manipulated in response to modifications to either said first virtual file system or said second virtual file system.

3. A method according to claim 2, wherein a plurality of data streams are accessible from any of a plurality of networked terminals, and at any of said terminals any user has access to their respective virtual file system.

4. A method according to claim 1, wherein [said hierarchical index indexes the application files contained in the root directory according to said virtual file system, and] each further directory in said virtual file system is indexed by a further hierarchical index.

5. A method according to claim 4, wherein each of said application files has a filename and a file identification, and each hierarchical index references the file identification of each application file in the corresponding directory by its filename.

6. A method according to claim 5, wherein each a file object index is provided that indexes file objects that facilitate access of said application files.

7. A method according to claim 6, wherein said file object index is common to a plurality of virtual file systems.

8. A method according to claim 6, wherein said file object index references each file object by its file identification.

9. A method according to claim 6, wherein said file object index has a tree structure.

10. A method according to claim 6, wherein an application file may be a directory or a file, and a file object corresponding to a file includes a reference to the data streams that contain the data in said file.

11. A method according to claim 10, wherein said reference is to a single data stream.

12. A method according to claim 10, wherein a file object corresponding to a directory includes a reference to the root data stream of the hierarchical index that defines said directory.

13. A method according to claim 1, further comprising the steps of

identifying new data streams that relate to said virtual file system;

and

broadcasting said data streams over a network with an identification of said virtual file system; and

at a computer connected to said network, locally storing said broadcast data streams.

14. A computer-readable medium having computer-readable instructions executable by a computer such that when executing said instructions a computer will perform the steps of:

storing, a plurality of data streams that are indexed by a first hierarchical index;

receiving instructions from a user to establish a virtual file system that defines a structure for a plurality of application files, each of which is either a virtual directory or a file, wherein the information in each of said application files is contained in at least one data stream, wherein;

the root directory of said virtual file system is defined by a first plurality of said data streams, said data streams forming a second hierarchical index,

at least one of said files is defined by a second plurality of said data streams, wherein said data streams form a tree-like structure in which each of a plurality of parent data streams references at least one child data stream,

said virtual file system is uniquely identified by the root node of said second hierarchical index, and

said first plurality of data streams and said second plurality of data streams are stored together;

receiving instructions to write data to or read data from said virtual file system; and

modifying relevant data streams to reflect instructed manipulations to data presented to a user via the virtual file system.

15. A computer-readable medium according to claim 14, wherein a first user defines a first virtual file system, a second user defines a second virtual file system and a shared pool of data streams are manipulated in response to modifications to either said first virtual file system or said second virtual file system.

16. A computer-readable medium according to claim 15, wherein a plurality of data streams are accessible from any of a plurality of networked terminals, and at any of said terminals any user has access to their respective virtual file system.

17. A computer-readable medium according to claim 14, wherein each further directory in said virtual file system is indexed by a further hierarchical index, and each directory is uniquely identified by the root node of its hierarchical index.

18. A computer-readable medium according to claim 17, wherein each a file object index is provided that indexes file objects that facilitate access of said application files.

19. A computer-readable medium according to claim 18, wherein said file object index is common to a plurality of virtual file systems.

20. A computer-readable medium according to claim 14, further comprising the steps of:

identifying new data streams that relate to said virtual file system; and

broadcasting said data streams over a network with an identification of said virtual file system; and

at a computer connected to said network, locally storing said broadcast data streams.

21. Data storage apparatus, comprising a processing device and at least one storage device, wherein:

said at least one storage device is configured to store a plurality of data streams [in which related data is defined by a reference in a first data stream identifying a data element in a second data stream] that are indexed by a first hierarchical index; and

said processing device is configured to

receive instructions from a user to establish a virtual file system that defines a structure for a plurality of application files, each of which is either a virtual directory or a file, wherein the information in each of said application files is contained in at least one data stream, wherein;

the root directory of said virtual file system is defined by a first plurality of said data streams, said data streams forming a second hierarchical index,

at least one of said files is defined by a second plurality of said data streams, wherein said data streams form a tree-like structure in which each of a plurality of parent data streams references at least one child data stream,

said virtual file system is uniquely identified by the root node of said second hierarchical index, and

said first plurality of data streams and said second plurality of data streams are stored together;

receive instructions to write data to or read data from said virtual file system; and

modify relevant data streams to reflect instructed manipulations to data presented to a user via the virtual file system.

22. Apparatus according to claim 21, wherein a first user defines a first virtual file system, a second user defines a second virtual file system and said processing means is configured to manipulate a shared pool of data streams in response to modifications to either said first virtual file system or said second virtual file system.

23. Apparatus according to claim 21, wherein each further directory in said virtual file system is indexed by a further hierarchical index.

24. A method according to claim 23, wherein each of said application files has a filename and a file identification, and each hierarchical index references the file identification of each application file in the corresponding directory by its filename.

25. Apparatus according to claim 24, wherein said storage device further stores a file object index that indexes file objects that facilitate access of said application files.

26. Apparatus according to claim 25, wherein said file object index is common to a plurality of virtual file systems.

27. Apparatus according to claim 25, wherein said file object index references each file object by its file identification.

28. Apparatus according to claim 25, wherein an application tile may be a directory or a file, and a file object corresponding to a file includes a reference to the data streams that contain the data in said file.

29. Apparatus according to claim 28, wherein said reference is to a single data stream.

30. Apparatus according to claim 28, wherein a file object corresponding to a directory includes a reference to the root data stream of the, hierarchical index that defines said directory.