Method and apparatus for secure and fault tolerant data storage

• US 20020046359A1
• Filed: 03/16/2001
• Published: 04/18/2002
• Est. Priority Date: 03/16/2000
• Status: Abandoned Application

• Current Assignee: Scott T. Boden
• Original Assignee: Scott T. Boden
• Inventors: Boden, Scott T.
• Application Number:
  US09/810,004
• Publication Number:
  US 20020046359A1
• Time in Patent Office: Days
• US Class Current: 714/6
• CPC Class Codes: G06F 12/1408 by using cryptography for digital transmission H04L9/00
• CPC Class Codes: G06F 21/6218 to a system of files or objects, e.g. local or distributed file system or database
• CPC Class Codes: G06F 21/78 to assure secure storage of data address-based protection against unauthorised use of memory G06F12/14; record carriers for use with machines and with at least a part designed to carry digital markings G06K19/00
• CPC Class Codes: G11B 20/1866 by interleaving G11B20/1809 takes precedence
• CPC Class Codes: G11B 2220/20 Disc-shaped record carriers
• CPC Class Codes: G11B 2220/2545 CDs
• CPC Class Codes: G11B 27/329 on a disc [VTOC]

Abstract

A computer system including software manipulates data prior to storage on media disposed within a system storage device. The data is initially stored sequentially within a first array, while a pseudo-random number sequence is generated in accordance with a seed value to identify storage locations for associated data bits within a second array. The second array is stored sequentially on the media to randomly distribute the data across that media. In order to retrieve the data in original form, the entire contents of the media are retrieved and stored in a third array. The sequence is reproduced in accordance with the seed value, while data bits are retrieved in the order of the sequence and stored in temporary storage to recover the data. The seed value may further serve as a password to maintain the data in a secure fashion.

Claims

1. A system for distributing data across storage media in a manner to facilitate fault tolerant data storage, said system comprising:

a storage unit to store data on storage media received within said storage unit, wherein said storage media has a memory space encompassing a storage capacity of said storage media; and

a processor to manipulate and facilitate storage of said data across said storage media in a manner to provide fault tolerant storage of said data with respect to defects arising within said storage media, said processor including;

a data retrieval module to selectively retrieve data for storage on said storage media, wherein said data includes a plurality of data portions;

a data distribution module to distribute said data portions within said memory space in a pseudo-random fashion; and

a storage module to facilitate storage of said distributed data on said storage media via said storage unit to produce a pseudo-random distribution of said data across said storage media.

2. The system of claim 1 wherein said data distribution module includes:

a sequence generation module to generate a sequence of random numbers, wherein said random numbers are selectively associated with corresponding data portions, and wherein each associated random number has a value within a range of said memory space and identifies a location within that space to store said corresponding data portion; and

a data arrangement module to store each said data portion within said memory space location identified by said associated random number.

3. The system of claim 2 wherein said sequence generation module produces said sequence in accordance with a seed value.

4. The system of claim 3 wherein said data distribution module further includes:

a user module to prompt a user to enter said seed value and to retrieve said seed value entered by said user;

wherein said sequence generation module includes;

a seed module to produce said sequence in accordance with said entered seed value in response to said user entering that value; and

a default seed module to retrieve a default seed value and to produce said sequence in accordance with said default seed value in response to said user failing to enter said seed value.

5. The system of claim 1 wherein said data distribution module further includes:

a data load module to store said data portions sequentially in a first storage space; and

a data transfer module to retrieve data portions sequentially from said first storage space and to store those data portions in said pseudo-random fashion within a second storage space having a storage capacity of said storage media;

wherein said storage module includes;

a write module to facilitate sequential storage of said distributed data portions from said second storage space to said storage media, thereby distributing said data across said storage media in said pseudo-random fashion.

6. The system of claim 3 wherein said processor farther includes:

a data recovery module to retrieve data portions from said storage media and arrange said data portions in a manner to produce said data in original form.

7. The system of claim 6 wherein said data recovery module includes:

a sequence reproduction module to reproduce said sequence of random numbers utilized for said pseudo-random data distribution, wherein said random numbers are selectively associated with locations within said memory space, and wherein each associated random number identifies a location within said memory space to retrieve a corresponding data portion; and

a data organization module to retrieve each data portion from said memory space location identified by said associated random number, wherein said data portions are retrieved in order of said sequence to arrange said data in original form.

8. The system of claim 7 wherein said data recovery module further includes:

a user module to prompt a user to enter said seed value utilized for said pseudo-random distribution and to retrieve said seed value entered by said user;

wherein said sequence reproduction module includes;

a seed module to reproduce said sequence in accordance with said entered seed value in response to said user entering that value; and

a default seed module to retrieve a default seed value and to reproduce said sequence in accordance with said default seed value in response to said user failing to enter said seed value.

9. The system of claim 6 wherein said data recovery module further includes:

a data load module to retrieve data portions sequentially from said storage media and to store those data portions sequentially in a first storage space; and

a restoration module to retrieve data portions in the order of and from locations within said first storage space identified by said random number sequence to produce said data in original form and to sequentially store said ordered data portions in a temporary storage area.

10. The system of claim 9 wherein said data recovery module further includes:

a data selection module to facilitate selection of said restored data by said user; and

a data transfer module to retrieve said selected data from said temporary storage area and to store said selected data at a user specified location.

11. The system of claim 1 wherein said data distribution module includes:

a partition module to selectively partition said memory space into data blocks and to selectively partition said data into data sections, wherein each data section is associated with a corresponding data block; and

a block distribution module to distribute data portions of each data section in said pseudo-random fashion within an associated data block;

wherein said storage module includes;

a block storage module to facilitate sequential storage of each said data block onto said storage media.

12. The system of claim 5 wherein said processor includes virtual memory and at least one of said first and second storage spaces is at least partially defined within said virtual memory.

13. The system of claim 1 wherein said processor further includes:

a copy module to facilitate storage of additional instances of said data onto said storage media in response to said storage media having available storage space;

a verification module to determine the value of a particular data portion within each said data instance;

a value module to determine the appropriate value for said data portion in accordance with said values retrieved from said data instances; and

an update module to correct said data portion with said determined value.

14. The system of claim 13 wherein said value module includes:

a consensus module to determine said appropriate value based on a data portion value appearing within a predetermined quantity of data instances.

15. The system of claim 13 wherein said value module includes:

a consensus module to determine said appropriate value in accordance with a data instance having a quantity of errors below an error threshold.

16. The system of claim 6 wherein said data recovery module includes:

a security module to enable said retrieval of said data in original form in response to a user entering an appropriate password.

18. The apparatus of claim 17 wherein said data distribution module includes:

a sequence generation module to generate a sequence of random numbers, wherein said random numbers are selectively associated with corresponding data portions, and wherein each associated random number has a value within a range of said memory space and identifies a location within that space to store said corresponding data portion; and

a data arrangement module to store each said data portion within said memory space location identified by said associated random number.

19. The apparatus of claim 18 further including:

a data recovery module to retrieve data portions from said storage media and arrange said data portions in a manner to produce said data in original form.

20. The apparatus of claim 19 wherein said data recovery module includes:

a sequence reproduction module to reproduce said sequence of random numbers utilized for said pseudo-random data distribution, wherein said random numbers are selectively associated with locations within said memory space, and wherein each associated random number identifies a location within said memory space to retrieve a corresponding data portion; and

a data organization module to retrieve each data portion from said memory space location identified by said associated random number, wherein said data portions are retrieved in order of said sequence to arrange said data in original form.

21. The apparatus of claim 17 wherein said data distribution module includes:

a partition module to selectively partition said memory space into data blocks and to selectively partition said data into data sections, wherein each data section is associated with a corresponding data block; and

a block distribution module to distribute data portions of each data section in said pseudo-random fashion within an associated data block;

wherein said storage module includes;

a block storage module to facilitate sequential storage of each said data block onto said storage media.

22. The apparatus of claim 17 further including:

a copy module to facilitate storage of additional instances of said data onto said storage media in response to said storage media having available storage space;

a verification module to determine the value of a particular data portion within each said data instance;

a value module to determine the appropriate value for said data portion in accordance with said values retrieved from said data instances; and

an update module to correct said data portion with said determined value.

23. The apparatus of claim 22 wherein said value module includes:

a consensus module to determine said appropriate value based on a data portion value appearing within a predetermined quantity of data instances.

24. The apparatus of claim 22 wherein said value module includes:

a consensus module to determine said appropriate value in accordance with a data instance having a quantity of errors below an error threshold.

25. The apparatus of claim 19 wherein said data recovery module includes:

a security module to enable said retrieval of said data in original form in response to a user entering an appropriate password.

27. The carrier signal of claim 26 wherein said data distribution module includes:

a sequence generation module to generate a sequence of random numbers, wherein said random numbers are selectively associated with corresponding data portions, and wherein each associated random number has a value within a range of said memory space and identifies a location within that space to store said corresponding data portion; and

a data arrangement module to store each said data portion within said memory space location identified by said associated random number.

28. The carrier signal of claim 27 further including:

a data recovery module to retrieve data portions from said storage media and arrange said data portions in a manner to produce said data in original form.

29. The carrier signal of claim 28 wherein said data recovery module includes:

a sequence reproduction module to reproduce said sequence of random numbers utilized for said pseudo-random data distribution, wherein said random numbers are selectively associated with locations within said memory space, and wherein each associated random number identifies a location within said memory space to retrieve a corresponding data portion; and

a data organization module to retrieve each data portion from said memory space location identified by said associated random number, wherein said data portions are retrieved in order of said sequence to arrange said data in original form.

30. The carrier signal of claim 26 wherein said data distribution module includes:

a partition module to selectively partition said memory space into data blocks and to selectively partition said data into data sections, wherein each data section is associated with a corresponding data block; and

a block distribution module to distribute data portions of each data section in said pseudo-random fashion within an associated data block;

wherein said storage module includes;

a block storage module to facilitate sequential storage of each said data block onto said storage media.

31. The carrier signal of claim 26 further including:

a copy module to facilitate storage of additional instances of said data onto said storage media in response to said storage media having available storage space;

a verification module to determine the value of a particular data portion within each said data instance;

a value module to determine the appropriate value for said data portion in accordance with said values retrieved from said data instances; and

an update module to correct said data portion with said determined value.

32. The carrier signal of claim 31 wherein said value module includes:

a consensus module to determine said appropriate value based on a data portion value appearing within a predetermined quantity of data instances.

33. The carrier signal of claim 31 wherein said value module includes:

a consensus module to determine said appropriate value in accordance with a data instance having a quantity of errors below an error threshold.

34. The carrier signal of claim 28 wherein said data recovery module includes:

a security module to enable said retrieval of said data in original form in response to a user entering an appropriate password.

36. The system of claim 35 wherein said data distribution means includes:

sequence generation means for generating a sequence of random numbers, wherein said random numbers are selectively associated with corresponding data portions, and wherein each associated random number has a value within a range of said memory space and identifies a location within that space to store said corresponding data portion; and

data arrangement means for storing each said data portion within said memory space location identified by said associated random number.

37. The system of claim 36 further including:

data recovery means for retrieving data portions from said storage media and arranging said data portions in a manner to produce said data in original form.

38. The system of claim 37 wherein said data recovery means includes:

sequence reproduction means for reproducing said sequence of random numbers utilized for said pseudo-random data distribution, wherein said random numbers are selectively associated with locations within said memory space, and wherein each associated random number identifies a location within said memory space to retrieve a corresponding data portion; and

data organization means for retrieving each data portion from said memory space location identified by said associated random number, wherein said data portions are retrieved in order of said sequence to arrange said data in original form.

39. The system of claim 35 wherein said data distribution means includes:

partition means for selectively partitioning said memory space into data blocks and for selectively partitioning said data into data sections, wherein each data section is associated with a corresponding data block; and

block distribution means for distributing data portions of each data section in said pseudo-random fashion within an associated data block;

wherein said storage means includes;

block storage means for storing each said data block sequentially onto said storage media.

40. The system of claim 35 further including:

copy means for storing additional instances of said data onto said storage media in response to said storage media having available storage space;

verification means for determining the value of a particular data portion within each said data instance;

value means for determining the appropriate value for said data portion in accordance with said values retrieved from said data instances; and

update means for correcting said data portion with said determined value.

41. The system of claim 40 wherein said value means includes:

consensus means for determining said appropriate value based on a data portion value appearing within a predetermined quantity of data instances.

42. The system of claim 40 wherein said value means includes:

consensus means for determining said appropriate value in accordance with a data instance having a quantity of errors below an error threshold.

43. The system of claim 37 wherein said data recovery means includes:

security means for enabling said retrieval of said data in original form in response to a user entering an appropriate password.

17. A program product apparatus having a computer readable medium with computer program logic recorded thereon for distributing data across storage media in a manner to facilitate fault tolerant data storage, wherein said storage media has a memory space encompassing a storage capacity of said storage media, said program product apparatus comprising:

a data retrieval module to selectively retrieve data for storage on said storage media, wherein said data includes a plurality of data portions;

a data distribution module to distribute said data portions within said memory space in a pseudo-random fashion; and

a storage module to facilitate storage of said distributed data on said storage media to produce a pseudo-random distribution of said data across said storage media.

26. A carrier signal having computer program logic embedded therein for distributing data across storage media in a manner to facilitate fault tolerant data storage, wherein said storage media has a memory space encompassing a storage capacity of said storage media, said carrier signal comprising:

a data retrieval module to selectively retrieve data for storage on said storage media, wherein said data includes a plurality of data portions;

a data distribution module to distribute said data portions within said memory space in a pseudo-random fashion; and

a storage module to facilitate storage of said distributed data on said storage media to produce a pseudo-random distribution of said data across said storage media.

35. A system for distributing data across storage media in a manner to facilitate fault tolerant data storage, wherein said storage media has a memory space encompassing a storage capacity of said storage media, said system comprising:

data retrieval means for selectively retrieving data for storage on said storage media, wherein said data includes a plurality of data portions;

data distribution means for distributing said data portions within said memory space in a pseudo-random fashion; and

storage means for storing said distributed data on said storage media to produce a pseudo-random distribution of said data across said storage media.

44. A method of distributing data across storage media in a manner to facilitate fault tolerant data storage, wherein said storage media has a memory space encompassing a storage capacity of said storage media, said method comprising the steps of:

(a) selectively retrieving data for storage on said storage media, wherein said data includes a plurality of data portions;

(b) distributing said data portions within said memory space in a pseudo-random fashion; and

(c) storing said distributed data on said storage media to produce a pseudo-random distribution of said data across said storage media.

45. The method of claim 44 wherein step (b) further includes:

(b.1) generating a sequence of random numbers, wherein said random numbers are selectively associated with corresponding data portions, and wherein each associated random number has a value within a range of said memory space and identifies a location within that space to store said corresponding data portion; and

(b.2) storing each said data portion within said memory space location identified by said associated random number.

46. The method of claim 45 wherein step (b.1) further includes:

(b.1.1) generating said sequence of random numbers in accordance with a seed value.

47. The method of claim 46 wherein step (b.1) further includes:

(b.1.1) prompting a user to enter said seed value and retrieving said seed value entered by said user;

(b.1.2) generating said sequence in accordance with said entered seed value in response to said user entering that value; and

(b.1.3) retrieving a default seed value and generating said sequence in accordance with said default seed value in response to said user failing to enter said seed value.

48. The method of claim 44 wherein step (b) further includes:

(b.1) storing said data portions sequentially in a first storage space; and

(b.2) retrieving data portions sequentially from said first storage space and storing those data portions in said pseudo-random fashion within a second storage space having a storage capacity of said storage media;

wherein step (c) further includes;

(c.1) storing said distributed data portions from said second storage space sequentially onto said storage media, thereby distributing said data across said storage media in said pseudo-random fashion.

49. The method of claim 46 further including:

(d) retrieving data portions from said storage media and arranging said data portions in a manner to produce said data in original form.

50. The method of claim 49 wherein step (d) further includes:

(d.1) reproducing said sequence of random numbers utilized for said pseudo-random data distribution, wherein said random numbers are selectively associated with locations within said memory space, and wherein each associated random number identifies a location within said memory space to retrieve a corresponding data portion; and

(d.2) retrieving each data portion from said memory space location identified by said associated random number, wherein said data portions are retrieved in order of said sequence to arrange said data in original form.

51. The method of claim 50 wherein step (d.1) further includes:

(d.1.1) prompting a user to enter said seed value utilized for said pseudo-random distribution and retrieving said seed value entered by said user;

(d.1.2) reproducing said sequence in accordance with said entered seed value in response to said user entering that value; and

(d.1.3) retrieving a default seed value and reproducing said sequence in accordance with said default seed value in response to said user failing to enter said seed value.

52. The method of claim 49 wherein step (d) further includes:

(d.1) retrieving data portions sequentially from said storage media and storing those data portions sequentially in a first storage space; and

(d.2) retrieving data portions in the order of and from locations within said first storage space identified by said random number sequence to produce said data in original form and sequentially storing said ordered data portions in a temporary storage area.

53. The method of claim 52 wherein step (d) further includes:

(d.3) facilitating selection of said restored data by said user; and

(d.4) retrieving said selected data from said temporary storage area and storing said selected data at a user specified location.

54. The method of claim 44 wherein step (b) further includes:

(b.1) selectively partitioning said memory space into data b locks and selectively partitioning said data into data sections, wherein each data section is associated with a corresponding data block; and

(b.2) distributing data portions of each data section in said pseudo-random fashion within an associated data block;

wherein step (c) further includes;

(c.1) storing each said data block sequentially onto said storage media.

55. The method of claim 48 wherein at least one of said first and second storage spaces is at least partially defined within virtual memory.

56. The method of claim 44 further including:

(d) storing additional instances of said data onto said storage media in response to said storage media having available storage space;

(e) determining the value of a particular data portion within each said data instance;

(f) determining the appropriate value for said data portion in accordance with said values retrieved from said data instances; and

(g) correcting said data portion with said determined value.

57. The method of claim 56 wherein step (f) further includes:

(f.1) determining said appropriate value based on a data portion value appearing within a predetermined quantity of data instances.

58. The method of claim 56 wherein step (f) further includes:

(f.1) determining said appropriate value in accordance with a data instance having a quantity of errors below an error threshold.

59. The method of claim 49 wherein step (d) further includes:

(d.1) enabling said retrieval of said data in original form in response to a user entering an appropriate password.