Systems and methods for arbitrary data transformations

• US 20060277153A1
• Filed: 06/03/2005
• Published: 12/07/2006
• Est. Priority Date: 06/03/2005
• Status: Active Grant

• Current Assignee: Open Invention Network LLC
• Original Assignee: OSR Open Systems Resources, Inc.
• Inventors: Cariddi, Mark J., Viscarola, Peter G., Noone, Scott J., Mason, W. Anthony
• Granted Patent: US 8,521,752 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/258 Data format conversion from or to a database

Abstract

Methods for organizing data. The methods may comprise the step of receiving a write request comprising a data unit. The methods may also comprise the steps of organizing the data unit into a sub-file and incorporating the sub-file into a data file according to a log-structured organization system. In addition, the methods may include the step of writing the data file to a data storage according to a second organization system.

Claims

1. A method for organizing data, the method comprising:

receiving a write request comprising a data unit;

organizing the data unit into a sub-file;

incorporating the sub-file into a data file according to a log-structured organization system; and

writing the data file to a data storage according to a second organization system.

2. The method of claim 1, further comprising performing a data transformation on the data unit, wherein the data transformation changes a size of the data unit.

3. The method of claim 2, wherein the data transformation is at least one of compression, encryption, translation from a first language to a second language, transformation from a first data format to a second data format, and translation from one encoding to a different encoding.

4. The method of claim 1, further comprising transferring the data file from a first computer device to a second computer device;

and the second computer device performing a data transformation on at least one data unit included in the data file.

5. The method of claim 1, further comprising maintaining a previous version of the data unit.

6. The method of claim 1, wherein the second organization system is at least one of File Allocation Table 16 (FAT16), File Allocation Table 32 (FAT32), NTFS, High Performance File System (HPFS), UNIX file system (UFS), XFS, journaled file system (JFS), Universal Data Format File System (UDFS), CD-ROM File System (CDFS), Enhanced File System (EFS), SGI XFS, Clustered XFS (CXFS), HFS, VxFS, Raw File System (RawFS), and Local File System (DCE/LFS).

7. The method of claim 1, further comprising:

receiving a read request identifying the data unit;

reading the data file from the data storage;

extracting the sub-file from the data file.

8. The method of claim 7, further comprising decrypting the data unit.

9. The method of claim 7, further comprising decompressing the data unit.

10. The method of claim 1, wherein the write request comprises a second data unit and wherein the data unit and the second data unit are organized into the sub-file.

11. The method of claim 10, wherein the second data unit includes at least one of an encryption header, a thumbnail image, a checksum, and information indexing the data unit.

12. A system for organizing data, the system comprising:

an application;

a data storage;

a data transformation module configured to;

receive a write request from the application wherein the write request comprises a data unit;

organize the data unit into a sub-file;

incorporate the sub-file into a data file according to a log-structured organization system; and

forward the data file to the data storage.

13. The system of claim 12, wherein the data transformation module is further configured to perform a data transformation on the data unit, wherein the data transformation changes a size of the data unit.

14. The system of claim 12, wherein the data transformation is at least one of compression, encryption, translation from a first language to a second language, transformation from a first data format to a second data format, and transformation from a first encoding to a second encoding.

15. The system of claim 12, wherein the data transformation module is further configured to maintain a previous version of the data unit.

16. The system of claim 12, wherein the data storage is organized according to at least one of File Allocation Table 16 (FAT16), File Allocation Table 32 (FAT32), NTFS, High Performance File System (HPFS), UNIX file system (UFS), XFS, journaled file system (JFS), Universal Data Format File System (UDFS), CD-ROM File System (CDFS), Enhanced File System (EFS), SGI XFS, Clustered XFS (CXFS), HFS, VxFS, Raw File System (RawFS), and Local File System (DCE/LFS).

17. The system of claim 12, wherein the write request comprises a second data unit and wherein the data unit and the second data unit are organized into the sub-file.

18. The system of claim 17, wherein the second data unit includes at least one of an encryption header, a thumbnail image, and a checksum.

19. A computer-readable medium comprising instructions for causing a computer to execute a method for organizing data, the medium comprising instructions for:

receiving a write request comprising a data unit;

organizing the data unit into a sub-file;

incorporating the sub-file into a data file according to a log-structured organization system; and

writing the file to a data storage according to the second organization system.

20. The medium of claim 19, further comprising instructions for performing a data transformation on the data unit, wherein the data transformation changes a size of the data unit.

21. The medium of claim 19, wherein the data transformation is at least one of compression, encryption, translation from a first language to a second language, and transformation from a first data format to a second data format.