Systems and methods for arbitrary data transformations
First Claim
Patent Images
1. A method for organizing data in a system comprising a data storage device and a host device, wherein the host device is programmed to execute an application;
- an operating system, a first file system for logically and physically organizing a plurality of data files on the data storage device, and a data transformation module logically positioned between the operating system and the first file system, the method comprising;
the application sending to the operating system a first write request indicating a logical grouping of at least one data unit;
the data transformation module receiving the first write request from the operating system;
the data transformation module organizing the logical grouping of the at least one data unit into a sub-file;
the data transformation module organizing the sub-file into a data file of the first file system according to a log-structured file system, wherein the log structured file system manages a logical and a physical organization of the sub-file within the data file; and
the data transformation module transmitting a second write request to the first file system, the second write request requesting storage of the data file on the data storage device according to the first file system;
the data transformation module receiving a first read request identifying a second sub-file;
the data transformation module, in response to the first read request, identifying a second data file selected from the plurality of data files that comprises the second sub-file;
the data transformation directing a second read request to the first file system, wherein the second read request indicates the second data file;
the data transformation module receiving the second data file from the first file system in response to the second read request;
the data transformation module extracting the second sub-file from the second data file utilizing the log-structured file system; and
the data transformation module returning the second sub-file in response to the first read request.
3 Assignments
0 Petitions
Accused Products
Abstract
Methods for organizing data. The methods may comprise the step of receiving a write request comprising a data unit. The methods may also comprise the steps of organizing the data unit into a sub-file and incorporating the sub-file into a data file according to a log-structured organization system. In addition, the methods may include the step of writing the data file to a data storage according to a second organization system.
-
Citations
20 Claims
-
1. A method for organizing data in a system comprising a data storage device and a host device, wherein the host device is programmed to execute an application;
- an operating system, a first file system for logically and physically organizing a plurality of data files on the data storage device, and a data transformation module logically positioned between the operating system and the first file system, the method comprising;
the application sending to the operating system a first write request indicating a logical grouping of at least one data unit; the data transformation module receiving the first write request from the operating system; the data transformation module organizing the logical grouping of the at least one data unit into a sub-file; the data transformation module organizing the sub-file into a data file of the first file system according to a log-structured file system, wherein the log structured file system manages a logical and a physical organization of the sub-file within the data file; and the data transformation module transmitting a second write request to the first file system, the second write request requesting storage of the data file on the data storage device according to the first file system; the data transformation module receiving a first read request identifying a second sub-file; the data transformation module, in response to the first read request, identifying a second data file selected from the plurality of data files that comprises the second sub-file; the data transformation directing a second read request to the first file system, wherein the second read request indicates the second data file; the data transformation module receiving the second data file from the first file system in response to the second read request; the data transformation module extracting the second sub-file from the second data file utilizing the log-structured file system; and the data transformation module returning the second sub-file in response to the first read request. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
- an operating system, a first file system for logically and physically organizing a plurality of data files on the data storage device, and a data transformation module logically positioned between the operating system and the first file system, the method comprising;
-
10. A system for storing data, the system comprising:
-
a data storage device; a host device comprising at least one processor and associated memory, wherein the host device is in communication with the data storage device, and wherein the host device is programmed to execute; an application programmed to send a first write request indicating a logical grouping of at least one data unit; an operating system; a first file system for logically and physically organizing a plurality of data files on the data storage device; and a data transformation module logically positioned between the operating system and the first file system, wherein the data transformation module is programmed to implement within the first data file a log-structured file system for logically and physically organizing a plurality of sub-files within the first data file, and wherein the data transformation module is further programmed to; receive the first write request; organize the logical grouping of at least one data unit into a sub-file; organize the sub-file into a second data file of the first file system according to the log-structured file system, wherein the log-structured file system manages a logical and a physical organization of the sub-file within the second data file; transmit a second write request to the first file system for storage of the second data file on the data storage device according to the first file system; receive a first read request specifying a first sub-file selected from the plurality of sub-files; in response to the first read request, derive an indication of a first data file selected from the plurality of data files that comprises the first sub-file; direct a second read request to the first file system, wherein the second read request indicates the first data file; receive the first data file from the first file system in response to the second read request; extract the first sub-file from the first data file utilizing the log-structured file system; and return the first sub-file in response to the first read request. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18, 19, 20)
-
Specification