Heterogeneous file optimization

• US 10,216,759 B2
• Filed: 11/22/2010
• Issued: 02/26/2019
• Est. Priority Date: 11/22/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Kalach, Ran, Dickson, Mathew James
• Primary Examiner(s): Saeed, Usmaan
• Assistant Examiner(s): Kim, Paul
• Application Number:
  US12/951,760
• Publication Number:
  US 20120130958A1
• Time in Patent Office: 3,018 Days
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/188 Virtual file systems

Abstract

Techniques are described herein that are capable of heterogeneously optimizing a file. Heterogeneous optimization involves optimizing regions of a file non-uniformly. For example, the regions of the file may be optimized to different extents. In accordance with this example, a different optimization technique may be used to optimize each region or subset of the regions. In one aspect, optimization designations are assigned to respective regions of a file based on access patterns that are associated with the respective regions. The file may be a database file, a virtualized storage file, or other suitable type of file. Each optimization designation indicates an extent to which the respective region is to be optimized. Each region may be optimized to the extent that is indicated by the respective optimization designation that is assigned to that region.

Claims

1. A method comprising:

assigning a plurality of optimization designations to a plurality of respective regions of a file based on a plurality of access patterns that is associated with the plurality of respective regions, each optimization designation indicating an extent to which the respective region is to be optimized, at least one optimization designation of the plurality of optimization designations indicating the extent to which the respective region is to be optimized in accordance with at least one of a specified compression technique, which is selected from a plurality of compression techniques that are capable of compressing the respective region based on the access pattern that is associated with the respective region, or a specified data de-duplication technique, which is selected from a plurality of data de-duplication techniques that are capable of de-duplicating the respective region based on the access pattern that is associated with the respective region, each access pattern at least one of indicating or describing at least one of the following;

(a) one or more accesses to the respective region with which the respective access pattern is associated,

(b) one or more modifications to the respective region with which the respective access pattern is associated; and

optimizing, using at least one of (A) one or more processors or (B) hardware logic/electrical circuitry, each region to the extent that is indicated by the respective optimization designation that is assigned to that region.

2. The method of claim 1, wherein assigning the plurality of optimization designations comprises:

assigning the plurality of optimization designations to the plurality of respective regions of a virtualized storage file.

3. The method of claim 1, wherein assigning the plurality of optimization designations comprises:

assigning the plurality of optimization designations to the plurality of respective regions of a database file.

4. The method of claim 1, wherein assigning the plurality of optimization designations comprises:

assigning each optimization designation to the respective region further based on a latency that is associated with accessing that region.

5. The method of claim 1, wherein assigning the plurality of optimization designations comprises:

assigning each optimization designation to the respective region further based on an amount of system resources that is utilized to access that region.

6. The method of claim 1, wherein assigning the plurality of optimization designations comprises:

assigning each optimization designation to the respective region based on at least one of a number of times that the respective region is accessed or a number of times that the respective region is modified.

7. The method of claim 1, wherein assigning the plurality of optimization designations comprises:

assigning each optimization designation to the respective region based on at least one of a frequency with which the respective region is accessed or a frequency with which the respective region is modified.

8. The method of claim 1, wherein assigning the plurality of optimization designations comprises:

assigning each optimization designation to the respective region based on at least one of a time at which the respective region is most recently accessed or a time at which the respective region is most recently modified.

9. The method of claim 1, wherein assigning the plurality of optimization designations comprises:

assigning each optimization designation to the respective region based on whether the respective region is accessed in response to mounting an operating system that uses the respective region.

10. The method of claim 1, wherein assigning the plurality of optimization designations comprises:

assigning each optimization designation to the respective region based on whether the respective region is accessed by a specified application.

11. The method of claim 1, wherein optimizing each region comprises:

iteratively optimizing each region to the extent that is indicated by the respective optimization designation that is assigned to that region.

15. The method of claim 1, wherein the at least one optimization designation indicates the extent to which the respective region is to be optimized in accordance with the specified compression technique, which is selected from the plurality of compression techniques based on the access pattern that is associated with the respective region, in response to a determination that the respective region is to be compressed.

16. The method of claim 1, wherein the at least one optimization designation indicates the extent to which the respective region is to be optimized in accordance with the specified data de-duplication technique, which is selected from the plurality of data de-duplication techniques based on the access pattern that is associated with the respective region, in response to a determination that the respective region is to be de-duplicated.

17. The method of claim 1, wherein the at least one optimization designation indicates the extent to which the respective region is to be optimized in accordance with the specified compression technique, which is selected from the plurality of compression techniques based on the access pattern that is associated with the respective region;

and

wherein at least one second optimization designation of the plurality of optimization designations indicates the extent to which the respective region is to be optimized in accordance with a designated data de-duplication technique, which is selected from the plurality of data de-duplication techniques or a second plurality of data de-duplication techniques based on the access pattern that is associated with the respective region.

19. The method of claim 1, further comprising:

monitoring the plurality of access patterns that is associated with the plurality of respective regions using a file system filter driver;

wherein assigning the plurality of optimization designations comprises;

assigning the plurality of optimization designations to the plurality of respective regions in response to monitoring the plurality of access patterns that is associated with the plurality of respective regions.

20. The method of claim 1, wherein the file is a virtualized storage file;

wherein the method further comprises;

mounting the virtualized storage file to provide a mounted virtualized storage file that includes a plurality of data sequences that corresponds to the plurality of respective regions, each data sequence being included in a collection of one or more respective files, and

executing a disk filter with respect to the mounted virtualized storage file to monitor an access pattern of each collection; and

wherein assigning the plurality of optimization designations comprises;

assigning each optimization designation to the respective region of the virtualized storage file based on the access pattern of the respective collection that includes the corresponding data sequence.

21. The method of claim 1, further comprising:

assigning a plurality of access indicators to the plurality of respective regions, each access indicator corresponding to the access pattern that is associated with the respective region;

wherein assigning the plurality of optimization designations comprises;

assigning each optimization designation to the respective region based on a latency that is associated with the respective optimization designation being less than a latency threshold that is associated with the access indicator that is assigned to that region.

12. A system comprising:

memory; and

one or more processors coupled to the memory, the one or more processors configured to;

assign a plurality of optimization designations to a plurality of respective regions of a file based on a plurality of access patterns that is associated with the plurality of respective regions, each optimization designation indicating an extent to which the respective region is to be optimized based on the access pattern that is associated with the respective region, at least a first optimization designation of the plurality of optimization designations indicating the extent to which the respective region is to be optimized in accordance with a specified compression technique, which is selected from a plurality of compression techniques that are capable of compressing the respective region, at least a second optimization designation of the plurality of optimization designations indicating a specified data de-duplication technique, which is selected from a plurality of data de-duplication techniques that are capable of de-duplicating the respective region, each access pattern at least one of indicating or describing at least one of the following;

(a) one or more accesses to the respective region with which the respective access pattern is associated,

(b) one or more modifications to the respective region with which the respective access pattern is associated; and

optimize each region to the extent that is indicated by the respective optimization designation that is assigned to that region.

13. The system of claim 12, wherein the one or more processors are configured to assign each optimization designation to the respective region further based on at least one of a latency that is associated with accessing that region or an amount of system resources that is utilized to access that region.

18. The system of claim 12, wherein at least one of the following is true:

(a) the first optimization designation indicates that the respective region is to be compressed but not de-duplicated,

(b) the second optimization designation indicates that the respective region is to be de-duplicated but not compressed.

22. The system of claim 12, wherein the file is a virtualized storage file;

and wherein the one or more processors are configured to;

mount the virtualized storage file to provide a mounted virtualized storage file that includes a plurality of data sequences that corresponds to the plurality of respective regions, each data sequence being included in a collection of one or more respective files;

execute a disk filter with respect to the mounted virtualized storage file to monitor an access pattern of each collection; and

assign each optimization designation to the respective region of the virtualized storage file based on the access pattern of the respective collection that includes the corresponding data sequence.

23. The system of claim 12, wherein the one or more processors are configured to:

assign a plurality of access indicators to the plurality of respective regions, each access indicator corresponding to the access pattern that is associated with the respective region; and

assign each optimization designation to the respective region based on a latency that is associated with the respective optimization designation being less than a latency threshold that is associated with the access indicator that is assigned to that region.

24. The system of claim 12, wherein the one or more processors are configured to:

assign a plurality of access indicators to the plurality of respective regions, each access indicator corresponding to the access pattern that is associated with the respective region; and

assign each optimization designation to the respective region based on an amount of system resource consumption that is associated with the respective optimization designation being less than a consumption threshold that is associated with the access indicator that is assigned to that region.

14. A computer program product comprising a computer-readable storage medium, which is not a signal, having computer program logic recorded thereon for enabling a processor-based system to optimize a file by performing operations, the operations comprising:

assign a plurality of optimization designations to a plurality of respective regions of a file based on a plurality of access patterns that is associated with the plurality of respective regions and further based on a plurality of latencies that is associated with accessing the plurality of respective regions, each optimization designation indicating an extent to which the respective region is to be optimized, at least one optimization designation of the plurality of optimization designations indicating the extent to which the respective region is to be optimized in accordance with at least one of a specified compression technique, which is selected from a plurality of compression techniques that are capable of compressing the respective region based on the access pattern that is associated with the respective region, or a specified data de-duplication technique, which is selected from a plurality of data de-duplication techniques that are capable of de-duplicating the respective region based on the access pattern that is associated with the respective region, each access pattern at least one of indicating or describing at least one of the following;

(a) one or more accesses to the respective region with which the respective access pattern is associated,

(b) one or more modifications to the respective region with which the respective access pattern is associated; and

optimize each region to the extent that is indicated by the respective optimization designation that is assigned to that region.