Identifying files associated with a workflow

• US 8,019,765 B2
• Filed: 10/29/2008
• Issued: 09/13/2011
• Est. Priority Date: 10/29/2008
• Status: Active Grant

• Current Assignee: Hewlett Packard Enterprise Development LP (Hewlett-Packard Enterprise Company), Valtrus Innovations Limited (f/k/a Dolya Holdco 9 Limited) (Key Patent Innovations Limited)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Uysal, Mustafa, Povzner, Anna, Keeton, Kimberly, Aguilera, Marcos K., Merchant, Arif A., Morrey, Charles B. III
• Primary Examiner(s): Breene; John E
• Assistant Examiner(s): Myint; Dennis
• Application Number:
  US12/260,836
• Publication Number:
  US 20100106681A1
• Time in Patent Office: 1,049 Days
• Field of Search: 707/739, 707/740
• US Class Current: 707/739
• CPC Class Codes: G06F 16/14 Details of searching files based on file metadata
• CPC Class Codes: H04L 69/22 Parsing or analysis of headers

Abstract

To determine files associated with one or more workflows, a trace of accesses of files in at least one server is received. The files are grouped into at least one set of files, where the files in the set are accessed together more than a predetermined number of times in the trace. Files associated with the particular workflow are identified based on the at least one set.

Claims

1. A method of determining files associated with one or more workflows, comprising:

receiving a trace of accesses of files in at least one server;

grouping the files into at least one set of files, wherein the files in the set are accessed together more than a predetermined number of times in the trace; and

identifying files associated with a particular workflow based on the at least one set; and

dividing the trace into a plurality of trace fragments, wherein grouping the files into the at least one set of files comprises grouping the files into the at least one set of files that appear together in more than the predetermined number of trace fragments.

2. The method of claim 1, wherein the at least one set used in identifying the files associated with the particular workflow is a maximal set.

3. The method of claim 1, wherein dividing the trace into the plurality of trace fragments comprises dividing the trace into the plurality of trace fragments using windows each having a predetermined size.

4. The method of claim 1, wherein receiving the trace of accesses comprises receiving the trace of accesses at a file server.

5. A method of determining files associated with one or more workflows, comprising:

receiving a trace of accesses of files in at least one server;

grouping the files into plural sets of files, wherein each set includes files that appear together more than a predetermined number of times in the trace; and

identifying files associated with a particular workflow based on the plural sets of files.

6. The method of claim 5, further comprising:

clustering the plural sets of files to combine at least some of the plural sets, wherein the combining produces the identified files associated with the particular workflow.

7. The method of claim 6, wherein the plural sets of files are referred to as frequent sets, wherein clustering the plural frequent sets comprises:

finding at least one frequent itemset that includes a collection of files contained in at least a predefined number of the frequent sets; and

designating a first initial cluster that includes all frequent sets that contain the frequent itemset.

8. The method of claim 7, further comprising:

finding a second frequent itemset that includes another collection of files in at least the predefined number of the frequent sets;

designating a second initial cluster that includes all frequent sets that contain the second frequent itemset; and

removing a particular file set that appears in both the first and second initial clusters from one of the first and second initial clusters based on a similarity metric relating the particular file set to the first and second initial clusters.

9. The method of claim 6, wherein clustering the plural sets comprises:

identifying leftover sets of the files that do not belong to any cluster; and

assigning a cluster to each of the leftover sets.

10. The method of claim 6, wherein clustering the plural sets comprises:

identifying plural clusters; and

merging at least some of the plural clusters based on similarities among the clusters.

11. The method of claim 5, further comprising:

identifying files associated with another workflow based on the plural sets.

12. The method of claim 5, further comprising:

filtering the accesses in the trace to remove at least one type of accesses prior to the grouping.

13. A method of identifying a file signature associated with a workflow, comprising:

receiving a trace of accesses of files in at least one server;

dividing the trace into plural trace fragments;

performing frequent file set extraction to identify file sets, the file sets containing corresponding collections of files that appear in multiple ones of the trace fragments; and

identifying files associated with the workflow based on the file sets.

14. The method of claim 13, wherein dividing the trace into the plural trace fragments comprises defining plural windows each of a predefined size, wherein corresponding portions of the trace are provided in the respective windows to define the trace fragments.

15. The method of claim 13, wherein performing the frequent file set extraction comprises identifying file sets each containing a corresponding collection of files that appear together in at least some predetermined number of trace fragments.

16. The method of claim 13, further comprising applying a clustering algorithm to the file sets to identify the files associated with the workflow.

17. The method of claim 16, wherein applying the clustering algorithm comprises:

identifying clusters containing files of the file sets; and

merging the clusters based on inter-cluster similarity metrics.

18. The method of claim 13, further comprising using the identified file signature for a purpose selected from among:

(1) managing of file placement in a tiered storage system;

(2) understanding utilization of a storage resource;

(3) performing data consolidation;

(4) performing data migration;

(5) performing data archival;

(6) file hoarding;

(7) optimizing storage performance;

(8) improving energy efficiency; and

(9) enabling provenance awareness.

19. An article comprising at least one storage medium containing instructions that when executed cause a computer to:

receive a trace of accesses of files in at least one server;

group the files into plural sets of files, wherein the files in each of the sets are accessed together more than a predetermined number of times in the trace; and

identify files associated with a particular workflow based on the plural sets.

20. The article of claim 19, wherein the instructions when executed cause the computer to further cluster the plural sets of files to combine at least some of the plural sets, wherein the combining produces the identified files associated with the particular workflow.

21. The article of claim 20, wherein clustering the plural sets comprises:

identifying plural clusters; and

merging at least some of the plural clusters based on similarities among the clusters.