Grouping and differentiating files based on underlying grouped and differentiated files

• US 8,566,323 B2
• Filed: 12/29/2009
• Issued: 10/22/2013
• Est. Priority Date: 07/16/2009
• Status: Expired due to Fees

• Current Assignee: Micro Focus Software, Inc. (Open Text Corporation)
• Original Assignee: Novell Incorporated (Open Text Corporation)
• Inventors: Isaacson, Scott A., Teerlink, Craig N., Nazeer, Nadeem A.
• Primary Examiner(s): Richardson, James E
• Application Number:
  US12/648,542
• Publication Number:
  US 20110016136A1
• Time in Patent Office: 1,393 Days
• Field of Search: 707/737, 707/739, 707/750, 707/804
• US Class Current: 707/739
• CPC Class Codes: G06F 16/1744 using compression, e.g. sparse files
• CPC Class Codes: G06F 16/285 Clustering or classification
• CPC Class Codes: G06T 9/005 Statistical coding, e.g. Huffman, run length coding
• CPC Class Codes: H04L 2209/30 Compression, e.g. Merkle-Damgard construction
• CPC Class Codes: H04L 2209/34 Encoding or coding, e.g. Huffman coding or error correction
• CPC Class Codes: H04L 9/0894 Escrow, recovery or storing of secret information, e.g. secret key escrow or cryptographic key storage
• CPC Class Codes: H04N 19/00 Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
• CPC Class Codes: Y10S 707/972 Partitioning

Abstract

Methods and apparatus teach a digital spectrum of a file. The digital spectrum is used to map a file'"'"'s position. This position relative to another file'"'"'s position reveals closest neighbors. When multiple such neighbors are arranged, first “patterns” of data are created that further define digital spectrums of new files. It is within this sorted new data that emergent relationships or second “patterns” are examined, according to the techniques for its underlying files, or “patterns of patterns.” Representatively, original files are stored on computing devices. If encoded, they have pluralities of symbols representing an underlying data stream of original bits of data. The original files are examined for relationships between each of the files. The original relationships are converted to new files. The new files are representatively encoded and examined for other relationships. The new files are then grouped or differentiated from one another based these new relationships yielding insight into how the original files can be grouped or differentiated.

Claims

1. In a computing system environment, a method of differentiating files stored on one or more computing devices, comprising:

receiving a plurality of compressed original files, said compressed original files being encoded as a plurality of first symbols derived from original data of said original files;

determining a frequency count for each first symbol of the plurality of symbols for each of the plurality of compressed original files;

determining an original distance relationship between each of said plurality of compressed original files using said frequency counts, said original distance relationship being a distance in an informational mapping space defined by the total number of said first symbols in said plurality of compressed original files;

converting said original distance relationships into a plurality of new files;

encoding each of said new files as a plurality of second symbols derived from said plurality of new files thereby generating a plurality of compressed new files;

determining a frequency count for each said second symbol for each of the plurality of compressed new files;

determining a second distance relationship between each of said compressed new files using said frequency counts for each said second symbol; and

differentiating said original files based on the determined second distance relationships.

2. The method of claim 1, wherein said differentiating includes grouping together said each compressed new file based on the second distance relationship.

3. The method of claim 1, wherein said plurality of first symbols and said plurality of second symbols respectively represent an underlying data stream of all original bits of data of said original files and said new files.

4. The method of claim 3, wherein the determining said original distance relationship further includes determining distances between said compressed original files as oriented in said informational mapping space.

5. The method of claim 4, wherein the converting said original relationship into said compressed new files further includes encoding the determined distances as said plurality of second symbols.

6. The method of claim 5, wherein the determining the second distance relationship according to the encoded determined distances determines new relationships amongst said original files.

7. In a computing system environment, a method of differentiating original files stored on one or more computing devices, each original file compressed as a plurality of first symbols derived from an underlying data stream of original bits of digital data of said original files, comprising:

determining a frequency count for each said first symbol of said each compressed original file;

determining an original distance relationship between each of said plurality of compressed original files from said frequency counts, said original distance relationship being a distance in an informational mapping space defined by the total number of said first symbols in said plurality of compressed original files;

converting said original distance relationships into a plurality of new files;

compressing said new files as a plurality of second symbols;

determining a frequency count for each said second symbol for each of the plurality of compressed new files;

determining a second distance relationship between each of said compressed new files using said second symbol frequency counts; and

differentiating said original files by grouping together ones of the new files according to said second distance relationship.

8. The method of claim 7, further including determining said original distance relationship and sorting closest neighbors between said each original file in said informational mapping space.

9. The method of claim 7, wherein the grouping together further includes determining file similarity between said ones of the new files.

10. The method of claim 7, further including determining a mapping space of the compressed new files based on a number of symbols in a plurality of second symbols in the compressed new files, the plurality of second symbols in the new files representing an underlying data stream of bits obtained from said each original file.

11. The method of claim 10, further including determining the second relationship based on a distance between each of the new files as oriented in the informational mapping space.

12. The method of claim 7, further including grouping together ones of the original files according to said second distance relationship.

13. In a computing system environment, a method of differentiating files stored on one or more computing devices, comprising:

encoding a plurality of original files as a plurality of first symbols each representing an optimal compression of all bits of original data of said original files to provide a plurality of compressed original files;

determining a frequency count for each first symbol of the plurality of symbols for each of the plurality of compressed original files;

determining an original distance relationship between each of the original files using said frequency counts, said original distance relationship being a distance in an informational mapping space defined by the total number of said first symbols in each said compressed original file;

converting said original distance relationship into pluralities of new files of binary data

encoding each said new file as a plurality of second symbols to provide a plurality of compressed new files;

determining a frequency count for each said second symbol;

determining a second distance relationship between each said compressed new file using said second symbol frequency counts; and

differentiating said original files based on the second distance relationship.

14. The method of claim 13, further including grouping said each compressed new file based on the second distance relationship.

15. The method of claim 14, wherein the grouping said each compressed new file further includes determining a distance between said each compressed new file as oriented in a mapping space based on a total number of second symbols in the plurality of second symbols.