Information Source Agent Systems and Methods for Distributed Data Storage and Management Using Content Signatures

• US 20170277705A1
• Filed: 06/12/2017
• Published: 09/28/2017
• Est. Priority Date: 05/22/2003
• Status: Active Grant

• Current Assignee: Callahan Cellular LLC (Intellectual Ventures LLC)
• Original Assignee: Callahan Cellular LLC (Intellectual Ventures LLC)
• Inventors: BORDEN, Bruce, BRAND, Russell
• Granted Patent: US 9,910,856 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 11/1458 Management of the backup or restore process
• CPC Class Codes: G06F 16/137 Hash-based content-based indexing of textual data G06F16/31
• CPC Class Codes: G06F 16/162 Delete operations erasing in storage systems G06F3/0652
• CPC Class Codes: G06F 16/1756 based on delta files
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 16/1873 Versioning file systems, temporal file systems, e.g. file system supporting different historic versions of files
• CPC Class Codes: G06F 16/20 of structured data, e.g. relational data
• CPC Class Codes: G06F 21/10 Protecting distributed programs or content, e.g. vending or licensing of copyrighted material protection in video systems or pay television H04N7/16 ; Digital rights management [DRM]
• CPC Class Codes: H04L 63/0428 wherein the data content is protected, e.g. by encrypting or encapsulating the payload

Abstract

Information source agent systems and methods for distributed content storage and management using content signatures that use file identicality properties are provided. A data management system is provided that includes a content engine for managing the storage of file content, a content signature generator that generates a unique content signature for a file processed by the content engine, a content signature comparator that compares content signatures and a content signature repository that stores content signatures. Information source agents are provided that include content signature generators and content signature comparators. Methods are provided for the efficient management of files using content signatures that take advantage of file identicality properties. Content signature application modules and registries exist within information source clients and centralized servers to support the content signature methods.

Claims

1. A method for identifying information source clients that have unique file distribution characteristics, comprising:

identifying a group of interest including one or more information source clients within an enterprise environment;

generating a respective content signature summary corresponding to each of the one or more information source clients of the group of interest, wherein each respective content signature summary includes a content signature for a file that appears on the corresponding information source client;

determining a count of the one or more information source clients that contain the content signature for the file;

comparing the count to an outlier threshold to determine whether the file is an outlier file; and

determining that the file is an outlier file when the count is below the outlier threshold.

2. The method of claim 1, wherein determining the count of the one or more information source clients that contain the content signature for the file further comprises:

comparing the content signature for the file to content signatures included in each respective content signature summary corresponding to the one or more information source clients; and

determining which information source clients contain the file based on the respective content signature summaries.

3. The method of claim 1, wherein generating the respective content signature summary further comprises:

retrieving the content signature from a content repository, wherein the content repository stores content signatures for all files contained within the one or more information source clients.

4. The method of claim 1, further comprising:

determining a respective count of outlier files contained within each of the one or more information source clients; and

identifying outlier devices of the one or more information source clients based on the respective count of outlier files for each of the one or more information source clients compared to an outlier device threshold.

5. The method of claim 1, further comprising:

performing an administrative control action in response to determining that the file is an outlier file.

6. The method of claim 1, wherein the one or more information source clients of the group of interest share an operating system or a job function.

7. The method of claim 1, wherein the group of interest is a department within an enterprise organization.

8. A system, comprising:

at least one processor; and

a memory operatively coupled to the at least one processor, the at least one processor configured to;

identify a group of interest including one or more information source clients within an enterprise environment;

generate a respective content signature summary corresponding to each of the one or more information source clients of the group of interest, wherein each respective content signature summary includes a content signature for a file that appears on the corresponding information source client;

determine a count of the one or more information source clients that contain the content signature for the file;

compare the count to an outlier threshold to determine whether the file is an outlier file; and

determine that the file is an outlier file when the count is below the outlier threshold.

9. The system of claim 8, wherein to determine the count of the one or more information source clients that contain the content signature for the file the at least one processor is further configured to:

compare the content signature for the file to content signatures included in each respective content signature summary corresponding to the one or more information source clients; and

determine which information source clients contain the file based on the respective content signature summaries.

10. The system of claim 8, wherein to generate the respective content signature summary the at least one processor is further configured to:

retrieve the content signature from a content repository, wherein the content repository stores content signatures for all files contained within the one or more information source clients.

11. The system of claim 8, wherein the at least one processor is further configured to:

determine a respective count of outlier files contained within each of the one or more information source clients; and

identify outlier devices of the one or more information source clients based on the respective count of outlier files for each of the one or more information source clients compared to an outlier device threshold.

12. The system of claim 8, wherein the at least one processor is further configured to:

perform an administrative control action in response to determining that the file is an outlier file.

13. The system of claim 8, wherein the one or more information source clients of the group of interest share an operating system or a job function.

14. The system of claim 8, wherein the group of interest is a department within an enterprise organization.

15. A tangible computer-readable device having instructions stored thereon that, when executed by at least one computing device, causes the at least one computing device to perform operations comprising:

identifying a group of interest including one or more information source clients within an enterprise environment;

generating a respective content signature summary corresponding to each of the one or more information source clients of the group of interest, wherein each respective content signature summary includes a content signature for a file that appears on the corresponding information source client;

determining a count of the one or more information source clients that contain the content signature for the file;

comparing the count to an outlier threshold to determine whether the file is an outlier file; and

determining that the file is an outlier file when the count is below the outlier threshold.

16. The computer-readable device of claim 15, wherein to determine the count of the one or more information source clients that contain the content signature for the file the operations further comprise:

comparing the content signature for the file to content signatures included in each respective content signature summary corresponding to the one or more information source clients; and

determining which information source clients contain the file based on the respective content signature summaries.

17. The computer-readable device of claim 15, wherein to generate the respective content signature summary the operations further comprise:

retrieving the content signature from a content repository, wherein the content repository stores content signatures for all files contained within the one or more information source clients.

18. The computer-readable device of claim 15, the operations further comprising:

determining a respective count of outlier files contained within each of the one or more information source clients; and

identifying outlier devices of the one or more information source clients based on the respective count of outlier files for each of the one or more information source clients compared to an outlier device threshold.

19. The computer-readable device of claim 15, the operations further comprising:

performing an administrative control action in response to determining that the file is an outlier file.

20. The computer-readable device of claim 15, wherein the one or more information source clients of the group of interest share an operating system or a job function.