Systems and methods for processing and managing object-related data for use by a plurality of applications

• US 8,458,186 B2
• Filed: 11/06/2009
• Issued: 06/04/2013
• Est. Priority Date: 11/06/2009
• Status: Active Grant

• Current Assignee: Veritas Technologies, LLC (Whitehouse Group Ltd.)
• Original Assignee: Symantec Corporation (NortonLifeLock Inc.)
• Inventors: Stringham, Russell, Suarez, Eduardo
• Primary Examiner(s): REYES, MARIELA D
• Application Number:
  US12/613,748
• Publication Number:
  US 20110113466A1
• Time in Patent Office: 1,306 Days
• Field of Search: 707741-747, 707/803, 707/804
• US Class Current: 707/741
• CPC Class Codes: G06F 16/81 Indexing, e.g. XML tags; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/84 Mapping; Conversion
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 21/6227 where protection concerns the structure of data, e.g. records, types, queries
• CPC Class Codes: G06F 2221/2115 Third party

Abstract

A computer-implemented method for indexing data for use by a plurality of applications may include receiving a data object at a first application of a plurality of applications. The method may include tokenizing the common-form data object to extract tokens from the data object and creating an index of the tokens extracted from the data object, the index being formatted to be utilized by each of the plurality of applications. The method may further include storing the index in a database that is accessible by the plurality of applications. The plurality of applications may comprise two or more application types. Various other methods and systems are also disclosed.

Claims

1. A computer-implemented method for indexing data for use by a plurality of applications, at least a portion of the method being performed by a computing device comprising at least one processor, the method comprising:

receiving a program-specific data object at a first application of a plurality of applications, the program-specific data object being configured to be accessed by at least one program type;

determining, based on metadata associated with the program-specific data object, that an index of tokens associated with the program-specific data object is not stored in a database that is accessible by the plurality of applications, wherein the plurality of applications comprise two or more application types;

converting, after determining that the index of tokens associated with the program-specific data object is not stored in the database, the program-specific data object to a common-form data object;

tokenizing the common-form data object to extract tokens from the common-form data object;

creating an index of the tokens extracted from the common-form data object, the index of the tokens extracted from the common-form data object being formatted to be utilized by each of the plurality of applications;

performing a first data classification of the program-specific data object to obtain a first set of classification data that is associated with the program-specific data object and particular to the first application;

storing the common-form data object, the index of the tokens extracted from the common-form data object, and the first set of classification data in the database that is accessible by the plurality of applications;

receiving, from a second application of the plurality of applications that has received the program-specific data object, a request for the index of the tokens extracted from the common-form data object;

allowing the second application to access the index of the tokens extracted from the common-form data object;

receiving, from the second application, a second set of classification data that is associated with the program-specific data object and particular to the second application, the first set of classification data being different than the second set of classification data;

storing the second set of classification data in the database that is accessible by the plurality of applications.

2. The method of claim 1, wherein the common-form data object comprises at least one of:

markup language;

plain text.

3. The method of claim 1, further comprising:

receiving, from another application of the plurality of applications, a request for the common-form data object;

sending the common-form data object to the other application.

4. The method of claim 1, further comprising generating at least one of:

metadata associated with the program-specific data object;

a hidden file associated with the program-specific data object.

5. The method of claim 1, further comprising

associating at least one of the first set of classification data and the second set of classification data with at least one of:

the common-form data object;

the index of the tokens extracted from the common-form data object.

6. The method of claim 5, wherein associating the first set of classification data and the second set of classification data with the common-form data object comprises adding data tags referencing the results of the first data classification and results of a second data classification.

7. The method of claim 1, wherein performing the first data classification comprises classifying data in the program-specific data object based on at least one of:

indexed metadata;

indexed content;

extracted patterns;

extracted entities.

8. The method of claim 1, further comprising executing at least one policy based on at least one of the first set of classification data and the second set of classification data, the policy comprising at least one of:

a spam policy;

an anti-virus policy;

a data-loss-prevention policy;

an intellectual property leak-prevention policy;

an archiving policy;

a backup policy;

a content-management policy;

a legal-compliance policy;

an electronic-discovery policy.

9. The method of claim 1, wherein the first application performs at least one of:

converting the program-specific data object to the common-form data object;

tokenizing the common-form data object;

creating the index of the tokens extracted from the common-form data object;

performing the first data classification of the program-specific data object;

performing language detection on the common-form data object.

10. The method of claim 1, wherein the first application instructs a third application to perform at least one of:

converting the program-specific data object to the common-form data object;

tokenizing the common-form data object;

creating the index of the tokens extracted from the common-form data object;

performing the first data classification of the program-specific data object;

performing language detection on the common-form data object.

11. The method of claim 1, further comprising performing at least one of:

language detection on the common-form data object;

pattern detection on the common-form data object;

entity extraction on the common-form data object.

12. The method of claim 1, wherein the plurality of application types comprises two or more of:

a search engine;

an archiving application;

a data-loss-prevention application;

a spam-filtering application;

an anti-virus application;

a backup application;

a content-management application;

a legal-compliance application;

an electronic-discovery application.

13. The method of claim 1, tangibly embodied as computer-executable instructions on at least one non-transitory computer-readable storage medium.

14. The method of claim 1, wherein the program-specific data object comprises at least one of a:

DOC file;

PDF file;

XLS file;

PPT file;

MSG file.

15. A computer-implemented method for indexing data for use by a plurality of applications, at least a portion of the method being performed by a computing device comprising at least one processor, the method comprising:

receiving a program-specific data object at a first application of a plurality of applications, the program-specific data object being configured to be accessed by at least one program type;

determining, based on metadata associated with the program-specific data object, that an index of tokens associated with the program-specific data object is not stored in a database that is accessible by the plurality of applications, wherein the plurality of applications comprise two or more application types;

converting, after determining that the index of tokens associated with the program-specific data object is not stored in the database, the program-specific data object to a common-form data object;

tokenizing the common-form data object to extract tokens from the common-form data object;

creating an object index of the tokens extracted from the common-form data object, the object index being formatted to be utilized by each of the plurality of applications;

performing a first data classification of the program-specific data object to obtain a first set of classification data that is associated with the program-specific data object and particular to the first application;

storing the common-form data object and the first set of classification data in the database that is accessible by the plurality of applications;

storing the object index of the tokens extracted from the common-form data object in a master index that includes indexing information associated with a plurality of program-specific data objects, the master index being accessible by the plurality of applications;

receiving, from a second application of the plurality of applications that has received the program-specific data object, a request for the object index;

allowing the second application to access the object index;

receiving, from the second application, a second set of classification data that is associated with the program-specific data object and particular to the second application, the first set of classification data being different than the second set of classification data;

storing the second set of classification data in the database that is accessible by the plurality of applications.

16. The method of claim 15, wherein the master index comprises a plurality of object indexes received from two or more of the plurality of applications.

17. The method of claim 15, tangibly embodied as computer-executable instructions on at least one non-transitory computer-readable storage medium.

18. A system for indexing data for use by a plurality of applications, the system comprising:

a database that is accessible by a plurality of applications, the plurality of applications comprising two or more application types;

a communication module programmed to;

receive a program-specific data object at a first application of the plurality of applications, the program-specific data object being configured to be accessed by at least one program type;

determine, based on metadata associated with the program-specific data object, that an index of tokens associated with the program-specific data object is not stored in the database that is accessible by the plurality of applications;

a conversion module programmed to convert, after determining that the index of tokens associated with the program-specific data object is not stored in the database, the program-specific data object to a common-form data object;

a tokenization module programmed to tokenize the common-form data object to extract tokens from the common-form data object;

a classification module programmed to perform a first data classification of the program-specific data object to obtain a first set of classification data that is associated with the program-specific data object and particular to the first application;

an indexing module programmed to;

create an index of the tokens extracted from the common-form data object, the index of the tokens extracted from the common-form data object being formatted to be utilized by each of the plurality of applications;

store the common-form data object, the index of the tokens extracted from the common-form data object, and the first set of classification data in the database that is accessible by the plurality of applications;

a data-sharing module programmed to;

receive, from a second application of the plurality of applications that has received the program-specific data object, a request for the index of the tokens extracted from the common-form data object;

allow the second application to access the index of the tokens extracted from the common-form data object;

receive, from the second application, a second set of classification data that is associated with the program-specific data object and particular to the second application, the first set of classification data being different than the second set of classification data;

store the second set of classification data in the database that is accessible by the plurality of applications.

19. The system of claim 18, wherein the program-specific data object is configured to be accessed by the program type, the system further comprising:

a language-detection module programmed to perform language detection on the common-form data object;

a security module programmed to limit data access to authorized applications.