Data augmentation based on second-phase metadata

• US 8,799,278 B2
• Filed: 10/01/2012
• Issued: 08/05/2014
• Est. Priority Date: 10/01/2012
• Status: Expired due to Fees

• Current Assignee: Discern, Inc.
• Original Assignee: Discern, Inc.
• Inventors: Shanahan, Travis, Clark, James, Guido, Dana, Blount, Harry
• Primary Examiner(s): SYED, FARHAN M
• Application Number:
  US13/632,829
• Publication Number:
  US 20140095521A1
• Time in Patent Office: 673 Days
• US Class Current: 707/726
• CPC Class Codes: G06F 16/9558 Details of hyperlinks; Management of linked annotations

Abstract

A data augmentation machine may form all or part of a data augmentation system that is configured to augment data. The data augmentation machine may be configured (e.g., by one or more software modules) to access data (e.g., by crawling one or more public or private networks), extract metadata based on the data (e.g., from the data and its source), create a link to additional data (e.g., based on the extracted metadata), and augment the extracted metadata (e.g., by storing augmented metadata with the extracted metadata). Such augmented metadata may be presented (e.g., within a user interface), published publicly (e.g., on a webpage), published privately (e.g., in a report available only to premium subscribers of a data augmentation service), or any suitable combination thereof.

Claims

1. A computer-implemented method comprising:

accessing first data from a first data source accessible via a network;

extracting first-phase metadata of the first data, the first-phase metadata being extracted from the first data and from the first data source;

creating a link from the first data to second data available from a second data source, the link being created by application of a template to the extracted first-phase metadata of the first data, the application of the template including accessing a lookup table that corresponds to a data type of the first data and identifying the second data from the lookup table,

the creating of the link being performed by a processor of a machine;

determining second-phase metadata of the first data, the second-phase metadata being determined based on the created link from the first data to the second data by accessing the second data source; and

storing the second-phase metadata of the first data, the second-phase metadata being stored as augmented metadata of the first data.

2. The computer-implemented method of claim 1, wherein:

the determining of the second-phase metadata includes accessing the second data based on the created link from the first data to the second data; and

the determining of the second-phase metadata of the first data is based on the accessed second data.

3. The computer-implemented method of claim 1, wherein:

the determining of the second-phase metadata includes accessing further metadata of the second data based on the created link from the first data to the second data; and

the determining of the second-phase metadata of the first data is based on the accessed further metadata.

4. The computer-implemented method of claim 1, wherein:

the creating of the link from the first data to the second data includes accessing the template based on the data type of the first data.

5. The computer-implemented method of claim 4, wherein:

the data type of the first data is selected from a group consisting of a document, a webpage, a report, a publication, an article, a news feed, a message, an email, a voicemail, a video, an image, an audio file, a blog post, a micro-blog post, a forum comment, a server log, and sensor data.

6. The computer-implemented method of claim 4, wherein:

the template is selected from a group consisting of a glossary, a thesaurus, a list of person names, and a list of acronyms.

7. The computer-implemented method of claim 1, wherein:

the creating of the link from the first data to the second data includes identifying the second data by applying a natural language programming (NLP) algorithm to the first data.

8. The computer-implemented method of claim 1, wherein:

the extracting of the first-phase metadata includes extracting from the first data at least one of a data type, an author name, a title, a date, a summary, a category, or a tag.

9. The computer-implemented method of claim 1, wherein:

the extracting of the first-phase metadata includes extracting from the first data source at least one of a publisher name, a provider name, a last refresh date, a next refresh date, an update frequency, or a permission indicator.

10. The computer-implemented method of claim 1, wherein:

the extracting of the first-phase metadata includes formatting the first-phase metadata into a format that is common to multiple data types within a data augmentation system.

11. The computer-implemented method of claim 1, wherein:

the storing of the second-phase metadata includes storing the second-phase metadata with the created link from the first data to the second data.

12. The computer-implemented method of claim 1, wherein:

the storing of the second-phase metadata includes storing the second-phase metadata with the extracted first-phase metadata of the first data.

13. The computer-implemented method of claim 1 further comprising:

initiating a web crawler configured to discover a location of the first data source from which the first data is to be accessed.

14. The computer-implemented method of claim 1 further comprising:

providing a communication generated based on the second-phase metadata stored as the augmented metadata of the first data,

the communication being at least one of a report or an alert.

15. The computer-implemented method of claim 1 further comprising:

presenting a valuation chart of an investment portfolio generated based on the second-phase metadata stored as the augmented metadata of the first data.

16. The computer-implemented method of claim 1 further comprising:

generating a graph of nodes in which a node represents a scenario described by an investment portfolio generated based on the second-phase metadata stored as the augmented metadata of the first data.

17. A machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

accessing first data from a first data source accessible via a network;

extracting first-phase metadata of the first data, the first-phase metadata being extracted from the first data and from the first data source;

creating a link from the first data to second data available from a second data source, the link being created by application of a template to the extracted first-phase metadata of the first data, the application of the template including accessing a lookup table that corresponds to a data type of the first data and identifying the second data from the lookup table,

the creating of the link being performed by the one or more processors of the machine;

determining second-phase metadata of the first data, the second-phase metadata being determined based on the created link from the first data to the second data by accessing the second data source; and

storing the second-phase metadata of the first data, the second-phase metadata being stored as augmented metadata of the first data.

18. The non-transitory machine-readable storage medium of claim 17, wherein:

the determining of the second-phase metadata includes accessing further metadata of the second data based on the created link from the first data to the second data; and

the determining of the second-phase metadata of the first data is based on the accessed further metadata.

19. A system comprising:

a source access module configured to access first data from a first data source accessible via a network;

a metadata extraction module configured to extract first-phase metadata of the first data, the first-phase metadata being extracted from the first data and from the first data source;

a processor configured by a template application module to create a link from the first data to second data available from a second data source, the link being created by application of a template to the extracted first-phase metadata of the first data, the application of the template including accessing a lookup table that corresponds to a data type of the first data and identifying the second data from the lookup table;

a metadata augmentation module configured to determine second-phase metadata of the first data, the second-phase metadata being determined based on the created link from the first data to the second data by accessing the second data source; and

a database configured to store the second-phase metadata of the first data, the second-phase metadata being stored as augmented metadata of the first data.

20. The system of claim 19, wherein:

the determining of the second-phase metadata includes accessing further metadata of the second data based on the created link from the first data to the second data; and

the determining of the second-phase metadata of the first data is based on the accessed further metadata.