Content acquisition system and method of implementation

• US 8,972,374 B2
• Filed: 02/12/2008
• Issued: 03/03/2015
• Est. Priority Date: 02/12/2008
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Jaffe, Stephen E., Smith, John R., Trevathan, Matthew B., Benson, Jesse L.
• Primary Examiner(s): ALAM, SHAHID AL
• Application Number:
  US12/029,678
• Publication Number:
  US 20090204617A1
• Time in Patent Office: 2,576 Days
• Field of Search: 455/466, 707/200, 707/776, 707/709, 707/770
• US Class Current: 707/709
• CPC Class Codes: G06F 16/435 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually

Abstract

A system is provided which solves content acquisition issues by providing an automated method to acquire content in mass and maintain an association between available meta-data and the actual content, e.g., video file. The system includes a first component configured to log network traffic. The system also includes a second component configured to correlate downloaded content of the logged network traffic with an XML stream of URLs and respective content descriptions.

Claims

1. A system comprising:

a hardware memory device that stores program instructions; and

a processor that executes the program instructions and causes;

a first component to log network traffic by creating a record of downloaded URLs; and

a second component to correlate the downloaded URLs of the logged network traffic with an XML stream of URLs to match downloaded content of the logged network traffic with respective content descriptions and the URLs of the XML stream.

2. The system of claim 1, further comprising an update component which is configured to tag a URL of the downloaded content with storage location information.

3. The system of claim 2, further comprising storage configured to receive the tag from the update component and store the tag with the downloaded content.

4. The system of claim 2, wherein the update component is configured to provide the tag in XML format with at least one of the URL and description of the downloaded content.

5. The system of claim 2, wherein the update component includes a description of the downloaded content or a pointer to the description in the tag.

6. The system of claim 1, wherein the first component is a proxy which is configured to provide a description of the downloaded content.

7. The system of claim 1, further comprising a filter which is configured to filter certain content types prior to downloading of the content.

8. The system of claim 1, further comprising a script builder configured to parse the XML stream for URLs and provide the URLs to a browser for display.

9. The system of claim 1, further comprising an exception component which is configured to determine at least one of:

whether a URL associated with the XML stream exists, and whether content of the URL is accessible via conventional download methods.

10. The system of claim 1, wherein the second component is configured to associate available meta-data of the downloaded content and a URL of the downloaded content.

11. The system of claim 10, further comprising a third component configured to generate a record which includes a description of the downloaded content, the URL of the downloaded content and a storage location of the downloaded content.

12. The system of claim 1, wherein the first and second component are maintained on a computer infrastructure by a service provider for a fee.

13. A computing system for correlating a description of content and content, the system comprising:

a CPU, a computer readable memory and a hardware memory device;

first program instructions to at least parse an XML stream for URLs;

second program instructions to log network traffic of downloaded content of the parsed URLs; and

third program instructions to correlate at least the description of the downloaded content and the URL of the XML stream,

wherein the first, second and third program instructions are stored on the hardware memory device for execution by the CPU via the computer readable memory.

14. The computing system of claim 13, wherein the computing system is at least one of maintained, deployed, supported and created by a service provider for a fee.

15. The computing system of claim 13, wherein the computing system is operable to detect a URL of the downloaded content and compare the URL of the downloaded content with a URL of the XML stream.

16. The computing system of claim 13, wherein the computing system is operable to store the downloaded content and description and provide a location of the stored downloaded content and description.

17. The computing system of claim 13, wherein the computing system is operable to tag a URL of the downloaded content with a file name.

18. The computing system of claim 17, wherein the tag includes storage location of the downloaded content and/or a description of the content or pointer thereto.

19. A method for correlating URLs and a description of content associated with the URLs that is implemented in a computer infrastructure having computer executable code tangibly embodied on a hardware memory device having programming instructions operable to:

detect and download media files, log content which is downloaded for each page load, and associate the downloaded media files with a URL provided in an XML stream.

20. The method of claim 19, wherein the computer infrastructure is at least one of maintained, deployed, supported and created by a service provider.

21. The method of claim 19, wherein the computer infrastructure is operable to analyze the downloaded media files for at least one of visual classification, piracy, speech to text conversion, object detection, facial detection and content duplication.

22. The method of claim 19, wherein the computer infrastructure is further operable to parse URLs from the XML stream and correlate descriptions provided in the XML stream with respective media files of the downloaded media files.

23. The method of claim 19, wherein the computer infrastructure is further operable to determine exception files.

24. A computer program product comprising a non-transitory computer readable storage medium having readable program instructions embodied in the storage medium, the program instructions are executable by a computing device to cause the computing device to:

receive an XML stream that includes a series of URLs and related descriptions;

parse the XML stream for each URL in the series of URLs;

determine whether each of the URLs still exists;

download and save content pertaining to each of the URLs;

log the parsed URLs used to download the content;

correlate the log of parsed URLs corresponding to the downloaded content with the received XML stream;

create and store an updated XML which includes the correlated URLs; and

provide the updated XML with a URL tag to identify the storage location of the updated XML.

25. The computer program product of claim 24, wherein the program instructions are further executable by the computing device to cause the computing device to correlate the downloaded content with the related description of the downloaded content and the URL of the downloaded content retrieved from the XML stream.