SOFTWARE WEB CROWLER AND METHOD THEREFOR

• US 20080046240A1
• Filed: 08/16/2007
• Published: 02/21/2008
• Est. Priority Date: 08/17/2006
• Status: Active Grant

• Current Assignee: Intersections Incorporated (Aura Sub, LLC)
• Original Assignee: Anchorfree Incorporated
• Inventors: GAVRILOV, Dimitry, MALOBRODSKY, Eugene, GORODYANSKY, David
• Granted Patent: US 7,693,872 B2
• Time in Patent Office: Days
• US Class Current: 704/235
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image

Abstract

Description of a web crawler that crawlers the web for audio and video files and indexes the files based on sound analysis and algorithmic translation and analysis of sounds in audio and video files to text.

Claims

1. A computerized system comprising:

a. A crawler operable to obtain multimedia files from a network;

b. A multimedia processor operable to receive the multimedia files from the crawler and process the multimedia files and generate metadata corresponding to the multimedia files;

c. A data mining module operable to extract relevant information from the generated metadata; and

d. An indexer operable to index the multimedia files based on the relevant information.

2. The computerized system of claim 1, wherein the web crawler further comprises:

i. A downloader operable to download web pages;

ii. A queue operable to store links corresponding to the download web pages; and

iii. A scheduler operable to obtain the stored links from the queue and pass the obtained links to the downloader.

3. The computerized system of claim 1, wherein the multimedia processor is operable to translate speech in the multimedia files into textual representation.

4. The computerized system of claim 1, wherein the multimedia processor is operable to generate metadata representative of sound effects in the multimedia files.

5. The computerized system of claim 4, wherein the multimedia processor is further operable to compare the sound effects in the multimedia files with a predetermined set of sounds.

6. The computerized system of claim 4, wherein the multimedia processor is further operable to detect a type of music in the multimedia files.

7. The computerized system of claim 4, wherein the metadata comprises at least one keyword describing the sound effects in the multimedia files.

8. The computerized system of claim 1, wherein the data mining algorithm is operable to:

a. detect frequency of keywords in the generated metadata;

b. add weights to the keywords; and

c. compile the keywords for each multimedia file.

9. The computerized system of claim 1, wherein the multimedia files are audio files.

10. The computerized system of claim 1, wherein the multimedia files are video files.

11. A method comprising:

a. Obtaining multimedia files from a network;

b. Processing the obtained multimedia files and generating metadata corresponding to the multimedia files;

c. Extracting relevant information from the generated metadata; and

d. Indexing the multimedia files based on the relevant information.

12. The method of claim 11, wherein processing further comprises translating speech in the multimedia files into textual representation.

13. The method of claim 11, wherein processing further comprises generating metadata representative of sound effects in the multimedia files.

14. The method of claim 13, wherein processing further comprises comparing the sound effects in the multimedia files with a predetermined set of sounds.

15. The method of claim 13, wherein processing further comprises detecting a type of music in the multimedia files.

16. The method of claim 13, wherein the metadata comprises at least one keyword describing the sound effects in the multimedia files.

17. The method of claim 11, wherein extracting further comprises:

a. detecting frequency of keywords in the generated metadata;

b. adding weights to the keywords; and

c. compiling the keywords for each multimedia file.

18. The method of claim 11, wherein the multimedia files are audio files.

19. The method of claim 11, wherein the multimedia files are video files.

20. A computerized system comprising:

a. A crawler operable to obtain multimedia files from a network;

b. A multimedia processor operable to process the obtained multimedia files and generate textual data corresponding to the multimedia files; and

c. An indexer operable to index the multimedia files based on the generated textual data.