Image, audio, and metadata inputs for keyword resource navigation links

• US 9,063,936 B2
• Filed: 12/30/2011
• Issued: 06/23/2015
• Est. Priority Date: 12/30/2011
• Status: Active Grant

• Current Assignee: VeriSign, Inc.
• Original Assignee: VeriSign, Inc.
• Inventors: Ramnath Krishnan, Harshini, Goyal, Neel, Raemy, Vincent
• Primary Examiner(s): Mehta, Bhavesh
• Assistant Examiner(s): MOYER, ANDREW M
• Application Number:
  US13/341,815
• Publication Number:
  US 20130170752A1
• Time in Patent Office: 1,271 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/433 using audio data
• CPC Class Codes: G06F 16/434 using image data, e.g. images, photos, pictures taken by a user
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/487 using geographical or spatial information, e.g. location
• CPC Class Codes: G06F 16/532 Query formulation, e.g. graphical querying
• CPC Class Codes: G06F 16/632 Query formulation
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 17/142 Fast Fourier transforms, e.g. using a Cooley-Tukey type algorithm

Abstract

A system, method, and computer-readable medium, is described that implements a resource navigation links tool that receives one or more inputs, extracts information from the inputs into a submission string, submits the submission string to a resource navigation links tool, and receives resource navigation links based on the submission string. Inputs types may include images, audio clips, and metadata. The inputs sources may be processed to extract information related to the image source to build the submission string.

Claims

1. A computer-implemented method of generating resource navigation links based on inputs comprising:

receiving, at a computer, an input source, wherein the input source corresponds to at least one of an image data file, an audio data file, or metadata source;

processing, via the computer, the input source to extract information from the input source;

building, via the computer, a submission string based on the extracted information, wherein the building comprises prioritizing words in the extracted information to place more significant words at a beginning of the submission string;

submitting the submission string to a resource navigation link tool;

receiving a resource navigation link from the resource navigation link tool when the submission string correlates with one or more keywords in the resource navigation link; and

submitting the submission string to an internet search engine when the submission string does not correlate with the one or more keywords in the resource navigation link.

2. The method of claim 1, wherein the input source corresponds to at least one image data file and the processing comprises:

submitting the image data file to an object recognition service; and

receiving from the object recognition service a list containing at least one recognized object from the image data file.

3. The method of claim 1, wherein the input source corresponds to at least one image data file and the processing comprises:

submitting the image data file to an image comparison service; and

receiving from the image comparison service, image information based on at least one similar image.

4. The method of claim 3, comprising:

determining additional information about the at least one similar image by extracting information from a website where the at least one similar image was found.

5. The method of claim 1, wherein the input source corresponds to at least one image data file and the processing comprises:

submitting the image data file to an optical character recognition tool; and

receiving from the optical character recognition tool, image information based on recognized characters found within the image.

6. The method of claim 1, wherein the input source corresponds to at least one audio data file and the processing comprises:

submitting the audio data file to an speech recognition service; and

receiving from the speech recognition service, a string containing at least one recognized word from the audio data file.

7. The method of claim 1, wherein the input source corresponds to at least one audio data file and the processing comprises:

submitting the audio data file to an audio clip comparison service; and

receiving from the audio clip comparison service, information based on at least one similar audio clip.

8. The method of claim 1, wherein the input source corresponds to at least one metadata source and the processing comprises:

extracting metadata from the metadata source; and

processing the metadata to create extracted information based on the metadata source.

9. The method of claim 8, wherein the extracted information comprises GPS coordinates related to the metadata source.

10. The method of claim 1, further comprising providing the resource navigation link, wherein the providing comprises at least one of:

displaying the resource navigation link;

emailing the resource navigation link to an email address;

or

playing speech corresponding to the resource navigation link.

11. The method of claim 10, wherein the emailing comprises including a link to retrieve the resource navigation link via a web browser interface.

12. The method of claim 1, wherein the resource navigation link is based on keywords in a keyword resource navigation database.

13. The method of claim 1, comprising:

receiving a selection of resource navigation links to save for later retrieval; and

storing data corresponding to the selection in a database.

40. The method of claim 1, wherein the resource navigation link provides access to a website selected by a person related to the website.

41. The method of claim 40, wherein the website is not selected by the internet search engine.

14. A system of generating resource navigation links based on inputs comprising:

a non-transitory memory storing instructions; and

a processor executing the instructions to cause the system to perform a method comprising;

receiving, at a computer, an input source, wherein the input source corresponds to at least one of an image data file, an audio data file, or metadata source;

processing, via the computer, the input source to extract information from the input source;

building, via the computer, a submission string based on the extracted information, wherein the building comprises prioritizing words in the extracted information to place more significant words at a beginning of the submission string;

submitting the submission string to a resource navigation link tool;

receiving a resource navigation link from the resource navigation link tool when the submission string correlates with one or more keywords in the resource navigation link; and

submitting the submission string to an internet search engine when the submission string does not correlate with the one or more keywords in the resource navigation link.

15. The system of claim 14, wherein the input source corresponds to at least one image data file and the processing comprises:

submitting the image data file to an object recognition service; and

receiving from the object recognition service a list containing at least one recognized object from the image data file.

16. The system of claim 14, wherein the input source corresponds to at least one image data file and the processing comprises:

submitting the image data file to an image comparison service; and

receiving from the image comparison service, image information based on at least one similar image.

17. The system of claim 16, wherein the method comprises:

determining additional information about the at least one similar image by extracting information from a website where the at least one similar image was found.

18. The system of claim 14, wherein the input source corresponds to at least one image data file and the processing comprises:

submitting the image data file to an optical character recognition tool; and

receiving from the optical character recognition tool, image information based on recognized characters found within the image.

19. The system of claim 14, wherein the input source corresponds to at least one audio data file and the processing comprises:

submitting the audio data file to an speech recognition service; and

receiving from the speech recognition service, a string containing at least one recognized word from the audio data file.

20. The system of claim 14, wherein the input source corresponds to at least one audio data file and the processing comprises:

submitting the audio data file to an audio clip comparison service; and

receiving from the audio clip comparison service, information based on at least one similar audio clip.

21. The system of claim 14, wherein the input source corresponds to at least one metadata source and the processing comprises:

extracting metadata from the metadata source; and

processing the metadata to create extracted information based on the metadata source.

22. The system of claim 21, wherein the extracted information comprises GPS coordinates related to the metadata source.

23. The system of claim 14, wherein the method further comprises providing the resource navigation link, and wherein the providing comprises at least one of:

displaying the resource navigation link;

emailing the resource navigation link to an email address;

or

playing speech corresponding to the resource navigation link.

24. The system of claim 23, wherein the emailing comprises including a link to retrieve the resource navigation link via a web browser interface.

25. The system of claim 14, wherein the resource navigation link is based on keywords in a keyword resource navigation database.

26. The system of claim 14, wherein the method comprises:

receiving a selection of resource navigation links to save for later retrieval; and

storing data corresponding to the selection in a database.

27. A non-transitory computer-readable storage medium containing instructions which, when executed on a processor, perform a method comprising:

receiving, at a computer, an input source, wherein the input source corresponds to at least one of an image data file, an audio data file, or metadata source;

processing, via the computer, the input source to extract information from the input source;

building, via the computer, a submission string based on the extracted information, wherein the building comprises prioritizing words in the extracted information to place more significant words at a beginning of the submission string;

submitting the submission string to a resource navigation link tool;

receiving a resource navigation link from the resource navigation link tool when the submission string correlates with one or more keywords in the resource navigation link; and

submitting the submission string to an internet search engine when the submission string does not correlate with the one or more keywords in the resource navigation link.

28. The computer-readable storage medium of claim 27, wherein the input source corresponds to at least one image data file and the processing comprises:

submitting the image data file to an object recognition service; and

receiving from the object recognition service a list containing at least one recognized object from the image data file.

29. The computer-readable storage medium of claim 27, wherein the input source corresponds to at least one image data file and the processing comprises:

submitting the image data file to an image comparison service; and

receiving from the image comparison service, image information based on at least one similar image.

30. The computer-readable storage medium of claim 29, wherein the method comprises:

determining additional information about the at least one similar image by extracting information from a website where the at least one similar image was found.

31. The computer-readable storage medium of claim 27, wherein the input source corresponds to at least one image data file and the processing comprises:

submitting the image data file to an optical character recognition tool; and

receiving from the optical character recognition tool, image information based on recognized characters found within the image.

32. The computer-readable storage medium of claim 27, wherein the input source corresponds to at least one audio data file and the processing comprises:

submitting the audio data file to an speech recognition service; and

receiving from the speech recognition service, a string containing at least one recognized word from the audio data file.

33. The computer-readable storage medium of claim 27, wherein the input source corresponds to at least one audio data file and the processing comprises:

submitting the audio data file to an audio clip comparison service; and

receiving from the audio clip comparison service, information based on at least one similar audio clip.

34. The computer-readable storage medium of claim 27, wherein the input source corresponds to at least one metadata source and the processing comprises:

extracting metadata from the metadata source; and

processing the metadata to create extracted information based on the metadata source.

35. The computer-readable storage medium of claim 34, wherein the extracted information comprises GPS coordinates related to the metadata source.

36. The computer-readable storage medium of claim 27, wherein the method further comprises providing the resource navigation link, and wherein the providing comprises at least one of:

displaying the resource navigation link;

emailing the resource navigation link to an email address;

or

playing speech corresponding to the resource navigation link.

37. The computer-readable storage medium of claim 36, wherein the emailing comprises including a link to retrieve the resource navigation link via a web browser interface.

38. The computer-readable storage medium of claim 27, wherein the resource navigation link is based on keywords in a keyword resource navigation database.

39. The computer-readable storage medium of claim 27, wherein the method comprises:

receiving a selection of resource navigation links to save for later retrieval; and

storing data corresponding to the selection in a database.