Search engine inference based virtual assistance

• US 8,495,051 B2
• Filed: 05/24/2012
• Issued: 07/23/2013
• Est. Priority Date: 03/16/2010
• Status: Expired due to Fees

• Current Assignee: Streamline Licensing LLC (IP Edge LLC)
• Original Assignee: Empire Technology Development LLC (Allied Inventors Management, LLC)
• Inventors: Kruglick, Ezekiel
• Primary Examiner(s): Boccio, Vincent F
• Application Number:
  US13/479,676
• Publication Number:
  US 20120233146A1
• Time in Patent Office: 425 Days
• Field of Search: 707/999.007, 707/705, 707/706, 707/765, 707/769
• US Class Current: 707/706
• CPC Class Codes: G06F 16/9035 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 16/957 Browsing optimisation, e.g. caching or content distillation
• CPC Class Codes: G06N 5/04 Inference or reasoning models
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

Techniques described herein generally relate to real time inference based systems. Example embodiments may set forth devices, methods, and computer programs related to search engine inference based virtual assistance. One example method may include a computing device adapted to receive text as input and a computer processor arranged to determine at least one inference regarding subject matter of the text based on one or more web searches of one or more terms within the text. The inference(s) may then be automatically displayed upon the inference(s) being determined. The text may be automatically received as input from a voice-to-text converter as voice-to-text conversion producing the text is occurring.

Claims

1. A method for automatically displaying inference terms by a computing device, comprising:

receiving streaming audio or video data;

playing received audio or video data in substantially real time as the audio or video data is received;

displaying streaming text corresponding to voice within the received audio or video data, as the received audio or video data is played;

identifying inference terms within the streaming text;

visually indicating identified inference terms within the streaming text, wherein visually indicating identified inference terms within the streaming text comprises highlighting or bracketing the identified inference terms within a text window comprising the streaming text; and

displaying, with the identified inference terms, web search information associated with the identified inference terms.

2. The method of claim 1, wherein the computing device comprises a mobile device.

3. The method of claim 1, wherein the streaming audio or video data is received in a communication session.

4. The method of claim 1, wherein the streaming audio or video data comprises video data received in a video chat session.

5. The method of claim 1, further comprising producing the streaming text with a voice-to text engine configured to operate upon the received audio or video data.

6. The method of claim 1, further comprising receiving the streaming text along with the streaming audio or video data.

7. The method of claim 1, wherein displaying streaming text comprises displaying streaming text in a text window.

8. The method of claim 1, wherein identifying inference terms within the streaming text comprises identifying rare words within the streaming text.

9. The method of claim 1, wherein displaying web search information associated with the identified inference terms comprises displaying numbers of web search hits resulting from web searches on the identified inference terms.

10. The method of claim 1, further comprising displaying an inference identified using the identified inference terms.

11. A computing device comprising:

a processor;

a memory; and

a search engine inference based virtual assistance application configured to;

receive streaming audio or video data;

play received audio or video data in substantially real time as the audio or video data is received;

display streaming text corresponding to voice within the received audio or video data, as the received audio or video data is played;

identify inference terms within the streaming text;

visually indicate identified inference terms within the streaming text, wherein visually indicating identified inference terms within the streaming text comprises highlighting or bracketing the identified inference terms within a text window comprising the streaming text; and

display, with the identified inference terms, web search information associated with the identified inference terms.

12. The computing device of claim 11, wherein the computing device comprises a mobile device.

13. The computing device of claim 11, wherein the search engine inference based virtual assistance application is configured to receive the streaming audio or video data in a communication session.

14. The computing device of claim 11, wherein the search engine inference based virtual assistance application is configured to receive the streaming audio or video data in a video chat session.

15. The computing device of claim 11, wherein the search engine inference based virtual assistance application is configured to produce the streaming text with a voice-to text engine configured to operate upon the received audio or video data.

16. The computing device of claim 11, wherein the search engine inference based virtual assistance application is configured to receive the streaming text along with the streaming audio or video data.

17. The computing device of claim 11, wherein the search engine inference based virtual assistance application is configured to display the streaming text by displaying the streaming text in a text window.

18. The computing device of claim 11, wherein the search engine inference based virtual assistance application is configured to identify inference terms within the streaming text by identifying rare words within the streaming text.

19. The computing device of claim 11, wherein the search engine inference based virtual assistance application is configured to display web search information associated with the identified inference terms by displaying numbers of web search hits resulting from web searches on the identified inference terms.

20. The computing device of claim 11, wherein the search engine inference based virtual assistance application is configured to display an inference identified using the identified inference terms.

21. A non-transitory computer readable storage medium having computer executable instructions executable by a processor, the instructions that, when executed by the processor, cause the processor to:

receive streaming audio or video data;

play received audio or video data in substantially real time as the audio or video data is received;

display streaming text corresponding to voice within the received audio or video data, as the received audio or video data is played;

identify inference terms within the streaming text;

visually indicate identified inference terms within the streaming text, wherein visually indicating identified inference terms within the streaming text comprises highlighting or bracketing the identified inference terms within a text window comprising the streaming text; and

display, with the identified inference terms, web search information associated with the identified inference terms.

22. The non-transitory computer readable storage medium of claim 21, wherein the streaming audio or video data is received in a communication session.

23. The non-transitory computer readable storage medium of claim 21, wherein the streaming audio or video data comprises video data received in a video chat session.

24. The non-transitory computer readable storage medium of claim 21, further comprising instructions that, when executed by the processor, cause the processor to produce the streaming text with a voice-to text engine configured to operate upon the received audio or video data.

25. The non-transitory computer readable storage medium of claim 21, further comprising instructions that, when executed by the processor, cause the processor to receive the streaming text along with the streaming audio or video data.

26. The non-transitory computer readable storage medium of claim 21, wherein displaying streaming text comprises displaying streaming text in a text window.

27. The non-transitory computer readable storage medium of claim 21, wherein identifying inference terms within the streaming text comprises identifying rare words within the streaming text.

28. The non-transitory computer readable storage medium of claim 21, wherein displaying web search information associated with the identified inference terms comprises displaying numbers of web search hits resulting from web searches on the identified inference terms.

29. The non-transitory computer readable storage medium of claim 21, further comprising instructions that, when executed by the processor, cause the processor to display an inference identified using the identified inference terms.