Active content rich media using intelligent personal assistant applications

• US 10,275,529 B1
• Filed: 04/29/2016
• Issued: 04/30/2019
• Est. Priority Date: 04/29/2016
• Status: Active Grant

• Current Assignee: Rich Media Ventures, LLC
• Original Assignee: Rich Media Ventures, LLC
• Inventors: Cronin, John, Balthaser, Neil, Springer, Colby Brian
• Primary Examiner(s): Singh, Amresh
• Application Number:
  US15/142,350
• Time in Patent Office: 1,096 Days
• Field of Search: None
• CPC Class Codes: G06F 16/3329 Natural language query formulation or dialogue systems
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/957 Browsing optimisation, e.g. caching or content distillation
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]

Abstract

The systems and methods are directed towards embodiments for incorporating alternative sources of information, other than current online sources, for use with intelligent personal assistants. These alternative sources are processed and prioritized by the intelligent personal assistant when performing queries by the user. Furthermore, the intelligent personal assistant is capable of performing other actions related to the alternative source of information. In another embodiment, the user is capable of providing both audio commands and motion-based commands to the intelligent personal assistant to instruct the intelligent personal assistant to perform specific processes whereby the audio commands correspond to a first set of processes and the motion-based commands correspond to a distinct second set of processes.

Claims

1. A method for querying active content via an intelligent personal assistant, the method comprising:

receiving an active content file at a computing device, wherein the active content file is an e-book and that is prioritized over other source files for preparing a response to one or more specified questions;

parsing the prioritized active content file of the e-book using at least text-to-speech conversion, wherein parsing the prioritized active content file of the e-book further includes parsing different information portions of the prioritized active content file of the e-book for use with one or more recognized commands compatible with an intelligent personal assistant of the computing device;

storing the parsed information portions of the prioritized active content file into a database;

receiving a question regarding the content of the e-book;

analyzing the question to identify at least one of the one or more recognized commands and at least one of the parsed information portions of the prioritized active content file associated with providing a response;

applying the at least one identified command to query the at least one parsed information portion for information responsive to the question;

generating a response based on the responsive information, the response generated to be displayed on a display of the computing device;

receiving an indication regarding accuracy of the generated response via a user interface of the computing device; and

modifying subsequent responses to the same question when the indication is negative regarding the accuracy of the displayed response.

2. The method of claim 1, further comprising accessing information from online sources when the indication regarding accuracy indicates that the displayed response is not satisfactory, wherein the displayed response is further modified to include information obtained from the online sources.

3. The method of claim 1, wherein a different active content file is prioritized for a different set of specified questions, and wherein the different active content file is one of e-mails, PDFs, and other text-based documents.

4. The method of claim 1, wherein the question is received via a voice/audio-based command.

5. The method of claim 1, wherein the question is received via a motion-based command.

6. The method of claim 5, wherein the motion-based command is obtained from a wearable device that includes at least one sensor.

14. The method of claim 1, further comprising querying an online source only when no responsive information to the question result is yielded within the parsed active content file.

7. A system for querying active content via an intelligent personal assistant, the system comprising:

a user interface associated with the computing device that;

receives an active content file at a computing device, wherein the active content file is an e-book and that is prioritized over other source files for preparing a response to one or more specified questions, and

receives a question regarding the content of the e-book;

a processor that executes instructions stored in memory, wherein the processor executes the instructions to;

parse the prioritized active content file of the e-book using at least text-to-speech conversion, wherein parsing the prioritized active content file of the e-book further includes parsing different information portions of the prioritized active content file of the e-book for use with one or more recognized commands compatible with an intelligent personal assistant of the computing device,

store the parsed information portions of the prioritized active content file into a database,

analyze the question to identify at least one of the one or more recognized commands and at least one of the parsed information portions of the prioritized active content file associated with providing a response,

apply the at least one identified command to query the at least one parsed information portion for information responsive to the question,

generate a response based on the responsive information,

the response generated to be displayed on a display of the computing device;

wherein the user interface receives an indication regarding accuracy of the generated response, and modifies subsequent responses to the same question when the indication is negative regarding the accuracy of the displayed response.

8. The system of claim 7, wherein the processor further executes instructions to access information from online sources when the indication regarding accuracy indicates that the displayed response is not satisfactory, wherein the displayed response is further modified to include information obtained from the online sources.

9. The system of claim 7, wherein a different active content file is prioritized for a different set of specified questions, and wherein the different active content file is one of e-mails, PDFs, and other text-based documents.

10. The system of claim 7, wherein the question is received via a voice/audio-based command.

11. The system of claim 7, wherein the question is received via a motion-based command.

12. The system of claim 11, wherein the motion-based command is obtained from a wearable device that includes at least one sensor.

13. A non-transitory computer readable storage medium having embodied thereon a program executable by a processor to perform a method for querying active content via an intelligent personal assistant, the method comprising:

receiving an active content file at a computing device, wherein the active content file is an e-book and that is prioritized over other source files for preparing a response to one or more specified questions;

parsing the prioritized active content file of the e-book using at least text-to-speech conversion, wherein parsing the prioritized active content file of the e-book further includes parsing different information portions of the prioritized active content file of the e-book for use with one or more recognized commands compatible with an intelligent personal assistant of the computing device;

storing the parsed information portions of the prioritized active content file into a database;

receiving a question regarding the content of the e-book;

analyzing the question to identify at least one of the one or more recognized commands and at least one of the parsed information portions of the prioritized active content file associated with providing a response;

applying the at least one identified command to query the at least one parsed information portion for information responsive to the question;

generating a response based on the responsive information, the response generated to be displayed on a display of the computing device;

receiving an indication regarding accuracy of the generated response via a user interface of the computing device; and

modifying subsequent responses to the same question when the indication is negative regarding the accuracy of the displayed response.