SELF-LEARNING, CONTEXT AWARE VIRTUAL ASSISTANTS, SYSTEMS AND METHODS

• US 20130204813A1
• Filed: 01/17/2013
• Published: 08/08/2013
• Est. Priority Date: 01/20/2012
• Status: Abandoned Application

• Current Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Original Assignee: Fluential, LLC
• Inventors: Ehsani, Farzad, Master, Demitrios Leo, Witt-Ehsani, Silke Maren
• Application Number:
  US13/744,056
• Publication Number:
  US 20130204813A1
• Time in Patent Office: Days
• US Class Current: 706/12
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 5/04 Inference or reasoning models

Abstract

A virtual assistant learning system is presented. A monitoring device, a cell phone for example, observes user interactions with an environment by acquiring sensor data. The monitoring device uses the sensor data to identify the interactions, which in turn is provided to an inference engine. The inference engine leverages the interaction data and previously stored knowledge elements about the user to determine if the interaction exhibits one or more user preferences. The inference engine can use the preferences and interactions to construct queries targeting search engines to seek out possible future interactions that might be of interest to the user.

Claims

1. A virtual assistant learning system comprising:

a user knowledge database storing knowledge elements associated with at least one user;

a monitoring device communicatively coupled with the user knowledge database and configured to;

acquire sensor data from a plurality of sensors, the sensor data representative of an environment; and

identify an interaction of a user with the environment as a function of the sensor data; and

an inference engine communicatively coupled with the monitoring device and the knowledge database, and configured to;

infer a preference from the interaction and knowledge elements;

construct a query according to an indexing system of a search engine and based on the preference, the query requesting a result set of proposed future interactions; and

enabling an electronic device to present at least a portion of the proposed future interactions to a user.

2. The system of claim 1, wherein the inference engine further is configured to update knowledge elements as a function of the inferred preferences.

3. The system of claim 1, wherein the monitoring device further is configured to update knowledge elements as a function of the interaction.

4. The system of claim 1, wherein the preference is derived from historical knowledge elements.

5. The system of claim 1, wherein the monitoring device comprises the electronic device.

6. The system of claim 5, wherein the electronic device comprises at least one of the following mobile devices:

a cell phone, a vehicle, a table computer, a robot, game system, and a personal sensor array.

7. The system of claim 5, wherein at least some of the sensors are disposed internal to the electronic device.

8. The system of claim 1, wherein at least some of the sensors are disposed external to the monitoring device.

9. The system of claim 8, wherein at least some of the sensors comprise fixed location sensors.

10. The system of claim 1, wherein some of the knowledge elements comprise an aging factor.

11. The system of claim 10, wherein the inference engine is configured to modify the aging factor of some of the knowledge element according to an adjustment based on a time.

12. The system of claim 11, wherein the adjustment is selected from the following group:

increasing a weight of the knowledge element based on time, and decreasing the weight of the knowledge element based on time.

13. The system of claim 1, wherein the sensor data comprises a representation of a real-world environment.

14. The system of claim 1, wherein the sensor data comprises a representation of a virtual environment.

15. The system of claim 1, wherein the sensor data comprises multiple modalities.

16. The system of claim 15, wherein the multiple modalities include at least two of the following:

audio, speech data, image data, motion data, temperature data, pressure data, tactile data, location data, and taste data.

17. The system of claim 1, wherein the interaction comprises metadata describing the nature of the interaction.

18. The system of claim 17, wherein the metadata includes as least one of the following:

a time stamp, a location, a user, an interaction identifier, a sensor data signature, a context, and a preference.

19. The system of claim 1, wherein the inference engine is further configured to identify a trend associated with the preference based on historical knowledge elements.

20. The system of claim 19, wherein the inference engine is further configured to identify a change in the trend.

21. The system of claim 20, wherein the query is constructed as a function of the change in the trend.

22. The system of claim 1, wherein the inference engine is further configured to recall knowledge elements associated with historical interactions.