Intent engines, systems and method

• US 10,346,753 B2
• Filed: 10/28/2014
• Issued: 07/09/2019
• Est. Priority Date: 10/28/2013
• Status: Active Grant

• Current Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Original Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Inventors: Soon-Shiong, Patrick, Soon-Shiong, Luke
• Primary Examiner(s): Starks, Wilbert L
• Application Number:
  US14/525,587
• Publication Number:
  US 20150120641A1
• Time in Patent Office: 1,715 Days
• Field of Search: None
• CPC Class Codes: G06N 5/04 Inference or reasoning models
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising

Abstract

A system and method to accurately modify the function of a user'"'"'s electronic device in response to the multiple aspects making up a user'"'"'s evolving state of mind are presented. Persistent intent objects are generated to represent a user'"'"'s state of mind and the relative importance of a particular state of mind to a user'"'"'s instant attention. The intent objects can be related to situations or environments and could exist beyond any specific situations or environments. The collective effect of the intent objects can be used to customize the functions of a user device to match the user'"'"'s state of mind extending beyond inferences drawn from an individual or instant set of circumstances.

Claims

1. A method of controlling an electronic device to learn intents of a user and control output actions based on intents, the method comprising:

providing access by the electronic device to an intent management engine;

providing access by the electronic device to an intent database configured to store intent objects according to interaction attributes;

obtaining, by the intent management engine, an environmental interaction representation related to an environment of the electronic device, including obtaining sensor data from two or more of the following sensors;

a camera, a microphone, a thermometer, a global positioning system (GPS) sensor, a mechanical sensor, a chemical sensor, a biometric sensor, a hall effect sensor, an accelerometer, a pressure sensor, a compass, a magnetometer, a gas sensor, a speed sensor, a breathalyzer, an electrochemical sensor, a touch display, an optical sensor, a proximity sensor, a vibration sensor, a piezoelectric sensor, a capacitive sensor, a resistive sensor, a current sensor, a magnetometer, a voltage sensor, a liquid sensor, and a weight sensor, and forming the environmental interaction representation based on the obtained sensor data;

deriving, by the intent management engine, interaction attributes within an interaction space as a function of the environmental interaction representation;

modifying, by the intent management engine, at least one intent object from the intent database based on the interaction attributes, wherein the at least one intent object includes a life time attribute;

outputting, by the electronic device, a request for confirmation by the user of a user state of mind corresponding to the modified intent object;

receiving input from the user indicating whether the user state of mind is confirmed;

using the user input to map a correlation between interaction attributes and the modified intent object; and

configuring an output device, by the intent management engine, to adjust an output device action according to the at least one modified intent object.

2. The method of claim 1, wherein the step of modifying the at least one intent object includes at least one of instantiating, removing, deleting, activating, deactivating, classifying, archiving, exporting, forwarding, importing, receiving, tagging, duplicating, selecting, and adding information to the at least one intent object.

3. The method of claim 1, wherein the step of modifying the at least one intent object includes adjusting the expiration time of the intent object.

4. The method of claim 1, wherein the step of modifying the at least one intent object includes adjusting a relevancy attribute of the intent object with respect to the environmental interaction representation.

5. The method of claim 4, wherein the relevancy attribute is multi-valued.

6. The method of claim 5, wherein the relevancy attribute comprises multiple dimensions according to the interaction space.

7. The method of claim 1, wherein the life time comprises a duration.

8. The method of claim 1, wherein the at least one intent object comprises at least one of a proposed future intent object, a current intent object, a suggested intent object, and a user selected intent object.

9. The method of claim 1, wherein the at least one intent object comprises at least one of a user attribute, a demographic attribute, a goal attribute, a privacy attribute, a priority attribute, and a location attribute.

10. The method of claim 1, wherein the step of obtaining an environmental interaction representation includes obtaining data from a sensor.

11. The method of claim 10, wherein the sensor comprises at least one of a camera, a microphone, a thermometer, a global positioning system (GPS) sensor, a mechanical sensor, a chemical sensor, a biometric sensor, a hall effect sensor, an accelerometer, a pressure sensor, a compass, a magnetometer, a gas sensor, a speed sensor, a breathalyzer, an electrochemical sensor, a touch display, an optical sensor, a proximity sensor, a vibration sensor, a piezoelectric sensor, a capacitive sensor, a resistive sensor, a current sensor, a magnetometer, a voltage sensor, a liquid sensor, and a weight sensor.

12. The method of claim 1, wherein the step of obtaining an environmental interaction representation includes obtaining input from an interface.

13. The method of claim 12, wherein the interface comprises at least one of a touch screen, a keyboard, a controller, a joystick, a track ball, a mouse, a light pen, a graphic tablet, a barcode reader, a gamepad, a paddle, an electronic white board, a midi instrument, a video capture device, a remote, a wand, a stylus, a glove, a motion detector and a scanner.

14. The method of claim 1, wherein the intent object comprises a medical intent.

15. The method of claim 14, wherein the medical intent comprises at least one of a diagnosis intent, an appointment intent, a surgery intent, a prescription intent, a dosage intent, and a therapy intent.

16. The method of claim 1, wherein the intent object comprises an educational intent.

17. The method of claim 16, wherein the educational intent comprises at least one of a teaching intent, a syllabus intent, a curriculum intent, a learning objective intent, a conditioning intent, an assignment intent, an exam intent, an evaluation intent, a mentoring intent, a notetaking intent, a certification intent, a discipline intent, an instructional intent, a grading intent, and a lecturing intent.

18. The method of claim 1, wherein the intent object comprises a travel intent.

19. The method of claim 18, wherein the travel intent comprises at least one of a booking intent, a commission intent, a destination intent, a place of origin intent, a tour intent, a hospitality intent, a check-in intent, a route intent, a cargo intent, a luggage intent, a sightseeing intent, and a traffic intent.

20. The method of claim 1, wherein the intent object comprises a gaming intent.

21. The method of claim 20, wherein the gaming intent comprises at least one of an objective intent, a strategy intent, a bet intent, a wager intent, an instructions intent, a rules intent, a score intent, a survival intent, a demo intent, a role-playing intent, a stealth intent, and a tactical intent.

22. The method of claim 1, wherein the intent object comprises a shopping intent.

23. The method of claim 22, wherein the shopping intent comprises at least one of a purchase intent, a selling intent, a delivery intent, a spending intent, a budget intent, a barter intent, a trading intent, a return intent, an exchange intent, a bargaining intent, a discount intent, a sale intent, a clearance intent, a manufacturing intent, a retail intent, an inventory intent, an auction intent, a commission intent, a sales objective intent, a storage intent, a display intent, a social intent, a gift intent, a credit intent, and a transaction intent.

24. The method of claim 1, wherein the intent object comprises a health intent.

25. The method of claim 24, wherein the health intent comprises at least one of a fitness intent, a diet intent, a strength intent, a cardiovascular intent, an exercise intent, a running intent, a swimming intent, a stretching intent, a weight-loss intent, a weight-gain intent, a muscle growth intent, a bodybuilding intent, an agility intent, a quickness intent, a speed intent, a nutrition intent, a fat-loss intent, a hygiene intent, a cosmetic intent, an endurance intent, a blood pressure intent, an energy intent, a flexibility intent, a performance intent, a recovery intent, a relaxation intent, a therapeutic intent, a toning intent, a training intent, a stretching intent, a skills intent, a warm up intent and a workout intent.

26. The method of claim 1, wherein the intent object comprises an entertainment intent.

27. The method of claim 26, wherein the entertainment intent comprises at least one of an entertainment activity intent, a hobby intent, a holiday intent, a weekend intent, an anticipation intent, and a nightlife intent.

28. A system for controlling an electronic device to learn intents of a user and control output actions based on intents, the system comprising:

an intent database coupled with the electronic device and configured to store intent objects according to interaction attributes; and

an intent management engine coupled with the electronic device and the intent database and configured to;

obtain an environmental interaction representation related to an environment of the electronic device, including obtaining data from two or more of the following sensors;

a camera, a microphone, a thermometer, a global positioning system (GPS) sensor, a mechanical sensor, a chemical sensor, a biometric sensor, a hall effect sensor, an accelerometer, a pressure sensor, a compass, a magnetometer, a gas sensor, a speed sensor, a breathalyzer, an electrochemical sensor, a touch display, an optical sensor, a proximity sensor, a vibration sensor, a piezoelectric sensor, a capacitive sensor, a resistive sensor, a current sensor, a magnetometer, a voltage sensor, a liquid sensor, and a weight sensor, and forming the environmental interaction representation based on the obtained data;

derive interaction attributes within an interaction space as function of the environmental interaction representation;

modify at least one intent object from the intent database based on the interaction attributes, wherein the at least one intent object comprises a life time;

output, by the electronic device, a request for confirmation by the user of a user state of mind corresponding to the modified intent object;

receive input from the user indicating whether the user state of mind is confirmed;

use the user input to map a correlation between interaction attributes and the modified intent object; and

configure an output device to adjust an output device action according to the at least one intent object.

29. The system of claim 28, wherein the intent management engine is configured to do at least one of instantiating, removing, deleting, activating, deactivating, classifying, archiving, exporting, forwarding, importing, receiving, tagging, duplicating, selecting and adding information to at least one intent object.

30. The system of claim 28, wherein the intent management engine is configured to adjust the expiration time of an intent object.

31. The system of claim 28, wherein the intent management engine is configured to adjust a relevancy attribute of an intent object with respect to the environmental interaction representation.

32. The system of claim 31, wherein the relevancy attribute is multi-valued.

33. The system of claim 32, wherein the relevancy attribute comprises multiple dimensions.

34. The system of claim 28, wherein the life time comprises a duration.

35. The system of claim 28, wherein the at least one intent object comprises at least one of a proposed future intent object, a past intent object, a current intent object, a suggested intent object, and a user selected intent object.

36. The system of claim 28, wherein the at least one intent object comprises at least one of a user attribute, a demographic attribute, a goal attribute, a privacy attribute, a priority attribute, a and a location attribute.

37. The system of claim 28, wherein the step of obtaining an environmental interaction representation includes obtaining data from a sensor.

38. The system of claim 37, wherein the sensor comprises at least one of a camera, a microphone, a thermometer, a global positioning system (GPS) sensor, a mechanical sensor, a chemical sensor, a biometric sensor, a hall effect sensor, an accelerometer, a pressure sensor, a compass, a magnetometer, a gas sensor, a speed sensor, a breathalyzer, an electrochemical sensor, a touch display, an optical sensor, a proximity sensor, a vibration sensor, a piezoelectric sensor, a capacitive sensor, a resistive sensor, a current sensor, a magnetometer, a voltage sensor, a liquid sensor, and a weight sensor.

39. The system of claim 28, wherein the interface comprises at least one of a touch screen, a keyboard, a controller, a joystick, a track ball, a mouse, a light pen, a graphic tablet, a barcode reader, a gamepad, a paddle, an electronic white board, a midi instrument, a video capture device, a remote, a wand, a stylus, a glove, a motion detector and a scanner.