Distributed, predictive, dichotomous decision engine for an electronic personal assistant

• US 10,169,712 B2
• Filed: 11/07/2017
• Issued: 01/01/2019
• Est. Priority Date: 01/25/2011
• Status: Active Grant

• Current Assignee: Telepathy Labs, Inc.
• Original Assignee: Telepathy IP Holdings
• Inventors: Stolarz, Damien, Diaz, David J., Rossfeld, James, Raven, Scott, O'Malley, Chris, Kurpinski, Christopher
• Primary Examiner(s): Sadio, Insa
• Application Number:
  US15/805,964
• Publication Number:
  US 20180075364A1
• Time in Patent Office: 420 Days
• CPC Class Codes: G06F 16/242 Query formulation
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 2203/011 Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06N 5/04 Inference or reasoning models
• CPC Class Codes: G06N 7/01 Probabilistic graphical models, e.g. probabilistic networks

Abstract

A system, method and user interface are described for providing a personal assistant functionality using a predictive, adaptive, dichotomous (two choices) decision engine that proactively prompts the user for decisions on matters deemed relevant by the decision engine based on past user decisions and activities.

Claims

1. A method comprising:

receiving on a personal electronic device an environmental input from a user;

if the environmental input cannot be fully processed on the personal electronic device, the personal electronic device forwarding the environmental input to a remote device via a communication link while registering input from the user, processing the environmental input on the remote device, and the remote device returning a response for processing on the personal electronic device based on the environmental input; and

if the environmental input can be fully processed on the personal electronic device, fully processing the environmental input on the personal electronic device.

2. The method of claim 1, wherein the personal electronic device further comprises a user interface for receiving the environmental input, the user interface is selected from a group consisting of a location sensor, a noise sensor, a neural interface, a face-tracking system interface, an eye-tracking system interface, a gestural device interface, a bodily sensor interface, an interactive voice response system interface, and a voice control device interface.

3. The method of claim 1, wherein the environmental input is selected from a group consisting of a sensory input, an audio input, pressing of a button or a key, an electronic signal induced in a brain by thoughts, an electronic signal induced in the brain by emotions, an electronic signal induced in a nerve, and an electronic signal induced in the brain, the nerve, and/or a surface of a head or a body of the user when tensing a muscle, moving or blinking at least one eye, making a particular face, smiling or frowning, moving at least one finger, moving a leg or an arm, and/or moving head.

4. The method of claim 1, wherein the remote device is a remote server or a smartphone.

5. The method of claim 1, wherein the personal electronic device is a watch, a headset, or a vehicle.

6. The method of claim 1, wherein the personal electronic device is a smartphone.

7. The method of claim 1, wherein the returned response indicates success or provides requested data to the personal electronic device.

8. The method of claim 1, wherein the processing of the response further comprises the personal electronic device delivering or performing the response.

9. The method of claim 1, wherein the remote device reduces message delivery based on the environmental input or the remote device stops message delivery based on the environmental input.

10. A computer program product comprising non-transitory computer executable code embodied in a non-transitory computer readable medium configured to:

receive an environmental input from a user on a personal electronic device;

if the environmental input cannot be fully processed on the personal electronic device, forward the environmental input to a remote device via a communication link while registering input from the user, process the environmental input on the remote device, and the remote device returns a response for processing on the personal electronic device based on the environmental input; and

if the environmental input can be fully processed on the personal electronic device, fully process the environmental input on the personal electronic device.

11. The computer program product of claim 10, wherein the non-transitory computer executable code embodied in a non-transitory computer readable medium is further configured to receive the environmental input on a user interface of the personal electronic device, the user interface selected from a group consisting of a location sensor, a noise sensor, a neural interface, a face-tracking system interface, an eye-tracking system interface, a gestural device interface, a bodily sensor interface, an interactive voice response system interface, and a voice control device interface.

12. The computer program product of claim 10, wherein the remote device is a remote server or a smartphone, and wherein the personal electronic device is a watch, a headset, or a vehicle.

13. The computer program product of claim 10, wherein the returned response indicates success or provides requested data to the personal electronic device.

14. The computer program product of claim 10, wherein the processing of the response further comprises the personal electronic device delivering or performing the response.

15. The computer program product of claim 10, wherein the remote device reduces message delivery based on the environmental input or the remote device stops message delivery based on the environmental input.

16. A personal assistant system comprising:

a personal electronic device for receiving an environmental input from a user; and

a software program running on the personal electronic device that is configured to;

receive the environmental input from the user;

if the environmental input cannot be fully processed on the personal electronic device, forward the environmental input to a remote device via a communication link while registering input from the user, process the environmental input on the remote device, and the remote device returns a response for processing on the personal electronic device based on the environmental input; and

if the environmental input can be fully processed on the personal electronic device, fully process the environmental input on the personal electronic device.

17. The personal assistant system of claim 16, wherein the personal electronic device further comprises a user interface for receiving the environmental input, the user interface is selected from a group consisting of a location sensor, a noise sensor, a neural interface, a face-tracking system interface, an eye-tracking system interface, a gestural device interface, a bodily sensor interface, an interactive voice response system interface, and a voice control device interface.

18. The personal assistant system of claim 16, wherein the remote device is a remote server or a smartphone.

19. The personal assistant system of claim 16, wherein the personal electronic device is a smartphone.

20. The personal assistant system of claim 16, wherein the processing of the response further comprises the personal electronic device delivering or performing the response.