Multi-Dimensional Interactions and Recall

• US 20130211841A1
• Filed: 02/14/2013
• Published: 08/15/2013
• Est. Priority Date: 02/15/2012
• Status: Abandoned Application

• Current Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Original Assignee: Fluential, LLC
• Inventors: Ehsani, Farzad, Master, Demitrios L., Witt-Ehsani, Silke Maren
• Application Number:
  US13/767,034
• Publication Number:
  US 20130211841A1
• Time in Patent Office: Days
• US Class Current: 704/270.1
• CPC Class Codes: G06F 40/35 Discourse or dialogue representation
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 21/00 Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility G10L19/00 takes precedence

Abstract

Methods for initiating actions based on analysis of multi-dimensional interactions are presented. Electronic devices can acquire sensor data representing interactions among multiple entities. Analysis engines can use the interaction data to create or otherwise manage interaction guide queues based on conceptual threads associated with the interactions. Interaction guides within the queue comprise instructions, possibly domain-specific instructions, for devices to participate in the interactions. Contemplated engines manage the queues as a function of attributes, for example priority, derived from the interactions.

Claims

1. A method of initiating actions based on multi-dimensional interactions, the method comprising:

configuring an electronic device to capture a digital representation of a interaction;

providing access to an interaction analysis engine coupled with the electronic device and configured to obtain the digital representation of the interaction;

differentiating, by the interaction analysis engine, at least two conceptual threads within the digital representation of the interaction;

modifying, by the interaction analysis engine, a queue of interaction guides as a function of attributes derived from differentiation of the at least two conceptual threads; and

configuring the electronic device to initiate an action as a function of the interaction guides and according to the queue.

2. The method of claim 1, further comprising providing access to a conceptual threads database storing a priori defined conceptual threads.

3. The method of claim 1, wherein the step of differentiating comprises identifying the at least two conceptual threads in a serialized interaction.

4. The method of claim 3, further comprising identifying a breakpoint between the at least two conceptual threads.

5. The method of claim 4, further comprising storing the breakpoint as a breakpoint object in a breakpoint database.

6. The method of claim 5, wherein the breakpoint object comprises attributes including at least one of the following:

a time, a location, a speaker, a context change, a modality shift, a sensed urgency, a tone, an manually inserted instruction, and metadata.

7. The method of claim 1, wherein the step of differentiating comprises identifying the at least two conceptual threads in a parallel interaction.

8. The method of claim 1, wherein the at least one conceptual thread comprises a NULL conceptual thread.

9. The method of claim 1, wherein the interaction comprises human speech.

10. The method of claim 1, wherein the interaction comprises multiple modalities.

11. The method of claim 10, wherein the interaction comprises human speech and at least one of the following modalities:

text data, visual data, kinesthetic data, auditory data, taste data, and ambient data.

12. The method of claim 1, wherein the step of modifying the queue includes at least one of the following queue actions:

queue creation, queue deletion, add an interaction guide, remove an interaction guide, prioritize an interaction guide, modify an interaction guide, insert an interaction guide, merge an interaction guide, change a state of an interaction guide, and re-order an interaction guide.

13. The method of claim 1, further comprising the electronic device initiating the action of controlling an external device.

14. The method of claim 1, further comprising the electronic device initiating the action of scheduling an appointment.

15. The method of claim 1, further comprising the electronic device initiating the action of conducting a transaction with an account.

16. The method of claim 1, further comprising the electronic device initiating the action of sending a message.

17. The method of claim 1, further comprising the electronic device initiating the action of initiating a software process.

18. The method of claim 1, further comprising the electronic device initiating the action of initiating a phone call.

19. The method of claim 1, further comprising the electronic device initiating the action of playing a game.

20. The method of claim 1, further comprising the electronic device initiating the action of requesting additional information from a user.

21. The method of claim 1, wherein the queue comprises a priority-based queue.

22. The method of claim 1, wherein the derived attributes include at least one of the following:

a priority, an urgency, an importance, and an initiator.

23. The method of claim 1, wherein the interaction guide comprises a domain-specific interaction guide.