×

System and method for multi-modal focus detection, referential ambiguity resolution and mood classification using multi-modal input

  • US 6,964,023 B2
  • Filed: 02/05/2001
  • Issued: 11/08/2005
  • Est. Priority Date: 02/05/2001
  • Status: Active Grant
First Claim
Patent Images

1. A multi-modal conversational computing system, the system comprising:

  • a user interface subsystem, the user interface subsystem being configured to input multi-modal data from an environment in which the user interface subsystem is deployed, the multi-modal data including data associated with a first modality input sensor and data associated with at least a second modality input sensor, and the environment including one or more users and one or more devices which are controllable by the multi-modal system;

    at least one processor, the at least one processor being operatively coupled to the user interface subsystem and being configured to;

    (i) receive at least a portion of the multi-modal input data from the user interface subsystem;

    (ii) be capable of making a determination of an intent, a focus and a mood of at least one of the one or more users based on at least a portion of the received multi-modal input data; and

    (iii) cause execution of one or more actions to occur in the environment based on at least one of the determined intent, the determined focus and the determined mood; and

    memory, operatively coupled to the at least one processor, which stores at least a portion of results associated with the intent, focus and mood determinations made by the processor for possible use in a subsequent determination;

    wherein the intent determination comprises resolving referential ambiguity associated with the one or more user and the one or more device in the environment based on at least a portion of the received multi-modal data.

View all claims
  • 1 Assignment
Timeline View
Assignment View
    ×
    ×