×

Method and system for integrating multimodal interpretations

  • US 20060143216A1
  • Filed: 12/23/2004
  • Published: 06/29/2006
  • Est. Priority Date: 12/23/2004
  • Status: Abandoned Application
First Claim
Patent Images

1. A method for integrating multimodal interpretations (MMIs) generated from user inputs to a data processing system, the user inputs being entered through at least one input modality, the method comprising:

  • generating a set of MMIs based on the user inputs for a user turn, at least one MMI comprising at least one semantic relationship function, the semantic relationship function denoting a semantic relationship between values determined from the user inputs entered through one or more of the at least one input modality, the semantic relationship function comprising at least one semantic operator;

    generating one or more sets of joint MMIs by using the generated set of MMIs, each set of joint MMIs comprising one or more MMIs of semantically compatible types;

    resolving reference values within each set of joint MMIs to generate corresponding sets of reference resolved MMIs; and

    generating an integrated MMI for each set of reference resolved MMIs by using semantic operator based fusion.

View all claims
  • 1 Assignment
Timeline View
Assignment View
    ×
    ×