Method and apparatus for determining when a user has ceased inputting data

• US 20050165601A1
• Filed: 01/28/2004
• Published: 07/28/2005
• Est. Priority Date: 01/28/2004
• Status: Abandoned Application

• Current Assignee: Motorola, Inc. (Motorola Solutions, Inc.)
• Original Assignee: Motorola, Inc. (Motorola Solutions, Inc.)
• Inventors: Lee, Hang Shun Raymond, Anastasakos, Tasos, Gupta, Anurag K.
• Application Number:
  US10/767,422
• Publication Number:
  US 20050165601A1
• Time in Patent Office: Days
• US Class Current: 704/9
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

In a system (200) where a user'"'"'s input is received by a user interface (201), users are free to use available input modalities in any order and at any time. In order to ensure that all inputs are collected before inferring the user'"'"'s intent, an multi-modal input fusion (MMIF) module (204) receives the user input and attempts to fill available MMI templates (contained within a database (206)) with the user'"'"'s input. The MMIF module (204) will wait for further modality inputs if no MMI template is filled. However, if any MMI template within the database (206) is filled completely, the MMIF module (204) will generate a semantic representation of the user'"'"'s input with the current collection of user inputs. Additionally, if after a predetermined time no MMIF template has been filled, the MMIF module (204) will generate a semantic representation of the current user'"'"'s input and output this representation.

Claims

1. A method for determining when a user has ceased inputting data, the method comprising the steps of:

receiving an input from a user;

accessing a plurality of templates from a database;

determining if all inputs received from the user fill any templates from the database; and

determining that the user has ceased inputting data if the user'"'"'s inputs fill any template from the database.

2. The method of claim 1 further comprising the steps of:

determining if predetermined amount of time has passed; and

determining that the user has ceased inputting data if the predetermined amount of time has passed.

3. The method of claim 1 wherein the step of receiving the input from the user comprises the step of receiving a multi-modal input from the user.

4. The method of claim 3 wherein the step of receiving the multi-modal input from the user comprises the step of receiving a multimodal input from the group consisting of a text input, a speech input, and a handwritten input.

5. The method of claim 1 wherein the step of accessing the plurality of templates comprises the step of accessing a plurality of semantic templates.

6. The method of claim 1 wherein the step of accessing the plurality of templates comprises the step of accessing a plurality of templates comprising combinations of possible user inputs and their possible mode of input.

7. The method of claim 1 further comprising the step of dynamically updating templates from the database.

8. The method of claim 7 wherein the step of dynamically updating templates from the database comprises the step of dynamically updating templates based on a characteristic taken from the group consisting of available modes of input, an expected response from the user, a list of discourse obligations that constrain what the user can input in the next dialog turn, and the history and the current status of the task(s) that the user is working on.

9. A method comprising the steps of:

receiving a plurality of user inputs;

determining a content of the input for each of the user inputs;

determining a mode of input for each of the user inputs;

accessing a plurality of templates;

determining if the content and mode of the user inputs fill a template from the plurality of templates; and

determining that the user has ceased inputting data if the user'"'"'s inputs fill any template.

10. The method of claim 9 further comprising the steps of:

determining if predetermined amount of time has passed; and

determining that the user has ceased inputting data if the predetermined amount of time has passed.

11. The method of claim 9 wherein the step of receiving the plurality of user inputs comprises the step of receiving a plurality of multi-modal inputs from the user.

12. The method of claim 11 wherein the step of receiving the plurality of user inputs comprises the step of receiving a plurality of multimodal inputs from the group consisting of a text input, a speech input, and a handwritten input.

13. The method of claim 9 wherein the step of accessing the plurality of templates comprises the step of accessing a plurality of semantic templates.

14. The method of claim 9 wherein the step of accessing the plurality of templates comprises the step of accessing a plurality of templates comprising combinations of possible user inputs and their possible mode of input.

15. The method of claim 9 further comprising the step of dynamically updating the plurality of templates.

16. The method of claim 15 wherein the step of dynamically updating the plurality of templates comprises the step of dynamically updating templates based on a characteristic taken from the group consisting of available modes of input, an expected response from the user, a list of discourse obligations that constrain what the user can input in the next dialog turn, and the history and the current status of the task(s) that the user is working on.

17. An apparatus comprising:

a user interface having a plurality of multi-modal user inputs;

a template database outputting templates; and

a multi-modal input fusion (MMIF) module receiving the multi-modal user inputs and the templates, and determining if a content and mode of inputs fills a template received from the database.

18. The apparatus of claim 17 wherein:

the MMIF module determines that a user has ceased inputting data when the content and mode of inputs fill a template received from the database, or a predetermined amount of time has passed since receiving a last input from the user.

19. The apparatus of claim 17 wherein the templates comprise semantic templates.

20. The apparatus of claim 17 further comprising a template generator dynamically updating the templates.