Displaying available menu choices in a multimodal browser

• US 20060288309A1
• Filed: 06/16/2005
• Published: 12/21/2006
• Est. Priority Date: 06/16/2005
• Status: Abandoned Application

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Pike, Hilary A., Wintermute, David W., Lewis, Benjamin D., Jablokov, Igor R., Smith, Daniel M., Hollinger, Michael C., Zaitzeff, Michael A., Cross, Charles W. Jr.
• Application Number:
  US11/154,899
• Publication Number:
  US 20060288309A1
• Time in Patent Office: Days
• US Class Current: 715/825
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: H04M 1/72445 for supporting Internet browser applications

Abstract

Methods, systems, and products are disclosed for displaying available menu choices in a multimodal browser including presenting a user a plurality of GUI menu fields; selecting one of the plurality of GUI menu fields; and displaying, in a GUI display box for the plurality of GUI menu fields, menu choices for the selected GUI menu field.

Claims

1. A method for displaying available menu choices in a multimodal browser, the method comprising:

presenting a user a plurality of GUI menu fields;

receiving user speech;

selecting one of the plurality of GUI menu fields in dependence upon the user speech and field selection rules; and

displaying, in a GUI display box for the plurality of GUI menu fields, menu choices for the selected GUI menu field.

2. The method of claim 1 wherein receiving user speech further comprises receiving a user instruction to select a particular GUI menu field.

5. The method of claim 1 further comprising highlighting the selected GUI menu field.

6. The method of claim 1 further comprising displaying to the user an icon representing a selection attribute of at least one of the plurality of GUI menu fields.

3. The method of claim 3 wherein receiving user speech further comprises receiving a selection of a menu choice from a user;

and

selecting one of the plurality of GUI menu fields in dependence upon user speech and field selection rules further comprises determining whether the selection matches one of a plurality of menu choices associated with the plurality of GUI menu fields;

identifying a GUI menu field associated with the selection if the selection matches one of the menu choices; and

identifying at least one GUI menu field not associated the matching menu choice.

4. The method of claim 3 further comprising prompting a user to select a menu choice of at least one of the GUI menu field not associated the matching menu choice.

7. A system for displaying available menu choices in a multimodal browser, the system comprising:

a computer processor;

a computer memory coupled for data transfer to the processor, the computer memory having disposed within it computer program instructions comprising;

a menu display module;

the menu display module capable of;

presenting a user a plurality of GUI menu fields;

receiving user speech;

selecting one of the plurality of GUI menu fields in dependence upon user speech and field selection rules; and

displaying, in a GUI display box for the plurality of GUI menu fields, menu choices for the selected GUI menu field.

8. The system of claim 7 wherein the menu display module is further capable of receiving a user speech instruction to select a particular GUI menu field.

9. The system of claim 7 wherein the display module is further capable of:

receiving a selection of a menu choice from a user;

determining whether the selection matches one of a plurality of menu choices associated with the plurality of GUI menu fields;

identifying a GUI menu field associated with the selection if the selection matches one of the menu choices; and

identifying at least one GUI menu field not associated the matching menu choice.

10. The system of claim 9 wherein the display module is further capable of prompting a user to select a menu choice of at least one of the GUI menu field not associated the matching menu choice.

11. The system of claim 7 wherein the display module is further capable of highlighting the selected GUI menu field.

12. The system of claim 7 wherein the display module is further capable of displaying to the user an icon representing a selection attribute of at least one of the plurality of GUI menu fields.

18. The computer program product of claim 12 further comprising computer program instructions that display to the user an icon representing a selection attributes of at least one of the plurality of GUI menu fields.

13. A computer program product for displaying available menu choices in a multimodal browser;

the computer program product disposed upon a recording medium, the computer program product comprising;

computer program instructions that present a user a plurality of GUI menu fields;

computer program instructions that receive user speech;

computer program instructions that select one of the plurality of GUI menu fields in dependence upon user speech and field selection rules; and

computer program instructions that display, in a GUI display box for the plurality of GUI menu fields, menu choices for the selected GUI menu field.

14. The computer program product of claim 13 wherein computer program instructions that receive user speech further comprise computer program instructions that receive a user instruction to select a particular GUI menu field.

15. The computer program product of claim 13 wherein computer program instructions that select the GUI menu field in dependence upon field selection rules further comprise:

computer program instructions that receive a selection of a menu choice from a user; and

computer program instructions that determine whether the selection matches one of a plurality of menu choices associated with the plurality of GUI menu fields;

computer program instructions that identify a GUI menu field associated with the selection if the selection matches one of the menu choices; and

computer program instructions that identify at least one GUI menu field not associated the matching menu choice.

16. The computer program product of claim 15 further comprising computer program instructions that prompt a user to select a menu choice of at least one of the GUI menu field not associated the matching menu choice.

17. The computer program product of claim 13 further comprising computer program instructions that highlight the selected GUI menu field.