Systems and methods of processing annotations and multimodal user inputs
First Claim
1. A computer-implemented method for processing user inputs comprising:
- prompting a user for a plurality of inputs;
receiving a command specifying one of the plurality of inputs, wherein the system is activated to receive both a voice command and a manual selection command;
activating a voice and manual selection mode associated with the specified input; and
if a voice input is detected, processing the voice input in accordance with the associated voice mode, or if a manual selection input is detected, processing the touch screen input in accordance with the associated manual selection mode.
1 Assignment
0 Petitions
Accused Products
Abstract
Embodiments of the present invention provide multimodal input capability. In one embodiment the present invention includes an input method comprising displaying one or more display objects to a user, associating at least one voice mode with one of said display objects, associating at least one stylus mode with the display object, and associating at least one voice navigation command with the display object. The system may prompt a user for a plurality of inputs, receive a voice command or a touch screen command specifying one of the plurality of inputs, activate a voice and touch screen mode associated with the specified input, and process the voice input in accordance with the associated voice mode or the associated touch screen mode.
140 Citations
35 Claims
-
1. A computer-implemented method for processing user inputs comprising:
-
prompting a user for a plurality of inputs;
receiving a command specifying one of the plurality of inputs, wherein the system is activated to receive both a voice command and a manual selection command;
activating a voice and manual selection mode associated with the specified input; and
if a voice input is detected, processing the voice input in accordance with the associated voice mode, or if a manual selection input is detected, processing the touch screen input in accordance with the associated manual selection mode. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A computer-implemented method for processing user inputs comprising:
-
displaying one or more display objects to a user;
associating at least one voice mode with one of said display objects;
associating at least one touch screen mode with the display object; and
associating at least one voice command with the display object. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A computer system including software for processing user inputs, the software comprising:
-
an annotation component for associating voice or touch screen inputs with particular objects in a display;
an input controller for selecting between voice and touch screen inputs;
a speech recognition component for receiving grammars and voice inputs and providing recognition results; and
metadata for specifying said grammars and said associations of voice or touch screen inputs with particular objects in a display. - View Dependent Claims (20, 21, 22, 23, 24)
-
-
25. A computer-readable medium containing instructions for controlling a computer system to perform a method of processing user inputs comprising:
-
displaying a plurality of display objects;
receiving a command specifying one of the plurality of display objects, wherein the command is a voice command or a touch screen command;
activating a voice and touch screen mode associated with the specified display object; and
if a voice input is detected, processing the voice input in accordance with the associated voice mode, or if a touch screen input is detected, processing the touch screen input in accordance with the associated touch screen mode. - View Dependent Claims (26, 27, 28, 29)
-
-
30. A computer-readable medium containing instructions for controlling a computer system to perform a method of processing user inputs comprising:
-
displaying one or more display objects to a user;
associating at least one voice mode with one of said display objects;
associating at least one touch screen mode with the display object; and
associating at least one voice command with the display object. - View Dependent Claims (31, 32, 33, 34, 35)
-
Specification