Method, apparatus and computer-readable media for touch and speech interface
First Claim
1. Touch and speech input apparatus configured for a user to provide input to (i) a touch sensitive input device and (ii) a speech input device, wherein multiple touch instances create an overlap in touch object time windows enabling more than one touch speech command to be executed from a common speech event, comprising:
- at least one memory storing a plurality of words in a global dictionary; and
at least one processor configured to;
receive a first input from the touch sensitive input device with respect to a first touch object;
establish a first touch object time window with respect to the first touch object, wherein the first touch object time window comprises a first pre-touch window and first a post-touch window;
receive a second input from the touch sensitive input device that is within the first touch object time window, with respect to a second touch object;
establish a second touch object time window with respect to the second touch object, wherein the second touch object time window comprises a second pre-touch window and a second post-touch window;
receive an input from the speech input device;
determine whether the received input from the speech input device is present in the global dictionary;
if the received input from the speech input device is present in the global dictionary, determine whether the received input from the speech input device has been received within the established first touch object time window;
if the received input from the speech input device has been received within the established first touch object time window, activate an action corresponding to both (i) the received first input from the touch sensitive input device and (ii) the received input from the speech input device, and make unavailable from a list of recognized words from the global dictionary a command corresponding to the first touch input; and
determine whether the received input from the speech input device has been received within the established second touch object time window, and, if so, activate an action corresponding to both (i) the received second input from the touch sensitive input device and (ii) the received input from the speech input device, and make unavailable from the list of recognized words from the global dictionary a command corresponding to the second touch input.
1 Assignment
0 Petitions
Accused Products
Abstract
Method, apparatus, and computer-readable media for touch and speech interface includes structure and/or function whereby at least one processor: (i) receives an input from a touch sensitive input device; (ii) establishes a touch speech time window with respect to the received touch input; (iv) receives an input from a speech input device; (v) determines whether the received speech input is present in a global dictionary; (vi) if the received speech input is present in the global dictionary, determines whether the received speech input has been received within the established touch speech time window; and (vii) if the received speech input has been received within the established touch speech time window, activate an action corresponding to both the received touch input and the received speech input.
43 Citations
31 Claims
-
1. Touch and speech input apparatus configured for a user to provide input to (i) a touch sensitive input device and (ii) a speech input device, wherein multiple touch instances create an overlap in touch object time windows enabling more than one touch speech command to be executed from a common speech event, comprising:
-
at least one memory storing a plurality of words in a global dictionary; and at least one processor configured to; receive a first input from the touch sensitive input device with respect to a first touch object; establish a first touch object time window with respect to the first touch object, wherein the first touch object time window comprises a first pre-touch window and first a post-touch window; receive a second input from the touch sensitive input device that is within the first touch object time window, with respect to a second touch object; establish a second touch object time window with respect to the second touch object, wherein the second touch object time window comprises a second pre-touch window and a second post-touch window; receive an input from the speech input device; determine whether the received input from the speech input device is present in the global dictionary; if the received input from the speech input device is present in the global dictionary, determine whether the received input from the speech input device has been received within the established first touch object time window; if the received input from the speech input device has been received within the established first touch object time window, activate an action corresponding to both (i) the received first input from the touch sensitive input device and (ii) the received input from the speech input device, and make unavailable from a list of recognized words from the global dictionary a command corresponding to the first touch input; and determine whether the received input from the speech input device has been received within the established second touch object time window, and, if so, activate an action corresponding to both (i) the received second input from the touch sensitive input device and (ii) the received input from the speech input device, and make unavailable from the list of recognized words from the global dictionary a command corresponding to the second touch input. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. Touch and speech input method for a user to provide input to a touch sensitive input device and using a speech input device, wherein multiple touch instances create an overlap in touch object time windows enabling more than one touch speech command to be executed from a common speech event, comprising:
-
storing a plurality of words in a global dictionary in at least one memory; using at least one processor to; receive a first input from the touch sensitive input device with respect to a first touch object; establish a first touch object time window with respect to the first touch object, wherein the first touch object time window comprises a first pre-touch window and first a post-touch window; receive a second input from the touch sensitive input device that is within the first touch object time window, with respect to a second touch object; establish a second touch object time window with respect to the second touch object, wherein the second touch object time window comprises a second pre-touch window and a second post-touch window; receive an input from the speech input device; receive an input from the speech input device; determine whether the received input from the speech input device is present in the global dictionary; if the received input from the speech input device is present in the global dictionary, determine whether the received input from the speech input device has been received within the established first touch object time window; if the received input from the speech input device has been received within the established first touch object time window, activate an action corresponding to both (i) the received first input from the touch sensitive input device and (ii) the received input from the speech input device, and make unavailable from a list of recognized words from the global dictionary a command corresponding to the first touch input; and determine whether the received input from the speech input device has been received within the established second touch object time window, and, if so, activate an action corresponding to both (i) the received second input from the touch sensitive input device and (ii) the received input from the speech input device, and make unavailable from the list of recognized words in the global dictionary a command corresponding to the second touch input. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18, 19, 30, 31)
-
-
20. Program code embodied in a non-transitory computer readable medium for touch and speech input for a user to provide input to a touch sensitive input device and using a speech input device, said program code comprising instructions causing at least one processor to:
-
receive a first input from the touch sensitive input device with respect to a first touch object; establish a first touch object time window with respect to the first touch object, wherein the first touch object time window comprises a first pre-touch window and first a post-touch window; receive a second input from the touch sensitive input device that is within the first touch object time window, with respect to a second touch object; establish a second touch object time window with respect to the second touch object, wherein the second touch object time window comprises a second pre-touch window and a second post-touch window; receive an input from the speech input device; determine whether the received input from the speech input device is present in the global dictionary; if the received input from the speech input device is present in the global dictionary, determine whether the received input from the speech input device has been received within the established first touch object time window; if the received input from the speech input device has been received within the established first touch object time window, activate an action corresponding to both (i) the received first input from the touch sensitive input device and (ii) the received input from the speech input device, and make unavailable from a list of recognized words in the global dictionary a command corresponding to the first touch input; and determine whether the received input from the speech input device has been received within the established second touch object time window, and, if so, activate an action corresponding to both (i) the received second input from the touch sensitive input device and (ii) the received input from the speech input device, and make unavailable from the list of recognized words in the global dictionary a command corresponding to the second touch input. - View Dependent Claims (21, 22, 23, 24, 25, 26, 27, 28, 29)
-
Specification