Method, apparatus and computer-readable media for touch and speech interface with audio location
First Claim
1. Touch and speech input with audio location apparatus configured for one or more users to provide input to (i) a touch sensitive input device and (ii) a speech input device in a shared physical space, comprising:
- at least one memory storing a plurality of words in a global dictionary; and
at least one processor configured to;
receive an input from the touch sensitive input device in the shared physical space;
establish a touch time window with respect to the received input from the touch sensitive input device;
receive an input from the speech input device in the shared physical space;
determine whether the received input from the speech input device is present in the global dictionary;
determine a position location of a sound source in the shared physical space from the received input from the speech input device;
determine whether the received input from the touch sensitive input device and the position location of received input from the speech input device are both within a same region of the touch sensitive input device in the shared physical space;
if the received input from the speech input device is present in the global dictionary, determine whether the received input from the speech input device has been received within the established touch time window; and
if the received input from the speech input device has been received within the established touch time window, and the received input from the touch sensitive input device and the received input from the speech input device are both within a same region of the touch sensitive input device in the shared physical space, activate an action corresponding to both (i) the received input from the touch sensitive input device and (ii) the received input from the speech input device.
1 Assignment
0 Petitions
Accused Products
Abstract
Method, apparatus, and computer-readable media for touch and speech interface, with audio location, includes structure and/or function whereby at least one processor: (i) receives a touch input from a touch device; (ii) establishes a touch-speech time window; (iii) receives a speech input from a speech device; (iii) determines whether the speech input is present in a global dictionary; (iv) determines a location of a sound source from the speech device; (v) determines whether the touch input and the location of the speech input are both within a same region; (vi) if the speech input is in the dictionary, determines whether the speech input has been received within the window; and (vii) if the speech input has been received within the window, and the touch input and the speech input are both within the same region, activates an action corresponding to both the touch input and the speech input.
-
Citations
29 Claims
-
1. Touch and speech input with audio location apparatus configured for one or more users to provide input to (i) a touch sensitive input device and (ii) a speech input device in a shared physical space, comprising:
-
at least one memory storing a plurality of words in a global dictionary; and at least one processor configured to; receive an input from the touch sensitive input device in the shared physical space; establish a touch time window with respect to the received input from the touch sensitive input device; receive an input from the speech input device in the shared physical space; determine whether the received input from the speech input device is present in the global dictionary; determine a position location of a sound source in the shared physical space from the received input from the speech input device; determine whether the received input from the touch sensitive input device and the position location of received input from the speech input device are both within a same region of the touch sensitive input device in the shared physical space; if the received input from the speech input device is present in the global dictionary, determine whether the received input from the speech input device has been received within the established touch time window; and if the received input from the speech input device has been received within the established touch time window, and the received input from the touch sensitive input device and the received input from the speech input device are both within a same region of the touch sensitive input device in the shared physical space, activate an action corresponding to both (i) the received input from the touch sensitive input device and (ii) the received input from the speech input device. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. Touch and speech input with audio location method for at least one user to provide input to (i) a touch sensitive input device and (ii) a speech input device, in a shared physical space, comprising:
-
storing a plurality of words in a global dictionary in at least one memory; and using at least one processor to; receive an input from the touch sensitive input device in the shared physical space; establish a touch time window with respect to the received input from the touch sensitive input device; receive an input from the speech input device in the shared physical space; determine whether the received input from the speech input device is present in the global dictionary; determine a position location of a sound source in the shared physical space from the received input from the speech input device; determine whether the received input from the touch sensitive input device and the position location of received input from the speech input device are both within a same region of the touch sensitive input device in the shared physical space; if the received input from the speech input device is present in the global dictionary, determine whether the received input from the speech input device has been received within the established touch time window; and if the received input from the speech input device has been received within the established touch time window, and the received input from the touch sensitive input device and the received input from the speech input device are both within a same region of the touch sensitive input device in the shared physical space, activate an action corresponding to both (i) the received input from the touch sensitive input device and (ii) the received input from the speech input device. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18, 19)
-
-
20. Program code embodied in a non-transitory computer readable medium for touch and speech input for at least one user to provide input to a touch sensitive input device and using a speech input device, said program comprising instructions causing at least one processor to:
-
store a plurality of words in a global dictionary in at least one memory; receive an input from the touch sensitive input device in a shared physical space; establish a touch time window with respect to the received input from the touch sensitive input device; receive an input from the speech input device; determine whether the received input from the speech input device is present in the global dictionary; determine a position location of a sound source in the shared physical space from the received input from the speech input device; determine whether the received input from the touch sensitive input device and the position location of received input from the speech input device are both within a same region of the touch sensitive input device in the shared physical space; if the received input from the speech input device is present in the global dictionary, determine whether the received input from the speech input device has been received within the established touch time window; and if the received input from the speech input device has been received within the established touch time window, and the received input from the touch sensitive input device and the received input from the speech input device are both within a same region of the touch sensitive input device in the shared physical space, activate an action corresponding to both (i) the received input from the touch sensitive input device and (ii) the received input from the speech input device. - View Dependent Claims (21, 22, 23, 24, 25, 26, 27, 28, 29)
-
Specification