Universal remote control allowing natural language modality for television and multimedia searches and requests
First Claim
1. A remote control system for controlling at least one audio/video component comprising:
- a handheld case;
a microphone disposed in said case for receiving speech input from a user;
a communication system disposed in said case for transmitting data signals to a location remote from said handheld case;
a speech recognizer for processing said speech input;
a memory for storing a semantic representation of an electronic program guide; and
a natural language parser in communication with said speech recognizer and with said memory, said parser being operative to extract semantic content from said processed speech input and to access semantic representation of said electronic program guide using said extracted semantic content to generate control instructions for said audio/video component such that the natural language parser is a task-based parser employing a grammar comprising a plurality of frames having slots representing semantic structure of said electronic program guide, wherein the natural language parser further comprises a local parser adapted to identify predetermined task-related fragments in said speech input, and a global parser adapted to receive task-related fragments and to extract overall semantics from the task-related fragments.
5 Assignments
0 Petitions
Accused Products
Abstract
The remote control unit supports multi-modal dialog with the user, through which the user can easily select programs for viewing or recording. The remote control houses a microphone into which the user can input natural language speech. The input speech is recognized and interpreted by a natural language parser that extracts the semantic content of the user'"'"'s speech. The parser works in conjunction with an electronic program guide, through which the remote control system is able to ascertain what programs are available for viewing or recording and supply appropriate prompts to the user. In one embodiment, the remote control includes a touch screen display upon which the user may view prompts or make selections by pen input or tapping. Selections made on the touch screen automatically limit the context of the ongoing dialog between user and remote control, allowing the user to interact naturally with the unit. The remote control unit can control virtually any audio-video component, including those designed before the current technology. The remote control system can be packaged entirely within the remote control handheld unit, or components may be distributed in other systems attached to the user'"'"'s multimedia equipment.
209 Citations
26 Claims
-
1. A remote control system for controlling at least one audio/video component comprising:
-
a handheld case;
a microphone disposed in said case for receiving speech input from a user;
a communication system disposed in said case for transmitting data signals to a location remote from said handheld case;
a speech recognizer for processing said speech input;
a memory for storing a semantic representation of an electronic program guide; and
a natural language parser in communication with said speech recognizer and with said memory, said parser being operative to extract semantic content from said processed speech input and to access semantic representation of said electronic program guide using said extracted semantic content to generate control instructions for said audio/video component such that the natural language parser is a task-based parser employing a grammar comprising a plurality of frames having slots representing semantic structure of said electronic program guide, wherein the natural language parser further comprises a local parser adapted to identify predetermined task-related fragments in said speech input, and a global parser adapted to receive task-related fragments and to extract overall semantics from the task-related fragments. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 23, 24, 25)
a processor component remote from said handheld case and wherein said speech recognizer is disposed in said processor component.
-
-
4. The remote control system of claim 1 wherein said natural language parser is disposed within said handheld case.
-
5. The remote control system of claim 1 further comprising:
a processor component remote from said handheld case and wherein said natural language parser is disposed in said processor component.
-
6. The remote control system of claim 1 further comprising:
an electronic program guide acquisition system coupled to said memory for downloading said representation of an electronic program guide via a telecommunications link.
-
7. The remote control system of claim 6 wherein said telecommunications link is the internet.
-
8. The remote control system of claim 6 wherein said telecommunications link is an audio/video program content delivery system.
-
9. The remote control system of claim 1 wherein said audio/video component includes a tuner and wherein said remote control system communicates with said tuner to acquire said representation of an electronic program guide.
-
10. The remote control system of claim 1 further comprising:
a dialog manager in communication with said parser for generating prompts to the user based on said extracted semantic content.
-
11. The remote control system of claim 1 further comprising:
a dialog manager having speech synthesizer for generating speech prompts to the user based on said extracted semantic content.
-
12. The remote control system of claim 1 further comprising:
a digitizing tablet disposed in said handheld case for pen-based input of user-supplied information.
-
13. The remote control system of claim 12 wherein said digitizing tablet displays prompts that are actuable by pen to limit the context in which said parser extracts semantic content.
-
14. The remote control system of claim 1 further comprising:
display unit disposed in said handheld case for providing information to the user.
-
23. The remote control device of claim 1 wherein said speech recognizer has a first component disposed in said handheld case and a second component disposed outside said handheld case.
-
24. The remote control device of claim 23 wherein said first component generates an audio domain signal for transmission to said second component.
-
25. The remote control device of claim 23 wherein said first component extracts speech parameters from input speech from a user and transmits said parameters to said second component for recognition.
-
15. A remote control device comprising:
-
a handheld case having a communication interface through which control instructions are issued to a remote component;
a display screen disposed in said case;
a microphone disposed in said case;
a speech recognizer system coupled to said microphone;
a user profile data store for storing information selected from the group consisting of prior use information, preference information and combinations thereof;
a dialog manager coupled to said speech recognizer system, to said user profile data store, and to said display screen for issuing control commands through said communication interface and for displaying information on said display screen based at least in part on information obtained from said user profile data store; and
a natural language parser in communication with said speech recognizer system, said parser being operative to extract a semantic content from said processed speech input and to access semantic representation of an electronic program guide and using said extracted semantic content to generate control instructions for said remote control, such that the natural language parser is a task-based parser employing a grammar comprising a plurality of frames having slots representing semantic structure of said electronic program guide, wherein the natural language parser further comprises a local parser adapted to identify predetermined task-related fragments in speech input received from said microphone, and a global parser adapted to receive task-related fragments and to extract overall semantics from the task-related fragments. - View Dependent Claims (16, 17, 18, 19, 20, 21, 22)
-
-
26. A remote control system for controlling at least one audio-video component comprising:
-
a handheld case;
a microphone disposed in said case for receiving speech input from a user;
a communication system disposed in said case for transmitting data signals to a location remote from said handheld case;
a speech recognizer for converting said speech input to text output;
a memory for storing a semantic representation of an electronic program guide;
a natural language parser in communication with said speech recognizer and with said memory, said parser being operative to extract semantic content from said processed speech input and to access semantic representation of said electronic program guide using said extracted semantic content to generate control instructions for said audio/video component, such that the natural language parser is a task-based parser employing a grammar comprising a plurality of frames having slots representing semantic structure of said electronic program guide, wherein the natural language parser further comprises a local parser adapted to identify predetermined task-related fragments in said speech input, and a global parser adapted to receive task-related fragments and to extract overall semantics from the task-related fragments.
-
Specification