Method and apparatus for voice control of a television control device

• US 7,260,538 B2
• Filed: 01/07/2003
• Issued: 08/21/2007
• Est. Priority Date: 01/08/2002
• Status: Active Grant

• Current Assignee: Promptu Systems Corporation
• Original Assignee: Promptu Systems Corporation
• Inventors: Calderone, Theodore, Foster, Mark J., Printz, Harry William, Kistler, James Jay
• Primary Examiner(s): Abebe, Daniel
• Application Number:
  US10/338,591
• Publication Number:
  US 20030167171A1
• Time in Patent Office: 1,687 Days
• Field of Search: 704/275, 348/14.05
• US Class Current: 704/275
• CPC Class Codes: G08C 2201/31 Voice input
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 2025/783 based on threshold decision
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device

Abstract

A method and apparatus is disclosed for remotely processing voice commands for controlling a television. A voice command is uttered by a user into a microphone contained in a remote control. The voice command is digitized, modulated, compressed, and wirelessly transmitted to a wireless receiver connected to a set-top box. The voice command is then transmitted to a cable head-end unit for voice and word recognition processing. Once the command function is determined, the function is transmitted back to the set-top box where the set-top box performs the command. The microphone is activated and deactivated by pressing and releasing a push-to-talk (PTT) switch. The PTT activates other functions by being turned, double-clicked and toggled up and down, left and right.

Claims

1. A method for providing voice recognition processing at a cable television head-end unit for a plurality of voice controlled television cable set-top boxes in a cable television network, comprising the steps of:

a television remote control receiving user-activated indication of a voice command;

receiving said voice command through a microphone associated with said television remote control;

said television remote control wirelessly transmitting a signal representing said voice command to a cable set-top box;

said cable set-top box transmitting a signal representing said voice command via cable television link to a remotely located head-end unit;

processing said voice command at said head-end unit;

the head-end unit deriving a set-top-box-compatible command function corresponding to said voice command;

the head-end unit transmitting said command function to said cable set-top box via the cable television link;

performing said command function at said cable set-top box.

2. A method for providing voice recognition processing at a cable television head-end unit for a plurality of television controllers in a cable television network, comprising the steps of:

a television remote control receiving indication of a voice command by user operation of an activation feature associated with the television remote control;

receiving said voice command through a microphone associated with said television remote control;

said television remote control wirelessly transmitting a signal representing said voice command to a television controller;

said television controller transmitting a signal representing said voice command via cable television link to a remotely located cable head-end unit;

the head-end unit deriving a controller-compatible command function corresponding to said voice command;

the head-end unit transmitting said command function to said controller via the cable television link; and

the controller performing said command function.

3. The method of claim 2, wherein the activation feature comprises a push-to-talk switch and activation of said push-to-talk switch comprises any of:

pressing said push-to-talk switch, double pressing said push-to-talk switch, turning said push-to-talk switch clockwise and/or counterclockwise, and toggling said push-to-talk switch.

4. The method of claim 2,

where the activation feature comprises a push-to-talk switch, and the steps further comprise, responsive to operation of the push-to-talk switch, performing functions including any of:

activating said microphone, deactivating said microphone, activating a help menu, deactivating a help menu, activating a telephone, deactivating said telephone, adjusting the gain on said microphone, muting said microphone and performing a shift function.

5. The method of claim 2,

where user operation of the activation feature comprises making one or more predetermined utterances to operate a voice-activation feature of the remote control.

6. The method of claim 2, wherein said remote control comprises a wireless transmitter employing any of the following wireless communication formats:

infrared, ultrasonic, radio frequency transmission, burst transmission, a multiplexed signal, a transmission device that conforms to a Bluetooth Specification, and an infrared repeater.

7. The method of claim 2,

where the television remote control includes a keypad and a first transmitter to wirelessly transmit signals representing user entries upon the keypad;

where the operation of wirelessly transmitting the signal representing the voice command to the television controller employs a second transmitter separate from the first transmitter.

8. The method of claim 2,

where the television remote control includes a keypad and a transmitter to wirelessly transmit signals representing user entries upon the keypad;

where the operation of wirelessly transmitting the signal representing the voice command to the television controller employs the transmitter;

where the steps further comprise distinguishing between signals representing the voice commands and the signals representing user entries upon the keypad by one or more of the following;

using transmissions of same frequency and different phase, using different frequencies, using different header or footer information, including a sub-audible signal in one or both signals.

9. The method of claim 2,

where the steps further comprise:

the television remote control adding information to the signal representing the voice command transmitted to the television controller, said information contained in locations comprising any of;

header data, footer data, a sub-audible signal.

10. The method of claim 9 wherein said information comprises any of:

source of said voice command, identity of a user, on air signal, off air signal, beginning of a voice command, and end of a voice command.

11. The method of claim 2, further comprising converting signals representing said voice command into cepstrals, the converting step performed by any of:

said remote control, said television controller, a wireless transmission receiver that receives signals from said remote control.

12. The method of claim 2, performing non-repudiation measures comprising any of:

deriving a low bit rate codec of said voice command, determining the source of said voice command, analyzing said voice command for the identity of the user, and requiring the input of a code.

13. The method of claim 2, further comprising:

automatically delaying deactivation of the activation feature for a period of time after user activation of the activation feature.

14. The method of claim 2, further comprising the step of:

the head-end unit transmitting further command functions to the television controller for relay to the television remote control;

responsive to receiving the further command functions, the television controller wirelessly forwarding the further command functions to the remote control.

15. The method of claim 14,

further comprising:

responsive to receiving the further command functions, the remote control performing any of;

adjusting the gain control of said microphone and muting said microphone.

16. The method of claim 14, further comprising the step of:

responsive to receiving the further command functions, the remote control wirelessly transmitting said command function to a wirelessly operated device.

17. The method of claim 2, where the step of deriving the controller-compatible command function includes any of:

word recognition, semantic analysis.

18. An apparatus for providing voice recognition processing at a cable television head-end unit for a plurality of voice controlled television cable set-top boxes in a cable television network, comprising:

a television remote control including;

activation means for receiving user-activated indication of a voice command, microphone means for receiving the voice command, and transmission means for wirelessly transmitting a signal representing the voice command to a cable television controller;

a cable television controller including receiver means for receiving the signal representing the voice command from the television remote control and transmitter means for transmitting a signal representing the voice command via cable television link to a remotely located head-end unit;

a head-end unit including processing means for deriving cable-television-controller-compatible command functions corresponding to signals representing the voice commands received from the cable television controllers, and transmission means for transmitting signals representing the command functions back to respective cable television controllers;

where the cable television controller additionally includes second receiver means for receiving the signals representing the command functions from the head-end unit via the cable television link, and where the cable television controller includes means responsive to receipt of the command functions for executing the command functions.

19. An apparatus for providing voice recognition processing at a cable television head-end unit for a plurality of television controllers in a cable television network, comprising:

a television remote control including;

activation feature to receive user indication of a voice command, a microphone to receive the voice command, and a transmitter to wirelessly transmit a signal representing the voice command to a cable set-top box;

a cable set-too box including a receiver to receive the signal representing the voice command from the television remote control and a transmitter to transmit a signal representing the voice command via cable television link to a remotely located head-end unit;

a head-end unit to derive set-top-box-compatible command functions corresponding to signals representing voice commands received from the cable set-top-boxes and transmit signals representing the command functions back to respective cable set-too boxes;

where the cable set-top box additionally includes a second receiver to receive signals representing the command functions from the head-end unit via the cable television link, the cable set-top box responsive to receipt of the signals representing the command functions to execute the command functions.

20. The apparatus of claim 19, wherein said activation feature comprises a push-to-talk switch activated by any of:

pressing said push-to-talk switch, double pressing said push-to-talk switch, turning said push-to-talk switch clockwise and counterclockwise, and toggling said push-to-talk switch.

21. The apparatus of claim 19,

where the activation feature comprises a push-to-talk switch with functions comprising any of:

activating said microphone, deactivating said microphone, activating a help menu, deactivating a help menu, activating a telephone, deactivating said telephone, adjusting the gain on said microphone, muting said microphone, and performing a shift function.

22. The apparatus of claim 19,

where the activation feature is operated by receipt of one or more predetermined utterances.

23. The apparatus of claim 19, wherein said remote control comprises a wireless transmitter employing any of the following wireless communication formats:

infrared, ultrasonic, radio frequency transmission, burst transmission, a multiplexed signal, a transmission device that conforms to a Bluetooth Specification, and an infrared repeater.

24. The apparatus of claim 19,

where the television remote control includes a keypad and a first transmitter to wirelessly transmit signals representing user entries upon the keypad;

where the operation of wirelessly transmitting the signal representing the voice command to the cable set-top box employs a second transmitter separate from the first transmitter.

25. The apparatus of claim 19,

where the television remote control includes a keypad and a transmitter to wirelessly transmit signals representing user entries upon the keypad;

where the operation of wirelessly transmitting a signal representing the voice command to the cable set-top box employs the transmitter;

where the television remote control is configured to distinguish the signals representing the voice commands and the signals representing user entries upon the keypad by one or more of the following;

using transmissions of same frequency and different phase, using different frequencies, using different header or footer information, including a sub-audible signal in one or both signals.

26. The apparatus of claim 19,

where the television remote control is configured to add information to the signal representing the voice command transmitted to the cable set-top box, where said information is contained in locations comprising any of:

header data, footer data and a sub-audible signal.

27. The apparatus of claim 26 wherein said information comprises any of:

source of said voice command, identity of a user, on air signal, off air signal, beginning of a voice command, and end of a voice command.

28. The apparatus of claim 19,

where one of the following is configured to convert signals representing the voice command into cepstrals:

said remote control, said cable set-top box, a wireless transmission receiver that receives said transmission from said remote control.

29. The apparatus of claim 19, the television remote control further configured to automatically delay deactivation of the activation feature for a period of time after user activation.

30. The apparatus of claim 19, where:

the head-end unit is configured to transmit further command functions to the set-top box for relay to the remote control;

the set-top box is configured, responsive to receiving the further command functions, to forward the further command functions to the remote control.

31. The apparatus of claim 30,

where the remote control is configured, response to receiving the further command functions, to perform any of:

adjusting the gain control of said microphone and muting said microphone.

32. The apparatus of claim 30,

the remote control is further configured, responsive to receiving the further command functions, to wirelessly transmit said command functions to a wirelessly operated device.

33. The apparatus of claim 19, where the head-end unit is programmed such that deriving the set-top-box-compatible command function includes any of:

word recognition, semantic analysis.

34. A centralized multi-user voice operated television control system, comprising:

television remote controls configured to directly and wirelessly control television sets and additionally to receive user voice input and wirelessly transmit first output representative of the voice input to television set-top boxes;

television set top boxes configured to receive television input signals via cable television link and provide television output signals compatible with television sets, the set top boxes additionally responsive to receiving the first output from the television remote controls to transmit representative second output to a central processing station via the cable television link;

a centralized processing station configured to receive and process second output from a multitude of television set top boxes by applying voice recognition to the second output to identify user-intended voice commands, to derive set-top-box-compatible instructions to carry out the identified voice commands, and returning signals representing the instructions to respective top boxes via the cable television link;

where the set top boxes are further responsive to receiving the signals representing the instructions from the central processing station to execute the instructions.

35. The system of claim 34, where the television remote controls include circuitry to ignore user voice input except during activation of a user-operated activation feature.

36. The system of claim 34, where each television remote control includes a signature generator providing a predetermined signature signal concurrent with wireless transmission of the first output, and where the set top boxes are configured to prevent transmission to the central processing station of output from the television remote controls not containing the predetermined signature signal.

37. The system of claim 34,

where each television remote control includes a keypad and a first transmitter to wirelessly transmit signals representing user entries upon the keypad;

where the operation of wirelessly transmitting the first output employs a second transmitter separate from the first transmitter.

38. The system of claim 34,

where each television remote control includes a keypad and a transmitter to wirelessly transmit signals representing user entries upon the keypad;

where the operation of wirelessly transmitting the first output employs the transmitter;

where each television remote control is further configured to distinguish the first output from signals representing user entries upon the keypad by one or more of the following;

using transmissions of same frequency and different phase, using different frequencies, using different header or footer information, including a sub-audible signal in one or both signals.

39. The system of claim 34, where:

the set top boxes are configured to only execute certain identified commands, and for other commands, to wirelessly forward a representative fourth output representing the other commands to the television remote controls;

the television remote controls further include receivers to receive the fourth output, and are further configured to directly control wireless devices by wirelessly transmitting signals representing the fourth output.

40. A centralized multi-user voice operated television control system, comprising:

a plurality of television remote control means each for directly and wirelessly controlling television sets and additionally receiving user voice input and wirelessly transmitting first output representative of the voice input to a television set-top box means;

a plurality of television set top box means each for receiving television input signals via cable television link and providing television output signals compatible with television sets, and responsive to receiving the first output from one of the television remote control means to transmit representative second output to a central processing station via the cable television link;

a centralized processing station configured to receive and process second output from a multitude of television set top box means by applying voice recognition to the second output to identify user-intended voice commands, to derive set-top-box-means-compatible instructions to carry out the identified voice commands, and returning signals representing the instructions to respective set top box means via the cable television link;

where each set top box means is further responsive to receiving the signals representing the instructions from the central processing station to execute the instructions.

41. A method for operating a centralized multi-user voice operated television control system that includes a multitude of television remote controls situated at various television viewing sites, a multitude of set top boxes situated at the television sites to receive television input signals via cable television link and provide television output signals compatible with television sets at the television viewing sites, and a centralized processing station remote from the television viewing sites and coupled to the set top boxes via the cable television link, the method comprising operations of:

operating the television remote controls to perform additional operations including receiving user voice input and wirelessly transmitting first output representative of the voice input to set-top boxes;

operating the set top boxes to perform additional operations including, responsive to receiving the first output from the television remote controls, transmitting representative second output to a central processing station via the cable television link;

operating the centralized processing station to receive and process second output from a multitude of set top boxes by applying voice recognition to the second outputs to identify user-intended voice commands, to derive set-top-box compatible instructions to carry out the identified voice commands, and to return signals representing the instructions to the set top boxes via the cable television link;

operating the set top boxes to perform further operations including, responsive to receiving the signals representing the instructions from the central processing station, executing the instructions.