Method and apparatus for processing an input speech signal during presentation of an output audio signal

• US 6,937,977 B2
• Filed: 10/05/1999
• Issued: 08/30/2005
• Est. Priority Date: 10/05/1999
• Status: Expired due to Term

• Current Assignee: Malikie Innovations Limited (Key Patent Innovations Limited)
• Original Assignee: fastmobile Incorporated (Blackberry Limited)
• Inventors: Gerson, Ira A.
• Primary Examiner(s): CHAWAN, VIJAY B
• Application Number:
  US09/412,202
• Publication Number:
  US 20030040903A1
• Time in Patent Office: 2,156 Days
• Field of Search: 704/270, 704/278, 704/231, 704/248, 704/201, 704/258, 704/220, 704/228, 704/263, 704/250, 704/255, 704/247, 704/270.1, 455/34.1, 455/31.1, 455/54.1, 379/410, 379/406, 379/411, 379/88, 379/89, 379/67, 379/201, 379/202, 370/32.1, 370/32, 370/110.1
• US Class Current: 704/201
• CPC Class Codes: G10L 25/78 Detection of presence or absence of voice signals switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10
• CPC Class Codes: H04M 2201/40 using speech recognition speech recognition per se G10L15/00
• CPC Class Codes: H04M 2201/60 Medium conversion
• CPC Class Codes: H04M 2207/18 wireless networks
• CPC Class Codes: H04M 3/002 Applications of echo suppressors or cancellers in telephonic connections in two-way loud-speaking telephone systems H04M9/08, echo suppressors or cancellers per se H04B3/20
• CPC Class Codes: H04M 3/493 Interactive information services, e.g. directory enquiries ; Arrangements therefor, e.g. interactive voice response [IVR] systems or voice portals

Abstract

A start of an input speech signal is detected during presentation of an output audio signal and an input start time, relative to the output audio signal, is determined. The input start time is then provided for use in responding to the input speech signal. In another embodiment, the output audio signal has a corresponding identification. When the input speech signal is detected during presentation of the output audio signal, the identification of the output audio signal is provided for use in responding to the input speech signal. Information signals comprising data and/or control signals are provided in response to at least the contextual information provided, i.e., the input start time and/or the identification of the output audio signal. In this manner, the present invention accurately establishes a context of an input speech signal relative to an output audio signal regardless of the delay characteristics of the underlying communication system.

Claims

1. A method for processing an input speech signal during presentation of an output audio signal, the method comprising steps of:

detecting a start of the input speech signal;

determining, relative to the output audio signal, an input start time of the start of the input speech signal; and

providing the input start time to establish a context in responding to the input speech signal.

2. The method of claim 1, wherein the input start time comprises any one of a time stamp relative to a temporal context of the output audio signal, a sample index relative to a sample context of the output audio signal, and a frame index relative to a frame context of the output audio signal.

3. A computer-readable medium having computer-executable instructions for performing the steps recited in claim 1.

4. A method for processing an input speech signal during presentation of an output audio signal, the method comprising steps of:

detecting the input speech signal;

determining an identification corresponding to the output audio signal; and

providing the identification to establish a context in responding to the input speech signal.

5. A computer-readable medium having computer-executable instructions for performing the steps recited in claim 4.

6. In a subscriber unit in wireless communication with an infrastructure comprising a speech recognition server, the subscriber unit comprising a speaker and a microphone, wherein the speaker provides an output audio signal and the microphone provides an input speech signal, a method for processing the input speech signal, the method comprising steps of:

detecting a start of the input speech signal during presentation of the output speech signal;

determining, relative to the output audio signal, an input start time of the start of the input speech signal; and

providing the input start time to the speech recognition server as a control parameter.

7. The method of claim 6, further comprising a step of:

receiving at least one information signal from the speech recognition server based at least in part upon the input start time.

8. The method of claim 6, the step of determining the input start time further comprising the steps of:

determining the input start time no earlier than a start of the output audio signal and no later than a start of a subsequent output audio signal.

9. The method of claim 6, wherein the input start time is any one of a time stamp relative to a temporal context of the output audio signal, a sample index relative to a sample context of the output audio signal, and a frame index relative to a frame context of the output audio signal.

10. The method of claim 6, wherein the output audio signal comprises a speech signal provided by the infrastructure.

11. The method of claim 6, wherein the output audio signal comprises a speech signal synthesized by the subscriber unit in response to control signaling provided by the infrastructure.

12. The method of claim 6, further comprising steps of:

analyzing the input speech signal to provide a parameterized speech signal;

providing the parameterized speech signal to the speech recognition server; and

receiving at least one information signal from the speech recognition server based at least in part upon the input start time and the parameterized speech signal.

13. In a subscriber unit in wireless communication with an infrastructure comprising a speech recognition server, the subscriber unit comprising a speaker and a microphone, wherein the speaker provides an output audio signal and the microphone provides an input speech signal, a method for processing the input speech signal, the method comprising steps of:

detecting the input speech signal during presentation of the output audio signal;

determining an identification corresponding to the output audio signal; and

providing the identification to the speech recognition server as a control parameter.

14. The method of claim 13, further comprising a step of:

receiving at least one information signal from the speech recognition server based at least in part upon the identification.

15. The method of claim 13, wherein the output audio signal comprises a speech signal provided by the infrastructure.

16. The method of claim 13, wherein the output audio signal comprises a speech signal synthesized by the subscriber unit in response to control signaling provided by the infrastructure.

17. The method of claim 13, further comprising steps of:

analyzing the input speech signal to provide a parameterized speech signal;

providing the parameterized speech signal to the speech recognition server; and

receiving at least one information signal from the speech recognition server based at least in part upon the identification and the parameterized speech signal.

18. In a speech recognition server forming a part of an infrastructure that wirelessly communicates with one or more subscriber units, a method for providing information signals to a subscriber unit of the one or more subscriber units, the method comprising steps of:

causing an output audio signal to be presented at the subscriber unit;

receiving, from the subscriber unit, at least an input start time corresponding to a start of an input speech signal relative to the output audio signal at the subscriber unit; and

responsive at least in part to the input start time, providing the information signals to the subscriber unit.

19. The method of claim 18, wherein the input start time is any one of a time stamp relative to a temporal context of the output audio signal, a sample index relative to a sample context of the output audio signal, and a frame index relative to a frame context of the output audio signal.

20. The method of claim 18, wherein the step of causing the output audio signal further comprises a step of:

providing a speech signal to the subscriber unit.

21. The method of claim 18, the step of providing the information signals further comprising a step of:

directing the information signals to the subscriber unit, wherein the information signals control operation of the subscriber unit.

22. The method of claim 18, wherein the subscriber unit is coupled to at least one device, the step of providing the information signals further comprising a step of:

directing the information signals to the at least one device, wherein the information signals control operation of the at least one device.

23. The method of claim 18, wherein the step of causing the output audio signal further comprises a step of:

providing control signaling to the subscriber unit, wherein the control signaling causes the subscriber unit to synthesize a speech signal as the output audio signal.

24. The method of claim 18, further comprising steps of:

receiving a parameterized speech signal corresponding to the input speech signal; and

responsive at least in part to the input start time and the parameterized speech signal, providing the information signals to the subscriber unit.

25. In a speech recognition server forming a part of an infrastructure that wirelessly communicates with one or more subscriber units, a method for providing information signals to a subscriber unit of the one or more subscriber units, the method comprising steps of:

causing an output audio signal to be presented at the subscriber unit, wherein the output audio signal has a corresponding identification;

receiving, from the subscriber unit, at least the identification when an input speech signal is detected at the subscriber unit during presentation of the output audio signal; and

responsive at least in part to the identification, providing the information signals to the subscriber unit.

26. The method of claim 25, wherein the step of causing the output audio signal further comprises a step of:

providing a speech signal to the subscriber unit.

27. The method of claim 25, the step of providing the information signals further comprising a step of:

directing the information signals to the subscriber unit, wherein the information signals control operation of the subscriber unit.

28. The method of claim 25, wherein the subscriber unit is coupled to at least one device, the step of providing the information signals further comprising a step of:

directing the information signals to the at least one device, wherein the information signals control operation of the at least one device.

29. The method of claim 25, wherein the step of causing the output audio signal further comprises a step of:

providing control signaling to the subscriber unit, wherein the control signaling causes the subscriber unit to synthesize a speech signal as the output audio signal.

30. The method of claim 25, further comprising steps of:

receiving a parameterized speech signal corresponding to the input speech signal; and

responsive at least in part to the identification and the parameterized speech signal, providing the information signals to the subscriber unit.

31. A subscriber unit that wirelessly communicates with an infrastructure comprising a speech recognition server, the subscriber unit comprising a speaker and a microphone, wherein the speaker provides an output audio signal and the microphone provides an input speech signal, the subscriber unit further comprising:

means for detecting a start of the input speech signal;

means for determining, relative to the output audio signal, an input start time of the start of the input speech signal; and

means for providing the input start time to the speech recognition server as a control parameter.

32. The subscriber unit of claim 31, further comprising:

means for receiving at least one control signal from the speech recognition server based at least in part upon the input start time.

33. The subscriber unit of claim 32, further comprising:

means for analyzing the input speech signal to provide a parameterized speech signal, wherein the means for providing also provides the parameterized speech signal to the speech recognition server, and the means for receiving also receives the at least one control signal from the speech recognition server based at least in part upon the input start time and the parameterized speech signal.

34. The subscriber unit of claim 31, wherein the means for determining the input start time function to determine the input start time no earlier than a start of the output audio signal and no later than a start of a subsequent output audio signal.

35. The subscriber unit of claim 31, wherein the input start time is any one of a time stamp relative to a temporal context of the output audio signal, a sample index relative to a sample context of the output audio signal, and a frame index relative to a frame context of the output audio signal.

36. The subscriber unit of claim 31, further comprising:

means for receiving, from the infrastructure, a speech signal to be provided as the output audio signal.

37. The subscriber unit of claim 31, further comprising:

means for receiving, from the infrastructure, control signaling regarding the output audio signal; and

means for synthesizing a speech signal as the output audio signal in response to the control signaling.

38. A subscriber unit that wirelessly communicates with an infrastructure comprising a speech recognition server, the subscriber unit comprising a speaker and a microphone, wherein the speaker provides an output audio signal and the microphone provides an input speech signal, the subscriber unit further comprising:

means for detecting the input speech signal during presentation of the output audio signal;

means for determining an identification corresponding to the output audio signal; and

means for providing the identification to the speech recognition server as a control parameter.

39. The subscriber unit of claim 38, further comprising:

means for receiving at least one control signal from the speech recognition server based at least in part upon the identification.

40. The subscriber unit of claim 39, further comprising:

means for analyzing the input speech signal to provide a parameterized speech signal, wherein the means for providing also provides the parameterized speech signal to the speech recognition server, and the means for receiving also receives the at least one control signal from the speech recognition server based at least in part upon the identification and the parameterized speech signal.

41. The subscriber unit of claim 38, further comprising:

means for receiving, from the infrastructure, a speech signal to be provided as the output audio signal.

42. The subscriber unit of claim 38, further comprising:

means for receiving, from the infrastructure, control signaling regarding the output audio signal; and

means for synthesizing a speech signal as the output audio signal in response to the control signaling.

43. A speech recognition server forming a part of an infrastructure that wirelessly communicates with one or more subscriber units, the speech recognition server further comprising:

means for causing an output audio signal to be presented at a subscriber unit of the one or more subscriber units;

means for receiving, from the subscriber unit, at least an input start time corresponding to a start of an input speech signal relative to the output audio signal at the subscriber unit; and

means, responsive at least in part to the input start time, for providing information signals to the subscriber unit.

44. The speech recognition server of claim 43, wherein the input start time is any one of a time stamp relative to a temporal context of the output audio signal, a sample index relative to a sample context of the output audio signal, and a frame index relative to a frame context of the output audio signal.

45. The speech recognition server of claim 43, wherein the means for providing the information signals further functions to direct the information signals to the subscriber unit, wherein the information signals control operation of the subscriber unit.

46. The method of claim 43, wherein the subscriber unit is coupled to at least one device, and wherein the means for providing the information signals further functions to direct the information signals to the at least one device, wherein the information signals control operation of the at least one device.

47. The speech recognition server of claim 43, wherein the means for causing the output audio signal further function to provide a speech signal to be provided as the output audio signal.

48. The speech recognition server of claim 43, wherein the means for causing the output audio signal further function to provide control signaling to the subscriber unit, wherein the control signaling causes the subscriber unit to synthesize a speech signal as the output audio signal.

49. The speech recognition server of claim 43, the means for receiving further functioning to receive a parameterized speech signal corresponding to the input speech signal, and the means for providing further functioning to provide the information signals to the subscriber unit responsive at least in part to the input start time and the parameterized speech signal.

50. A speech recognition server forming a part of an infrastructure that wirelessly communicates with one or more subscriber units, the speech recognition server further comprising:

means for causing an output audio signal to be presented at a subscriber unit of the one or more subscriber units, wherein the output audio signal has a corresponding identification;

means for receiving, from the subscriber unit, at least the identification when an input speech signal is detected at the subscriber unit during presentation of the output audio signal; and

means, responsive at least in part to the identification, for providing information signals to the subscriber unit.

51. The speech recognition server of claim 50, wherein the means for causing the output audio signal further function to provide a speech signal to be provided as the output audio signal.

52. The speech recognition server of claim 50, wherein the means for causing the output audio signal further function to provide control signaling to the subscriber unit, wherein the control signaling causes the subscriber unit to synthesize a speech signal as the output audio signal.

53. The speech recognition server of claim 50, the means for receiving further functioning to receive a parameterized speech signal corresponding to the input speech signal, and the means for providing further functioning to provide the information signals to the subscriber unit responsive at least in part to the input start time and the parameterized speech signal.

54. The speech recognition server of claim 50, wherein the means for providing the information signals further functions to direct the information signals to the subscriber unit, wherein the information signals control operation of the subscriber unit.

55. The method of claim 50, wherein the subscriber unit is coupled to at least one device, and wherein the means for providing the information signals further functions to direct the information signals to the at least one device, wherein the information signals control operation of the at least one device.