Personal mobile computing device having antenna microphone and speech detection for improved speech recognition

• US 7,120,477 B2
• Filed: 10/31/2003
• Issued: 10/10/2006
• Est. Priority Date: 11/22/1999
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Huang, Xuedong D.
• Primary Examiner(s): LE, DANH C
• Application Number:
  US10/698,324
• Publication Number:
  US 20040092297A1
• Time in Patent Office: 1,075 Days
• Field of Search: 455/575.7, 455/575.1, 455/563, 455/231, 455/246, 704/231, 704/246, 434/185, 434/157
• US Class Current: 455/575.7
• CPC Class Codes: G06F 1/1616 with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1684 Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
• CPC Class Codes: G06F 1/1698 the I/O peripheral being a sending/receiving arrangement to establish a cordless communication link, e.g. radio or infrared link, integrated cellular phone details of antennas disposed inside a computer H01Q1/2266
• CPC Class Codes: G10L 15/25 using position of the lips, movement of the lips or face analysis
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04M 1/0214 Foldable telephones, i.e. with body parts pivoting to an open position around an axis parallel to the plane they define in closed position combined with translation movement H04M1/0235
• CPC Class Codes: H04M 1/03 Constructional features of telephone transmitters or receivers, e.g. telephone hand-sets
• CPC Class Codes: H04M 1/271 controlled by voice recognition
• CPC Class Codes: H04M 1/72409 by interfacing with external accessories hands-free H04M1/60
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces

Abstract

A mobile computing device, adapted to be held in the palm of a user'"'"'s hand, includes an antenna for transmission of information from the mobile computing device. A first microphone, adapted to convert audible speech from the user into speech signals, is positioned at a distal end of the antenna. The antenna is rotatable, while the mobile computing device is held by the user, into a position which directs the first microphone toward the mouth of the user. A speech sensor outputs a sensor signal indicative of whether the user is speaking.

Claims

1. A mobile computing device comprising:

an antenna adapted to be oriented toward a user;

a first microphone positioned on the antenna and adapted to convert audible speech from the user into speech signals;

a speech sensor outputting a sensor signal indicative of whether the user is speaking based on a non-audio input generated by speech action of the user;

a speech detector component outputting a speech detection signal indicative of whether the user is speaking based on the sensor signal;

a speech recognition component coupled to the first microphone and adapted to perform speech recognition algorithms on the speech signals to generate speech recognition data; and

an analog-to-digital converter coupling the first microphone to the speech recognition component and digitizing the speech signals, the analog-to-digital converter providing the digitized speech signals to the speech recognition component, and the speech recognition component performing the speech recognition algorithms on the digitized speech signals to generate the speech recognition data.

2. The mobile computing device of claim 1, wherein the speech recognition component is enabled or disabled as a function of the speech detection signal.

3. A mobile computing device comprising:

an antenna adapted to be oriented toward a user;

a first microphone positioned on the antenna and adapted to convert audible speech from the user into speech signals;

a speech sensor outputting a sensor signal indicative of whether the user is speaking based on a non-audio input generated by speech action of the user; and

a speech detector component outputting a speech detection signal indicative of whether the user is speaking based on the sensor signal, wherein the speech detector component outputs the speech detection signal based on a first characteristic of the sensor signal and based on the speech signals from the first microphone, wherein the first characteristic of the sensor signal has a first level when the user is speaking and a second level when the user is not speaking and wherein the speech detector component outputs the speech detection signal based on a level of the first characteristic of the sensor sienal relative to a baseline level of the first characteristic that comprises a predetermined one of the first and second levels of the first characteristic.

4. The mobile computing device of claim 3, wherein the baseline level is calculated based on a level of the first characteristic over a time period.

5. The mobile computing device of claim 4, wherein the baseline level is calculated, by averaging the level of the first characteristic over the time period.

6. The mobile computing device of claim 4, wherein the baseline level is recalculated intermittently during operation of the speech detection system.

7. The mobile computing device of claim 6, wherein the baseline level is recalculated periodically to represent the level of the first characteristic over a revolving time window.

8. The mobile computing device of claim 6, wherein the speech detection component outputs the speech detection signal based on a comparison of the level of the first characteristic of the sensor signal to the baseline level, and wherein the comparison is performed periodically.

9. A method of performing speech recognition, the method comprising:

providing a mobile computing device;

rotating an antenna of the mobile computing device toward the user such that a first microphone positioned at a distal end of the antenna is directed toward a mouth of the user;

converting audible speech from the user into speech signals using the first microphone positioned at the distal end of the antenna;

digitizing the speech signals;

providing a sensor signal based on a non-audio input generated by speech action of the user and indicative of whether the user is speaking; and

performing speech recognition algorithms on the digitized speech signals using a microprocessor positioned within the mobile computing device to generate speech recognition data if the sensor signal is indicative of the user speaking.

10. The method of claim 9, wherein the step of rotating the antenna toward the user further comprises rotating the antenna from a first position to a second position which minimizes a distance between the first microphone and the mouth of the user for a particular separation distance of the mobile computing device relative to the user.

11. The method of claim 10 wherein the step of rotating the antenna toward the user further comprises rotating the antenna to the second position which minimizes the distance between the first microphone and the mouth of the user for a particular combination of separation distance and viewing angle of the mobile computing device relative to the user.

12. The method of claim 11, and further comprising outputting a speech detection signal indicative of whether the user is speaking based on the sensor signal.

13. The method of claim 9, wherein providing the sensor signal based on the non-audio input generated by speech action of the user and indicative of whether the user is speaking further comprises generating a facial movement sensor output indicative of facial movement of the user.