Multisensory Speech Detection

• US 20130013316A1
• Filed: 09/14/2012
• Published: 01/10/2013
• Est. Priority Date: 11/10/2008
• Status: Abandoned Application

• Current Assignee: Google Inc. (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Burke, Dave, LeBeau, Michael J., Gianno, Konrad, Kristjansson, Trausti, Jitkoff, John Nicholas, Senior, Andrew W.
• Application Number:
  US13/618,928
• Publication Number:
  US 20130013316A1
• Time in Patent Office: Days
• US Class Current: 704/270
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/10 using distance or distortion measures between unknown speech and reference templates
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 17/00 Speaker identification or verification techniques
• CPC Class Codes: G10L 25/21 the extracted parameters being power information
• CPC Class Codes: G10L 25/78 Detection of presence or absence of voice signals switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10
• CPC Class Codes: H04M 1/72454 according to context-related or environment-related conditions
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion telephones including GPS signal receivers H04M2250/10
• CPC Class Codes: H04M 2250/74 with voice recognition means voice activated dialling H04M1/271; voice recognition algorithms G10L15/00
• CPC Class Codes: H04R 1/08 Mouthpieces; Microphones; Attachments therefor
• CPC Class Codes: H04W 4/026 using orientation information, e.g. compass

Abstract

A computer-implemented method of multisensory speech detection is disclosed. The method comprises determining an orientation of a mobile device and determining an operating mode of the mobile device based on the orientation of the mobile device. The method further includes identifying speech detection parameters that specify when speech detection begins or ends based on the determined operating mode and detecting speech from a user of the mobile device based on the speech detection parameters.

Claims

1. A computer-implemented method, comprising:

determining, using a processor, an orientation of a mobile device;

determining, using the processor, an operating mode of the mobile device based on the determined orientation of the mobile device;

identifying speech detection parameters that specify when speech detection begins or ends based on the determined operating mode; and

detecting speech from a user of the mobile device based on the speech detection parameters.

2. The method of claim 1, wherein determining the orientation of the mobile device comprises detecting an angle of the mobile device.

3. The method of claim 1, wherein determining the orientation of the mobile device comprises detecting a proximity of the mobile device to the user of the mobile device.

4. The method of claim 1, wherein the determined operating mode of the mobile device consists of one of a personal digital assistant operating mode, a telephone operating mode, or a walkie-talkie operating mode.

5. The method of claim 1, wherein determining the operating mode of the mobile device comprises using a Bayesian network to identify a movement of the mobile device.

6. The method of claim 1, wherein determining the operating mode of the mobile device comprises using a Hidden Markov Model to identify a movement of the mobile device.

7. The method of claim 1, further comprising indicating to the user of the mobile device that speech detection has started or ended.

8. The method of claim 7, wherein indicating to the user of the mobile device that speech detection has started or ended comprises a visual or auditory notification.

9. A system, comprising:

one or more computers having

at least one sensor that detects an orientation of a mobile device;

a pose identifier that identifies a pose of the mobile device based on the detected orientation of the mobile device; and

a speech endpointer that identifies selected speech detection parameters that specify when speech detection begins or ends.

10. The system of claim 9, wherein the at least one sensor comprises an accelerometer.

11. The system of claim 9, wherein the at least one sensor comprises a proximity sensor.

12. The system of claim 9, further comprising a gesture classifier that classifies movements of the mobile device.

13. The system of claim 9, wherein the identified pose identifier consists of one of a personal digital assistant pose, a telephone pose, or a walkie-talkie pose.

14. A system, comprising:

one or more computers having

at least one sensor that detects an orientation of a mobile device;

a pose identifier that identifies a pose of the mobile device based on the detected orientation of the mobile device; and

means for identifying selected speech detection parameters that determine whether a user of the mobile device is speaking to the mobile device.

15. The system of claim 14, wherein the at least one sensor comprises a proximity sensor.

16. The system of claim 14, wherein the identified pose identifier consists of one of a personal digital assistant pose, a telephone pose, or a walkie-talkie pose.

17. The system of claim 14, further comprising a gesture classifier that classifies movements of the mobile device.

18. The system of claim 14, wherein the at least one sensor comprises a camera.

19. The system of claim 14, wherein the at least one sensor comprises an accelerometer.