SPEECH PROCESSING WITH SOURCE LOCATION ESTIMATION USING SIGNALS FROM TWO OR MORE MICROPHONES

• US 20100211387A1
• Filed: 02/02/2010
• Published: 08/19/2010
• Est. Priority Date: 02/17/2009
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Inventors: Chen, Ruxin
• Granted Patent: US 8,442,833 B2
• Time in Patent Office: Days
• US Class Current: 704/226
• CPC Class Codes: G10L 2015/025 Phonemes, fenemes or fenones being the recognition units
• CPC Class Codes: G10L 2021/02165 Two microphones, one receiving mainly the noise signal and the other one mainly the speech signal
• CPC Class Codes: G10L 25/78 Detection of presence or absence of voice signals switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10

Abstract

Computer implemented speech processing is disclosed. First and second voice segments are extracted from first and second microphone signals originating from first and second microphones. The first and second voice segments correspond to a voice sound originating from a common source. An estimated source location is generated based on a relative energy of the first and second voice segments and/or a correlation of the first and second voice segments. A determination whether the voice segment is desired or undesired may be made based on the estimated source location.

Claims

1. A computer speech processing system, comprising:

one or more voice segment detection modules configured to extract first and second voice segments from first and second microphone signals originating from first and second microphones, wherein the first and second voice segments correspond to a voice sound originating from a common source;

a source location estimation module configured to produce an estimated source location based on a relative energy of the first and second voice segments and/or a correlation of the first and second voice segments; and

a decision module configured to determine whether the voice segment is desired or undesired based on the estimated source location.

2. The system of claim 1, further comprising:

a speech recognition module coupled to the decision module, wherein the speech recognition module configured to convert the first voice segment into a group of input phonemes, compare the group of phonemes to one or more entries in a database stored in a memory, and trigger a change of state of the system corresponding to a database entry that matches the group of input phonemes.

3. The system of claim 2 wherein the decision module is further configured to enable processing of a desired voice segment by the speech recognition module and disable processing of an undesired speech segment by the speech recognition module.

4. The system of claim 1 wherein the source location estimation module is configured to generate an estimated distance to the source from the relative energy of the first and second voice segments.

5. The system of claim 4, wherein the decision module is configured to determine whether the first voice segment is desired or undesired based on the estimated distance.

6. The system of claim 4, wherein the source location estimation module is further configured to generate an estimated direction to the common source from on a correlation of the first and second voice segments.

7. The system of claim 6, wherein the decision module is configured to determine whether the first voice segment is desired or undesired based on the estimated distance and the estimated direction.

8. The system of claim 6, wherein the first microphone signal is from a near-field microphone and the second signal is from a far-field microphone.

9. The system of claim 6, wherein the decision module is configured to analyze an image from a video camera and determine from the estimated direction and an analysis of the image whether the common source is within a field of view of the video camera.

10. The system of claim 9, wherein the video camera is a depth camera and the estimation module is configured to analyze one or more images from the depth camera to determine the estimated distance.

11. The system of claim 1 wherein the first and second microphones are synchronized to a common clock.

21. The method of claim 9, wherein the video camera is a depth camera and the estimated distance is determined by analyzing one or more images from the depth camera.

12. In a computer voice processing system having a processing unit and a memory unit, and first and second microphones coupled to the processing unit a computer implemented method for voice recognition, the method comprising:

a) extracting first and second voice segments from first and second microphone signals originating from the first and second microphones, wherein the first and second voice segments correspond to a voice sound originating from a common source;

b) producing an estimated source location based on a relative energy of the first and second voice segments and/or a correlation of the first and second voice segments; and

c) determining whether the first voice segment is desired or undesired based on the estimated source location.

13. The method of claim 12, further comprising:

d) changing a state of the system based on whether the first voice segment is desired or undesired.

14. The method of claim 13, wherein d) comprises:

e) converting the first voice segment into a group of input phonemes;

f) comparing the group of phonemes to one or more entries in the database; and

g) executing a command corresponding to an entry that matches the group of input phonemes.

15. The method of claim 12, wherein b) includes generating an estimated distance to the common source from the relative energy of the common voice segment from the first and second microphone signals.

16. The method of claim 15, wherein c) includes determining whether the voice segment is desired or undesired based on the estimated distance.

17. The method of claim 16, wherein b) includes generating an estimated direction to the source from on a correlation of the common voice segment from the first and second microphone signals.

18. The method of claim 17, wherein c) includes determining whether the voice segment is desired or undesired based on the estimated distance and the estimated direction.

19. The method of claim 17, wherein the first microphone signal is from a near-field microphone and the second signal is from a far-field microphone.

20. The method of claim 17, wherein c) includes analyzing an image from a video camera and determining from the estimated direction and an analysis of the image whether the source of sound is within a field of view of the video camera.

22. The method of claim 12 wherein the first and second microphones are synchronized to a common clock.

23. A computer apparatus for implementing computer voice recognition, the apparatus comprising:

a) means for extracting first and second voice segments from first and second microphone signals originating from the first and second microphones, wherein the first and second voice segments correspond to a voice sound originating from a common source;

b) means for producing an estimated source location based on a relative energy of the first and second voice segments and/or a correlation of the first and second voice segments; and

c) means for determining whether the first voice segment is desired or undesired based on the estimated source location.

24. A computer readable storage medium, having embodied therein computer readable instructions executable by a computer speech processing apparatus having a processing unit and a memory unit, the computer readable instructions being configured to implement a speech processing method upon execution by the processor, the method comprising:

a) extracting first and second voice segments from first and second microphone signals originating from the first and second microphones, wherein the first and second voice segments correspond to a voice sound originating from a common source;

b) producing an estimated source location based on a relative energy of the first and second voice segments and/or a correlation of the first and second voice segments; and

c) determining whether the first voice segment is desired or undesired based on the estimated source location.