In-vehicle speech recognition device
First Claim
Patent Images
1. An in-vehicle speech recognition device coupled with an imaging device for capturing an image of a lip shape of a user speaking speech, the in-vehicle speech recognition device comprising:
- a sound receiver that is configured to receive sound of the speech;
a stationary noise reduction section that is configured to reduce a stationary noise in the sound based on a spectral pattern of the stationary noise, the stationary noise being constantly generable and superimposable on the sound;
a first recognition section that is configured to perform a first speech recognition operation to recognize content of the speech based on the sound of the speech having the reduced stationary noise;
a second recognition section that is configured to perform a second speech recognition operation to recognize the content of the speech based on the image captured by the imaging device;
a sudden noise determination section that is configured to determine whether a sudden noise is generated during the speaking, the sudden noise being superimposable on the sound of the speech; and
a control section that is configured to;
cause the first recognition section to perform the first speech recognition operation when the sudden noise determination section determines that the sudden noise is not generated; and
cause the second recognition section to perform the second speech recognition operation when the sudden noise determination section determines that the sudden noise is generated.
1 Assignment
0 Petitions
Accused Products
Abstract
A speech recognition device is disclosed. The device obtains sound of speech of a user and an image of a lip shape of the user. The device determines whether a sudden noise is generated during user speaking. When it is determined that a sudden noise is not generated, the device recognizes content of the speech based on the sound of the speech. When it is determined that a sudden noise is generated, the device recognize the content of the speech based on the image of the lip shape of the user.
-
Citations
11 Claims
-
1. An in-vehicle speech recognition device coupled with an imaging device for capturing an image of a lip shape of a user speaking speech, the in-vehicle speech recognition device comprising:
-
a sound receiver that is configured to receive sound of the speech; a stationary noise reduction section that is configured to reduce a stationary noise in the sound based on a spectral pattern of the stationary noise, the stationary noise being constantly generable and superimposable on the sound; a first recognition section that is configured to perform a first speech recognition operation to recognize content of the speech based on the sound of the speech having the reduced stationary noise; a second recognition section that is configured to perform a second speech recognition operation to recognize the content of the speech based on the image captured by the imaging device; a sudden noise determination section that is configured to determine whether a sudden noise is generated during the speaking, the sudden noise being superimposable on the sound of the speech; and a control section that is configured to; cause the first recognition section to perform the first speech recognition operation when the sudden noise determination section determines that the sudden noise is not generated; and cause the second recognition section to perform the second speech recognition operation when the sudden noise determination section determines that the sudden noise is generated. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
Specification