Sensor Fusion to Improve Speech/Audio Processing in a Mobile Device
First Claim
1. A computer-implemented method performed by one or more processors of a mobile device, comprising:
- receiving data from one or more sensors of a mobile device;
calculating an orientation and distance of a signal source relative to a first microphone of the mobile device based on the data;
receiving a signal from the source through the first microphone; and
processing the signal based on the calculated orientation and distance.
1 Assignment
0 Petitions
Accused Products
Abstract
The disclosed system and method for a mobile device combines information derived from onboard sensors with conventional signal processing information derived from a speech or audio signal to assist in noise and echo cancellation. In some implementations, an Angle and Distance Processing (ADP) module is employed on a mobile device and configured to provide runtime angle and distance information to an adaptive beamformer for canceling noise signals, provides a means for building a table of filter coefficients for adaptive filters used in echo cancellation, provides faster and more accurate Automatic Gain Control (AGC), provides delay information for a classifier in a Voice Activity Detector (VAD), provides a means for automatic switching between a speakerphone and handset mode of the mobile device, or primary microphone and reference microphones and assists in separating echo path changes from double talk.
-
Citations
23 Claims
-
1. A computer-implemented method performed by one or more processors of a mobile device, comprising:
-
receiving data from one or more sensors of a mobile device; calculating an orientation and distance of a signal source relative to a first microphone of the mobile device based on the data; receiving a signal from the source through the first microphone; and processing the signal based on the calculated orientation and distance. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A computer-implemented method performed by one or more processors of a mobile device, comprising:
-
receiving sensor data; computing an angle and distance from the sensor data, the angle defining a relative orientation of a speech signal source and a microphone of the mobile device, the distance defining a distance between the speech signal source and the microphone; receiving a speech signal from the speech signal source through the microphone; and performing at least one of noise cancellation, echo cancellation, voice activity detection, switching from handset to speakerphone mode, or automatic gain control based on the angle.
-
-
12. A system comprising:
-
a first microphone; a sensor configured for providing sensor output data in response to a change of position of the system; a processor coupled to the sensor and the first microphone and programmed for; receiving data from one or more sensors of a mobile device; calculating an orientation and distance of a signal source relative to a first microphone of the mobile device based on the data; receiving a signal from the source through the first microphone; and processing the signal based on the calculated orientation and distance. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21)
-
-
22. A mobile device comprising:
-
one or more sensors configured to generate data in response to motion of the mobile device; one or more microphones; one or more processors coupled to the one or more sensors and the one or more microphones and programmed for; receiving data from the sensor; calculating an orientation and distance of a signal source relative to the one or more microphones based on the sensor data; receiving a signal from the source through at least one microphone; and processing the signal based on the calculated orientation and distance. - View Dependent Claims (23)
-
Specification