Acoustic echo cancellation using visual cues
First Claim
Patent Images
1. A device, comprising:
- one or more processors;
a camera;
a loudspeaker;
a microphone; and
an acoustic echo canceller unit, wherein the device is configured to;
capture, using the camera, an image of an environment in which the device is located,determine, using the one or more processors and based at least in part on the image, an absence of a human within the environment,output a first audio signal, via the loudspeaker, based at least in part on determining the absence of the human,determine one or more echo paths associated with the environment based at least in part on a second audio signal detected by the microphone, andcalibrate a filter of the acoustic echo canceller unit based at least in part on the one or more echo paths.
1 Assignment
0 Petitions
Accused Products
Abstract
Techniques for enhancing an acoustic echo canceller based on visual cues are described herein. The techniques include changing adaptation of a filter of the acoustic echo canceller, calibrating the filter, or reducing background noise from an audio signal processed by the acoustic echo canceller. The changing, calibrating, and reducing are responsive to visual cues that describe acoustic characteristics of a location of a device that includes the acoustic echo canceller. Such visual cues may indicate that no human being is present at the location, that some subject(s) are engaged in speaking or sound generating activities, or that motion associated with an echo path change has occurred at the location.
29 Citations
20 Claims
-
1. A device, comprising:
-
one or more processors; a camera; a loudspeaker; a microphone; and an acoustic echo canceller unit, wherein the device is configured to; capture, using the camera, an image of an environment in which the device is located, determine, using the one or more processors and based at least in part on the image, an absence of a human within the environment, output a first audio signal, via the loudspeaker, based at least in part on determining the absence of the human, determine one or more echo paths associated with the environment based at least in part on a second audio signal detected by the microphone, and calibrate a filter of the acoustic echo canceller unit based at least in part on the one or more echo paths. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A method, comprising:
-
capturing, with a camera, an image of an environment, determining, with an electronic device and using the image, an absence of a human within the environment, outputting a first audio signal within the environment, using a loudspeaker, based at least in part on determining the absence of the human, detecting a second audio signal within the environment using a microphone, determining, with the electronic device, one or more echo paths associated with the environment based at least in part on the second audio signal, and changing an adaptation of an acoustic filter of the electronic device based at least in part on the one or more echo paths. - View Dependent Claims (12, 13, 14, 15)
-
-
16. A method, comprising:
-
determining, with an electronic device, an absence of a human within an environment; outputting a first audio signal, within the environment, based at least in part on determining the absence of the human; capturing a second audio signal, within the environment, during the absence, the second audio signal being indicative of the absence of the human; determining, with the electronic device, an echo path associated with the environment based at least in part on the second audio signal; changing an adaptation of an acoustic filter of the electronic device based at least in part on the echo path; capturing a third audio signal from the environment; determining, with the electronic device, a confidence score indicating a likelihood that the third audio signal is associated with a person speaking within the environment; determining that the confidence score exceeds a threshold; and removing, at least in part, background noise from the third audio signal with the acoustic filter based at least in part on the confidence score exceeding the threshold, wherein an amount of the background noise removed from the third audio signal is based at least in part on the echo path. - View Dependent Claims (17, 18, 19, 20)
-
Specification