LOW-POWER ENVIRONMENT MONITORING AND ACTIVATION TRIGGERING FOR MOBILE DEVICES THROUGH ULTRASOUND ECHO ANALYSIS

• US 20160044394A1
• Filed: 08/07/2014
• Published: 02/11/2016
• Est. Priority Date: 08/07/2014
• Status: Abandoned Application

• Current Assignee: NXP B.V. (NXP Semiconductors NV)
• Original Assignee: NXP B.V. (NXP Semiconductors NV)
• Inventors: Derom, Koen
• Application Number:
  US14/454,110
• Publication Number:
  US 20160044394A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G01S 15/04 Systems determining presence of a target
• CPC Class Codes: G06F 1/3231 Monitoring the presence, absence or movement of users
• CPC Class Codes: H04M 1/6008 in the transmitter circuit
• CPC Class Codes: H04M 1/605 involving control of the receiver volume to provide a dual operational mode at close or far distance from the user
• CPC Class Codes: H04M 1/72454 according to context-related or environment-related conditions
• CPC Class Codes: H04R 1/00 Details of transducers, loudspeakers or microphones
• CPC Class Codes: H04R 29/00 Monitoring arrangements; Testing arrangements for hearing aids H04R25/30; detection of loudspeaker connection H04R5/04; sound-field adaptation dependent on speaker detection H04S7/308
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management
• CPC Class Codes: Y02D 30/70 in wireless communication networks

Abstract

Systems and methods are disclosed that provide for low-power monitoring of the acoustic echo path around a device to enable device triggering based on activity detection in the environment. An ultrasonic (or more generally an acoustic) reference signal is played through a speaker at well-chosen intervals and its echoes recorded through a microphone. The recorded signal is analyzed to obtain an estimation of the total echo path or echo energy. By monitoring this estimation variation, significant changes in the echo path or echo energy can be identified and used as a trigger. In one embodiment, a hand approaching a phone changes the echo path, activating the phone to a power on mode. In another embodiment, a user using a phone close to the ear changes the echo energy, triggering the phone to select the “ear-fit” mode speaker/microphone.

Claims

1. A method that uses acoustic echo to trigger a device, the method comprising:

transmitting an acoustic reference signal through a speaker at selected intervals;

receiving an echo of the acoustic reference signal through a microphone;

analyzing the echo of the acoustic reference signal to determine an echo path or an echo energy;

monitoring for changes in the echo path or the echo energy; and

in response to identifying a significant change in the echo path or the echo energy, sending a control signal to trigger the device.

2. The method of claim 1, wherein the acoustic reference signal is an ultrasonic reference signal.

3. The method of claim 2, wherein the control signal triggers the device to make a switch in a power level of the device.

4. The method of claim 3, wherein the significant change in the echo path is associated with a body part of a user moving relative to the device.

5. The method of claim 4, wherein triggering the device to make the switch in the power level of the device comprises:

triggering the device to switch from a low power mode to a high power mode.

6. The method of claim 5,

wherein the low power mode is a “

device off”

state or a power saving standby state, and

wherein the high power mode is a “

device on”

state or a high power state that has more functionalities turned on.

7. The method of claim 2, wherein the ultrasonic reference signal is a reference pulse with good autocorrelation properties.

8. The method of claim 7, wherein the reference pulse with good autocorrelation properties is optimally detectable in noise when the reference pulse is a low power pulse.

9. The method of claim 8, wherein the step of analyzing the echo of the acoustic reference signal to determine the echo path or the echo energy is optimized by adjusting one or more of the following parameters:

pulse duration,

pulse frequency bandwidth,

pulse loudness,

listening window, and

pulse interval.

10. The method of claim 8, wherein an expected timing of the echo is used to determine an optimized listening window and pulse interval.

11. The method of claim 2, wherein the control signal triggers the device to make an automatic speaker/microphone selection and control based on the identified significant change in the echo energy.

12. The method of claim 11, wherein the identified significant change in the echo energy indicates a low echo energy that is associated with the device being far away from a user'"'"'s ear so that this is a “

hands-free”

mode and the device automatically switches to using a “

hands-free”

speaker/microphone selection and control.

13. The method of claim 11, wherein the identified significant change in the echo energy indicates a high echo energy that is associated with the device being close to a user'"'"'s ear so that this is an “

ear-fit”

mode and the device automatically switches to using an “

ear-fit”

speaker/microphone selection and control.

14. The method of claim 7,

wherein the reference pulse is sent in a unique and/or randomized sequence to allow different devices to coexist,

wherein the device only reacts to pulses the device identifies as its own.

15. The method of claim 2, wherein the significant change is identified through an automatic dynamic threshold calculation.

16. An apparatus that uses acoustic echo to trigger a device, the apparatus comprising:

an output configured for transmitting an acoustic reference signal at selected intervals by coupling to a speaker;

an input configured for receiving an echo of the acoustic reference signal by coupling to a microphone; and

a processor configured for;

analyzing the echo of the acoustic reference signal to determine an echo path or an echo energy,

monitoring for changes in the echo path or the echo energy, and

in response to identifying a significant change in the echo path or the echo energy, sending a control signal to trigger the device.

17. The apparatus of claim 16, wherein the acoustic reference signal is an ultrasonic reference signal.

18. The apparatus of claim 17, wherein the control signal triggers the device to make a switch in a power level of the device based on the identified significant change in the echo path.

19. The apparatus of claim 18, wherein the control signal triggers the device to make an automatic speaker/microphone selection and control based on the identified significant change in the echo energy.

20. A computer program product encoded in a non-transitory computer readable medium for using ultrasonic echo to trigger a device, the computer program product comprising:

computer code for transmitting an ultrasonic reference signal through a speaker at selected intervals;

computer code for receiving an echo of the ultrasonic reference signal through a microphone;

computer code for analyzing the echo of the ultrasonic reference signal to determine an echo path or an echo energy;

computer code for monitoring for changes in the echo path or the echo energy; and

computer code for, in response to identifying a significant change in the echo path or the echo energy, sending a control signal to trigger the device.