Microphone apparatus and method with catch-up buffer

• US 9,711,144 B2
• Filed: 09/08/2016
• Issued: 07/18/2017
• Est. Priority Date: 07/13/2015
• Status: Active Grant

• Current Assignee: Knowles Electronics Llc (Knowles Corporation)
• Original Assignee: Knowles Electronics Llc (Knowles Corporation)
• Inventors: Raghuvir, Ramanujapuram, Pawlowski, Andrzej, Berthelsen, Kim Spetzler, Warren, Niel D., Rossum, David P., Nandy, Dibyendu, Li, Yang, Popper, Robert A., Thomsen, Henrik
• Primary Examiner(s): Flanders, Andrew C
• Application Number:
  US15/259,473
• Publication Number:
  US 20170061963A1
• Time in Patent Office: 313 Days
• CPC Class Codes: G06F 1/3206 Monitoring of events, devices or parameters that trigger a change in power modality
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 25/48 specially adapted for particular use
• CPC Class Codes: G10L 25/78 Detection of presence or absence of voice signals switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10
• CPC Class Codes: H04R 19/04 Microphones H04R19/01 takes precedence
• CPC Class Codes: H04R 2201/003 Mems transducers or their use of the electrostatic type H04R19/005
• CPC Class Codes: H04R 3/00 Circuits for transducers , loudspeakers or microphones
• CPC Class Codes: H04R 3/005 for combining the signals of two or more microphones specially adapted for hearing aids H04R25/407

Abstract

At a microphone, voice activity is detected in a data stream while simultaneously buffering audio data from the data stream to create buffered data. A signal is sent to a host indicating the positive detection of voice activity in the data stream. When an external clock signal is received from the host, the internal operation of the microphone is synchronized with the external clock signal. Buffered data stream is selectively sent through a first path, the first path including a buffer having a buffer delay time representing the time the first data stream takes to move through the buffer. The data stream is continuously sent through a second path as a real-time data stream, the second path not including the buffer, the real-time data stream beginning with the extended buffer data at a given instant in time. The buffered data stream and the real-time data stream are multiplexed onto a single data line and transmitting the multiplexed data stream to the host.

Claims

1. A method in a microphone apparatus, the method comprising:

clocking the microphone apparatus using a local oscillator of the microphone;

generating a digital data stream from an electrical signal representative of acoustic energy;

determining whether voice activity is present in the electrical signal while buffering data representative of the electrical signal in a buffer of the microphone apparatus, the buffered data having a delay time with respect to real-time data representative of the electrical signal;

providing a multiplexed data stream at an interface of the microphone apparatus after determining the presence of voice activity, the multiplexed data stream including a buffered data stream and a real-time data stream, the buffered data stream and the real-time data stream based on the electrical signal, the buffered data stream including non-real-time buffered data and real-time buffered data, an end portion of the buffered data stream temporally overlapping a beginning portion of the real-time data stream; and

providing the real-time data stream at the interface after discontinuing providing the buffered data stream at the interface.

2. The method of claim 1, further comprising discontinuing providing the multiplexed data stream at the interface of the microphone apparatus after a time period corresponding to a duration of the buffered data stream.

3. The method of claim 2, further comprising:

providing a signal at the interface in response to determining the voice activity is present;

receiving an external clock signal at the interface of the microphone apparatus in response to providing the signal at the interface,

providing the multiplexed data stream at the interface after receiving the external clock signal.

4. The method of claim 3, further comprising synchronizing the multiplexed data stream with the external clock signal by synchronizing the buffered data stream with a first portion of the external clock signal and synchronizing the real-time data stream with a second portion of the external clock signal.

5. The method of claim 1, wherein the generating the digital data stream includes generating a first digital data stream from a first electrical signal produced by a first acoustic sensor and generating a second digital data stream from a second electrical signal produced by a second acoustic sensor, and wherein the providing the real-time data stream at the interface includes providing a first real-time data stream based on the first electrical signal and a second real-time data stream based on the second electrical signal.

6. The method of claim 5, further comprising synchronizing the first real-time data stream with a first portion of a clock signal and synchronizing the second real-time data stream with a second portion of the clock signal.

7. The method of claim 1, further comprising providing the multiplexed data stream at a single connection of the interface of the microphone apparatus.

8. The method of claim 1, further comprising synchronizing the buffered data stream of the multiplexed data stream with a first portion of a clock signal and synchronizing the real-time data stream of the multiplexed data stream with a second portion of the clock signal.

9. The method of claim 1, further comprising:

operating the microphone apparatus in a first mode before providing the multiplexed data stream at the interface of the microphone apparatus; and

operating the microphone apparatus in a second mode while providing the multiplexed data stream at the interface of the microphone apparatus,

wherein a power consumption of the microphone apparatus operating in the first mode is less than a power consumption of the microphone apparatus operating in the second mode.

10. A microphone apparatus comprising:

a converter having an analog input and a digital output, wherein a digital data stream on the output of the converter is produced from an electrical signal representative of acoustic energy on the analog input of the converter;

a buffer coupled to the digital output of the converter, wherein the buffer is configured to buffer data representative of the electrical signal, the buffered data having a delay time with respect to real-time data representative of the electrical signal;

a voice activity detector (VAD) coupled to the digital output of the converter, wherein the VAD is configured to detect whether voice activity is present in the electrical signal while data is buffered in the buffer; and

a multiplexer coupled to the buffer and to the converter, the multiplexer coupled to an interface of the microphone apparatus,

wherein a multiplexed data stream is provided, by the microphone apparatus, at the interface after voice activity is detected, the multiplexed data stream including a buffered data stream and a real-time data stream, the buffered data stream and the real-time data stream based on the electrical signal, the buffered data stream including non-real-time buffered data and real-time buffered data, a portion of the real-time buffered data of the buffered data stream temporally overlapping a portion of the real-time data stream,

and wherein the real-time data stream is provided, by the microphone apparatus, at the interface after the buffered data stream is no longer provided at the interface.

11. The apparatus of claim 10, further comprising a local oscillator, wherein the microphone apparatus is clocked by the local oscillator at least before providing the multiplexed data stream at the interface.

12. The apparatus of claim 11, wherein the apparatus is an integrated circuit.

13. The apparatus of claim 11, further comprising an acoustic sensor packaged with the integrated circuit, the acoustic sensor coupled to the analog input of the converter, the integrated circuit comprising at least the local oscillator, the converter, the buffer, the VAD, and the multiplexer.

14. The apparatus of claim 10, wherein the buffered data stream of the multiplexed data stream is synchronized with a first portion of a clock signal and the real-time data stream of the multiplexed data stream is synchronized with a second portion of the clock signal.

15. The apparatus of claim 10, further comprising a controller coupled to the VAD and to the interface, the interface including a clock connection, a data connection, and a signal connection, wherein:

a signal of the controller is provided at the signal connection of the interface in response to the VAD detecting voice activity,

the microphone apparatus is clocked by an external clock signal provided at the clock connection of the interface in response to the signal of the controller,

the multiplexed data stream of the multiplexer is provided at the data connection of the interface in response to the external clock signal, and

the real-time data stream is provided at the data connection of the interface after the buffered data stream is no longer provided.

16. The apparatus of claim 15, wherein the buffered data stream is synchronized with a first edge of the external clock signal and the real-time data stream is synchronized with a second edge of the external clock signal.

17. The apparatus of claim 10, wherein the digital data stream includes a first digital data stream generated from a first electrical signal produced by a first acoustic sensor and a second digital data stream generated from a second electrical signal produced by a second acoustic sensor, and wherein the real-time data stream includes a first real-time data stream based on the first electrical signal and a second real-time data stream based on the second electrical signal.

18. The apparatus of claim 17, wherein the first real-time data stream is synchronized with a first portion of a clock signal and the second real-time data stream is synchronized with a second portion of the clock signal.

19. The apparatus of claim 10, wherein the interface has a single data pin, and wherein the multiplexed data stream is provided at the single data pin of the interface after voice activity is detected.

20. The apparatus of claim 10, wherein the microphone apparatus has a first mode of operation before the multiplexed data stream is provided at the interface, wherein the microphone apparatus has a second mode of operation while the multiplexed data stream is provided at the interface, and wherein a power consumption of the first mode of operation is less than a power consumption of the second mode of operation.