Audio system and method of operation therefor

• US 9,596,549 B2
• Filed: 01/02/2012
• Issued: 03/14/2017
• Est. Priority Date: 01/05/2011
• Status: Active Grant

• Current Assignee: Koninklijke Philips N.V.
• Original Assignee: Koninklijke Philips N.V.
• Inventors: Pandharipande, Ashish Vijay, Srinivasan, Sriram
• Primary Examiner(s): Ratcliffe, Luke
• Assistant Examiner(s): Ndure Jobe, Amienatta M
• Application Number:
  US13/996,347
• Publication Number:
  US 20130272096A1
• Time in Patent Office: 1,898 Days
• Field of Search: 381/86, 381/303, 381/92, 381/71.4, 381/119, 381/57, 381/71.7, 381/26, 381/300, 381/313, 381/317, 381/398, 381/71.1, 381/71.6, 381/80, 381/97, 381/107, 381/110, 381/152, 381/17, 381/301, 381/309, 381/315, 381/330, 381/337, 381/428, 381/56, 381/71.14, 381/91, 381/94.3, 367/11, 367/7, 367/87, 367/119, 367/12, 367/140, 367/180, 367/188, 367/97, 446/456, 446/454, 704/231, 704/205, 704/227, 704/233, 704/275, 181/148, 181/169, 181/290, 248/205.1, 252/182.14, 340/467, 342/357.51, 348/14.08, 348/14.16, 370/260, 700/94, 701/2, 705/14.63, 710/314, 735/89, 736/44
• US Class Current: 1/1
• CPC Class Codes: G01S 15/06 Systems determining the position data of a target
• CPC Class Codes: G01S 15/10 using transmission of interrupted, pulse-modulated waves determination of distance by phase measurement G01S15/32
• CPC Class Codes: G01S 7/521 Constructional features
• CPC Class Codes: G01V 1/001 Acoustic presence detection
• CPC Class Codes: G10K 11/348 using amplitude variation
• CPC Class Codes: H04M 3/56 Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities video conference systems H04N7/15
• CPC Class Codes: H04R 1/403 loud-speakers
• CPC Class Codes: H04R 1/406 microphones
• CPC Class Codes: H04R 2400/01 Transducers used as a loudspeaker to generate sound aswell as a microphone to detect sound
• CPC Class Codes: H04R 2430/03 Synergistic effects of band splitting and sub-band processing
• CPC Class Codes: H04R 2430/20 Processing of the output signals of the acoustic transducers of an array for obtaining a desired directivity characteristic H04R2203/12 takes precedence
• CPC Class Codes: H04R 2499/11 Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
• CPC Class Codes: H04R 2499/13 Acoustic transducers and sound field adaptation in vehicles
• CPC Class Codes: H04R 25/405 by combining a plurality of transducers
• CPC Class Codes: H04R 3/005 for combining the signals of two or more microphones specially adapted for hearing aids H04R25/407
• CPC Class Codes: H04R 3/12 for distributing signals to two or more loudspeakers specially adapted for hearing aids H04R25/407
• CPC Class Codes: H04S 2420/07 Synergistic effects of band splitting and sub-band processing
• CPC Class Codes: H04S 7/303 Tracking of listener position or orientation
• CPC Class Codes: H04S 7/305 Electronic adaptation of stereophonic audio signals to reverberation of the listening space H04S7/301 takes precedence

Abstract

An audio system that includes an ultrasound sensor array which has a plurality of ultrasound sensor elements, and an audio band array which has a plurality of audio band elements. An estimator is configured to generate a presence characteristic of a user in response to ultrasound signals received from the ultrasound sensor array. The presence characteristic may include a position estimate for the user. An audio array circuit is configured to generate a directional response for the audio band array by applying weights to individual audio band signals for the audio band elements. A weight circuit is configured to determine the weights in response to the presence characteristic.

Claims

1. An audio system comprising:

an ultrasound transmitter configured to transmit an ultrasound test signal;

an ultrasound sensor array comprising a plurality of ultrasound sensor elements;

an estimator configured to estimate a presence characteristic of a user in response to a comparison between a characteristic of the ultrasound test signal and a characteristic of ultrasound signals received from the ultrasound sensor array, the ultrasound signals being reflected signals of the ultrasound test signal;

an audio band array comprising audio band elements;

an audio array circuit configured to generate a directional response of the audio band array by applying weights to individual audio band signals of the audio band elements; and

a weight circuit configured to determine the weights in response to the presence characteristic.

2. The audio system of claim 1, wherein the presence characteristic comprises a position estimate and the audio array circuit is configured to determine the weights in response to the position estimate.

3. The audio system of claim 1, wherein the audio band elements are audio sensors and the audio array circuit is configured to generate a directional output signal by combining the individual audio band signals from the audio sensors, the combining comprising applying the weights to the individual audio band signals.

4. The audio system of claim 3, further comprising a plurality of wideband sensors each of which is both an ultrasound sensor of the ultrasound sensor array and an audio sensor of the audio band array.

5. The audio system of claim 4, wherein the plurality of wideband sensors forms both the ultrasound sensor array and the audio band array.

6. The audio system of claim 3, further comprising:

a user movement model configured to track a position of the user; and

an update circuit configured to update the user movement model in response to both the ultrasound signals and the audio band signals.

7. The audio system of claim 6, wherein the update circuit is configured to update the user movement model in response to the ultrasound signals when a characteristic of the audio band signals meets a criterion.

8. The audio system of claim 7, wherein the criterion is a signal level of the audio band signals being below a threshold, wherein the update circuit is configured to switch to an ultrasound mode to update the user movement model based on the ultrasound signals.

9. The audio system of claim 6, wherein the update circuit is configured to not update the user movement model in response to the ultrasound signals when a characteristic of the audio band signals meets a criterion.

10. The audio system of claim 9, wherein the ultrasound test signal is a pulsed ultrasound test signal, and wherein the estimator is configured to perform a movement estimation in response to a comparison of signal segments of the ultrasound signals corresponding to different pulses of the pulsed ultrasound test signal.

11. The audio system of claim 10, wherein the estimator is configured to estimate a position of a moving object in response to a difference between the signal segments.

12. The audio system of claim 9, wherein the criterion is a signal level of the audio band signals being above a threshold, the threshold being a variable threshold, and wherein the update circuit is configured to switch to an audio band mode to update the user movement model based on the audio band signals.

13. The audio system of claim 6, wherein the user movement model comprises a memory for storing stored positions of the user, the stored positions representing presence characteristics of the user estimated by the estimator, wherein the update circuit is configured to continually update the memory in response to both the ultrasound signals and the audio band signals, wherein the user movement model is configured to obtain a user movement trajectory based on combining the stored positions, wherein the user movement model uses a last stored position as the current position, and wherein the user movement model is configured to predict movement of the user based on the user movement trajectory and the last stored position.

14. The audio system of claim 1, wherein the weight circuit is configured to determine ultrasound weight delays for the ultrasound signals to correspond to a direction of an ultrasound source, and wherein the weight circuit is configured to determine audio weight delays for the individual audio band signals to correspond to the ultrasound weight delays.

15. The audio system of claim 1, wherein the ultrasound sensor array and the audio band array are spatially overlapping.

16. The audio system of claim 1, wherein the audio band elements are audio drivers configured to generate a sound signal in response to a drive signal, and wherein the individual audio band signals are drive signals.

17. The audio system of claim 1, wherein the presence characteristic of the user is different than a position of the ultrasound transmitter.

18. The audio system of claim 1, wherein the ultrasound transmitter is proximal to the ultrasound sensor array and collocated therewith.

19. The audio system of claim 1, wherein the estimator is configured to estimate the presence characteristic of the user in response to a comparison between the characteristic of the ultrasound signals and a threshold.

20. The audio system of claim 1, wherein the presence characteristic comprises a motion estimate of the user, and wherein the estimator is configured to estimate the motion estimate based on changes in the reflected signals received by the ultrasound sensor array.

21. The audio system of claim 1, wherein the audio array circuit is configured to generate a directional output signal as the directional response when the presence characteristic of the user is detected, and wherein the audio array circuit is configured to generate an omni-directional output signal as the directional response when no presence characteristic of the user is detected.

22. A method of operation for an audio system having an ultrasound sensor array comprising a plurality of ultrasound sensor elements and an audio band array comprising audio band elements, the method comprising acts of:

transmitting an ultrasound test signal by an ultrasound transmitter;

estimating by an estimator a presence characteristic of a user in response to a comparison between a characteristic of the ultrasound test signal and a characteristic of ultrasound signals received from the ultrasound sensor array, the ultrasound signals being reflected signals of the ultrasound test signal;

generating a directional response of the audio band array by applying weights to individual audio band signals of the audio band elements by an audio array circuit; and

determining the weights in response to the presence characteristic by a weight circuit.