System and method of generating an audio signal

• US 7,684,571 B2
• Filed: 06/23/2005
• Issued: 03/23/2010
• Est. Priority Date: 06/26/2004
• Status: Expired due to Fees

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Dickson, Shane, Grosvenor, David Arthur, Adams, Guy de Warrenne Bruce
• Primary Examiner(s): Chin; Vivian
• Assistant Examiner(s): KURR, JASON RICHARD
• Application Number:
  US11/159,977
• Publication Number:
  US 20050286728A1
• Time in Patent Office: 1,734 Days
• Field of Search: 381/92, 381/107, 381/122, 381/91, 381/111, 381104-109, 348/231.4, 348/462, 348/208.16, 348/211.9, 348/169, 367/99, 367/104
• US Class Current: 381/92
• CPC Class Codes: H04R 1/406 microphones
• CPC Class Codes: H04R 5/027 Spatial or constructional arrangements of microphones, e.g. in dummy heads

Abstract

A method of generating an audio signal comprises receiving a plurality of input audio signals from a plurality of microphones forming a microphone array, the plurality of input audio signals being representative of a set of sound sources within the auditory field of view of the microphone array at a given instant in time; receiving a motion input signal from a motion sensor, the motion input signal being representative of the motion of the microphone array; and manipulating the received plurality of input audio signals in response to the received motion input signal to generate an audio output signal that is representative of a set of sound sources within the auditory field of view of a virtual microphone, the apparent motion of the virtual microphone being independent of the motion of the microphone array.

Claims

1. A method of generating an audio signal, the method comprising:

receiving a plurality of input audio signals from a plurality of microphones forming a microphone array, the plurality of input audio signals being representative of a set of sound sources within an auditory field of view of the microphone array at a given instant in time;

receiving a motion input signal from a motion sensor, the motion input signal being representative of the motion of the microphone array; and

manipulating the received plurality of input audio signals in response to the received motion input signal to generate an audio output signal that is representative of a set of sound sources within the auditory field of view of a virtual microphone, the apparent motion of the virtual microphone being independent of the motion of the microphone arrays,

wherein manipulating further comprises,

generating an orientation signal that represents the orientation of the plurality of microphones and a trajectory signal that represents the trajectory of the plurality of microphones from the motion input signal,

generating a difference signal representing a difference between the orientation signal and the trajectory signal,

damping the difference signal,

adding the damped difference signal to the trajectory signal, and

providing a damped orientation signal representing an apparent orientation of the virtual microphone.

2. A method according to claim 1, wherein damping the difference signal further comprises:

applying one or more constraints to the difference signal.

3. A method according to claim 1, wherein the step of manipulating the received plurality of input audio signals further comprises:

applying a weighting to each of the input signals; and

combining the weighted signals.

4. A method according to claim 3, wherein the weighting applied to each input audio signal is in the range of 0-100% of a received input signal value.

5. A method according to claim 3, wherein the signal weighting is determined according to the damped microphone orientation and field of view of the microphone array.

6. A method according to claim 5, wherein the signal weighting is further determined according to the configuration of each microphone in the array.

7. A computer-readable medium encoded with computer executable logic configured to perform:

receiving a plurality of input audio signals from a plurality of microphones forming a microphone array, the plurality of input audio signals being representatives of a set of sound sources within auditory field of view of the microphone array at a given instant in time;

reviving a motion input signal from a motion sensor, the motion input signal being representative of the motion of the microphone array;

manipulating the received plurality of input audio signals in response to the received motion input signal to generate an audio output signal that is representative of a set of sound sources within the auditory field of view of a virtual microphone, the apparent motion of the virtual microphone being independent of the motion of the microphone array,

wherein manipulating further comprises,

generating an orientation signal that represents the orientation of the plurality of microphones and a trajectory signal that represents the trajectory of the plurality of microphones from the motion input signal,

generating a difference signal representing a difference between the orientation signal and the trajectory signal,

damping the difference signal,

adding the damped difference signal to the trajectory signal, and

providing a damped orientation signal representing an apparent orientation of the virtual microphone.

8. An audio signal processor comprising:

a first input for receiving a plurality of input audio signals from a plurality of microphones forming a microphone array;

a second input for receiving a motion input signal from a motion sensor, the motion input signal being representative of the motion of the microphone array;

a data processor connected to the first input and the second input, and arranged to;

receive the plurality of input audio signals from the plurality of microphones forming a microphone array, the plurality of input audio signals being representative of a set of sound sources within an auditory field of view of the microphone array at a given instant in time;

receive the motion input signal from the motion sensor, the motion input signal being representative of the motion of the microphone array;

manipulate the received plurality of input audio signals in response to the received motion input signal to generate an audio output signal that is representative of a set of sound sources within the auditory field of view of a virtual microphone, the apparent motion of the virtual microphone being independent of the motion of the microphone array; and

generate an audio output signal; and

an output for providing the generated audio output signal,

wherein manipulate the received plurality of audio input signals further comprises,

generate an orientation signal that represents the orientation of the plurality of microphones and a trajectory signal that represents the trajectory of the plurality of microphones from the motion input signal,

generate a difference signal representing a difference between the orientation signal and the trajectory signal,

damp the difference signal,

add the damped difference signal to the trajectory signal, and

provide a damped orientation signal representing an apparent orientation of the virtual microphone.

9. An audio signal generating system comprising:

a microphone array comprising a plurality of microphones, each microphone being arranged to provide an input audio signal;

a motion sensor arranged to provide a motion input signal representative of the motion of the microphone array; and

an audio signal processor according to claim 8.

10. A method of generating an audio signal, the method comprising:

receiving a plurality of input audio signals from a plurality of microphones forming a microphone array, the plurality of input audio signals being representative of a set of sound sources within an auditory field of view of the microphone array at a given instant in time;

receiving a motion input signal from a motion sensor, the motion input signal being representative of the motion of the microphone array; and

manipulating the received plurality of input audio signals in response to the received motion input signal to generate an audio output signal that is representative of a set of sound sources within the auditory field of view of a virtual microphone, the apparent motion of the virtual microphone being independent of the motion of the microphone array,

wherein manipulating further comprises;

determining an initial trajectory signal for the virtual microphone from the motion input signal;

repeatedly modifying the initial trajectory signal until the initial trajectory signal conforms to one or more predetermined criteria, and

generating the conforming trajectory signal as an apparent trajectory signal for the virtual microphone.

11. A method according to claim 10, wherein repeatedly modifying the initial trajectory signal further comprises:

iteratively evaluating the determined trajectory signal against the one or more predetermined criteria; and

modifying the determined trajectory signal in response to the evaluation.

12. A method according to claim 10, further comprising:

analysing the plurality of the input audio signals to extract spatial sound information;

determining the trajectory of the virtual microphone;

modifying the virtual microphone trajectory in accordance with the extracted spatial sound information; and

manipulating the spatial sound information in accordance with the modified virtual microphone trajectory to generate the audio output signal.

13. A method according to claim 12, further comprising:

determining from the spatial sound information the presence of an individual sound source within the auditory field of view of the virtual microphone over a given time interval; and

modifying the virtual microphone trajectory in accordance with the determined sound source presence.

14. A method according to claim 13, wherein the virtual microphone trajectory is modified so as to substantially maintain the presence of a selected sound source within the auditory field of view of the virtual microphone.

15. A method according to claim 12, further comprising:

determining from the spatial sound information the saliency of an individual sound source; and

modifying the virtual microphone trajectory in accordance with the determined sound source saliency.

16. A method according to claim 15, wherein the virtual microphone trajectory is modified so as to substantially maintain the selected sound source within the auditory field of view of the virtual microphone, the sound source being selected in dependence on the saliency of the sound source.