Visual audio processing apparatus
First Claim
1. An apparatus comprising at least one processor and at least one memory including computer code for one or more programs, the at least one memory and the computer code configured to with the at least one processor cause the apparatus to:
- determine at least one visual image element;
receive at least two audio signals from at least two microphones, wherein each microphone of the at least two microphones is separated from each other;
determine, using the at least two audio signals, a location of at least one audio source relative to the at least two microphones, wherein the at least one audio source is determined at least in part as environmental sound;
associate the at least one visual image element with the location of the at least one audio source relative to the at least two microphones;
provide at least one control input associated with the at least one visual element, the at least one control input comprising at least one control for at least one focus region direction and width;
process the at least one audio source to change at least one audio characteristic of the at least one audio source according to the determined location of the at least one audio source based on the provided and width of the at least one focus region; and
amplify or attenuate the at least one audio source for playback dependent on the location of the at least one audio source based on the at least one control for the at least one focus region direction and width.
2 Assignments
0 Petitions
Accused Products
Abstract
An apparatus comprising: an image element determiner configured to determine at least one visual image element; a spatial audio analyser configured to determine, using at least two audio signals, at least one audio source with a location associated with the at least one visual image element; a user interface controller configured to provide at least one control input associated with the at least one visual element, and an audio processor configured to process the at least one audio source to change at least one audio characteristic of the at least one audio source based on the at least one control input.
-
Citations
20 Claims
-
1. An apparatus comprising at least one processor and at least one memory including computer code for one or more programs, the at least one memory and the computer code configured to with the at least one processor cause the apparatus to:
-
determine at least one visual image element; receive at least two audio signals from at least two microphones, wherein each microphone of the at least two microphones is separated from each other; determine, using the at least two audio signals, a location of at least one audio source relative to the at least two microphones, wherein the at least one audio source is determined at least in part as environmental sound; associate the at least one visual image element with the location of the at least one audio source relative to the at least two microphones; provide at least one control input associated with the at least one visual element, the at least one control input comprising at least one control for at least one focus region direction and width; process the at least one audio source to change at least one audio characteristic of the at least one audio source according to the determined location of the at least one audio source based on the provided and width of the at least one focus region; and amplify or attenuate the at least one audio source for playback dependent on the location of the at least one audio source based on the at least one control for the at least one focus region direction and width. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15)
-
-
16. A method comprising:
-
determining at least one visual image element; receiving at least two audio signals from at least two microphones, wherein each microphone of the at least two microphones is separated from each other; determining, using the at least two audio signals, a location of at least one audio source relative the at least two microphones, wherein the at least one audio source is determined at least in part as environmental sound; associating the at least one visual image element with the location of the at least one audio source relative to the at least two microphones; providing at least one control input associated with the at least one visual element, the at least one control input comprising at least one control for at least one focus region direction and width; processing the at least one audio source to change at least one audio characteristic of the at least one audio source according to the determined location of the at least one audio source based on the provided direction and width of the at least one focus region during playback; and amplifying or attenuating the at least one audio source for playback dependent on the location of the at least one audio source based on the at least one control for the at least one focus region direction and width. - View Dependent Claims (17, 18, 19)
-
-
20. An apparatus comprising:
-
an image element determiner configured to determine at least one visual image element; a spatial audio analyzer configured to receive at least two audio signals from at least two microphones, wherein each microphone of the at least two microphones is separated from each other; the spatial audio analyzer configured to determine, using the at least two audio signals, a location of at least one audio source relative to the at least two microphones, wherein the at least one audio source is determined at least in part as environmental sound; the spatial audio analyzer further configured to associate the at least one visual image element with the location of the at least one audio source relative to the at least two microphones; a user interface controller configured to provide at least one control input associated with the at least one visual element, the at least one control input comprising at least one control for at least one focus region direction and width; an audio processor configured to process the at least one audio source to change at least one audio characteristic of the at least one audio source according to the determined location of the at least one audio source based on the provided direction and width of the at least one focus region; and the audio processor further configured to amplify or attenuate the at least one audio source for playback dependent on the location of the at least one audio source based on the at least one control for the at least one focus region direction and width.
-
Specification