Upmixing object based audio
First Claim
1. A method for rendering an object based audio program for playback by a speaker set, wherein the object based audio program comprises an object channel, wherein the object based audio program comprises metadata which is indicative of a trajectory of an audio object determined by the object channel of the object based audio program, wherein the trajectory is defined by a sequence of time-varying source positions of the audio object, wherein the sequence of time-varying source positions is indicated by the metadata, wherein the trajectory is within a subspace of a three-dimensional volume, wherein the object based audio program comprises audio data for the audio object, wherein each speaker in the speaker set has a known position in a playback system, the speaker set includes a first subset of speakers at positions in a first space of the playback system corresponding to positions in the subspace containing the trajectory, the speaker set also includes a second subset including at least one speaker, and each speaker in the second subset is at a position in the playback system corresponding to a position outside the subspace, said method including the steps of:
- (a) modifying the program, using an upmixer, to determine a modified program comprising modified metadata indicative of a modified trajectory of the object, wherein the modified trajectory is defined by a sequence of time-varying modified source positions of the audio object, where at least a portion of the modified trajectory is outside the subspace;
wherein the modified trajectory includes a start point in the first space which coincides with a start point of the trajectory, an end point in the first space which coincides with an end point of the trajectory, and at least one intermediate point corresponding to the position of a speaker in the second subset; and
(b) generating speaker feeds in response to the modified program comprising the modified metadata and the audio data for the audio object, such that the speaker feeds include at least one feed for driving at least one speaker in the speaker set whose position corresponds to a position outside the subspace, and feeds for driving speakers in the speaker set whose positions correspond to positions within the subspace;
wherein step (a) includes steps of;
for each modified source position in the sequence of modified source positions, determining a distance between the modified source position and the position of each speaker in the speaker set; and
for each modified source position in the sequence of modified source positions, determining a primary subset of the speaker set, said primary subset consisting of each speaker of the speaker set which is closest to the modified source position;
wherein the method further comprises;
determining, for each said primary subset, a three-dimensional space which contains each speaker of the primary subset and the modified source position for said primary subset but contains no other speaker of the speaker set, wherein step (b) includes the step of generating,for each modified source position in the sequence of modified source positions, at least one speaker feed for driving each speaker of the primary subset for said modified source position, and at least one other speaker feed for driving each other speaker of the speaker set; and
in response to the speaker feeds generated for said each modified source position, driving the speaker set to emit sound intended to be perceived as being emitted by the audio object from a characteristic point of the three-dimensional space which contains said modified source position.
1 Assignment
0 Petitions
Accused Products
Abstract
In some embodiments, a method for rendering an object based audio program indicative of a trajectory of an audio source, including by generating speaker feeds for driving loudspeakers to emit sound intended to be perceived as emitting from the source, but with the source having a different trajectory than that indicated by the program. In other embodiments, a method for modifying (upmixing) an object based audio program indicative of a trajectory of an audio object within a subspace of a full volume, to determine a modified program indicative of a modified trajectory of the object such that at least a portion of the modified trajectory is outside the subspace. Other aspects include a system configured to perform, and a computer readable medium which stores code for implementing, any embodiment of the inventive method.
12 Citations
27 Claims
-
1. A method for rendering an object based audio program for playback by a speaker set, wherein the object based audio program comprises an object channel, wherein the object based audio program comprises metadata which is indicative of a trajectory of an audio object determined by the object channel of the object based audio program, wherein the trajectory is defined by a sequence of time-varying source positions of the audio object, wherein the sequence of time-varying source positions is indicated by the metadata, wherein the trajectory is within a subspace of a three-dimensional volume, wherein the object based audio program comprises audio data for the audio object, wherein each speaker in the speaker set has a known position in a playback system, the speaker set includes a first subset of speakers at positions in a first space of the playback system corresponding to positions in the subspace containing the trajectory, the speaker set also includes a second subset including at least one speaker, and each speaker in the second subset is at a position in the playback system corresponding to a position outside the subspace, said method including the steps of:
-
(a) modifying the program, using an upmixer, to determine a modified program comprising modified metadata indicative of a modified trajectory of the object, wherein the modified trajectory is defined by a sequence of time-varying modified source positions of the audio object, where at least a portion of the modified trajectory is outside the subspace;
wherein the modified trajectory includes a start point in the first space which coincides with a start point of the trajectory, an end point in the first space which coincides with an end point of the trajectory, and at least one intermediate point corresponding to the position of a speaker in the second subset; and(b) generating speaker feeds in response to the modified program comprising the modified metadata and the audio data for the audio object, such that the speaker feeds include at least one feed for driving at least one speaker in the speaker set whose position corresponds to a position outside the subspace, and feeds for driving speakers in the speaker set whose positions correspond to positions within the subspace; wherein step (a) includes steps of; for each modified source position in the sequence of modified source positions, determining a distance between the modified source position and the position of each speaker in the speaker set; and for each modified source position in the sequence of modified source positions, determining a primary subset of the speaker set, said primary subset consisting of each speaker of the speaker set which is closest to the modified source position; wherein the method further comprises; determining, for each said primary subset, a three-dimensional space which contains each speaker of the primary subset and the modified source position for said primary subset but contains no other speaker of the speaker set, wherein step (b) includes the step of generating, for each modified source position in the sequence of modified source positions, at least one speaker feed for driving each speaker of the primary subset for said modified source position, and at least one other speaker feed for driving each other speaker of the speaker set; and in response to the speaker feeds generated for said each modified source position, driving the speaker set to emit sound intended to be perceived as being emitted by the audio object from a characteristic point of the three-dimensional space which contains said modified source position. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A system for rendering an object based audio program for playback by a speaker set, where each channel of the program is an object channel, the program is indicative of a trajectory of an audio object, and the trajectory is within a subspace of a three-dimensional volume, said system including:
-
an upmixing subsystem configured to modify the program to determine a modified program indicative of a modified trajectory of the object, where at least a portion of the modified trajectory is outside the subspace; and a speaker feed subsystem coupled and configured to generate speaker feeds in response to the modified program, such that the speaker feeds include at least one feed for driving at least one speaker in the speaker set whose position corresponds to a position outside the subspace, and feeds for driving speakers in the speaker set whose positions correspond to positions within the subspace. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27)
-
Specification