IN-VEHICLE GESTURE INTERACTIVE SPATIAL AUDIO SYSTEM
First Claim
1. A method for modifying an audio parameter based on a gesture, the method comprising:
- acquiring sensor data associated with a hand of a user;
analyzing the sensor data to determine at least one hand position;
determining, based on the at least one hand position, an interaction between a first virtual object that corresponds to an audio event and a second virtual object that corresponds to the hand of the user;
based on the interaction, modifying a spatial audio parameter associated with the audio event to generate a modified audio stream; and
causing the modified audio stream to be reproduced for output to the user.
1 Assignment
0 Petitions
Accused Products
Abstract
One embodiment of the present invention sets forth a technique for modifying an audio parameter based on a gesture. The technique includes acquiring sensor data associated with a hand of a user and analyzing the sensor data to determine at least one hand position. The technique further includes determining, based on the at least one hand position, an interaction between a first virtual object that corresponds to an audio event and a second virtual object that corresponds to the hand of the user. The technique further includes, based on the interaction, modifying a spatial audio parameter associated with the audio event to generate a modified audio stream and causing the modified audio stream to be reproduced for output to the user.
51 Citations
20 Claims
-
1. A method for modifying an audio parameter based on a gesture, the method comprising:
-
acquiring sensor data associated with a hand of a user; analyzing the sensor data to determine at least one hand position; determining, based on the at least one hand position, an interaction between a first virtual object that corresponds to an audio event and a second virtual object that corresponds to the hand of the user; based on the interaction, modifying a spatial audio parameter associated with the audio event to generate a modified audio stream; and causing the modified audio stream to be reproduced for output to the user. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A system for modifying an audio parameter based on a gesture, comprising:
-
at least one sensor configured to acquire sensor data associated with a hand of a user; a processor coupled to the at least one sensor and configured to; analyze the sensor data to determine at least one hand position; determine, based on the at least one hand position, an interaction between a first virtual object that corresponds to an audio event and a second virtual object that corresponds to the hand of the user; based on the interaction, modify a spatial audio parameter associated with the audio event to generate a modified audio stream; and cause the modified audio stream to be reproduced for output to the user; and a display coupled to the processor and configured to display a visual representation of the first virtual object. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19)
-
-
20. A non-transitory computer-readable storage medium including instructions that, when executed by a processor, cause the processor to modify an audio parameter based on a gesture, by performing the steps of:
-
acquiring sensor data associated with a hand of a user; analyzing the sensor data to determine at least one hand position; determining, based on the at least one hand position, an interaction between a first virtual object that corresponds to an audio event and a second virtual object that corresponds to the hand of the user; based on the interaction, resizing a portion of a sound space spanned by the audio event to generate a modified audio stream; and causing the modified audio stream to be reproduced for output to the user.
-
Specification