Method and device for adjusting sound levels of sources based on sound source priority
First Claim
1. A method for adjusting sound levels based on contextual information, comprising:
- capturing at a mobile device one or more sounds from an environment using a microphone array, the mobile device comprises a head-mounted display device;
identifying one or more sources of sound within the environment based on the one or more sounds captured using the microphone array, the one or more sources of sound include a first sound source and a second sound source different from the first sound source, the first sound source comprises a particular person, the second sound source comprises a second person different from the particular person;
determining a location of the mobile device, the location of the mobile device is determined using GPS location information corresponding with the location of the mobile device;
determining using one or more processors an identification of the particular person;
assigning a first priority level to the first sound source based on the location of the mobile device and the identification of the particular person, the assigning the first priority level to the first sound source includes determining whether an end user of the mobile device has gazed at the particular person for at least a particular period of time;
assigning a second priority level to the second sound source based on the location of the mobile device;
determining one or more weighting coefficients based on the first priority level and the second priority level, the determining one or more weighting coefficients is performed by the mobile device;
generating using the one or more processors one or more enhanced audio signals based on the one or more weighting coefficients and the one or more sounds captured using the microphone array, the generating the one or more enhanced audio signals is performed by the mobile device; and
outputting the one or more enhanced audio signals from the mobile device.
2 Assignments
0 Petitions
Accused Products
Abstract
A system for generating one or more enhanced audio signals such that one or more sound levels corresponding with sounds received from one or more sources of sound within an environment may be dynamically adjusted based on contextual information is described. The one or more enhanced audio signals may be generated by a head-mounted display device (HMD) worn by an end user within the environment and outputted to earphones associated with the HMD such that the end user may listen to the one or more enhanced audio signals in real-time. In some cases, each of the one or more sources of sound may correspond with a priority level. The priority level may be dynamically assigned depending on whether the end user of the HMD is focusing on a particular source of sound or has specified a predetermined level of importance corresponding with the particular source of sound.
-
Citations
15 Claims
-
1. A method for adjusting sound levels based on contextual information, comprising:
-
capturing at a mobile device one or more sounds from an environment using a microphone array, the mobile device comprises a head-mounted display device; identifying one or more sources of sound within the environment based on the one or more sounds captured using the microphone array, the one or more sources of sound include a first sound source and a second sound source different from the first sound source, the first sound source comprises a particular person, the second sound source comprises a second person different from the particular person; determining a location of the mobile device, the location of the mobile device is determined using GPS location information corresponding with the location of the mobile device; determining using one or more processors an identification of the particular person; assigning a first priority level to the first sound source based on the location of the mobile device and the identification of the particular person, the assigning the first priority level to the first sound source includes determining whether an end user of the mobile device has gazed at the particular person for at least a particular period of time; assigning a second priority level to the second sound source based on the location of the mobile device; determining one or more weighting coefficients based on the first priority level and the second priority level, the determining one or more weighting coefficients is performed by the mobile device; generating using the one or more processors one or more enhanced audio signals based on the one or more weighting coefficients and the one or more sounds captured using the microphone array, the generating the one or more enhanced audio signals is performed by the mobile device; and outputting the one or more enhanced audio signals from the mobile device. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. An electronic device for adjusting sound levels based on contextual information, comprising:
-
a plurality of microphones configured to capture one or more sounds from an environment; one or more processors in communication with the plurality of microphones, the one or more processors configured to identify one or more sources of sound within the environment based on the one or more sounds captured using the plurality of microphones, the one or more sources of sound include a first sound source and a second sound source different from the first sound source, the first sound source comprises a particular person, the one or more processors configured to determine a location of the electronic device and determine an identification of the particular person, the one or more processors configured to assign a first priority level to the first sound source based on the location of the electronic device and the identification of the particular person and assign a second priority level to the second sound source based on the location of the electronic device, the one or more processors configured to assign the first priority level to the first sound source based on whether an end user of the electronic device has gazed at the particular person for at least a particular period of time, the one or more processors configured to determine one or more weighting coefficients based on the first priority level and the second priority level, the one or more processors configured to generate one or more enhanced audio signals based on the one or more weighting coefficients and the one or more sounds captured using the plurality of microphones; and an audio output device in communication with the one or more processors, the audio output device configured to output the one or more enhanced audio signals, the electronic device comprises a head-mounted display device. - View Dependent Claims (8, 9)
-
-
10. An apparatus, comprising:
-
a microphone array configured to capture one or more sounds from an environment; one or more processors configured to identify one or more sources of sound within the environment based on the one or more sounds captured using the microphone array, the one or more sources of sound include a first sound source and a second sound source different from the first sound source, the first sound source comprises a particular person, the one or more processors configured to determine a location of the apparatus and determine an identification of the particular person, the one or more processors configured to assign a first priority level to the first sound source based on the location of the apparatus and the identification of the particular person, the one or more processors configured to assign the first priority level to the first sound source in response to detecting that an end user of the apparatus has gazed at the particular person for at least a particular period of time, the one or more processors configured to assign a second priority level to the second sound source based on the location of the apparatus, the one or more processors configured to determine one or more weighting coefficients based on the first priority level and the second priority level, the one or more processors configured to generate one or more enhanced audio signals based on the one or more weighting coefficients and the one or more sounds captured using the microphone array; and an audio output device configured to output the one or more enhanced audio signals, the apparatus comprises a see-through head-mounted display device. - View Dependent Claims (11, 12, 13, 14, 15)
-
Specification