Time heuristic audio control

• US 9,918,159 B2
• Filed: 12/16/2016
• Issued: 03/13/2018
• Est. Priority Date: 04/08/2014
• Status: Active Grant

• Current Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Original Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Inventors: Jaffe, Matthew J., Kraft, Noah, Lanman, III, Richard Fritz, Baker, Jeffrey
• Primary Examiner(s): Zhang, Leshui
• Application Number:
  US15/382,475
• Publication Number:
  US 20170105064A1
• Time in Patent Office: 452 Days
• Field of Search: 381 231, 381 92, 381 26, 381 56, 381 57, 381 60, 381312, 381313, 381314, 381315, 381317, 381318, 381320, 381321, 381 61, 381 66, 381 72, 381 74, 381 731, 381 86, 381 91, 381 93, 381 941, 381 942, 381 943, 381 944, 381 947, 381 948, 381 949, 381 95, 381 96, 381 97, 381 98, 381 99, 381100, 381101, 381102, 381103, 381120, 381121, 381122, 381 711- 7114, 381334, 4554141, 4554142, 4554042, 4554041, 455440, 4554221, 4554561, 4554562, 4554563, 4554564, 4554566, 455457, 704E19013, 704E19014, 704E21002-E21009, 704E21014, 37940601-40616, 700 94
• CPC Class Codes: G10L 21/0208 Noise filtering
• CPC Class Codes: H04R 1/1016 Earpieces of the intra-aural type
• CPC Class Codes: H04R 1/1083 Reduction of ambient noise active noise reduction per se G10K11/175; protective devices for the ear, e.g. providing acoustic protection A61F11/06
• CPC Class Codes: H04R 2227/003 Digital PA systems using, e.g. LAN or internet
• CPC Class Codes: H04R 2420/07 Applications of wireless loudspeakers or wireless microphones
• CPC Class Codes: H04R 2460/07 Use of position data from wide-area or local-area positioning systems in hearing devices, e.g. program or information selection
• CPC Class Codes: H04R 27/00 Public address systems circuits for preventing acoustic reaction H04R3/02; circuits for distributing signals to loudspeakers H04R3/12; monitoring or testing arrangements for public address systems H04R29/007; amplifiers H03F
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/80 Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication

Abstract

A time heuristic audio control system, comprises a receiver for receiving time-based data from a personal computing device and a memory storing one or more sets processing parameters comprising instructions for processing the ambient sound based upon the time-based data. The system further includes a processor coupled to the memory and the receiver configured to adjust the ambient sound as directed by a selected set of processing parameters retrieved from the memory to create adjusted audio, the selected set of processing parameters retrieved based upon the time-based data and at least one speaker for outputting the adjusted audio.

Claims

1. A time heuristic audio system, comprising:

an audio processing system configured to receive ambient sound and to convert the ambient sound into a digitized ambient sound signal;

a memory storing one or more sets of processing parameters comprising instructions for processing the digitized ambient sound signal based upon time-based data, wherein the time-based data at least indicates an event or activity; and

a processor coupled to the memory, the processor configured to;

receive manually altered processing parameters and store the time-based data and the manually altered processing parameters together in the memory;

in the event a user of the time heuristic audio system manually alters the processing parameters to be a same manually altered processing parameters more than a threshold numbers of times, update the memory to use the same manually altered processing parameters when the event or activity occurs;

compare current time data to the time-based data; and

adjust the digitized ambient sound signal to create an adjusted digitized sound signal based on the same manually altered processing parameters and when the current time data matches the time-based data,

wherein the audio processing system is configured to convert the adjusted digitized sound signal into adjusted ambient sound for output.

2. The time heuristic audio system of claim 1 wherein the time-based data is a selected one of:

data from a digital calendar indicating that the user is currently present in at a particular location, data comprising a present time in a location, data obtained from a series of past user actions suggesting that the user is taking part in a particular activity, data obtained from an email account suggesting that the user is currently present at a particular location, data obtained from an email account suggesting that the user is currently viewing one of a particular artist, a particular sporting event, a particular activity, or taking part in a particular activity, data from an instant messaging or short message service suggesting that the user is currently present at a particular location, data obtained from an application operating on a personal computing device, and data obtained from an instant messaging or short message service suggesting that the user is currently viewing one of a particular artist, a particular sporting event, a particular activity, or taking part in a particular activity.

3. The time heuristic audio system of claim 2 wherein the time-based data is used in conjunction with a secondary source of data comprising one of the Internet, a database, or a data repository available via a network to the processor to select one of the one or more sets of processing parameters for retrieval.

4. The time heuristic audio system of claim 1 wherein the digitized ambient sound signal is adjusted based upon the time-based data so as to perform one or more of the following:

lower overall volume, increase overall volume, lower relative volume or attenuate the adjusted ambient sound signal within a first predetermined frequency range, raise the relative volume of the adjusted ambient sound signal within a second predetermined frequency, raise relative volume of a nearby sound while lowering the volume of sounds further away, raise the relative volume of a particular sound source, based upon characteristics of the particular sound source which were previously categorized, and raise relative volume of one or more particular sound sources based upon the time-based data indicating that the one or more particular sound sources are taking part in an event involving a user of the time heuristic audio system.

5. The time heuristic audio system of claim 1 wherein:

the one or more sets of processing parameters stored in the memory further comprise instructions for processing secondary audio from at least one secondary audio source based upon the time-based data; and

the processor is further configured to adjust the secondary audio as directed by one of the one or more sets of processing parameters retrieved from the memory to create adjusted secondary audio and to combine the adjusted secondary audio with the adjusted digitized sound signal.

6. The time heuristic audio system of claim 1 wherein the same manually altered processing parameters is automatically selected based upon more than one prior user selection of the same manually altered processing parameters when the time-based data indicates that the user of the time heuristic audio system is in a particular location or at a particular event.

7. The time heuristic audio system of claim 6 wherein the processor is further for:

determining, based upon time-based data, that the user is at the particular location or the particular event; and

automatically selecting the same manually altered processing parameters.

8. The time heuristic audio system of claim 1 wherein one of the one or more sets of processing parameters is automatically selected based upon information provided by a participant in an event identified by the time-based data.

9. The time heuristic audio system of claim 1 wherein the processor is further for:

determining, based upon the time-based data, that the user associated with the time heuristic audio system is at the particular location or the particular event and that the user has selected the same manually altered processing parameters for at least a second time; and

storing the same manually altered processing parameters as stored processing parameters to be automatically selected when time-based data received later indicates that the user is at the particular location or the particular event.

10. The time heuristic audio system of claim 1 further comprising a personal computing device, coupled to the processor via a wireless communication link.

11. The time heuristic audio system of claim 10 wherein the personal computing device operates as a source of the time-based data, the personal computing device comprising:

a second memory storing at least one time-based data source; and

a transmitter for transmitting the time-based data to a receiver.

12. The time heuristic audio system of claim 1, wherein the audio processing system comprises:

a housing enclosing at least a portion of the processor and at least a portion of the memory;

at least one microphone for receiving the ambient sound, converting the ambient sound into electrical signals, and for providing the ambient sound in a form of the electrical signals to a preamplifier;

the preamplifier coupled to an analog to digital converter and the analog to digital converter configured to convert the ambient sound into the digitized ambient sound signal for operation by the processor; and

a digital to analog converter, an amplifier, and at least one speaker to convert the adjusted digitized sound signal from the processor into the adjusted ambient sound, wherein

the at least one microphone, the preamplifier, the analog to digital converter, the digital to analog converter, the amplifier, and the at least one speaker are disposed within the housing.

13. The time heuristic audio system of claim 12 wherein the housing is an earbud housing configured to fit, at least partially, within and be supported by the user'"'"'s ear.

14. The time heuristic audio system of claim 1 wherein the time-based data is used in conjunction with ambient sound characterization performed by the time heuristic audio system to identify when the same manually altered processing parameters should begin being used to process the digitized ambient sound signal so as to derive the adjusted digitized ambient sound.

15. A method for time heuristic audio control, comprising:

storing in a memory one or more sets processing parameters comprising instructions for processing ambient sound based upon received time-based data, wherein the time-based data at least indicates an event or activity;

receiving the ambient sound and converting the ambient sound into a digitized ambient sound signal;

receiving manually altered processing parameters and storing the time-based data and the manually altered processing parameters together in the memory;

in the event a user of the time heuristic audio system manually alters the processing parameters to be a same manually altered processing parameters more than a threshold numbers of times, updating the memory to use the same manually altered processing parameters when the event or activity occurs;

comparing current time data to the time-based data;

adjusting, by a processor, the digitized ambient sound signal to create an adjusted digitized sound signal based on the same manually altered processing parameters and when the current time data matches the time-based data and whether the memory has been updated;

converting the adjusted digitized sound signal into adjusted ambient sound; and

outputting the adjusted ambient sound using at least one speaker.

16. The method of claim 15 further comprising:

determining, based upon the time-based data, that the user is at the particular location or the particular event and that the user has selected one of the one or more sets of processing parameters for at least a second time; and

storing the selected set of processing parameters as stored processing parameters to be automatically selected when time-based data received later indicates that the user is at the particular location or the particular event.

17. The method of claim 15 further comprising:

determining, based upon time-based data, that the user is at a particular location or a particular event; and

automatically selecting the same manually altered processing parameters as a selected set of processing parameters.

18. The method of claim 15 wherein a personal computing device operates as a source of the time-based data, the personal computing device for:

storing at least one time-based data source; and

transmitting the time-based data for reception by a receiver.

19. The method of claim 15 further comprising:

performing ambient sound characterization; and

using the time-based data in conjunction with the ambient sound characterization to identify when the same manually altered processing parameters should begin being used to process the ambient sound so as to generate the adjusted digitized ambient sound for output.

20. A computer program product, the computer program product being embodied in a tangible non-transitory computer readable storage medium and comprising computer instructions, while executed by a computer to perform functions of:

storing in a memory one or more sets processing parameters comprising instructions for processing ambient sound based upon received time-based data, wherein the time-based data at least indicates an event or activity;

receiving the ambient sound and converting the ambient sound into a digitized ambient sound signal;

receiving manually altered processing parameters and storing the time-based data and the manually altered processing parameters together in the memory;

in the event a user of the time heuristic audio system manually alters the processing parameters to be a same manually altered processing parameters more than a threshold numbers of times, updating the memory to use the same manually altered processing parameters when the time or activity occurs;

comparing current time data to the time-based data;

adjusting, by a processor, the digitized ambient sound signal to create an adjusted digitized sound signal based on same manually altered processing parameters and when the current time data matches the time-based data;

converting the adjusted digitized sound signal into adjusted ambient sound; and

outputting the adjusted ambient sound using at least one speaker.