Processing sound using collective feedforward

• US 9,678,709 B1
• Filed: 11/25/2015
• Issued: 06/13/2017
• Est. Priority Date: 11/25/2015
• Status: Active Grant

• Current Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Original Assignee: Doppler Labs, Inc.
• Inventors: Klimanis, Gints, Jaffe, III, Matthew J., Kraft, Noah, Lanman, III, Richard Fritz, Baker, Jeff
• Primary Examiner(s): Goins, Davetta W
• Assistant Examiner(s): Ojo, Oyesola C
• Application Number:
  US14/952,761
• Publication Number:
  US 20170147280A1
• Time in Patent Office: 566 Days
• Field of Search: 381104
• CPC Class Codes: G06F 16/68 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/686 using information manually generated, e.g. tags, keywords, comments, title or artist information, time, location or usage information, user ratings
• CPC Class Codes: G06F 16/687 using geographical or spatial information, e.g. location
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: H04L 67/30 Profiles
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04R 1/1083 Reduction of ambient noise active noise reduction per se G10K11/175; protective devices for the ear, e.g. providing acoustic protection A61F11/06
• CPC Class Codes: H04R 2420/07 Applications of wireless loudspeakers or wireless microphones
• CPC Class Codes: H04R 2460/07 Use of position data from wide-area or local-area positioning systems in hearing devices, e.g. program or information selection
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/025 using location based information parameters

Abstract

Personal audio systems and methods are disclosed. A personal audio system includes a processor to generate a personal audio stream by processing an ambient audio stream in accordance with an active processing parameter set, a circular buffer memory to store a most recent snippet of the ambient audio stream, and an event detector to detect a trigger event. In response to detection of the trigger event, a controller may transmit, to a knowledgebase remote from the personal audio system, the most recent snippet of the ambient audio stream and associated metadata.

Claims

1. A personal audio system, comprising:

a housing;

a microphone, a preamplifier, and an analog to digital converter to convert ambient sound into an ambient audio stream;

a processor to generate a personal audio stream by processing the ambient audio stream in accordance with an active processing parameter set, wherein the active processing parameter set indicates a type and degree of one or more processes to be performed on the ambient audio stream to modify a manner in which a user of the personal audio system hears the ambient audio stream, wherein the personal audio stream is a modified version of the ambient audio stream;

a buffer memory to store a most recent snippet of the ambient audio stream;

an event detector to detect a trigger event from a set of trigger events, wherein at least one of the trigger events indicates or causes a change in the active processing parameter set; and

a controller configured to, in response to detection of the at least one of the trigger events, upload from the buffer memory the most recent snippet of the ambient audio stream and associated metadata to a knowledgebase remote from the personal audio system, wherein the knowledgebase remote from the personal audio system analyzes the most recent snippet of the ambient audio stream, wherein the most recent snippet of the ambient audio stream comprises a duration of the ambient audio stream that occurs immediately preceding the trigger event; and

a digital to analog converter, an amplifier, and a speaker to convert the personal audio stream into personal output sound, wherein the microphone, the preamplifier, the analog to digital converter, the processor, the digital to analog converter, the amplifier, and the speaker are disposed within the housing.

2. The personal audio system of claim 1, wherein

at least one of the trigger events is receiving, via a user interface, a command to modify the active processing parameter set, and

the metadata transmitted to the knowledgebase includes the active processing parameter set after modification.

3. The personal audio system of claim 1, further comprising:

a parameter memory that stores one or more processing parameter sets.

4. The personal audio system of claim 3, wherein

at least one of the trigger events is receiving, via a user interface, a command to store the active processing parameter set in the parameter memory, and

the metadata transmitted to the knowledgebase includes the active processing parameter set.

5. The personal audio system of claim 3, wherein

at least one of the trigger events is retrieving a selected processing parameter set from the parameter memory for use as the active processing parameter set.

6. The personal audio system of claim 5, further comprising:

a profile developer to develop a profile of the ambient audio stream,

wherein the selected processing parameter set retrieved from the parameter memory is selected based on the profile of the ambient audio stream.

7. The personal audio system of claim 5, further comprising:

a geo-locator to determine a location of the personal audio system, wherein

wherein the processing parameter set retrieved from the parameter memory is selected based on the location of the personal audio system.

8. The personal audio system of claim 1, wherein

the metadata transmitted to the knowledgebase includes a descriptor received from a issuer via a user interface.

9. The personal audio system of claim 1, further comprising:

a geo-locator to determine a location of the personal audio system, wherein

the metadata transmitted to the knowledgebase includes data indicating the location of the personal audio system.

10. The personal audio system of claim 1, wherein the controller is further configured to

receive, from the knowledgebase, one or more processing parameter sets derived by the knowledgebase from snippets and associated metadata received by the knowledgebase from a plurality of personal audio systems, and

store the one or more processing parameter sets received from the knowledgebase in a parameter memory.

11. The personal audio system of claim 1, wherein:

the housing is an earbud housing configured to fit, at least partially, within and be supported by a user'"'"'s ear.

12. A method for processing ambient sound in a personal audio system, comprising:

generating a personal audio stream by processing an ambient audio stream in accordance with an active processing parameter set, wherein the active processing parameter set indicates a type and degree of one or more processes to be performed on the ambient audio stream to modify a manner in which a user of the personal audio system hears the ambient audio stream, wherein the personal audio stream is a modified version of the ambient audio stream;

storing a most recent snippet of the ambient audio stream in a buffer memory;

detecting a trigger event from a set of trigger events, wherein at least one of the trigger events indicates or causes a change in the active processing parameter set; and

in response to detecting the trigger event, uploading from the buffer memory the most recent snippet of the ambient audio stream and associated metadata to a knowledgebase remote from the personal audio system, wherein the knowledgebase remote from the personal audio system analyzes the most recent snippet of the ambient audio stream, wherein the most recent snippet of the ambient audio stream comprises a duration of the ambient audio stream that occurs immediately preceding the trigger event;

receiving, from the knowledgebase, one or more processing parameter sets derived by the knowledgebase from snippets and associated metadata from a plurality of personal audio systems; and

storing the one or more processing parameter sets received from the knowledgebase in a parameter memory.

13. The method of claim 12, wherein

at least one of the trigger events is receiving, via a user interface, a command to modify the active processing parameter set, and

the metadata transmitted to the knowledgebase includes the active processing parameter set after modification.

14. The method of claim 12, further comprising:

storing one or more processing parameter sets in a parameter memory.

15. The method of claim 14, wherein

at least one of the trigger events is receiving, via a user interface, a command to store the active processing parameter set in the parameter memory, and

the metadata transmitted to the knowledgebase includes the active processing parameter set.

16. The method of claim 14, wherein

at least one of the trigger events is retrieving a selected one of the one or more processing parameter sets from the parameter memory for use as the active processing parameter set.

17. The method of claim 16, further comprising:

developing a profile of the ambient audio stream,

wherein the selected processing parameter set retrieved from the parameter memory is selected based on the profile of the ambient audio stream.

18. The method of claim 16, further comprising:

determining a geo-location of the personal audio system

wherein the processing parameters set retrieved from the parameter memory is selected based on the geo-location of the personal audio system.

19. The method of claim 12, wherein

the metadata transmitted to the knowledgebase includes a descriptor received from a issuer via a user interface.

20. The method of claim 12, further comprising:

determining a geo-location of the personal audio system, wherein

the metadata transmitted to the knowledgebase includes data indicating the geo-location of the personal audio system.

21. The method of claim 12, further comprising:

converting ambient sound into the ambient audio stream; and

converting the personal audio stream into personal output sound.

22. A system, comprising:

a knowledgebase; and

a plurality of personal audio systems in communications with the knowledgebase via a network, each personal audio system comprising;

a processor to generate a personal audio stream by processing an ambient audio stream in accordance with an active processing parameter set, wherein the active processing parameter set indicates a type and degree of one or more processes to be performed on the ambient audio stream to modify a manner in which a user of the personal audio system hears the ambient audio stream, wherein the personal audio stream is a modified version of the ambient audio stream;

a circular buffer memory to store a most recent snippet of the ambient audio stream;

an event detector to detect a trigger event from a set of trigger events, wherein at least one of the trigger events indicates or causes a change in the active processing parameter set; and

a controller configured to, in response to detection of the trigger event, upload from the circular buffer memory the most recent snippet of the ambient audio stream and associated metadata to the knowledgebase via the network,

wherein the knowledgebase is configured to analyze the most recent snippet of the ambient audio stream and create new and/or revised processing parameter sets based on snippets and metadata collectively received from the plurality of personal audio systems and to transmit the new and/or revised processing parameter sets to at least some of the plurality of personal audio systems, wherein the most recent snippet of the ambient audio stream comprises a duration of the ambient audio stream that occurs immediately preceding the trigger event.

23. The system of claim 22, wherein the knowledgebase is configured to push the new and/or revised processing parameter sets to the plurality of personal audio system on an as-available basis.

24. The system of claim 22, wherein the knowledgebase is configured to transmit the new and/or revised processing parameter sets to a particular personal audio system from the plurality of personal audio systems in response to a request from the particular personal audio system.

25. The system of claim 22, wherein the knowledgebase is configured to transmit the new and/or revised processing parameter sets to a particular personal audio system from the plurality of personal audio systems in response to a change in location of the particular personal audio system.

26. The system of claim 22, wherein the knowledgebase is configured to transmit the new and/or revised processing parameter sets to the at least some of the plurality of personal audio systems at predetermined periodic intervals.