Voice-enhanced awareness mode

• US 9,830,930 B2
• Filed: 12/30/2015
• Issued: 11/28/2017
• Est. Priority Date: 12/30/2015
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Knowles Electronics Llc (Knowles Corporation)
• Inventors: Miller, Thomas E., Gadonniex, Sharon
• Primary Examiner(s): FISCHER, MARK L
• Application Number:
  US14/985,112
• Publication Number:
  US 20170194020A1
• Time in Patent Office: 699 Days
• CPC Class Codes: G10K 11/17821 characterised by the analysis of the input signals only
• CPC Class Codes: G10K 11/17823 Reference signals, e.g. ambient acoustic environment
• CPC Class Codes: G10K 11/17837 by retaining part of the ambient acoustic environment, e.g. speech or alarm signals that the user needs to hear
• CPC Class Codes: G10K 11/17881 the reference signal being an acoustic signal, e.g. recorded with a microphone
• CPC Class Codes: G10K 11/17885 additionally using a desired external signal, e.g. pass-through audio such as music or speech
• CPC Class Codes: G10K 2210/1081 Earphones, e.g. for telephones, ear protectors or headsets
• CPC Class Codes: G10K 2210/30231 Sources, e.g. identifying noisy processes or components
• CPC Class Codes: G10L 21/0272 Voice signal separating
• CPC Class Codes: G10L 25/51 for comparison or discrimination
• CPC Class Codes: H04R 1/1016 Earpieces of the intra-aural type
• CPC Class Codes: H04R 1/1041 Mechanical or electronic switches, or control elements switches in general H01H
• CPC Class Codes: H04R 1/1083 Reduction of ambient noise active noise reduction per se G10K11/175; protective devices for the ear, e.g. providing acoustic protection A61F11/06
• CPC Class Codes: H04R 2460/01 Hearing devices using active noise cancellation
• CPC Class Codes: H04W 8/205 Transfer to or from user equipment or user record carrier

Abstract

Systems and methods for providing ambient awareness are provided. An example method includes receiving an acoustic signal representing at least one captured ambient sound and determining that at least one triggering event has occurred based at least on the acoustic signal, a user profile, and a user context. In response to the determination, the method proceeds to modify, based on the at least one triggering event, the acoustic signal which represents the at least one captured ambient sound. The modified acoustic signal is provided to at least one ear canal of a user. In an exemplary embodiment, ambient sounds are selectively passed through automatically to a user based on certain triggering events, allowing a user to be able to hear sounds outside of headset while the user is wearing the headset. The triggering events may be selected by the user, for example, using a smartphone application.

Claims

1. A method for providing ambient awareness, the method comprising:

receiving an acoustic signal, the acoustic signal representing at least one captured ambient sound;

determining that at least one triggering event has occurred based at least on a user context including at least that a user is speaking while not currently participating in a telephone call;

in response to the determination, modifying, based on the at least one triggering event, the acoustic signal; and

providing the modified acoustic signal to at least one ear canal of the user.

2. The method of claim 1, wherein the modifying includes adjusting an amount of noise suppression performed on the acoustic signal based on the user profile.

3. The method of claim 1, further comprising determining that the at least one triggering event has occurred based at least on detection of a moving object approaching the user at a speed greater than a predetermined threshold.

4. The method of claim 1, further comprising determining that the at least one triggering event has occurred based at least on detection of a specific sound present in the acoustic signal.

5. The method of claim 4, wherein the specific sound includes at least one pre-defined word being spoken.

6. The method of claim 1, wherein the modifying the acoustic signal includes:

separating the acoustic signal into a voice component and a noise component; and

keeping the voice component in the acoustic signal while suppressing the noise component.

7. The method of claim 1, further comprising providing to the user at least one of the following:

an alert signal and a warning message based on the at least one triggering event.

8. The method of claim 1, further comprising determining that the at least one triggering event has occurred based at least on one or more of a current user location, and a current user movement.

9. The method of claim 1, further comprising determining that the at least one triggering event has occurred based at least on a user profile including at least one definition of the at least one triggering event and at least one rule for the modifying the acoustic signal in response to an occurrence of the at least one triggering event.

10. The method of claim 9, further comprising providing an application for customizing the user profile.

11. The method of claim 9, wherein the at least one triggering event is based on a combination of at least two of the acoustic signal, the user profile, and the user context.

12. A system for providing ambient awareness, the system comprising:

a processor; and

a memory communicatively coupled with the processor, the memory storing instructions which, when executed by the processor, cause the processor to perform a method comprising;

receiving an acoustic signal, the acoustic signal including at least one captured ambient sound;

determining that at least one triggering event has occurred based at least on a user context including at least that a user is speaking while not currently participating in a telephone call;

in response to the determination, modifying, based on the at least one triggering event, the acoustic signal; and

providing the modified acoustic signal to at least one ear canal of a user.

13. The system of claim 12, wherein the modifying includes adjusting an amount of noise suppression performed on the acoustic signal based on the user profile.

14. The system of claim 12, the method further comprising determining that the at least one triggering event has occurred based at least on detection of a moving object approaching the user at a speed greater than a predetermined threshold.

15. The system of claim 12, the method further comprising determining that the at least one triggering event has occurred based at least on detection of a specific sound present in the acoustic signal, the specific sound including at least one pre-defined word being spoken.

16. The system of claim 12, wherein the modifying the acoustic signal includes:

separating the acoustic signal into a voice component and a noise component; and

keeping the voice component in the acoustic signal while suppressing the noise component.

17. The system of claim 12, further comprising providing to the user one of an alert signal and a warning message based on the at least one triggering event.

18. The system of claim 12, further comprising determining that the at least one triggering event has occurred based at least on one or more of a current user location, a current user movement, and a current position taken by the user.

19. The system of claim 12, further comprising determining that the at least one triggering event has occurred based at least on a user profile including at least one definition of the at least one triggering event and at least one rule for the modifying the acoustic signal when the at least one triggering event occurs.

20. The system of claim 19, further comprising providing an application for customizing the user profile.

21. A non-transitory computer-readable storage medium having embodied thereon instructions, which, when executed by at least one processor, cause the processor to perform a method comprising:

receiving an acoustic signal, the acoustic signal including at least one captured ambient sound;

determining that at least one triggering event has occurred based at least on a user context including at least that a user is speaking while not currently participating in a telephone call;

in response to the determination, modifying, based on the at least one triggering event, the acoustic signal; and

providing the modified acoustic signal to at least one ear canal of a user.