Hearing Agent and a Related Method

• US 20090010466A1
• Filed: 02/03/2006
• Published: 01/08/2009
• Est. Priority Date: 02/03/2006
• Status: Abandoned Application

• Current Assignee: Nokia Corporation
• Original Assignee: Nokia Corporation
• Inventors: Haikonen, Pentti O. A.
• Application Number:
  US12/223,516
• Publication Number:
  US 20090010466A1
• Time in Patent Office: Days
• US Class Current: 381/315
• CPC Class Codes: G08B 1/08 using electric transmission ; transformation of alarm signals to electrical signals from a different medium, e.g. transmission of an electric alarm signal upon detection of an audible alarm signal

Abstract

A hearing agent being an entity capable of recognizing a number of predetermined sounds by an associative matrix and providing the user of the entity with an alert indicating the particular recognized sound, and a corresponding method. The agent may be implemented as a dedicated device, a module attachable to another device, or software introduced to a more general device such as a mobile terminal or a PDA.

Claims

1. A portable hearing agent comprising

an audio sensor for transforming an acoustic signal into a representative electric signal,

a processing unit configured, while in a training mode, to associate the sensed signal with a predetermined response, and, while in a recognition mode, to activate the predetermined response,

an output module for alerting a user of the agent and indicating the acoustic signal via the predetermined response,

an auditory feature extractor for determining auditory feature values of the sensed signal, said auditory feature values indicating presence or non-presence of predetermined auditory features, and

an associative matrix configured to store, while in said training mode, weight values representing an association between said auditory feature values and a predetermined matrix output signal linked with the predetermined response, and

wherein said processing unit is configured to input, while in said recognition mode, said auditory feature values to the matrix so as to evoke a predetermined matrix output signal that is an associatively best match, according to a predetermined criterion applying the weight values, to said input auditory feature values.

2. The hearing agent of claim 1, further comprising a camera for taking a video sequence or a still image of a localized sound source emitting the sensed signal.

3. The hearing agent of claim 1, wherein said output module includes at least one element selected from the group consisting of:

a display, a loudspeaker, a vibration unit, and an information transfer module.

4. The hearing agent of claim 1, wherein said predetermined response includes at least one element selected from the group consisting of:

a sound, an image, a video sequence, a text, and a vibration pattern.

5. The hearing agent of claim 1, wherein said auditory features include at least one element selected from the group consisting of:

a frequency component, a ratio of predetermined frequency components, signal energy, and a sound coefficient value.

6. The hearing agent of claim 1, configured to sense, during said training mode, a user-determined acoustic signal as one of said predetermined acoustic signals, to determine the auditory feature values therefrom and to store the corresponding associative weight values in the associative matrix.

7. The hearing agent of claim 1, wherein said predetermined response is user-determined.

8. The hearing agent of claim 1, wherein said auditory feature values are binary.

9. The hearing agent of claim 1, wherein the auditory feature values relating to a predetermined acoustic signal are respectively stored as cell values of an associative matrix, preferably on a single row or column.

10. The hearing agent of claim 1, configured to multiply a number of weight values relating to a certain matrix output with auditory feature values of the sensed signal and summing the multiplication results together to form an aggregate value.

11. The hearing agent of claim 10, wherein an output with the highest aggregate value is selected as the associatively best mach.

12. The hearing agent of claim 1, further comprising a linker for linking the predetermined matrix output signal with the predetermined response.

13. The hearing agent of claim 1, comprising a plurality of audio sensors for localizing a sound source.

14. The hearing agent of claim 1 that is a mobile terminal, a Personal Digital Assistant, a module attachable to another device, or a robot.

15. A method comprising:

obtaining a sensed acoustic signal in electric form,

associating, while the agent is in a training mode, the sensed signal with a predetermined response, and activating, while in a recognition mode, the predetermined response,

alerting the user of the agent and indicating the acoustic signal via the predetermined response,

extracting a plurality of auditory feature values from the sensed signal, wherein said auditory feature values respectively indicate presence or non-presence of predetermined auditory features,

storing in an associative matrix, while in said training mode, weight values representing an association between said auditory feature values and a predetermined matrix output signal linked with the predetermined response, and

inputting, while in said recognition mode, said auditory feature values to the matrix so as to evoke a predetermined matrix output signal that is an associatively best match, according to a predetermined criterion applying the weight values, to said input auditory feature values.

16. (canceled)

17. (canceled)

18. A readable memory stored with instructions for execution by a processor, for:

obtaining a sensed acoustic signal in electric form,

associating, while the agent is in a training mode, the sensed signal with a predetermined response, and activating, while in a recognition mode, the predetermined response,

alerting the user of the agent and indicating the acoustic signal via the predetermined response,

extracting a plurality of auditory feature values from the sensed signal, wherein said auditory feature values respectively indicate presence or non-presence of predetermined auditory features,

storing in an associative matrix, while in said training mode, weight values representing an association between said auditory feature values and a predetermined matrix output signal linked with the predetermined response, and

inputting, while in said recognition mode, said auditory feature values to the matrix so as to evoke a predetermined matrix output signal that is an associatively best match, according to a predetermined criterion applying the weight values, to said input auditory feature values.

19. A portable hearing agent comprising:

means for transforming an acoustic signal into a representative electric signal,

means for associating the sensed signal with a predetermined response while in a training mode, and while in a recognition mode, for activating the predetermined response,

means for alerting a user of the agent and indicating the acoustic signal via the predetermined response,

means for determining auditory feature values of the sensed signal, said auditory feature values indicating presence or non-presence of predetermined auditory features, and

means for storing weight values representing an association between said auditory feature values and a predetermined matrix output signal linked with the predetermined response while in said training mode, and

wherein said means for associating is for inputting, while in said recognition mode, said auditory feature values to the means for storing so as to evoke a predetermined matrix output signal that is an associatively best match, according to a predetermined criterion applying the weight values, to said input auditory feature values.