Intelligent media processing and language architecture for speech applications

• US 20040073430A1
• Filed: 10/10/2002
• Published: 04/15/2004
• Est. Priority Date: 10/10/2002
• Status: Abandoned Application

• Current Assignee: Houghton Mifflin Harcourt Publishing Company (Houghton Mifflin Harcourt Co. (Private Equity))
• Original Assignee: Houghton Mifflin Harcourt Publishing Company (Houghton Mifflin Harcourt Co. (Private Equity))
• Inventors: Desai, Ranjit, Swain, Michael, Dey, Jayanta K., Sivasankaran, Rajendran M., Jenkins, Adam, Mukhopadhyay, Sugata
• Application Number:
  US10/267,929
• Publication Number:
  US 20040073430A1
• Time in Patent Office: Days
• US Class Current: 704/270.1
• CPC Class Codes: G10L 15/28 Constructional details of speech recognition systems

Abstract

A modular architecture is described for providing an intelligent media processing and language architecture working in conjunction with a speech application. The modular architecture comprises four modules: a user profile module, an active audio markup language (AAML) module, a real-time monitoring and sensing module, and a process and control module. The user profile module enables creation of personal profiles and is capable of learning user preferences. The AAML module provides a rich media representation wherein an AAML codec is provided as a part of the module. The processing and control module is responsible for processing the information received from each of the other modules, interpreting the received information, and intelligently routing it to the application layer.

Claims

1. A modularized intelligent media processing and language architecture comprising:

a. a user profile module for customizing preferences associated with one or more users;

b. an active media markup language module providing a media representation based upon an active media markup language codec;

c. a real-time monitoring and sensing module for identifying variations in quality of service; and

d. a process and control module interfacing said user profile module, said active media markup language module, and said real-time monitoring module with an application layer;

wherein said process and control module;

interacts with said user profile module to identify user preferences based upon a user'"'"'s profile;

interacts with said active media markup module to decode and forward, to said application layer, a media stream in an active media markup language format consistent with identified user preferences; and

/or interacts with said real-time monitoring and sensing module to interpret monitored real-time sensed parameters and forwards said parameters to said application layer.

2. A modularized intelligent media processing and language architecture, as per claim 1, wherein said user profile module comprises a learning component for intelligently learning and recording preferences associated with said users.

3. A modularized intelligent media processing and language architecture, as per claim 1, wherein said media stream comprises the following information:

a. media data;

b. statistical description of said media data;

c. media processing parameters for processing said media data;

d. tags associated with said media data; and

e. instructions for processing said media data.

4. A modularized intelligent media processing and language architecture, as per claim 3, wherein said statistical description comprises any of the following:

signal-to-noise ratio information, local statistics, or global statistics.

5. A modularized intelligent media processing and language architecture, as per claim 3, wherein said media processing parameters comprises any of the following:

thresholds for processing said media data, order of filters for processing said media data, or time window of local analysis of said media data.

6. A modularized intelligent media processing and language architecture, as per claim 3, wherein said instructions for processing said media data comprises information regarding type of filter to be used to process said media data.

7. A method for facilitating entry and retrieval of audio data from a database using a modularized architecture comprising a user profile module, an active audio markup language (AAML) module, a real-time monitoring and sensing module, and a process and control module, said method comprising the steps of:

a. receiving vocal inputs from a communication device requesting audio information;

b. forwarding such requests to said database;

c. identifying user preferences associated with a user of said communication device, said identification done based upon an interaction between said process control module and said user profile module;

d. receiving requested audio information in an AAML formatted audio stream from said database;

e. decoding said audio stream via an AAML codec, said decoding based upon an interaction between said process control module and said AAML module;

f. identifying variations in quality of service associated with said communication device, said identification done based on an interaction between said process and control module and said real-time monitoring and sensing module; and

g. forwarding said identified variations in quality of service and decoded audio stream in a format consistent with said identified user'"'"'s profile to said application layer.

8. A method as per claim 7, wherein said communication device is any of the following:

telephones, wireless telephones, cellular telephones, WAP-enabled telephones, personal audio systems, audio playback systems, or wireless communication devices.

9. A method as per claim 7, wherein said method further comprises the step of intelligently learning and recording preferences associated with said user.

10. A system for facilitating entry and retrieval of audio data from a database via a communication device, said system comprising:

a. a speech-based application receiving vocal inputs from said communication device requesting audio information and forwarding such requests to said database; and

b. a modularized architecture interacting with said speech-based application and said database to enter and retrieve data, said modularized architecture comprising;

(i) a user profile module for customizing preferences associated with user of said communication device;

(ii) an active audio markup language (AAML) module receiving requested audio information as an AAML formatted audio stream from said database and decoding said audio stream via a AAML codec;

(iii) a real-time monitoring and sensing module for identifying variations in quality of service associated with said communication device; and

(iv) a process and control module interfacing said user profile module, said AAML module, and real-time monitoring module with an application layer associated with said speech-based application;

wherein said process and control module;

interacts with said user profile module to identify said user'"'"'s profile;

interacts with said AAML module and forwards said decoded audio stream in a format consistent with said identified user'"'"'s profile to said application layer; and

/or interacts with said real-time monitoring and sensing module to interpret monitored real-time sensed parameters and forwarding said parameters to said application layer.

11. A method as per claim 10, wherein said communication device is any of the following:

telephones, wireless telephones, cellular telephones, WAP-enabled telephones, personal audio systems, audio playback systems, or wireless communication devices.

12. A system as per claim 10, wherein said audio stream comprises the following information:

a. audio data;

b. statistical description of said audio data;

c. media processing parameters for processing said audio data;

d. tags associated with said audio data; and

e. instructions for processing said audio data.

13. A system as per claim 12, wherein said statistical description comprises any of the following:

signal-to-noise ratio information, local statistics, or global statistics.

14. A system as per claim 12, wherein said audio processing parameters comprises any of the following:

thresholds for processing said audio data, order of filters for processing said media data, or time window of local analysis of said audio data.

15. A system as per claim 12, wherein said instructions for processing said media data comprises information regarding type of filter to be used to process said audio data.

16. A system as per claim 10, wherein said user profile module comprises a learning component for intelligently learning and recording preferences associated with said user.

17. An article of manufacture comprising a computer usable medium having computer readable program code embodied therein for facilitating entry and retrieval of audio data from a database using a modularized architecture comprising a user profile module, an active audio markup language (AAML) module, a real-time monitoring and sensing module, and a process and control module, said medium comprising:

a. computer readable program code facilitating the reception of vocal inputs from a communication device requesting audio information;

b. computer readable program code forwarding such requests to said database;

c. computer readable program code identifying user preferences associated with a user of said communication device, said identification done based upon an interaction between said process control module and said user profile module;

d. computer readable program code receiving requested audio information in an AAML formatted audio stream from said database;

e. computer readable program code decoding said audio stream via a AAML codec, said decoding based upon an interaction between said process control module and said AAML module;

f. computer readable program code identifying variations in quality of service associated with said communication device, said identification done based on an interaction between said process and control module and said real-time monitoring and sensing module; and

g. computer readable program code forwarding said identified variations in quality of service and decoded audio stream in a format consistent with said identified user'"'"'s profile to said application layer.

18. An article of manufacture as per claim 17, wherein said medium further comprises computer readable program code learning and recording user preferences.