Automatic creation of an interactive log based on real-time content

• US 7,844,460 B2
• Filed: 02/15/2007
• Issued: 11/30/2010
• Est. Priority Date: 02/15/2007
• Status: Active Grant

• Current Assignee: Motorola Solutions, Inc.
• Original Assignee: Motorola, Inc. (Motorola Solutions, Inc.)
• Inventors: Lee, Joong Thye, Zhang, Yaxin, Baranov, Sergey N., Charlier, Michael L., Sparrell, Carlton J.
• Primary Examiner(s): Chawan; Vijay B
• Application Number:
  US11/675,139
• Publication Number:
  US 20080201142A1
• Time in Patent Office: 1,384 Days
• Field of Search: 704/257, 704/235, 704/270.1, 704/275, 704/251, 704/277, 704/7, 704/27, 704/270, 709/231, 709/227, 709/203, 379/100.08, 379/88.03, 369/25.01, 700/94
• US Class Current: 704/257
• CPC Class Codes: G10L 15/1822 Parsing for meaning understanding
• CPC Class Codes: G10L 2015/088 Word spotting

Abstract

A system [100] includes an audio reception device [105] to receive audio from a person speaking and convert the audio to a text format. An intelligent agent [110] receives the text format and detects at least one key term in the text format based on predetermined criteria. A logic engine [115] compares the at least one key term with a listener knowledge base [125] corresponding to a listener to determine context information corresponding to the at least one key term. A search device [135] searches for multimedia content corresponding to the context information. A communication device [150] communicates display content comprising at least one of: the multimedia content, and a link to the multimedia content to an electronic display device [155] adapted to display the display content.

Claims

1. A system comprising:

an audio reception device to receive audio from a person speaking and convert the audio to a text format;

an intelligent agent to receive the text format and detect at least one key term in the text format based on predetermined criteria;

a logic engine to compare the at least one key term with a listener knowledge base corresponding to a listener, the listener distinct from the person speaking, to determine context information corresponding to the at least one key term;

a search device to search for multimedia content corresponding to the context information;

a communication device to communicate display content comprising at least one of;

the multimedia content and a link to the multimedia content; and

an electronic display device to display the display content to the listener.

2. The system of claim 1 wherein the search device is adapted to search for the multimedia content in at least one of:

a database and the Internet.

3. The system of claim 1 wherein the electronic display device comprises at least one of:

a wireless telephone, a Personal Digital Assistant, a laptop computer, and a television set-top box.

4. The system of claim 1 wherein the logic engine is adapted to update the listener knowledge base based on a detection of the at least one key term.

5. The system of claim 1 further comprising a memory to store the listener knowledge base.

6. The system of claim 5 wherein the memory is further adapted to store a speaker knowledge base corresponding to the person speaking, and wherein the logic engine is adapted to utilize the speaker knowledge base to disambiguate the at least one key term.

7. The system of claim 1 wherein the intelligent agent is adapted to store the text format and the multimedia content in a log in a memory.

8. The system of claim 1 wherein the intelligent agent is adapted to organize the display content into at least a three-level hierarchy, wherein a first level comprises a relatively short definition of the at least one key term, a second level comprises a paragraph summary of the at least one key term, and a third level comprises a detailed description of the at least one key term.

9. A method comprising:

receiving audio from a person speaking;

converting the audio to a text format;

detecting at least one key term in the text format based on predetermined criteria;

comparing the at least one key term with a listener knowledge base corresponding to a listener, the listener distinct from the person speaking, to determine context information corresponding to the at least one key term;

searching for multimedia content corresponding to the context information;

communicating display content comprising at least one of;

the multimedia content, and a link to the multimedia content; and

displaying the display content to the listener.

10. The method of claim 9 further comprising searching for the multimedia content in at least one of:

a database and the Internet.

11. The method of claim 9 wherein the electronic display device comprises at least one of:

a wireless telephone, a Personal Digital Assistant, a laptop computer, and a television set-top box.

12. The method of claim 9 further comprising updating the listener knowledge base based on a detection of the at least one key term.

13. The method of claim 9 further comprising storing the text format and the multimedia content in a log in a memory.

14. The method of claim 9 further comprising organizing the display content into at least a three-level hierarchy, wherein a first level comprises a relatively short definition of the at least one key term, a second level comprises a paragraph summary of the at least one key term, and a third level comprises a detailed description of the at least one key term.