SPEECH DATA SUMMARIZING AND REPRODUCING APPARATUS, SPEECH DATA SUMMARIZING AND REPRODUCING METHOD, AND SPEECH DATA SUMMARIZING AND REPRODUCING PROGRAM

• US 20090204399A1
• Filed: 05/07/2007
• Published: 08/13/2009
• Est. Priority Date: 05/17/2006
• Status: Abandoned Application

• Current Assignee: NEC Corporation
• Original Assignee: NEC Corporation
• Inventors: Akamine, Susumu
• Application Number:
  US12/301,201
• Publication Number:
  US 20090204399A1
• Time in Patent Office: Days
• US Class Current: 704/235
• CPC Class Codes: G10L 15/1822 Parsing for meaning understanding
• CPC Class Codes: G10L 2015/088 Word spotting

Abstract

Necessary portions of stored speech data representing conference content are summarized and reproduced in a predetermined time. Conference speech is summarized and reproduced using a speech data summarizing and reproducing apparatus comprising a speech data divider for dividing and structuring conference speech data into several utterance unit data based on utterers, distributed documents, the occurrence frequency of words in speech recognition results, and pauses, an importance level calculator for determining important utterance unit data based on the occurrence frequency of keywords, the information of utterers, and data specified by the user, a summarizer for extracting important utterance unit data and summarizing them within a specified time, and a speech data reproducer for reproducing the summarized speech data in chronological order or an order of importance levels with auxiliary information added thereto.

Claims

1. A speech data summarizing and reproducing apparatus comprising:

a speech data storing means for storing speech data;

a speech data dividing means for dividing the speech data into several utterance unit data;

an importance level calculating means for calculating importance levels of the respective utterance unit data based on predetermined importance level information which includes importance levels of keywords and importance levels of utterers;

a summarizing means for selecting the utterance unit data in descending order of importance levels thereof such that the total utterance time is kept within a predetermined amount of time; and

a speech data reproducing means for successively reproducing and outputting the selected utterance unit data.

2. The speech data summarizing and reproducing apparatus according to claim 1, wherein said summarizing means has a function which selects said utterance unit data in descending order of importance levels there of such that the total utterance time is kept within a time that is input and specified by the user.

3. The speech data summarizing and reproducing apparatus according to claim 1, further comprising:

an importance level information determining means for determining said importance level information based on an input from the user;

wherein said importance level calculating means has a function which calculates importance levels of the respective utterance unit data based on the importance level information determined by said importance level information determining means.

4. The speech data summarizing and reproducing apparatus according to claim 1, wherein said speech data dividing means has a function which divides said speech data at break points including when an utterer takes over and when there is a pause interval in said speech data.

5. The speech data summarizing and reproducing apparatus according to claim 4, wherein priority levels are set for respective type of said break points, and said speech data dividing means has a function which successively selects break points in descending order of priority levels to divide said speech data such that the utterance time of each of the utterance unit data is kept within a predetermined amount of time.

6. The speech data summarizing and reproducing apparatus according to claim 1, wherein said speech data reproducing means has a function which reproduces and outputs the utterance unit data selected by said summarizing means in chronological order.

7. The speech data summarizing and reproducing apparatus according to claim 1, wherein said speech data reproducing means has a function which reproduces and outputs the utterance unit data selected by said summarizing means in descending order of importance levels thereof.

8. The speech data summarizing and reproducing apparatus according to claim 1, further comprising:

a text information displaying means for displaying utterance unit data information including the utterers of utterance unit data, the utterance times thereof, and character strings of speech recognition results thereof as text information on a screen when the utterance unit data are reproduced.

9. A speech data summarizing and reproducing method comprising:

dividing stored speech data into several utterance unit data;

calculating importance levels of respective utterance unit data based on predetermined importance level information which includes importance levels of keywords and importance levels of utterers;

of selecting the utterance unit data in descending order of importance levels thereof such that the total utterance time is kept within a predetermined amount of time; and

successively reproducing and outputting the selected utterance unit data.

10. The speech data summarizing and reproducing method according to claim 9, wherein said utterance unit data selecting step comprises a step of selecting said utterance unit data in descending order of importance levels thereof such that the total utterance time is kept within a time that is input and specified by the user.

11. The speech data summarizing and reproducing method according to claim 9, further comprising:

determining said importance level information based on an input from the user;

wherein said importance level calculating step includes a step of calculating importance levels of respective utterance unit data based on importance level information determined by said importance level information determining step.

12. The speech data summarizing and reproducing method according to claim 9, wherein said speech data dividing step includes a step of dividing said speech data at break points including when an utterer takes over and when there is a pause interval in said speech data.

13. The speech data summarizing and reproducing method according to claim 12, wherein priority levels are set for respective type of said break points, and said speech data dividing step comprises includes a step of successively selecting the break points in descending order of priority levels to divide said speech data such that the utterance time of each of the utterance unit data is kept within a predetermined amount of time.

14. The speech data summarizing and reproducing method according to claim 9, wherein said speech data reproducing step includes a step of reproducing and outputting the utterance unit data selected by said summarizing step in chronological order.

15. The speech data summarizing and reproducing method according to claim 9, wherein said speech data reproducing step includes a step of reproducing and outputting the utterance unit data selected by said summarizing step in descending order of importance levels thereof.

16. The speech data summarizing and reproducing method according to claim 9, further comprising:

displaying utterance unit data information including the utterers of utterance unit data, the utterance times thereof, and character strings of speech recognition results thereof as text information on a screen when the utterance unit data are reproduced.

17. A recording medium recorded with a speech data summarizing and reproducing program, said program being for causing a computer to execute:

a speech data dividing process for dividing stored speech data into several utterance unit data;

an importance level calculating process for calculating importance levels of respective utterance unit data based on predetermined importance level information which includes importance levels of keywords and importance levels of utterers;

a summarizing process for selecting the utterance unit data in descending order of importance levels thereof such that the total utterance time is kept within a predetermined amount of time; and

a speech data reproducing process for successively reproducing and outputting the selected utterance unit data.

18. The recording medium according to claim 17, wherein said summarizing process comprises a process for specifying the content of said utterance unit data such that said utterance unit data is selected in descending order of importance levels thereof and such that the total utterance time is kept within a time that is input and specified by the user.

19. The recoding medium according to claim 17, wherein said program causes the computer to further execute a process for enabling the computer to perform an importance level information determining process for determining said importance level information based on an input from the user, and said importance level calculating process comprises a process for specifying the content of respective utterance unit data such that importance levels of respective utterance unit data are calculated based on the importance level information determined by said importance level information determining process.

20. The recoding medium according to claim 17, wherein said speech data dividing process comprises a process for specifying the content of said speech data such that said speech data is divided at break points including when an utterer takes over and when there is a pause interval in said speech data.

21. The recording medium according to claim 20, wherein priority levels are set for the respective type of said break points, and said speech data dividing process comprises a process for specifying the content of said speech data such that said break points are successively selected in descending order of priority levels to divide said speech data and such that the utterance time of each of the utterance unit data is kept within a predetermined amount of time.

22. The recording medium according to claim 17, wherein said speech data reproducing process comprises a process for specifying the content of the utterance unit data selected by said summarizing such that the selected utterance unit data is reproduced and output in a chronological order.

23. The recording medium according to claim 17, wherein said speech data reproducing process comprises a process for specifying the content of the utterance unit data selected by said summarizing process such that the selected utterance unit data is reproduced and output in descending order of importance levels thereof.

24. The recording medium according to claim 17, wherein said program causes the computer to further execute a process for enabling the computer to perform a text information displaying process for displaying utterance unit data information including the utterers of utterance unit data, the utterance times thereof and character strings of speech recognition results thereof as text information on a screen when the utterance unit data are reproduced.

25. A speech data summarizing and reproducing apparatus comprising:

a speech data storage unit which stores speech data;

a speech data divider which divides the speech data into several utterance unit data;

an importance level calculator which calculates importance levels of the respective utterance unit data based on predetermined importance level information which includes importance levels of keywords and importance levels of utterers;

a summarizer which selects the utterance unit data in descending order of importance levels thereof such that the total utterance time is kept within a predetermined amount of time; and

a speech data reproducer which successively reproduces and outputs the selected utterance unit data.