Information processing apparatus and method with speech synthesis function

• US 20030158735A1
• Filed: 02/11/2003
• Published: 08/21/2003
• Est. Priority Date: 02/15/2002
• Status: Abandoned Application

• Current Assignee: Canon Ayutthaya Limited (Canon Inc.)
• Original Assignee: Canon Ayutthaya Limited (Canon Inc.)
• Inventors: Yamada, Masayuki, Fukada, Toshiaki, Okutani, Yasuo, Kawasaki, Katsuhiko
• Application Number:
  US10/361,612
• Publication Number:
  US 20030158735A1
• Time in Patent Office: Days
• US Class Current: 704/260
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems

Abstract

With this invention, an information processing apparatus which has an audio data playback function and text-to-speech synthesis function allows the user to input an instruction by a fewer operations and provides a fast-forward/fast-reverse function optimal to speech synthesis. During speech synthesis, an instruction input by a button operation is supplied to a speech synthesis unit. When playback of audio data is underway, but speech synthesis is inactive, an instruction input by a button operation is supplied to an audio data playback unit. In a fast-forward mode, an abstract is read aloud or head parts of sentences are read aloud. In a fast-reverse mode, head parts of sentences are read aloud. Also, given tones are generated in correspondence with skipped parts.

Claims

1. An information processing apparatus comprising:

playback means for playing back audio data;

speech synthesis means for converting text data into synthetic speech, and outputting the synthetic speech;

instruction detection means for detecting a user'"'"'s instruction;

detection means for detecting operation states of said playback means and said speech synthesis means;

instruction supply means for supplying the user'"'"'s instruction to one of said playback means and said speech synthesis means in accordance with the operation states; and

control means for controlling said playback means or said speech synthesis means that has received the user'"'"'s instruction to execute a process based on the user'"'"'s instruction.

2. The apparatus according to claim 1, wherein the user'"'"'s instruction is one of a fast-forward, fast-reverse, stop, and pause instructions.

3. The apparatus according to claim 1, wherein said instruction supply means supplies the instruction to said speech synthesis means when said speech synthesis means is active.

4. The apparatus according to claim 1, wherein said instruction supply means supplies the instruction to said playback means when said speech synthesis means is inactive and said playback means is active.

5. The apparatus according to claim 2, wherein when the user'"'"'s instruction is a fast-forward instruction and said instruction supply means supplies the instruction to said speech synthesis means, said control means controls said speech synthesis means to generate abstract data by extracting predetermined partial data from respective sentences of text data to be read, and to output the abstract data as synthetic speech.

6. The apparatus according to claim 2, wherein when the user'"'"'s instruction is a fast-forward instruction and said instruction supply means supplies the instruction to said speech synthesis means, said control means controls said speech synthesis means to extract the first words from respective sentences of text data to be read and to output the extracted words as synthetic speech in turn.

7. The apparatus according to claim 2, wherein when the user'"'"'s instruction is a fast-reverse instruction and said instruction supply means supplies the instruction to said speech synthesis means, said control means controls said speech synthesis means to extract the first words from respective sentences of text data to be read and to output the extracted words as synthetic speech in an order opposite to an arrangement of sentences of the text data.

8. The apparatus according to claim 1, wherein when the user'"'"'s instruction is a playback instruction, said instruction supply means detects whether or not a reading pointer indicating a reading start position is set in the text data, and when the reading pointer is detected, said instruction supply means supplies the user'"'"'s instruction to said speech synthesis means to start speech synthesis of the text data from the position of the reading pointer.

9. The apparatus according to claim 1, wherein when the user'"'"'s instruction is a playback instruction, said instruction supply means detects whether or not a playback pointer indicating a playback start position is set in recorded audio data, and when the playback pointer is detected, said instruction supply means supplies the user'"'"'s instruction to said playback means to start playback of the recorded audio data from the position of the playback pointer.

10. The apparatus according to claim 1, wherein said control means controls said speech synthesis means to output a predetermined tone in correspondence with data, of the text data, which does not undergo speech synthesis of said speech synthesis means and is omitted.

11. An information processing apparatus comprising:

speech synthesis means for converting text data into synthetic speech, and outputting the synthetic speech;

input means used to input a user'"'"'s instruction;

status detection means for detecting a state of the input means; and

control means for controlling said speech synthesis means to output synthetic speech of the text data in a fast-forward mode or a fast-reverse mode in accordance with the detected state of the input means.

12. The apparatus according to claim 11, wherein said input means is a dial, and said status detection means detects an angle of said dial.

13. The apparatus according to claim 12, wherein said control means controls to output synthetic speech of the text data in the fast-forward mode when the angle of said dial is positive.

14. The apparatus according to claim 13, wherein said control means comprises change means for changing the number of words to be skipped, which are to undergo speech synthesis, in the fast-forward mode.

15. The apparatus according to claim 14, wherein said control means controls said speech synthesis means to output a predetermined tone in correspondence with a position of each skipped word.

16. The apparatus according to claim 12, wherein said control means controls to output synthetic speech of the text data in the fast-reverse mode when the angle of said dial is negative.

17. The apparatus according to claim 15, wherein said control means comprises change means for changing the number of words to be skipped, which are to undergo speech synthesis, in the fast-reverse mode.

18. The apparatus according to claim 17, wherein said control means controls said speech synthesis means to output a predetermined tone in correspondence with a position of each skipped word.

19. An information processing method comprising:

a playback step of playing back audio data;

a speech synthesis step of converting text data into synthetic speech, and outputting the synthetic speech;

an instruction detection step of detecting a user'"'"'s instruction;

a detection step of detecting operation states of the playback step and the speech synthesis step;

an instruction supply step of supplying the user'"'"'s instruction to one of the playback step and the speech synthesis step in accordance with the operation states; and

a control step of controlling the playback step or the speech synthesis step that has received the user'"'"'s instruction to execute a process based on the user'"'"'s instruction.

20. An information processing method comprising:

a speech synthesis step of converting text data into synthetic speech, and outputting the synthetic speech;

a status detection step of detecting a state of a input means used to input a user'"'"'s instruction; and

a control step of controlling the speech synthesis step to output synthetic speech of the text data in a fast-forward mode or a fast-reverse mode in accordance with the detected state of the input means.

21. A program for making a computer execute:

a playback step of playing back audio data;

a speech synthesis step of converting text data into synthetic speech, and outputting the synthetic speech;

an instruction detection step of detecting a user'"'"'s instruction;

a detection step of detecting operation states of the playback step and the speech synthesis step;

an instruction supply step of supplying the user'"'"'s instruction to one of the playback step and the speech synthesis step in accordance with the operation states; and

a control step of controlling the playback step or the speech synthesis step that has received the user'"'"'s instruction to execute a process based on the user'"'"'s instruction.

22. A computer readable storage medium that stores a program for making a computer execute:

a playback step of playing back audio data;

a speech synthesis step of converting text data into synthetic speech, and outputting the synthetic speech;

an instruction detection step of detecting a user'"'"'s instruction;

a detection step of detecting operation states of the playback step and the speech synthesis step;

an instruction supply step of supplying the user'"'"'s instruction to one of the playback step and the speech synthesis step in accordance with the operation states; and

a control step of controlling the playback step or the speech synthesis step that has received the user'"'"'s instruction to execute a process based on the user'"'"'s instruction.

23. A program for controlling an information processing apparatus which has an input means used to input a user'"'"'s instruction,

said program making a computer execute:

a speech synthesis step of converting text data into synthetic speech, and outputting the synthetic speech;

a status detection step of detecting a state of the input means; and

a control step of controlling the speech synthesis step to output synthetic speech of the text data in a fast-forward mode or a fast-reverse mode in accordance with the detected state of the input means.

24. A computer readable storage medium that stores a control program for controlling an information processing apparatus which has an input means used to input a user'"'"'s instruction,

said control program making a computer execute:

a speech synthesis step of converting text data into synthetic speech, and outputting the synthetic speech;

a status detection step of detecting a state of the input means; and

a control step of controlling the speech synthesis step to output synthetic speech of the text data in a fast-forward mode or a fast-reverse mode in accordance with the detected state of the input means.

25. An information processing apparatus comprising:

speech synthesis means for converting text data into synthetic speech, and outputting the synthetic speech;

instruction detection means for detecting a user'"'"'s instruction;

detection means for detecting an operation state of said speech synthesis means;

instruction supply means for supplying the user'"'"'s instruction to said speech synthesis means in accordance with the operation state; and

control means for controlling said speech synthesis means that has received the user'"'"'s instruction to execute a process based on the user'"'"'s instruction.

26. The apparatus according to claim 25, wherein when the user'"'"'s instruction is a fast-forward instruction and said instruction supply means supplies the instruction to said speech synthesis means, said control means controls said speech synthesis means to generate abstract data by extracting predetermined partial data from respective sentences of text data to be read, and to output the abstract data as synthetic speech.

27. The apparatus according to claim 25, wherein when the user'"'"'s instruction is a fast-forward instruction and said instruction supply means supplies the instruction to said speech synthesis means, said control means controls said speech synthesis means to extract the first words from respective sentences of text data to be read and to output the extracted words as synthetic speech in turn.

28. The apparatus according to claim 25, wherein when the user'"'"'s instruction is a fast-reverse instruction and said instruction supply means supplies the instruction to said speech synthesis means, said control means controls said speech synthesis means to extract the first words from respective sentences of text data to be read and to output the extracted words as synthetic speech in an order opposite to an arrangement of sentences of the text data.

29. The apparatus according to claim 25, wherein said control means controls said speech synthesis means to output a predetermined tone in correspondence with data, of the text data, which does not undergo speech synthesis of said speech synthesis means and is omitted.

30. A program for making a computer implement text-to-speech reading using speech synthesis,

said program making the computer execute:

a control step of controlling start/stop of text-to-speech reading of text;

a measurement step of measuring a time period between reading stop and restart timings; and

a determination step of determining a reading restart position of the text upon restarting the text-to-speech reading in accordance with the measured time period.

31. The program according to claim 30, wherein the determination step includes the step of determining a position going back a given number of sentences corresponding to the time period from a position of the text at the reading stop timing as the reading restart position.

32. The program according to claim 31, wherein the number of sentences is counted based on punctuation marks.

33. The program according to claim 30, wherein the determination step includes the step of determining a position going back a given number of paragraphs corresponding to the time period from a position of the text at the reading stop timing as the reading restart position.

34. The program according to claim 33, wherein the number of paragraphs is counted on the basis of positions at each of which a punctuation mark, return code, and space occur in turn.

35. The program according to claim 30, further comprising the step of changing at least one of a reading speed and reading voice before and after a reading position of the text at the reading stop timing.

36. A text-to-speech reading apparatus for implementing text-to-speech reading using speech synthesis, comprising:

control means for controlling start/stop of text-to-speech reading of text; and

measurement means for measuring a time period between reading stop and restart timings,

wherein said control means controls a reading restart position of the text upon restarting the text-to-speech reading in accordance with the measured time period.

37. The apparatus according to claim 36, wherein said control means determines a position going back a given number of sentences corresponding to the time period from a position of the text at the reading stop timing as the reading restart position.

38. The apparatus according to claim 37, wherein the number of sentences is counted based on punctuation marks.

39. The apparatus according to claim 36, wherein said control means determines a position going back a given number of paragraphs corresponding to the time period from a position of the text at the reading stop timing as the reading restart position.

40. The apparatus according to claim 39, wherein the number of paragraphs is counted on the basis of positions at each of which a punctuation mark, return code, and space occur in turn.

41. The apparatus according to claim 36, further comprising means for changing at least one of a reading speed and reading voice before and after a reading position of the text at the reading stop timing.

42. A method of controlling a text-to-speech reading apparatus for implementing text-to-speech reading using speech synthesis, comprising:

a control step of controlling start/stop of text-to-speech reading of text;

a measurement step of measuring a time period between reading stop and restart timings; and

a determination step of determining a reading restart position of the text upon restarting the text-to-speech reading in accordance with the measured time period.