Electronic document processing apparatus and method for forming summary text and speech read-out

• US 6,985,864 B2
• Filed: 08/26/2004
• Issued: 01/10/2006
• Est. Priority Date: 06/30/1999
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Nagao, Katashi
• Primary Examiner(s): Azad, Abul K.
• Application Number:
  US10/926,805
• Publication Number:
  US 20050055212A1
• Time in Patent Office: 502 Days
• Field of Search: 704258-270, 704/9, 704/257, 704/270.1
• US Class Current: 704/260
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems

Abstract

On receipt of a tagged file, as a tagged document, at step S1, a document processing apparatus at step S2 derives the attribute information for read-out from tags of the tagged file and embeds the attribute information to generate a speech read-out file. Then, at step S3, the document processing apparatus performs processing suited for a speech synthesis engine, using the generated speech read-out file. At step S4, the document processing apparatus performs processing depending on the operation by the user through a user interface.

Claims

1. An electronic document processing apparatus for processing an electronic document, comprising:

summary text forming means for forming a summary text of said electronic document; and

speech read-out data generating means for generating speech read-out data for reading said electronic document out by a speech synthesizer;

said speech read-out data generating means generating said speech read-out data as the attribute information indicating reading out a portion of said electronic document included in said summary text with emphasis as compared to a portion thereof not included in said summary text.

2. The electronic document processing apparatus according to claim 1 wherein said attribute information includes the attribute information indicating an increased sound volume in reading out the document portion included in said summary text as compared to the sound volume in reading out the document portion not included in said summary text.

3. The electronic document processing apparatus according to claim 2 wherein said attribute information indicating the increased sound volume is represented by the percentage of the increased volume to the standard volume.

4. The electronic document processing apparatus according to claim 1 wherein said attribute information includes the attribute information for emphasizing the accent in reading the portion of said electronic document included in said summary text.

5. The electronic document processing apparatus according to claim 1 wherein said attribute information includes the attribute information for imparting characteristics of the speech in reading out the portion of the electronic document included in said summary text different from those of the speech in reading out the portion of the electronic document not included in said summary text.

6. The electronic document processing apparatus according to claim 1 wherein said speech read-out data generating means adds the tag information necessary in reading out the electronic document by said speech synthesizer.

7. The electronic document processing apparatus according to claim 1 wherein said summary text forming means sets the size of a summary text display area in which said summary text of the electronic document is displayed;

the length of said summary text of the electronic document is determined responsive to the size of the summary text display area as set; and

wherein a summary text of a length to be comprised in said summary text display area is formed based on the length of the summary text as determined.

8. The electronic document processing apparatus according to claim 1 wherein the tag information indicating the inner structure of said electronic document of a hierarchical structure having a plurality of elements is added to said electronic document.

9. The electronic document processing apparatus according to claim 8 wherein the tag information indicating at least paragraphs, sentences and phrases, among a plurality of elements making up the electronic document is added to the electronic document;

and

wherein said speech read-out data generating means discriminates the paragraphs, sentences and phrases making up the electronic document based on the tag information indicating said paragraphs, sentences and phrases.

10. The electronic document processing apparatus according to claim 8 wherein the tag information necessary for reading out by said speech synthesizer is added to said electronic document.

11. The electronic document processing apparatus according to claim 10 wherein the tag information necessary for reading out by said speech synthesizer includes the attribute information for inhibiting the reading out.

12. The electronic document processing apparatus according to claim 10 wherein the tag information necessary for reading out by said speech synthesizer includes the attribute information indicating the pronunciation.

13. The electronic document processing apparatus according to claim 1 wherein said speech read-out data generating means adds to said electronic document the attribute information specifying the language with which the electronic document is formed to generate said speech read-out data.

14. The electronic document processing apparatus according to claim 1 wherein said speech read-out data generating means adds to said electronic document the attribute information specifying the beginning positions of the paragraphs, sentences and phrases making up the electronic document to generate said speech read-out data.

15. The electronic document processing apparatus according to claim 14 wherein if the attribute information representing a homologous syntactic structure among the attribute information specifying the beginning positions of the paragraphs, sentences and phrases appear in succession in said electronic document, said speech read-out data generating means unifies said attribute information appearing in succession into one attribute information.

16. The electronic document processing apparatus according to claim 14 wherein said speech read-out data generating means adds to said electronic document the attribute information indicating provision of said pause period to said electronic document directly before the attribute information specifying the beginning positions of said paragraph, sentence and phrase, to generate said speech read-out data.

17. The electronic document processing apparatus according to claim 1 wherein said speech read-out data generating means adds to said electronic document the attribute information indicating the read-out inhibited portion of said electronic document to generate said speech read-out data.

18. The electronic document processing apparatus according to claim 1 wherein said speech read-out data generating means adds to said electronic document the attribute information indicating correct reading or pronunciation to generate said speech read-out data.

19. The electronic document processing apparatus according to claim 1 further comprising:

processing means for performing processing suited to a speech synthesizer using said speech read-out data;

said processing means finding an absolute value of the read-out sound volume based on the attribute information added to said speech read-out data for indicating the read-out sound volume.

20. The electronic document processing apparatus according to claim 1 further comprising:

processing means for performing processing suited to a speech synthesizer using said speech read-out data;

said processing means finding an absolute value of the read-out sound volume based on the attribute information added to said speech read-out data for indicating the language with which said electronic document is formed.

21. The electronic document processing apparatus according to claim 1 further comprising:

document read-out means for reading said electronic document out based on said speech read-out data.

22. The electronic document processing method according to claim 21 wherein said document read-out step locates in terms of said paragraph, sentence and phrase making up said electronic document as unit, based on the attribute information specifying the beginning position of said paragraph, sentence and phrase.

23. An electronic document processing apparatus for processing an electronic document, comprising:

a summary text forming step of forming a summary text of said electronic document; and

a speech read-out data generating step of generating speech read-out data for reading said electronic document out by a speech synthesizer;

said speech read-out data generating step generating said speech read-out data as the attribute information indicating reading out a portion of said electronic document included in said summary text with emphasis as compared to a portion thereof not included in said summary text.

24. The electronic document processing method according to claim 23 wherein said attribute information includes the attribute information indicating an increased sound volume in reading out the document portion included in said summary text as compared to the sound volume in reading out the document portion not included in said summary text.

25. The electronic document processing method according to claim 24 wherein said attribute information indicating the increased sound volume is represented by the percentage of the increased volume to the standard volume.

26. The electronic document processing method according to claim 23 wherein said attribute information includes the attribute information for emphasizing the accent in reading the portion of said electronic document included in said summary text.

27. The electronic document processing method according to claim 23 wherein said attribute information includes the attribute information for imparting characteristics of the speech in reading out the portion of the electronic document included in said summary text different from those of the speech in reading out the portion of the electronic document not included in said summary text.

28. The electronic document processing method according to claim 23 wherein said speech read-out data generating step adds the tag information necessary in reading out the electronic document by said speech synthesizer.

29. The electronic document processing method according to claim 23 wherein said summary text forming step sets the size of a summary text display area in which said summary text of the electronic document is displayed;

the length of said summary text of the electronic document is determined responsive to the size of the summary text display area as set; and

wherein a summary text of a length to be comprised in said summary text display area is formed based on the length of the summary text as determined.

30. The electronic document processing method according to claim 23 wherein the tag information indicating the inner structure of said electronic document of a hierarchical structure having a plurality of elements is added to said electronic document.

31. The electronic document processing method according to claim 30 wherein the tag information indicating at least paragraphs, sentences and phrases, among a plurality of elements making up the electronic document, is added to the electronic document;

and

wherein said speech read-out data generating step discriminating the paragraphs, sentences and phrases making up the electronic document based on the tag information indicating said paragraphs, sentences and phrases.

32. The electronic document processing method according to claim 30 wherein the tag information necessary for reading out by said speech synthesizer is added to said electronic document.

33. The electronic document processing method according to claim 32 wherein the tag information necessary for reading out by said speech synthesizer includes the attribute information for inhibiting the reading out.

34. The electronic document processing method according to claim 32 wherein the tag information necessary for reading out by said speech synthesizer includes the attribute information indicating the pronunciation.

35. The electronic document processing method according to claim 23 wherein said speech read-out data generating step adds to said electronic document the attribute information specifying the language with which the electronic document is formed to generate said speech read-out data.

36. The electronic document processing method according to claim 23 wherein said speech read-out data generating step adds to said electronic document the attribute information specifying the beginning positions of the paragraphs, sentences and phrases making up the electronic document to generate said speech read-out data.

37. The electronic document processing method according to claim 36 wherein if the attribute information representing a homologous syntactic structure among the attribute information specifying the beginning positions of the paragraphs, sentences and phrases appear in succession in said electronic document, said speech read-out data generating step unifies said attribute information appearing in succession into one attribute information.

38. The electronic document processing method according to claim 36 wherein said speech read-out data generating step adds to said electronic document the attribute information indicating provision of said pause period to said electronic document directly before the attribute information specifying the beginning positions of said paragraph, sentence and phrase, to generate said speech read-out data.

39. The electronic document processing method according to claim 23 wherein said speech read-out data generating step adds to said electronic document the attribute information indicating the read-out inhibited portion of said electronic document to generate said speech read-out data.

40. The electronic document processing method according to claim 23 wherein said speech read-out data generating step adds to said electronic document the attribute information indicating correct reading or pronunciation to generate said speech read-out data.

41. The electronic document processing method according to claim 23 further comprising:

a processing step of performing processing suited to a speech synthesizer using said speech read-out data;

said processing step finding an absolute value of the read-out sound volume based on the attribute information added to said speech read-out data for indicating the read-out sound volume.

42. The electronic document processing method according to claim 23 further comprising:

a processing step of performing processing suited to a speech synthesizer using said speech read-out data;

said processing step finding an absolute value of the read-out sound volume based on the

attribute information added to said speech read-out data for indicating the language with which said electronic document is formed.

43. The electronic document processing method according to claim 23 further comprising:

a document read-out step of reading said electronic document out based on said speech read-out data.

44. The electronic document processing method according to claim 43 wherein said document read-out step locates in terms of said paragraph, sentence and phrase making up said electronic document as unit, based on the attribute information specifying the beginning position of said paragraph, sentence and phrase.

45. A recording program having recorded thereon a computer-controllable program for processing an electronic document, said program comprising:

a summary text forming step of forming a summary text of said electronic document; and

a speech read-out data generating step of generating speech read-out data for reading said electronic document out by a speech synthesizer;

said speech read-out data generating step generating said speech read-out data as the attribute information indicating reading out a portion of said electronic document included in said summary text with emphasis as compared to a portion thereof not included in said summary text.

46. An electronic document processing apparatus for processing an electronic document, comprising:

summary text forming means for preparing a summary text of said electronic document; and

document read-out means for reading out a portion of said electronic document included in said summary text with emphasis as compared to a portion thereof not included in said summary text.

47. The electronic document processing apparatus according to claim 46 wherein said document read-out means reads out said electronic document with a sound volume in reading out a portion of said electronic document included in said summary text which is increased as compared to that in reading out a portion of said electronic document not included in said summary text.

48. The electronic document processing apparatus according to claim 46 wherein said document read-out means reads out said electronic document with an emphasis in accentuation in reading out a portion of said electronic document included in said summary text.

49. The electronic document processing apparatus according to claim 46 wherein said document read-out means reads out the portion of the electronic document included in said summary text with speech characteristics different from those in reading out the portion of the electronic document not included in said summary text.

50. The electronic document processing apparatus according to claim 46 wherein said summary text forming means sets the size of a summary text display area in which said summary text of the electronic document is displayed;

the length of said summary text of the electronic document is determined responsive to the size of the summary text display area as set; and

wherein a summary text of a length to be comprised in said summary text display area is formed based on the length of the summary text as determined.

51. The electronic document processing apparatus according to claim 46 further comprising:

document inputting means for being fed with said electronic document of a hierarchical structure having a plurality of elements and having added thereto the tag information indicating its inner structure.

52. The electronic document processing apparatus according to claim 51 wherein the electronic document, added with the tag information indicating at least paragraphs, sentences and phrases, among a plurality of elements making up the electronic document, is input to said document inputting means;

and

wherein said document read-out means reads said electronic document out by providing pause periods at the beginning positions of said paragraphs, sentences and phrases, based on the tag information specifying said paragraphs, sentences and phrases.

53. The electronic document processing apparatus according to claim 51 wherein the tag information indicating at least paragraphs, sentences and phrases, among a plurality of elements making up the electronic document, is added to the electronic document;

and

wherein said document read-out means discriminates the paragraphs, sentences and phrases making up the electronic document based on the tag information indicating said paragraphs, sentences and phrases.

54. The electronic document processing apparatus according to claim 51 wherein the tag information necessary for reading out by said document read-out means is added to said electronic document.

55. The electronic document processing apparatus according to claim 54 wherein the tag information necessary for reading out by said document read-out means includes the attribute information for inhibiting the reading out.

56. The electronic document processing apparatus according to claim 54 wherein the tag information necessary for reading out by said document read-out means includes the attribute information indicating the pronunciation.

57. The electronic document processing apparatus according to claim 46 wherein said document read-out means reads out said electronic document as a read-out inhibited portion of said electronic document is excepted.

58. The electronic document processing apparatus according to claim 46 wherein said document read-out means reads out said electronic document with substitution by correct reading or pronunciation.

59. The electronic document processing apparatus according to claim 51 wherein said document read-out means locates in terms of said paragraph, sentence and phrase making up said electronic document as unit, based on the attribute information specifying the beginning position of said paragraph, sentence and phrase.

60. An electronic document processing method for processing an electronic document, comprising:

a summary text forming step for forming a summary text of said electronic document; and

a document read out step of reading out a portion of said electronic document included in said summary text with emphasis as compared to the portion thereof not included in said summary text.

61. The electronic document processing method according to claim 60 wherein in said document read out step, the electronic document is read out with a sound volume for a portion of the electronic document included in the summary text which is increased as compared to that for a portion of the electronic document not included in the summary text.

62. The electronic document processing method according to claim 60 wherein said document read-out step reads out said electronic document with an emphasis in accentuation in reading out a portion of said electronic document included in said summary text.

63. The electronic document processing method according to claim 60 wherein said document read-out step reads out the portion of the electronic document included in said summary text with speech characteristics different from those in reading out the portion of the electronic document not included in said summary text.

64. The electronic document processing method according to claim 60 wherein said summary text forming step sets the size of a summary text display area in which said summary text of the electronic document is displayed;

the length of said summary text of the electronic document is determined responsive to the size of the summary text display area as set; and

wherein a summary text of a length to be comprised in said summary text display area is formed based on the length of the summary text as determined.

65. The electronic document processing method according to claim 60 further comprising:

a document inputting step of being fed with said electronic document of a hierarchical structure having a plurality of elements and having added thereto the tag information indicating its inner structure.

66. The electronic document processing method according to claim 65 wherein the electronic document, added with the tag information indicating at least paragraphs, sentences and phrases, among a plurality of elements making up the electronic document, is input to said document inputting step;

and

wherein said document read-out step reads said electronic document out by providing pause periods at the beginning positions of said paragraphs, sentences and phrases, based on the tag information specifying said paragraphs, sentences and phrases.

67. The electronic document processing method according to claim 65 wherein the tag information indicating at least paragraphs, sentences and phrases, among a plurality of elements making up the electronic document, is added to the electronic document;

and

wherein said document read-out step discriminates the paragraphs, sentences and phrases making up the electronic document based on the tag information indicating said paragraphs, sentences and phrases.

68. The electronic document processing method according to claim 65 wherein the tag information necessary for reading out by said document read-out step is added to said electronic document.

69. The electronic document processing method according to claim 68 wherein the tag information necessary for reading out by said document read-out step includes the attribute information for inhibiting the reading out.

70. The electronic document processing method according to claim 68 wherein the tag information necessary for reading out by said document read-out step includes the attribute information indicating the pronunciation.

71. The electronic document processing method according to claim 60 wherein said document read-out step reads out said electronic document as a read-out inhibited portion of said electronic document is excepted.

72. The electronic document processing method according to claim 60 wherein said document read-out step reads out said electronic document with substitution by correct reading or pronunciation.

73. The electronic document processing method according to claim 65 wherein said document read-out step locates in terms of said paragraph, sentence and phrase making up said electronic document as unit, based on the attribute information specifying the beginning position of said paragraph, sentence and phrase.

74. A recording medium having recorded thereon a computer-controllable electronic document processing program for processing an electronic document, said program comprising:

a summary text forming step for forming a summary text of said electronic document; and

a document read out step of reading out a portion of said electronic document included in said summary text with emphasis as compared to the portion thereof not included in said summary text.