Differential dynamic content delivery with text display in dependence upon simultaneous speech

• US 20050154595A1
• Filed: 01/13/2004
• Published: 07/14/2005
• Est. Priority Date: 01/13/2004
• Status: Active Grant

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: International Business Machines Corporation
• Inventors: Watson, Thomas J., Schumacher, Daniel Mark, Burkhart, Michael John, Bodin, William Kress, Eisenhauer, Daniel G.
• Granted Patent: US 7,567,908 B2
• Time in Patent Office: Days
• US Class Current: 704/277
• CPC Class Codes: G01L 19/04 Means for compensating for effects of changes of temperature , i.e. other than electric compensation
• CPC Class Codes: G06F 16/35 Clustering; Classification
• CPC Class Codes: G09B 1/00 Manually or mechanically operated educational appliances using elements forming, or bearing, symbols, signs, pictures, or the like which are arranged or adapted to be arranged in one or more particular ways puzzle-games A63F9/00; advertising or displaying in general G09F
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 15/01 Assessment or evaluation of speech recognition systems
• CPC Class Codes: G10L 15/04 Segmentation; Word boundary detection
• CPC Class Codes: G10L 15/08 Speech classification or search
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces
• CPC Class Codes: G10L 19/00 Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis in musical instruments G10H
• CPC Class Codes: G10L 19/08 Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 1/00 Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof

Abstract

Differential dynamic content delivery including providing a session document for a presentation, wherein the session document includes a session grammar and a session structured document; selecting from the session structured document a classified structural element in dependence upon user classifications of a user participant in the presentation; presenting the selected structural element to the user; streaming presentation speech to the user including individual speech from at least one user participating in the presentation; converting the presentation speech to text; detecting whether the presentation speech contains simultaneous individual speech from two or more users; and displaying the text if the presentation speech contains simultaneous individual speech from two or more users.

Claims

1. A method for differential dynamic content delivery, the method comprising:

providing to a multiplicity of users a presentation including content from a session document;

streaming presentation speech to the user including individual speech from at least one user participating in the presentation;

converting the presentation speech to text;

detecting whether the presentation speech contains simultaneous individual speech from two or more users; and

displaying the text if the presentation speech contains simultaneous individual speech from two or more users.

2. The method of claim 1 wherein the presentation speech contains simultaneous individual speech from two or more users, the method includes identifying a period of simultaneous speech, and displaying the text includes displaying presentation text for a presentation period longer than the period of simultaneous speech.

3. The method of claim 1 wherein detecting whether the presentation speech contains simultaneous speech from two or more users further comprises determining whether a period of individual speech from a first user overlaps a period of individual speech from another user.

4. The method of claim 1 wherein displaying the text further comprises segregating display text.

5. The method of claim 2 wherein segregating display text further comprises segregating display text according to channel.

6. The method of claim 2 wherein segregating display text further comprises segregating display text according to user.

7. The method of claim 1 wherein providing to a multiplicity of users a presentation including content from a session document further comprises:

providing a session document for the presentation, wherein the session document includes a session grammar and a session structured document;

selecting from the session structured document a classified structural element in dependence upon user classifications of a user participant in the presentation; and

presenting the selected structural element to the user.

8. The method of claim 7 wherein selecting a classified structural element further comprises selecting a classified structural element having an associated classification identifier that corresponds to the user classification.

9. The method of claim 7 further comprising creating a session document from a presentation document, including:

identifying a presentation document for a presentation, the presentation document including a presentation grammar and a structured document having structural elements classified with classification identifiers;

identifying a user participant for the presentation, the user having a user profile comprising user classifications; and

filtering the structured document in dependence upon the user classifications and the classification identifiers.

10. The method of claim 9 further comprising filtering the presentation grammar, in dependence upon the extracted structural elements, into a session grammar in the session document.

11. The method of claim 9 further comprising creating a presentation document, including:

creating, in dependence upon an original document, a structured document comprising one or more structural elements;

classifying a structural element of the structured document according to a presentation attribute; and

creating a presentation grammar for the structured document, wherein the presentation grammar for the structured document includes grammar elements each of which includes an identifier for at least one structural element of the structured document.

12. The method of claim 11 wherein classifying a structural element comprises:

identifying a presentation attribute for the structural element;

identifying a classification identifier in dependence upon the presentation attribute; and

inserting the classification identifier in association with the structural element in the structured document.

13. The method of claim 11 wherein creating a presentation grammar for the structured document comprises:

identifying the content type of the original document;

selecting, in dependence upon the content type, a full presentation grammar from among a multiplicity of full presentation grammars; and

filtering the full presentation grammar into a presentation grammar for the structured document in dependence upon the structural elements of the structured document.

15. The system of claim 13 wherein the presentation speech contains simultaneous individual speech from two or more users, the system includes means for identifying a period of simultaneous speech, and means for displaying the text includes means for displaying presentation text for a presentation period longer than the period of simultaneous speech.

16. The system of claim 13 wherein means for detecting whether the presentation speech contains simultaneous speech from two or more users further comprises means for determining whether a period of individual speech from a first user overlaps a period of individual speech from another user.

17. The system of claim 13 wherein means for displaying the text further comprises means for segregating display text.

14. A system for differential dynamic content delivery, the system comprising:

means for providing to a multiplicity of users a presentation including content from a session document;

means for streaming presentation speech to the user including individual speech from at least one user participating in the presentation;

means for converting the presentation speech to text;

means for detecting whether the presentation speech contains simultaneous individual speech from two or more users; and

means for displaying the text if the presentation speech contains simultaneous individual speech from two or more users.

18. The system of claim 14 wherein means for segregating display text further comprises means for segregating display text according to channel.

19. The system of claim 14 wherein means for segregating display text further comprises means for segregating display text according to user.

20. The system of claim 14 wherein means for providing to a multiplicity of users a presentation including content from a session document further comprises:

means for providing a session document for the presentation, wherein the session document includes a session grammar and a session structured document;

means for selecting from the session structured document a classified structural element in dependence upon user classifications of a user participant in the presentation; and

means for presenting the selected structural element to the user.

21. The system of claim 20 wherein means for selecting a classified structural element further comprises means for selecting a classified structural element having an associated classification identifier that corresponds to the user classification.

22. The system of claim 20 further comprising means for creating a session document from a presentation document, including:

means for identifying a presentation document for a presentation, the presentation document including a presentation grammar and a structured document having structural elements classified with classification identifiers;

means for identifying a user participant for the presentation, the user having a user profile comprising user classifications; and

means for filtering the structured document in dependence upon the user classifications and the classification identifiers.

23. The system of claim 22 further comprising means for filtering the presentation grammar, in dependence upon the extracted structural elements, into a session grammar in the session document.

24. The system of claim 22 further comprising means for creating a presentation document, including:

means for creating, in dependence upon an original document, a structured document comprising one or more structural elements;

means for classifying a structural element of the structured document according to a presentation attribute; and

means for creating a presentation grammar for the structured document, wherein the presentation grammar for the structured document includes grammar elements each of which includes an identifier for at least one structural element of the structured document.

25. The system of claim 24 wherein means for classifying a structural element comprises:

means for identifying a presentation attribute for the structural element;

means for identifying a classification identifier in dependence upon the presentation attribute; and

means for inserting the classification identifier in association with the structural element in the structured document.

26. The system of claim 24 wherein means for creating a presentation grammar for the structured document comprises:

means for identifying the content type of the original document;

means for selecting, in dependence upon the content type, a full presentation grammar from among a multiplicity of full presentation grammars; and

means for filtering the full presentation grammar into a presentation grammar for the structured document in dependence upon the structural elements of the structured document.

28. The computer program product of claim 25 wherein the presentation speech contains simultaneous individual speech from two or more users, the computer program product includes means, recorded on the recording medium, for identifying a period of simultaneous speech, and means, recorded on the recording medium, for displaying the text includes means, recorded on the recording medium, for displaying presentation text for a presentation period longer than the period of simultaneous speech.

29. The computer program product of claim 25 wherein means, recorded on the recording medium, for detecting whether the presentation speech contains simultaneous speech from two or more users further comprises means, recorded on the recording medium, for determining whether a period of individual speech from a first user overlaps a period of individual speech from another user.

30. The computer program product of claim 25 wherein means, recorded on the recording medium, for displaying the text further comprises means, recorded on the recording medium, for segregating display text.

31. The computer program product of claim 26 wherein means, recorded on the recording medium, for segregating display text further comprises means, recorded on the recording medium, for segregating display text according to channel.

32. The computer program product of claim 26 wherein means, recorded on the recording medium, for segregating display text further comprises means, recorded on the recording medium, for segregating display text according to user.

27. A computer program product for differential dynamic content delivery, the computer program product comprising:

a recording medium;

means, recorded on the recording medium, for providing to a multiplicity of users a presentation including content from a session document;

means, recorded on the recording medium, for streaming presentation speech to the user including individual speech from at least one user participating in the presentation;

means, recorded on the recording medium, for converting the presentation speech to text;

means, recorded on the recording medium, for detecting whether the presentation speech contains simultaneous individual speech from two or more users; and

means, recorded on the recording medium, for displaying the text if the presentation speech contains simultaneous individual speech from two or more users.

33. The computer program product of claim 27 wherein means, recorded on the recording medium, for providing to a multiplicity of users a presentation including content from a session document further comprises:

means, recorded on the recording medium, for providing a session document for the presentation, wherein the session document includes a session grammar and a session structured document;

means, recorded on the recording medium, for selecting from the session structured document a classified structural element in dependence upon user classifications of a user participant in the presentation; and

means, recorded on the recording medium, for presenting the selected structural element to the user.

34. The computer program product of claim 33 wherein means, recorded on the recording medium, for selecting a classified structural element further comprises means, recorded on the recording medium, for selecting a classified structural element having an associated classification identifier that corresponds to the user classification.

35. The computer program product of claim 33 further comprising means, recorded on the recording medium, for creating a session document from a presentation document, including:

means, recorded on the recording medium, for identifying a presentation document for a presentation, the presentation document including a presentation grammar and a structured document having structural elements classified with classification identifiers;

means, recorded on the recording medium, for identifying a user participant for the presentation, the user having a user profile comprising user classifications; and

means, recorded on the recording medium, for filtering the structured document in dependence upon the user classifications and the classification identifiers.

36. The computer program product of claim 34 further comprising means, recorded on the recording medium, for filtering the presentation grammar, in dependence upon the extracted structural elements, into a session grammar in the session document.

37. The computer program product of claim 34 further comprising means, recorded on the recording medium, for creating a presentation document, including:

means, recorded on the recording medium, for creating, in dependence upon an original document, a structured document comprising one or more structural elements;

means, recorded on the recording medium, for classifying a structural element of the structured document according to a presentation attribute; and

means, recorded on the recording medium, for creating a presentation grammar for the structured document, wherein the presentation grammar for the structured document includes grammar elements each of which includes an identifier for at least one structural element of the structured document.

38. The computer program product of claim 36 wherein means, recorded on the recording medium, for classifying a structural element comprises:

means, recorded on the recording medium, for identifying a presentation attribute for the structural element;

means, recorded on the recording medium, for identifying a classification identifier in dependence upon the presentation attribute; and

means, recorded on the recording medium, for inserting the classification identifier in association with the structural element in the structured document.

39. The computer program product of claim 36 wherein means, recorded on the recording medium, for creating a presentation grammar for the structured document comprises:

means, recorded on the recording medium, for identifying the content type of the original document;

means, recorded on the recording medium, for selecting, in dependence upon the content type, a full presentation grammar from among a multiplicity of full presentation grammars; and

means, recorded on the recording medium, for filtering the full presentation grammar into a presentation grammar for the structured document in dependence upon the structural elements of the structured document.