Differential dynamic content delivery with text display in dependence upon sound level

• US 7,287,221 B2
• Filed: 01/13/2004
• Issued: 10/23/2007
• Est. Priority Date: 01/13/2004
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: International Business Machines Corporation
• Inventors: Watson, Thomas J., Schumacher, Daniel Mark, Burkhart, Michael John, Bodin, William Kress, Eisenhauer, Daniel G.
• Primary Examiner(s): Hutton; Doug
• Assistant Examiner(s): RUTLEDGE, AMELIA L
• Application Number:
  US10/756,159
• Publication Number:
  US 20050154972A1
• Time in Patent Office: 1,379 Days
• Field of Search: 715/530, 715/540, 704/200
• US Class Current: 715/202
• CPC Class Codes: G06F 40/103 Formatting, i.e. changing of presentation of documents automatic justification G06F40/189; automatic line break hyphenation G06F40/191
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04M 3/493 Interactive information services, e.g. directory enquiries ; Arrangements therefor, e.g. interactive voice response [IVR] systems or voice portals
• CPC Class Codes: H04M 3/4938 comprising a voice browser which renders and interprets, e.g. VoiceXML

Abstract

Differential dynamic content delivery including providing a session document for a presentation, where the session document includes a session grammar and a session structured document; selecting from the session structured document a classified structural element in dependence upon user classifications of a user participant in the presentation; presenting the selected structural element to the user; streaming speech to the user from one or more users participating in the presentation; converting the speech to text; detecting a total sound level for the user; and determining whether to display the text in dependence upon the total sound level for the user.

Claims

1. A computer-implemented method for differential dynamic content delivery, the method comprising:

creating, in dependence upon an original document, a structured document comprising one or more structural elements;

classifying a structural element of the structured document according to a presentation attribute;

creating a presentation grammar for the structured document, wherein the presentation grammar for the structured document includes grammar elements each of which includes an identifier for at least one structural element of the structured document;

filtering the presentation grammar to derive a session document for a presentation, wherein the session document includes a session grammar and a session structured document;

selecting from the session structured document a classified structural element in dependence upon user classifications of a user participant in the presentation;

presenting the selected structural element to the user;

streaming speech to the user from one or more users participating in the presentation;

converting the speech to text;

detecting a total sound level for the user; and

determining whether to display the text in dependence upon the total sound level for the user.

2. The method of claim 1 wherein the total sound level for the user includes ambient noise and the method includes detecting an ambient noise level for the user.

3. The method of claim 2 wherein detecting an ambient noise level for the user further comprises temporarily interrupting the speech streaming to the user and measuring a sound level on the user'"'"'s voice channel during the interruption and while the user is not speaking.

4. The method of claim 2 wherein determining whether to display the text in dependence upon the total sound level for the user further comprises determining to display the text to the user if the ambient noise level is above a predetermined threshold.

5. The method of claim 1 wherein:

the total sound level comprises the streaming speech plus ambient noise; and

determining whether to display the text further comprises determining whether to display the text in dependence upon a ratio of the total sound level to the ambient noise level.

6. The method of claim 5 further comprising displaying the text if the ratio of the total sound level to the ambient noise level is less than a predetermined minimum.

7. The method of claim 1 wherein selecting a classified structural element further comprises selecting a classified structural element having an associated classification identifier that corresponds to the user classification.

8. The method of claim 1 further comprising creating a session document from a presentation document, including:

identifying a presentation document for a presentation, the presentation document including a presentation grammar and a structured document having structural elements classified with classification identifiers;

identifying a user participant for the presentation, the user having a user profile comprising user classifications; and

filtering the structured document in dependence upon the user classifications and the classification identifiers.

9. The method of claim 8 further comprising filtering the presentation grammar, in dependence upon the extracted structural elements, into a session grammar in the session document.

10. The method of claim 1 wherein classifying a structural element comprises:

identifying a presentation attribute for the structural element;

identifying a classification identifier in dependence upon the presentation attribute; and

inserting the classification identifier in association with the structural element in the structured document.

11. The method of claim 1 wherein creating a presentation grammar for the structured document comprises:

identifying the content type of the original document;

selecting, in dependence upon the content type, a full presentation grammar from among a multiplicity of full presentation grammars; and

filtering the full presentation grammar into a presentation grammar for the structured document in dependence upon the structural elements of the structured document.

12. A system for differential dynamic content delivery, the system comprising a computer processor, a computer memory operatively coupled to the computer processor, the computer memory having disposed within it computer program instructions capable of:

creating, in dependence upon an original document, a structured document comprising one or more structural elements;

classifying a structural element of the structured document according to a presentation attribute;

creating a presentation grammar for the structured document, wherein the presentation grammar for the structured document includes grammar elements each of which includes an identifier for at least one structural element of the structured document;

filtering the presentation grammar to derive a session document for a presentation, wherein the session document includes a session grammar and a session structured document;

selecting from the session structured document a classified structural element in dependence upon user classifications of a user participant in the presentation;

presenting the selected structural element to the user;

streaming speech to the user from one or more users participating in the presentation;

converting the speech to text;

detecting a total sound level for the user; and

determining whether to display the text in dependence upon the total sound level for the user.

13. The system of claim 12 wherein the total sound level for the user includes ambient noise and the system includes computer program instructions capable of detecting an ambient noise level for the user.

14. The system of claim 13 wherein detecting an ambient noise level for the user further comprises temporarily interrupting the speech streaming to the user and measuring a sound level on the user'"'"'s voice channel during the interruption and while the user is not speaking.

15. The system of claim 13 wherein determining whether to display the text in dependence upon the total sound level for the user further comprises determining to display the text to the user if the ambient noise level is above a predetermined threshold.

16. The system of claim 12 wherein:

the total sound level comprises the streaming speech plus ambient noise; and

determining whether to display the text further comprises determining whether to display the text in dependence upon a ratio of the total sound level to the ambient noise level.

17. The system of claim 16 further comprising computer program instructions capable of displaying the text if the ratio of the total sound level to the ambient noise level is less than a predetermined minimum.

18. The system of claim 12 wherein selecting a classified structural element further comprises selecting a classified structural element having an associated classification identifier that corresponds to the user classification.

19. The system of claim 12 further comprising computer program instructions capable of creating a session document from a presentation document, including:

identifying a presentation document for a presentation, the presentation document including a presentation grammar and a structured document having structural elements classified with classification identifiers;

identifying a user participant for the presentation, the user having a user profile comprising user classifications; and

filtering the structured document in dependence upon the user classifications and the classification identifiers.

20. The system of claim 19 further comprising computer program instructions capable of filtering the presentation grammar, in dependence upon the extracted structural elements, into a session grammar in the session document.

21. The system of claim 12 wherein classifying a structural element comprises:

identifying a presentation attribute for the structural element;

identifying a classification identifier in dependence upon the presentation attribute; and

inserting the classification identifier in association with the structural element in the structured document.

22. The system of claim 12 wherein creating a presentation grammar for the structured document comprises:

identifying the content type of the original document;

selecting, in dependence upon the content type, a full presentation grammar from among a multiplicity of full presentation grammars; and

filtering the full presentation grammar into a presentation grammar for the structured document in dependence upon the structural elements of the structured document.

23. A computer program product for differential dynamic content delivery, the computer program product tangibly embodied on a computer readable medium, the computer program product comprising computer program instructions capable of:

creating, in dependence upon an original document, a structured document comprising one or more structural elements;

classifying a structural element of the structured document according to a presentation attribute;

creating a presentation grammar for the structured document, wherein the presentation grammar for the structured document includes grammar elements each of which includes an identifier for at least one structural element of the structured document;

filtering the presentation grammar to derive a session document for a presentation, wherein the session document includes a session grammar and a session structured document;

selecting from the session structured document a classified structural element in dependence upon user classifications of a user participant in the presentation;

presenting the selected structural element to the user;

streaming speech to the user from one or more users participating in the presentation;

converting the speech to text;

detecting a total sound level for the user; and

determining whether to display the text in dependence upon the total sound level for the user.

24. The computer program product of claim 23 wherein the total sound level for the user includes ambient noise and the computer program product includes computer program instructions capable of detecting an ambient noise level for the user.

25. The computer program product of claim 24 wherein detecting an ambient noise level for the user further comprises temporarily interrupting the speech streaming to the user and measuring a sound level on the user'"'"'s voice channel during the interruption and while the user is not speaking.

26. The computer program product of claim 25 further comprising computer program instructions capable of displaying the text if the ratio of the total sound level to the ambient noise level is less than a predetermined minimum.

27. The computer program product of claim 24 wherein determining whether to display the text in dependence upon the total sound level for the user further comprises determining to display the text to the user if the ambient noise level is above a predetermined threshold.

28. The computer program product of claim 23 wherein:

the total sound level comprises the streaming speech plus ambient noise; and

determining whether to display the text further comprises determining whether to display the text in dependence upon a ratio of the total sound level to the ambient noise level.

29. The computer program product of claim 23 wherein selecting a classified structural element further comprises selecting a classified structural element having an associated classification identifier that corresponds to the user classification.

30. The computer program product of claim 23 further comprising computer program instructions capable of creating a session document from a presentation document, including:

identifying a presentation document for a presentation, the presentation document including a presentation grammar and a structured document having structural elements classified with classification identifiers;

identifying a user participant for the presentation, the user having a user profile comprising user classifications; and

filtering the structured document in dependence upon the user classifications and the classification identifiers.

31. The computer program product of claim 30 further comprising computer program instructions capable of filtering the presentation grammar, in dependence upon the extracted structural elements, into a session grammar in the session document.

32. The computer program product of claim 23 wherein classifying a structural element comprises:

identifying a presentation attribute for the structural element;

identifying a classification identifier in dependence upon the presentation attribute; and

inserting the classification identifier in association with the structural element in the structured document.

33. The computer program product of claim 23 wherein creating a presentation grammar for the structured document comprises:

identifying the content type of the original document

selecting, in dependence upon the content type, a full presentation grammar from among a multiplicity of full presentation grammars; and

filtering the full presentation grammar into a presentation grammar for the structured document in dependence upon the structural elements of the structured document.