Differential dynamic content delivery with text display

• US 9,691,388 B2
• Filed: 01/15/2015
• Issued: 06/27/2017
• Est. Priority Date: 01/13/2004
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Inventors: Bodin, William Kress, Burkhart, Michael John, Eisenhauer, Daniel G., Schumacher, Daniel Mark, Watson, Thomas James
• Primary Examiner(s): COLUCCI, MICHAEL C
• Application Number:
  US14/597,990
• Publication Number:
  US 20150206536A1
• Time in Patent Office: 894 Days
• Field of Search: 704203, 704235, 704275, 704200, 704221, 704239, 704243, 704246, 704260, 704270, 709204, 709203, 709231, 707 3, 707 5, 715202, 715230, 715234, 715700, 715727, 398 75, 370260, 348 1407, 9203, 9235, 9275
• CPC Class Codes: G01L 19/04 Means for compensating for effects of changes of temperature , i.e. other than electric compensation
• CPC Class Codes: G06F 16/35 Clustering; Classification
• CPC Class Codes: G09B 1/00 Manually or mechanically operated educational appliances using elements forming, or bearing, symbols, signs, pictures, or the like which are arranged or adapted to be arranged in one or more particular ways puzzle-games A63F9/00; advertising or displaying in general G09F
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 15/01 Assessment or evaluation of speech recognition systems
• CPC Class Codes: G10L 15/04 Segmentation; Word boundary detection
• CPC Class Codes: G10L 15/08 Speech classification or search
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces
• CPC Class Codes: G10L 19/00 Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis in musical instruments G10H
• CPC Class Codes: G10L 19/08 Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 1/00 Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof

Abstract

Differential dynamic content delivery including providing a session document for a presentation, wherein the session document includes a session grammar and a session structured document; selecting from the session structured document a classified structural element in dependence upon user classifications of a user participant in the presentation; presenting the selected structural element to the user; streaming presentation speech to the user including individual speech from at least one user participating in the presentation; converting the presentation speech to text; detecting whether the presentation speech contains simultaneous individual speech from two or more users; and displaying the text if the presentation speech contains simultaneous individual speech from two or more users.

Claims

1. A system comprising:

at least one processor; and

at least one storage device storing program instructions which, when executed by the at least one processor, cause the at least one processor to;

access a session document for a multimedia presentation, wherein;

the multimedia presentation comprises a plurality of slides;

the plurality of slides comprises a first slide and a second slide that is different from the first slide; and

the session document comprising a plurality of versions of the first slide and a plurality of versions of the second slide;

deliver the multimedia presentation to a plurality of users via an online conferencing system, wherein delivering the multimedia presentation to the plurality of users comprises;

identifying first and second attributes of at least one user participating in the multimedia presentation;

selecting, based on the first attribute of the at least one user participating in the multimedia presentation, a version of the first slide from the plurality of versions of the first slide;

selecting, based on the second attribute of the at least one user participating in the multimedia presentation, a version of the second slide from the plurality of versions of the second slide, the second attribute being different from the first attribute;

causing at least one display device to display the selected version of the first slide and the selected version of the second slide to the at least one user;

detecting a trigger relating to a quality of at least one speech signal associated with the multimedia presentation; and

in response to detecting the trigger, causing the at least one display device to display, to the at least one user, text recognized from at least one portion of the at least one speech signal associated with the multimedia presentation.

2. The system of claim 1, wherein each version of the plurality of versions of the first slide is associated with at least one respective classification identifier, and wherein the program instructions, when executed, cause the at least one processor to:

determine whether the at least one classification identifier associated with the version of the first slide matches the first attribute of the at least one user.

3. The system of claim 1, wherein:

the at least one user comprises a first user;

the version of the first slide is a first version of the first slide; and

the program instructions, when executed, cause the at least one processor to select, based on a third attribute of a second user different from the first user, a second version of the first slide from the plurality of versions of the first slide, the second version being different from the first version.

4. The system of claim 3, wherein the at least one display device comprises a first display device, and wherein the program instructions, when executed, cause the at least one processor to cause a second display device different from the first display device to display the second version of the first slide to the second user.

5. The system of claim 1, wherein the program instructions, when executed, cause the at least one processor to detect the trigger at least in part by detecting whether the speech associated with the presentation comprises simultaneous speech resulting from two or more speakers speaking simultaneously.

6. The system of claim 1, wherein the program instructions, when executed, cause the at least one processor to detect the trigger at least in part by detecting whether a level of ambient noise associated with a voice channel is above a selected threshold.

7. The system of claim 1, wherein the first attribute comprises a level of technical ability of the at least one user.

8. A method comprising acts of:

accessing a session document for a multimedia presentation, wherein;

the multimedia presentation comprises a plurality of slides;

the plurality of slides comprises a first slide and a second slide that is different from the first slide; and

the session document comprising a plurality of versions of the first slide and a plurality of versions of the second slide;

delivering the multimedia presentation to a plurality of users via an online conference system, wherein delivering the multimedia presentation to the plurality of users comprises;

identifying first and second attributes of at least one user participating in the multimedia presentation;

selecting, by at least one processor, based on the first attribute of the at least one user participating in the multimedia presentation, a version of the first slide from the plurality of versions of the first slide;

selecting, by at least one processor, based on the second attribute of the at least one user participating in the multimedia presentation, a version of the second slide from the plurality of versions of the second slide, the second attribute being different from the first attribute;

causing at least one display device to display the selected version of the first slide and the selected version of the second slide to the at least one user;

detecting a trigger relating to a quality of at least one speech signal associated with the multimedia presentation; and

in response to detecting the trigger, causing the at least one display device to display, to the at least one user, text recognized from at least one portion of the at least one speech signal associated with the multimedia presentation.

9. The method of claim 8, wherein each version of the plurality of versions of the first slide is associated with at least one respective classification identifier, and wherein the act of selecting the version of the first slide comprises:

determining whether the at least one classification identifier associated with the version of the first slide matches the first attribute of the at least one user.

10. The method of claim 8, wherein:

the at least one user comprises a first user;

the version of the first slide is a first version of the first slide; and

the method further comprises selecting, based on a third attribute of a second user different from the first user, a second version of the first slide from the plurality of versions of the first slide, the second version being different from the first version.

11. The method of claim 10, wherein the at least one display device comprises a first display device, and wherein the method further comprises causing a second display device different from the first display device to display the second version of the first slide to the second user.

12. The method of claim 8, wherein the act of detecting the trigger comprises detecting whether the speech associated with the presentation comprises simultaneous speech resulting from two or more speakers speaking simultaneously.

13. The method of claim 8, wherein the act of detecting the trigger comprises detecting whether a level of ambient noise associated with a voice channel is above a selected threshold.

14. The method of claim 8, wherein the first attribute comprises a level of technical ability of the at least one user.

15. At least one computer-readable storage device having encoded thereon instructions which, when executed by at least one processor, perform a method comprising acts of:

accessing a session document for a multimedia presentation, wherein;

the multimedia presentation comprises a plurality of slides;

the plurality of slides comprises a first slide and a second slide that is different from the first slide; and

the session document comprising a plurality of versions of the first slide and a plurality of versions of the second slide;

delivering the multimedia presentation to a plurality of users via an online conference system, wherein delivering the multimedia presentation to the plurality of users comprises;

identifying first and second attributes of at least one user participating in the multimedia presentation;

selecting, by at least one processor, based on the first attribute of the at least one user participating in the multimedia presentation, a version of the first slide from the plurality of versions of the first slide;

selecting, by at least one processor, based on the second attribute of the at least one user participating in the multimedia presentation, a version of the second slide from the plurality of versions of the second slide, the second attribute being different from the first attribute;

causing at least one display device to display the selected version of the first slide and the selected version of the second slide to the at least one user;

detecting a trigger relating to a quality of at least one speech signal associated with the multimedia presentation; and

in response to detecting the trigger, causing the at least one display device to display, to the at least one user, text recognized from at least one portion of the at least one speech signal associated with the multimedia presentation.

16. The at least one computer-readable storage device of claim 15, wherein each version of the plurality of versions of the first slide is associated with at least one respective classification identifier, and wherein the act of selecting the version of the first slide comprises:

determining whether the at least one classification identifier associated with the version of the first slide matches the first attribute of the at least one user.

17. The at least one computer-readable storage device of claim 15, wherein:

the at least one user comprises a first user;

the version of the first slide is a first version of the first slide; and

the method further comprises selecting, based on a third attribute of a second user different from the first user, a second version of the first slide from the plurality of versions of the first slide, the second version being different from the first version.

18. The at least one computer-readable storage device of claim 17, wherein the at least one display device comprises a first display device, and wherein the method further comprises causing a second display device different from the first display device to display the second version of the first slide to the second user.

19. The at least one computer-readable storage device of claim 15, wherein the act of detecting the trigger comprises detecting whether the speech associated with the presentation comprises simultaneous speech resulting from two or more speakers speaking simultaneously.

20. The at least one computer-readable storage device of claim 15, wherein the act of detecting the trigger comprises detecting whether a level of ambient noise associated with a voice channel is above a selected threshold.