Augmenting web conferences via text extracted from audio content

• US 9,621,851 B2
• Filed: 06/25/2015
• Issued: 04/11/2017
• Est. Priority Date: 01/16/2013
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Sanso, Antonio
• Primary Examiner(s): El-Zoobi, Maria
• Application Number:
  US14/749,816
• Publication Number:
  US 20150296181A1
• Time in Patent Office: 656 Days
• Field of Search: 348 1401
• CPC Class Codes: G06Q 30/0269 based on user profile or attribute
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

Systems and methods for augmenting web conference sessions with multimedia content based on text extracted from audio content transmitted during the web conference. In one embodiment, a conference application or other application can receive audio content from at least one client participating in a web conference. The web conference can connect multiple clients for live sharing of audio and video. The conference application can also extract at least one text item from the audio content. The conference application can also generate augmented electronic content by combining electronic content received via the web conference with additional electronic content based on the at least one text item. The conference application can also provide the augmented electronic content via the web conference.

Claims

1. A method comprising:

receiving, by a processing device configured to host a web conference, audio content from a client participating in the web conference;

extracting, by the processing device, text content from the audio content, wherein the text content comprises a transcription of the audio content;

analyzing, by the processing device, the transcription to generate data describing qualitative criteria of the audio content;

generating, by the processing device, augmented electronic content by combining electronic content received via the web conference with the data describing qualitative criteria of the audio content; and

providing, by the processing device, the augmented electronic content via the web conference,

wherein the audio content is received and the augmented electronic content is provided in real time during the web conference, wherein the augmented electronic content indicates a suggested improvement to a presentation that includes the audio content.

2. The method of claim 1, wherein the augmented electronic content comprises at least one of video content, additional audio content, and additional text content.

3. The method of claim 1, wherein the qualitative criteria describes at least one of a frequency with which a specified word is used in a presentation, a speed at which words of the presentation have been spoken, and a clarity of language used in the presentation.

4. The method of claim 1, wherein extracting the text content comprises applying a speech recognition algorithm to the audio content.

5. The method of claim 1, wherein the text content further comprises a keyword, the method further comprising generating additional augmented electronic content including the electronic content received via the web conference and electronic content corresponding to the keyword.

6. The method of claim 1, wherein the text content further comprises a command, the method further comprising generating additional augmented electronic content including the electronic content received via the web conference and electronic content retrieved in response to the command.

16. The non-transitory computer-readable medium of claim 1, wherein the text content further comprises a keyword and wherein the program code further comprises program code for generating additional augmented electronic content including the electronic content received via the web conference and electronic content corresponding to the keyword.

7. A system comprising:

a processor; and

a non-transitory computer-readable medium communicatively coupled to the processor,

wherein the processor is configured to execute program code stored in the non-transitory computer-readable medium and thereby perform operations comprising;

receiving audio content from a client participating in a web conference,

extracting text content from the audio content, wherein the text content comprises a transcription of the audio content,

analyzing the transcription to generate data describing qualitative criteria of the audio content,

generating augmented electronic content by combining electronic content received via the web conference with the data describing qualitative criteria of the audio content, and

providing the augmented electronic content via the web conference,

wherein the audio content is received and the augmented electronic content is provided in real time during the web conference, wherein the augmented electronic content indicates a suggested improvement to a presentation that includes the audio content.

8. The system of claim 7, wherein the augmented electronic content comprises at least one of video content, additional audio content, and additional text content.

9. The system of claim 7, wherein the qualitative criteria describes at least one of a frequency with which a specified word is used in a presentation, a speed at which words of the presentation have been spoken, and a clarity of language used in the presentation.

10. The system of claim 7, wherein extracting the text content comprises applying a speech recognition algorithm to the audio content.

11. The system of claim 7, wherein the text content further comprises a keyword, wherein the operations further comprise generating additional augmented electronic content including the electronic content received via the web conference and electronic content corresponding to the keyword.

12. The system of claim 7, wherein the text content further comprises a command, wherein the operations further comprise generating additional augmented electronic content including the electronic content received via the web conference and electronic content retrieved in response to the command.

13. A non-transitory computer-readable medium storing program code executable by a processor, the program code comprising:

program code for receiving audio content from a client participating in a web conference;

program code for extracting text content from the audio content, wherein the text content comprises a transcription of the audio content;

program code for analyzing the transcription to generate data describing qualitative criteria of the audio content;

program code for generating augmented electronic content by combining electronic content received via the web conference with the data describing qualitative criteria of the audio content; and

program code for providing the augmented electronic content via the web conference, wherein the audio content is received and the augmented electronic content is provided in real time during the web conference, wherein the augmented electronic content indicates a suggested improvement to a presentation that includes the audio content.

14. The non-transitory computer-readable medium of claim 13, wherein the qualitative criteria describes at least one of a frequency with which a specified word is used in a presentation, a speed at which words of the presentation have been spoken, and a clarity of language used in the presentation.

15. The non-transitory computer-readable medium of claim 13, wherein extracting the text content comprises applying a speech recognition algorithm to the audio content.

17. The non-transitory computer-readable medium of claim 13, wherein the text content further comprises a command and wherein the program code further comprises program code for generating additional augmented electronic content including the electronic content received via the web conference and electronic content retrieved in response to the command.