Augmenting web conferences via text extracted from audio content

• US 9,100,539 B2
• Filed: 01/16/2013
• Issued: 08/04/2015
• Est. Priority Date: 01/16/2013
• Status: Active Grant

• Current Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Sanso, Antonio
• Primary Examiner(s): El-Zoobi, Maria
• Application Number:
  US13/742,449
• Publication Number:
  US 20140198174A1
• Time in Patent Office: 930 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06Q 30/0269 based on user profile or attribute
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

Systems and methods for augmenting web conference sessions with multimedia content based on text extracted from audio content transmitted during the web conference. In one embodiment, a conference application or other application can receive audio content from at least one client participating in a web conference. The web conference can connect multiple clients for live sharing of audio and video. The conference application can also extract at least one text item from the audio content. The conference application can also generate augmented electronic content by combining electronic content received via the web conference with additional electronic content based on the at least one text item. The conference application can also provide the augmented electronic content via the web conference.

Claims

1. A method comprising:

receiving, by a processing device configured to host a web conference, audio content from at least one client participating in the web conference;

extracting, by the processing device, at least one text item from the audio content, wherein the at least one text item comprises a transcription of the audio content;

determining an accuracy for information in the transcription based on a comparison to reference data;

generating additional electronic content describing the accuracy for the information in the transcription;

generating, by the processing device, augmented electronic content by combining electronic content received via the web conference with the additional electronic content; and

providing, by the processing device, the augmented electronic content via the web conference.

2. The method of claim 1, wherein the audio content is received in real time during the web conference.

3. The method of claim 1, wherein extracting the at least one text item comprises applying a speech recognition algorithm to the audio content.

4. The method of claim 1, wherein the at least one text item further comprises at least one keyword, the method further comprising generating additional augmented electronic content including the electronic received via the web conference and electronic content corresponding to the at least one keyword.

5. The method of claim 1, wherein the at least one text item further comprises at least one command, the method further comprising generating additional augmented electronic content including the electronic received via the web conference and electronic content retrieved in response to the at least one command.

6. The method of claim 1, further comprising analyzing the transcription to generate additional data describing one or more qualitative criteria of the audio content, wherein the additional electronic content comprises the additional data describing the quality of the audio content.

7. The method of claim 1, further comprising:

receiving, by the processing device, video content from the at least one client; and

extracting, by the processing device, at least one image from the video content;

wherein the augmented electronic content is generated by combining the electronic content received via the web conference with the additional electronic content based on the at least one text item extracted from the audio content and the at least one image extracted from the video content.

8. The method of claim 1, wherein the additional electronic content comprises video content.

9. The method of claim 1, wherein the additional electronic content comprises audio content.

10. The method of claim 1, wherein the additional electronic content comprises text content.

11. A non-transitory computer-readable medium embodying program code executable by a processing device, the non-transitory computer-readable medium comprising:

program code for receiving audio content from at least one client participating in a web conference, the web conference connecting multiple clients for live sharing of audio and video;

program code for extracting at least one text item from the audio content, wherein the at least one text item comprises a transcription of the audio content;

program code for determining an accuracy for information in the transcription based on a comparison to reference data;

program code for generating additional electronic content describing the accuracy for the information in the transcription;

program code for generating augmented electronic content by combining electronic content received via the web conference with the additional electronic content; and

program code for providing the augmented electronic content via the web conference.

12. The non-transitory computer-readable medium of claim 11, further comprising program code for receiving the audio content in real time during the web conference.

13. The non-transitory computer-readable medium of claim 11, wherein the program code for extracting the at least one text item comprises program code for applying a speech recognition algorithm to the audio content.

14. The non-transitory computer-readable medium of claim 11, wherein the at least one text item further comprises at least one keyword, the non-transitory computer-readable medium further comprising program code for generating additional augmented electronic content including the electronic received via the web conference and electronic content corresponding to the at least one keyword.

15. The non-transitory computer-readable medium of claim 11, wherein the at least one text item further comprises at least one command, the non-transitory computer-readable medium further comprising program code for generating additional augmented electronic content including the electronic received via the web conference and electronic content retrieved in response to the at least one command.

16. The non-transitory computer-readable medium of claim 11, further comprising program code for analyzing the transcription to generate additional data describing one or more qualitative criteria of the audio content, wherein the additional electronic content comprises the additional data describing the quality of the audio content.

17. The non-transitory computer-readable medium of claim 11, further comprising:

program code for receiving video content from the at least one client; and

program code for extracting at least one image from the video content;

wherein the augmented electronic content is generated by combining the electronic content received via the web conference with the additional electronic content based on the at least one text item extracted from the audio content and the at least one image extracted from the video content.

18. A system comprising:

a processor configured to execute instructions stored in a non-transitory computer-readable medium providing a conference application;

wherein the conference application comprises one or more modules configured to perform operations comprising;

receiving audio content from at least one client participating in a web conference, the web conference connecting multiple clients for live sharing of audio and video;

extracting at least one text item from the audio content, wherein the at least one text item comprises a transcription of the audio content;

determining an accuracy for information in the transcription based on a comparison to reference data;

generating additional electronic content describing the accuracy for the information in the transcription;

generating augmented electronic content by combining electronic content received via the web conference with the additional electronic content; and

providing the augmented electronic content via the web conference.

19. The system of claim 18, wherein the audio content is received in real time during the web conference.

20. The system of claim 18, wherein extracting the at least one text item comprises applying a speech recognition algorithm to the audio content.

21. The system of claim 18, wherein the at least one text item further comprises at least one keyword, the operations further comprising generating additional augmented electronic content including the electronic received via the web conference and electronic content corresponding to the at least one keyword.