Analyzing speech delivery

• US 10,395,545 B2
• Filed: 08/24/2017
• Issued: 08/27/2019
• Est. Priority Date: 10/28/2016
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Bassemir, Richard T., Hoffman, Beth L., Jimenez, David, Tong, Britney, Young, Yvonne M.
• Primary Examiner(s): Chawan, Vijay B
• Application Number:
  US15/685,062
• Publication Number:
  US 20180122374A1
• Time in Patent Office: 733 Days
• Field of Search: 704260, 704258, 704228, 704207, 704235, 704233, 704220
• CPC Class Codes: G06F 40/253 Grammatical analysis; Style critique
• CPC Class Codes: G09B 19/04 Speaking with audible presentation of the material to be studied G09B5/04
• CPC Class Codes: G09B 5/02 with visual presentation of the material to be studied, e.g. using film strip
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 25/51 for comparison or discrimination
• CPC Class Codes: G10L 25/72 for transmitting results of analysis

Abstract

In an aspect of the present disclosure, a method for analyzing the speech delivery of a user is disclosed including presenting to the user a plurality of speech delivery analysis criteria, receiving from the user a selection of at least one of the speech delivery analysis criterion, receiving, from at least one sensing device, speech data captured by the at least one sensing device during the delivery of a speech by the user, transmitting the speech data and the selected at least one speech delivery analysis criterion to an analysis engine for analysis based on the selected at least one speech delivery analysis criteria, receiving, from the analysis engine an analysis report for the speech data, the analysis report comprising an analysis of the speech data performed by the analysis engine based on the selected at least one criterion, and presenting to the user the analysis report.

Claims

1. A method implemented by at least one hardware processor for analyzing speech delivery of a user comprising:

presenting to a user, via a graphical user interface on a display of a computing device, a plurality of criteria for analyzing the speech delivery of the user;

receiving, from the user via the computing device, a selection of at least one of the criteria for analyzing speech delivery;

receiving from the user, via the computing device, an input speech goal;

receiving, by the computing device, from at least one sensing device, speech data captured by the at least one sensing device during a delivery of a speech by the user;

transmitting the input speech goal, the speech data, and the selected at least one criteria to an analysis engine for analysis based on the selected at least one criteria;

receiving, from the analysis engine, an analysis report for the speech data, the analysis report comprising an analysis of the speech data performed by the analysis engine based on the selected at least one criteria and using the input speech goal to select a training corpus for training the analysis engine; and

presenting, to the user, via the graphical user interface, the analysis report.

2. The method of claim 1, wherein the received selection of the at least one criteria comprises a selection to compare the delivery of the speech by the user to a speech of at least one well known orator.

3. The method of claim 2, wherein the at least one well known orator is selected by the user.

4. The method of claim 2, wherein the analysis engine is trained using a training corpus of speech data of speeches of the at least one well known orator and is configured to identify, based on the comparison of the speech data captured during the delivery of the speech by the user to the speech data of the speeches of the at least one well known orator, which speech of the at least one well known orator the user'"'"'s speech matches the most.

5. The method of claim 1, wherein the received selection of the at least one criteria comprises a selection to compare the delivery of the speech by the user to a past delivery of the speech by the user.

6. The method of claim 5, wherein the received selection of the at least one criteria comprises the selection of at least one topic as a focus for the speech delivery analysis and wherein the analysis report comprises feedback on whether the user has improved or regressed in the selected at least one topic during the speech delivery as compared to the past delivery of the speech by the user.

7. The method of claim 1, wherein the received selection of the at least one criteria comprises a selection to analyze the correlation of movement of the user with a context of the speech during delivery of the speech.

8. The method of claim 7,

wherein transmitting the speech data to the analysis engine comprises transmitting a least one of visual speech data and motion speech data to the analysis engine, the analysis engine comparing the at least one of visual speech data and motion speech data to the speech data of the speech to determine whether movement of the user correlates to the context of the speech during delivery of the speech;

and

wherein the analysis report comprises an indication of how well the movement of the user during delivery of the speech correlates to the context of the speech.

9. A system for analyzing speech delivery of a user comprising:

at least one sensing device configured to capture speech data during the delivery of a speech by the user;

a computing device comprising a display and at least one processor configured to;

present to the user, via a graphical user interface on the display, a plurality of criteria for analyzing the delivery of the speech by the user;

receive from the user a selection of at least one of the criteria for analyzing speech delivery;

receive from the user an input speech goal;

receive from the at least one sensing device, the speech data captured by the at least one sensing device during the delivery of the speech by the user;

transmit the input speech goal, the speech data and the selected at least one criteria to an analysis engine for analysis based on the selected at least one criteria;

receive from the analysis engine an analysis report for the speech data, the analysis report comprising an analysis of the speech data performed by the analysis engine based on the selected at least one criteria and using the input speech goal to select a training corpus for training the analysis engine; and

present, to the user, via the graphical user interface, the analysis report.

10. The system of claim 9, wherein the received selection of the at least one criteria comprises a selection to compare the delivery of the speech by the user to a speech of at least one well known orator.

11. The system of claim 10, wherein the at least one well known orator is selected by the user.

12. The system of claim 10, wherein the analysis engine is trained using a training corpus of speech data of speeches of the at least one well known orator and is configured to identify, based on the comparison of the speech data captured during the delivery of the speech by the user to the speech data of the speeches of the at least one well known orator, which speech of the at least one well known orator the user'"'"'s speech matches the most.

13. The system of claim 9, wherein the received selection of the at least one criteria comprises a selection to compare the delivery of the speech by the user to a past delivery of the speech by the user.

14. The system of claim 13, wherein the received selection of the at least one criteria comprises the selection of at least one topic as a focus for analyzing the speech delivery, and wherein the analysis report comprises feedback on whether the user has improved or regressed in the selected at least one topic during the speech delivery as compared to the past delivery of the speech by the user.

15. The system of claim 9, wherein the received selection of the at least one criteria comprises a selection to analyze the correlation of movement of the user with a context of the speech during delivery of the speech.

16. The system of claim 15,

wherein transmitting the speech data to the analysis engine comprises transmitting a least one of visual speech data and motion speech data to the analysis engine, the analysis engine comparing the at least one of visual speech data and motion speech data to the speech data of the speech to determine whether movement of the user correlates to the context of the speech during delivery of the speech;

and

wherein the analysis report comprises an indication of how well the movement of the user during delivery of the speech correlates to the context of the speech.

17. A computer readable medium comprising instructions for analyzing speech delivery of a user that, when executed by at least one processor, configure the at least one processor to:

present to the user, via a graphical user interface on a display of a computing device, a plurality of criteria for analyzing the speech delivery of the user;

receive from the user a selection of at least one of the criteria for analyzing speech delivery;

receive from the user an input speech goal;

receive from at least one sensing device, speech data captured by the at least one sensing device during the delivery of the speech by the user;

transmit the input speech goal, the speech data and the selected at least one criteria to an analysis engine for analysis based on the selected at least one of the speech delivery analysis criteria and using the input speech goal to select a training corpus for training the analysis engine;

receive from the analysis engine an analysis report for the speech data, the analysis report comprising an analysis of the speech data performed by the analysis engine based on the selected at least one criteria; and

present, to the user, via the graphical user interface, the analysis report.

18. The computer readable medium of claim 17, wherein the received selection of the at least one criteria comprises a selection to compare the delivery of the speech by the user to a speech of at least one well known orator.

19. The computer readable medium of claim 17,

wherein the received selection of the at least one criteria comprises a selection to compare the delivery of the speech by the user to a past delivery of the speech by the user;

and

wherein the received selection of the at least one criteria comprises the selection of at least one topic as a focus for analyzing the speech delivery, and wherein the analysis report comprises feedback on whether the user has improved or regressed in the selected at least one topic during the speech delivery as compared to the past delivery of the speech by the user.

20. The computer readable medium of claim 17,

wherein the received selection of the at least one criteria comprises a selection to analyze the correlation of movement of the user with a context of the speech during delivery of the speech;

wherein transmitting the speech data to the analysis engine comprises transmitting a least one of visual speech data and motion speech data to the analysis engine, the analysis engine comparing the at least one of visual speech data and motion speech data to the speech data of the speech to determine whether movement of the user correlates to the context of the speech during delivery of the speech; and

wherein the analysis report comprises an indication of how well the movement of the user during delivery of the speech correlates to the context of the speech.