Public Speaking Trainer With 3-D Simulation and Real-Time Feedback

• US 20160049094A1
• Filed: 08/11/2015
• Published: 02/18/2016
• Est. Priority Date: 08/13/2014
• Status: Active Grant

• Current Assignee: Pitchvantage, LLC
• Original Assignee: Pitchvantage, LLC
• Inventors: Gupta, Anindya, Makhiboroda, Yegor, Story, Brad H.
• Granted Patent: US 10,446,055 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 13/205 driven by audio data
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G09B 19/04 Speaking with audible presentation of the material to be studied G09B5/04
• CPC Class Codes: G09B 5/06 with both visual and audible presentation of the material to be studied
• CPC Class Codes: G09B 7/02 of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
• CPC Class Codes: G09B 9/00 Simulators for teaching or training purposes for the use of weapons F41; computing aspects G06; protocols for games, networked simulations or virtual reality H04L67/131
• CPC Class Codes: G10L 15/02 Feature extraction for speech recognition; Selection of recognition unit
• CPC Class Codes: G10L 15/04 Segmentation; Word boundary detection
• CPC Class Codes: G10L 15/187 Phonemic context, e.g. pronunciation rules, phonotactical constraints or phoneme n-grams
• CPC Class Codes: G10L 25/03 characterised by the type of extracted parameters
• CPC Class Codes: G10L 25/27 characterised by the analysis technique
• CPC Class Codes: H04N 5/76 Television signal recording

Abstract

A public speaking trainer has a computer system including a display monitor. A microphone is coupled to the computer system. A video capture device is coupled to the computer system. A biometric device is coupled to the computer system. A simulated environment including a simulated audience member is rendered on the display monitor using the computer system. A presentation is recorded onto the computer system using the microphone and video capture device. A first feature of the presentation is extracted based on data from the microphone and video capture device while recording the presentation. A metric is calculated based on the first feature. The simulated audience member is animated in response to a change in the metric. A score is generated based on the metric. The score is displayed on the display monitor of the computer system after recording the presentation. A training video is suggested based on the score.

Claims

1. A method of public speaking training, comprising:

providing a computer system including a display monitor;

providing a microphone coupled to the computer system;

providing a video capture device coupled to the computer system;

rendering a simulated environment including a simulated audience member on the display monitor using the computer system;

recording a presentation onto the computer system using the microphone and video capture device;

extracting a first feature of the presentation based on data from the microphone and video capture device while recording the presentation;

calculating a metric based on the first feature;

animating the simulated audience member in response to a change in the metric;

generating a score based on the metric; and

displaying the score on the display monitor of the computer system after recording the presentation.

2. The method of claim 1, further including:

providing a biometric device coupled to the computer system; and

extracting a second feature of the presentation based on a data from the biometric device.

3. The method of claim 1, further including displaying a training video on the display monitor.

4. The method of claim 3, further including suggesting the training video based on the metric or score.

5. The method of claim 1, further including drawing a notification on the display monitor based on the metric while recording the presentation.

6. The method of claim 1, wherein providing the computer system includes providing a virtual reality headset.

7. A method of public speaking training, comprising:

providing a computer system including a display monitor;

providing a microphone coupled to the computer system;

providing a video capture device coupled to the computer system;

rendering a simulated audience member on the display monitor using the computer system;

recording a presentation onto the computer system using the microphone and video capture device;

extracting a feature of the presentation based on a data from the microphone and video capture device while recording the presentation; and

animating the simulated audience member in response to the feature.

8. The method of claim 7, further including providing a topic as a prompt for the presentation.

9. The method of claim 7, further including providing a second video capture device coupled to the computer system.

10. The method of claim 7, wherein providing the computer system includes providing a video game console.

11. The method of claim 7, further including storing the feature on a cloud storage.

12. The method of claim 7, further including calculating a metric based on the feature using a supervised machine learning classification algorithm.

13. The method of claim 7, further including rendering the simulated audience member using a video game engine.

14. A method of public speaking training, comprising:

providing a computer system including a display monitor;

providing a microphone coupled to the computer system;

rendering a simulated audience member on the display monitor using the computer system;

recording a presentation onto the computer system using the microphone; and

animating the simulated audience member based on a data from the microphone.

15. The method of claim 14, further including providing a biometric device coupled to the computer system.

16. The method of claim 14, further including suggesting a training video based on the presentation.

17. The method of claim 14, further including rendering the simulated audience member using a video game engine.

18. The method of claim 14, further including displaying a notification on the display monitor while recording the presentation.

19. The method of claim 14, further including providing a topic as a prompt for the presentation.

20. The method of claim 14, wherein providing the computer system includes providing a tablet computer or mobile phone.

21. A method of public speaking training, comprising:

providing a simulated audience member;

receiving a presentation; and

animating the simulated audience member in response to the presentation.

22. The method of claim 21, further including animating the simulated audience member to appear bored or engaged.

23. The method of claim 21, further including:

extracting a feature of the presentation; and

animating the simulated audience member based on the feature.

24. The method of claim 21, further including providing the simulated audience member using a virtual reality headset.

25. The method of claim 21, further including providing real-time feedback based on the presentation.