System and method for creating a presentation using natural language

• US 9,959,260 B2
• Filed: 05/04/2015
• Issued: 05/01/2018
• Est. Priority Date: 10/31/2005
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Inventors: Ehlen, Patrick, Gibbon, David Crawford, Gilbert, Mazin, Johnston, Michael, Liu, Zhu, Shahraray, Behzad
• Primary Examiner(s): Tran, Quoc A
• Application Number:
  US14/702,825
• Publication Number:
  US 20150234800A1
• Time in Patent Office: 1,093 Days
• Field of Search: 715202, 715730, 715862, 715705, 715712
• CPC Class Codes: G06F 16/2445 Data retrieval commands; View definitions
• CPC Class Codes: G06F 16/4393 Multimedia presentations, e.g. slide shows, multimedia albums
• CPC Class Codes: G06F 16/70 of video data
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 16/9538 Presentation of query results
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 40/103 Formatting, i.e. changing of presentation of documents automatic justification G06F40/189; automatic line break hyphenation G06F40/191
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G06F 40/40 Processing or translation of natural language natural language analysis G06F40/20; semantic analysis G06F40/30
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: H04N 5/74 Projection arrangements for image reproduction, e.g. using eidophor

Abstract

The invention provides for a system, method, and computer readable medium storing instructions related to controlling a presentation in a multimodal system. The method embodiment of the invention is a method for the retrieval of information on the basis of its content for incorporation into an electronic presentation. The method comprises receiving from a user a content-based request for at least one segment from a first plurality of segments within a media presentation preprocessed to enable natural language content searchability; in response to the request, presenting a subset of the first plurality of segments to the user; receiving a selection indication from the user associated with at least one segment of the subset of the first plurality of segments and adding the selected at least one segment to a deck for use in a presentation.

Claims

1. A method comprising:

updating a grammar based on a searchable plurality of presentation source files stored on a storage device connected to a presentation device via a network, to yield an updated grammar, wherein the searchable plurality of presentation source files is processed by extracting content from each searchable presentation source file to generate;

(1) a web-based form of each searchable presentation source file;

(2) a list of key phrases; and

(3) a corpus of all sentences that appear in all the searchable presentation source files;

receiving, from a user, a spoken natural language content request for a presentation source file from the searchable plurality of presentation source files;

identifying a list of presentation source files in the searchable plurality of presentation source files, wherein the list of presentation source files is identified by using the updated grammar;

receiving, from the user, input identifying the presentation source file from the list of presentation source files, wherein the input is in a modality distinct from speech; and

adding the presentation source file to a deck for use in a presentation using the presentation device.

2. The method of claim 1, wherein the presentation source file is confirmed by the user via one of graffiti, handwritten, typed, motion, and button click input.

3. The method of claim 1, wherein the presentation source files are viewgraphs.

4. The method of claim 1, wherein the list of key phrases is used to populate a menu of key phrases available to the user.

5. The method of claim 4, wherein the user can use the menu of key phrases to select searchable presentation source files.

6. The method of claim 1, wherein the updating, the receiving of the spoken natural language content request, the identifying of the list of presentation source files, the receiving of the input identifying the presentation source file, and the adding of the presentation source file all occur as the presentation device presents the presentation.

7. The method of claim 1, wherein the key phrases are displayed on a graphical user interface.

8. A system comprising:

a processor; and

a computer-readable storage medium having instructions stored which, when executed by the processor, result in the processor performing operations comprising;

updating a grammar based on a searchable plurality of presentation source files stored on a storage device connected to a presentation device via a network, to yield an updated grammar, wherein the searchable plurality of presentation source files is processed by extracting content from each searchable presentation source file to generate;

(1) a web-based form of each searchable presentation source file;

(2) a list of key phrases; and

(3) a corpus of all sentences that appear in all the searchable presentation source files;

receiving, from a user, a spoken natural language content request for a presentation source file from the searchable plurality of presentation source files;

identifying a list of presentation source files in the searchable plurality of presentation source files, wherein the list of presentation source files is identified by using the updated grammar;

receiving, from the user, input identifying the presentation source file from the list of presentation source files, wherein the input is in a modality distinct from speech; and

adding the presentation source file to a deck for use in a presentation using the presentation device.

9. The system of claim 8, wherein the presentation source file is confirmed by the user via one of graffiti, handwritten, typed, motion, and button click input.

10. The system of claim 8, wherein the presentation source files are viewgraphs.

11. The system of claim 8, wherein the list of key phrases is used to populate a menu of key phrases available to the user.

12. The system of claim 11, wherein the user can use the menu of key phrases to select searchable presentation source files.

13. The system of claim 8, wherein the updating, the receiving of the spoken natural language content request, the identifying of the list of presentation source files, the receiving of the input identifying the presentation source file, and the adding of the presentation source file all occur as the presentation device presents the presentation.

14. The system of claim 8, wherein the key phrases are displayed on a graphical user interface.

15. A computer-readable storage device having instructions stored which, when executed by a computing device, cause the computing device to perform operations comprising:

updating a grammar based on a searchable plurality of presentation source files stored on a storage device connected to a presentation device via a network, to yield an updated grammar, wherein the searchable plurality of presentation source files is processed by extracting content from each searchable presentation source file to generate;

(1) a web-based form of each searchable presentation source file;

(2) a list of key phrases; and

(3) a corpus of all sentences that appear in all the searchable presentation source files;

receiving, from a user, a spoken natural language content request for a presentation source file from the searchable plurality of presentation source files;

identifying a list of presentation source files in the searchable plurality of presentation source files, wherein the list of presentation source files is identified by using the updated grammar;

receiving, from the user, input identifying the presentation source file from the a list of presentation source files, wherein the input is in a modality distinct from speech; and

adding the presentation source file to a deck for use in a presentation using the presentation device.

16. The computer-readable storage device of claim 15, wherein the presentation source file is confirmed by the user via one of graffiti, handwritten, typed, motion, and button click input.

17. The computer-readable storage device of claim 15, wherein the presentation source files are viewgraphs.

18. The computer-readable storage device of claim 15, wherein the list of key phrases is used to populate a menu of key phrases available to the user.

19. The computer-readable storage device of claim 18, wherein the user can use the menu of key phrases to select searchable presentation source files.

20. The computer-readable storage device of claim 15, wherein the updating, the receiving of the spoken natural language content request, the identifying of the list of presentation source files, the receiving of the input identifying the presentation source file, and the adding of the presentation source file all occur as the presentation device presents the presentation.