Annotating notes from passive recording with categories

• US 9,910,840 B2
• Filed: 08/21/2015
• Issued: 03/06/2018
• Est. Priority Date: 04/03/2015
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Liu, Jie, Dalal, Mayuresh P., Gabor, Michal, Prajapati, Gaurang
• Primary Examiner(s): Riley, Marcus T
• Application Number:
  US14/832,144
• Publication Number:
  US 20160292141A1
• Time in Patent Office: 928 Days
• Field of Search: None
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G11B 20/10527 Audio or video recording; Data buffering arrangements G11B20/12 - G11B20/18 take precedence
• CPC Class Codes: G11B 2020/10546 specifically adapted for audio data
• CPC Class Codes: G11B 2020/10629 the buffer having a specific structure
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals

Abstract

Systems and methods, and computer-readable media bearing instructions for carrying out methods of capturing notes from passive recording of an ongoing content stream and annotating the note with a category are presented. Passive recording comprises temporarily recording the most recent content of the ongoing content stream. An ongoing content stream is passively recorded in a passive recording buffer. The passive recording buffer is configured to store a limited amount of recorded content corresponding to the most recently recorded content of the ongoing content stream. Upon indication by the user, a note is generated from the recorded content in the passive recording, annotated with a category, and stored in a note file for the user.

Claims

1. A computer implemented method conducted on a user'"'"'s computing device, comprising at least a processor and a memory, for generating notes from an ongoing content stream, the method comprising:

initiating passive recording of an ongoing content stream as frames of recorded content, the passive recording storing the frames of recorded content of the ongoing content stream in a passive recording buffer;

receiving a user indication to generate a note based on the recorded content of the passive recording of the ongoing content stream;

processing the frames of recorded content in the passive recording buffer into an audio stream;

generating a note of the ongoing content stream from the audio stream and storing the note in a note file;

receiving an indication to associate a category with the generated note from the user; and

annotating the generated note with the category in the note file.

2. The computer implemented method of claim 1, wherein the indication to associate the category with the generated note from the user is received from the user after the note has been generated and stored in the note file.

3. The computer implemented method of claim 1, wherein the indication to associate the category with the generated note from the user is automatically applied as a function of generating the note based on the recorded content of the passive recording of the ongoing content stream.

4. The computer implemented method of claim 3, wherein the indication to associate the category with the generated note from the user is included as part of the user indication to generate the note based on the recorded content of the passive recording of the ongoing content stream.

5. The computer implemented method of claim 1, wherein the category associated with the generated note is one of a plurality of predetermined categories for annotating a generated note.

6. The computer implemented method of claim 5, wherein the plurality of predetermined categories for annotating a generated note are user configurable.

7. The computer implemented method of claim 1 further comprising:

receiving an indication to associate a plurality of categories with the generated note from the user; and

annotating the generated note with the plurality of categories in the note file.

8. The computer implemented method of claim 1, wherein the generated note is stored in the note file in association with a meeting corresponding to the ongoing content stream.

9. The computer implemented method of claim 8, wherein the generated note is stored in the note file as one of a plurality of notes associated with the meeting corresponding to the ongoing content stream.

10. A computer readable medium bearing computer executable instructions which, when executed on a computing system comprising at least a processor, carry out a method for generating notes annotated with a category from an ongoing content stream, the method comprising:

initiating passive recording of an ongoing content stream as frames of recorded content, the passive recording storing the frames of recorded content of the ongoing content stream in a passive recording buffer;

receiving a user indication to generate a note based on the recorded content of the passive recording of the ongoing content stream;

processing the frames of recorded content in the passive recording buffer into an audio stream;

receiving a user indication to associate a category of a plurality of predetermined categories with the generated note;

generating a note of the ongoing content stream from the audio stream;

annotating the generated note with the category in the note file; and

storing the note in a note file in association with an event corresponding to the ongoing content stream.

11. The computer readable medium of claim 10, wherein the user indication to associate a category of a plurality of predetermined categories with the generated note is received from a user after the note has been generated and stored in the note file.

12. The computer readable medium of claim 10, wherein the user indication to associate a category of a plurality of predetermined categories with the generated note is automatically applied as a function of generating the note based on the recorded content of the passive recording of the ongoing content stream.

13. The computer readable medium of claim 12, wherein the user indication to associate the category with the generated note from the user is a part of the user indication to generate the note based on the recorded content of the passive recording of the ongoing content stream.

14. The computer readable medium of claim 10, wherein the plurality of predetermined categories are user configurable.

15. The computer readable medium of claim 10, the method further comprising:

receiving a user indication to associate an additional category of the plurality of predetermined categories with the generated note; and

annotating the generated note with additional category in the note file.

16. The computer readable medium of claim 10, wherein the generated note is stored in the note file as one of a plurality of notes associated with a meeting corresponding to the ongoing content stream.

17. A computing device for generating annotated notes from an ongoing content stream, the computing device comprising a processor and a memory, wherein the processor executes instructions stored in the memory as part of or in conjunction with additional components to generate notes from an ongoing content stream, the additional components comprising:

a passive recording buffer temporarily storing a predetermined amount of recorded content of an ongoing content stream, wherein the recorded content is stored as a plurality of frames of recorded content;

an audio recording component generating a plurality of frames of recorded content of the ongoing content stream;

a passive recording component obtaining the plurality of frames of recorded content of the ongoing content stream from the audio recording component and storing the plurality of frames of the recorded content to the passive recording buffer;

an annotation component annotating a generated note with a category; and

a note generator component initiating a passive recording process via the passive recording component, receiving an indication from a user, via a user interface component, to capture the plurality of frames of the recorded content of the ongoing content stream, generate an audio stream from the plurality of frames of the recorded content, generating a note from the audio stream, annotating the generated note with a category via the annotation component, and storing the generated note in a note file in a data store.

18. The computing device of claim 17, wherein the indication from the user to capture the plurality of frames of the recorded content of the ongoing content stream includes an indication to annotate the generated note with a category.

19. The computing device of claim 17, wherein the generated note is stored in the note file in the data store in association with a meeting corresponding to the ongoing content stream.

20. The computing device of claim 17, wherein the generated note is stored in the note file in the data store as one of a plurality of notes in association with a meeting corresponding to the ongoing content stream.