Personal audio-video recorder for live meetings

• US 8,209,181 B2
• Filed: 02/14/2006
• Issued: 06/26/2012
• Est. Priority Date: 02/14/2006
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Heckerman, David E., Rounthwaite, Robert L.
• Primary Examiner(s): Godbold, Douglas
• Assistant Examiner(s): Villena, Mark
• Application Number:
  US11/353,382
• Publication Number:
  US 20070188901A1
• Time in Patent Office: 2,324 Days
• Field of Search: 704/270, 360/23, 715/811, 715/723, 715/203, 709/228, 434/236, 368/95, 348/14.01
• US Class Current: 704/270
• CPC Class Codes: G09B 19/00 Teaching not covered by other main groups of this subclass teaching or practice apparatus for gun-aiming or gun-laying F41G3/26

Abstract

A unique recording system and method that facilitates recording live meetings, discussions or conversations whereby such recordings are available for immediate or near immediate playback is provided. As a result, a user who has momentarily become distracted or inattentive during the meeting can quickly re-listen to what was missed or misunderstood in order to readily catch up to the current discussion. The current discussion can continue to be recorded during playback of any previously recorded data. User behavior can be monitored to estimate when the user has started to become inattentive and likely segments or time points of the recordings can be suggested for playback. One or more portions of the recordings can be filtered or selected for playback so that any desired content can be eliminated or skipped in the playback version.

Claims

1. A recording system that facilitates providing playback of recorded information comprising:

a recording component that receives and records live data, the live data including an online slide presentation for a meeting;

a rapid playback component that provides playback of at least a subset of recorded data concurrently with recording of any current live data;

a personal monitoring component that observes at least one of user behavior, user actions, and user activity to ascertain whether a loss of attention of a user has occurred during the meeting, and compares content of a computer file opened by the user at a computer with content of the online slide presentation, the online slide presentation being available to the user to open at the computer when the computer file is opened by the user and the user is participating in the meeting;

a voice recognition component that identifies voices of multiple speakers included in the live data;

a voice filter component that selects a speaker from the multiple speakers whose data recorded has been identified to be interesting to the user; and

a playback suggestion component that suggests at least one segment of recorded data relating to the speaker to playback based at least in part on when the loss of attention occurred and a selection of the speaker.

2. The system of claim 1 further comprises one or more playback controls that regulate at least one of speed and subset of the recorded data selected for playback.

3. The system of claim 1, the rapid playback component plays the recorded data faster than real-time which facilitates getting caught up to the current live data.

4. The system of claim 1 further comprises a filter component that substantially eliminates background noise or any other audible data not of interest from the playback.

5. The system of claim 1 further comprises a recorded data store that stores at least one of the following:

recorded data and filtered recorded data.

6. The system of claim 1 wherein the voice recognition component that identifies voices of different speakers included in the audible live data;

and a voice filter component selectively skips or excludes the recorded data corresponding to at least one voice during playback.

7. The system of claim 1 further comprises an artificial intelligence component that estimates when the loss of attention occurred.

8. The system of claim 7, the artificial intelligence component estimates when the loss of attention occurred, and duration of the loss of attention in part by analyzing user behavior to determine whether any changes occurred therein.

9. The system of claim 1, the personal monitoring component comprises a monitoring device that captures at least one of movements, gestures, user absence or user presence.

10. The system of claim 1, wherein the personal monitoring component is further configured to observe at least one of user behavior, user actions, and user activity by comparing one or more terms in a calendar with one or more terms in a text that the user inputs during a meeting, the calendar indicating a starting and an ending time of the meeting.

11. A method that facilitates recording a live meeting performed by a process ring unit executing computer-executable instructions stored on a computer storage media, the method comprising:

recording live audio-video data;

playing back at least a portion of the data recorded at one or more speeds concurrently with recording any current live data to facilitate quickly reviewing at least a portion of the data in order to join back into the current live meeting;

monitoring at least one of user activity, user behavior, and user actions, the monitoring occurring concurrently with the recording the live audio-video data, the monitoring including using a monitoring device to observe a behavior of a user during the live meeting to indicate a loss of attention of the user, the user being an attendee of the live meeting;

identifying multiple speakers in the data recorded;

selecting a speaker from the multiple speakers whose data recorded has been identified to be interesting to a user; and

suggesting at least one segment of data recorded relating to the speaker to play back based on at least an estimation of when the loss of attention occurred and a selection of the speaker.

12. The method of claim 11 further comprises filtering at least a subset of the data recorded before playback of the subset to facilitate eliminating undesirable content.

13. The method of claim 11, wherein the playing back comprises playing back at least a portion of the data recorded at a speed faster than real-time to facilitate getting caught up to join back into a current live meeting.

14. The method of claim 11 further comprises identifying multiple voices of the multiple speakers included in the data recorded and filtering at least one voice to facilitate skipping over the voice.

15. The method of claim 11, wherein the playing back comprises playing back at least a portion of the data recorded is performed by at least one of the following:

speaking selected portions of the data or displaying text corresponding to recognized speech.

16. The method of claim 11, wherein the monitoring comprises inferring the user'"'"'s eyes looking down observed by the monitoring device as an indication of the loss of attention.

17. The method of claim 11, wherein the monitoring device includes a camera.

18. The method of claim 11, wherein the monitoring comprises:

finding a scheduled activity of the user based on a calendar; and

comparing an action of the user with the scheduled activity when the scheduled activity is due to ascertain whether the loss of attention of the user has occurred.

19. The method of claim 11, wherein the monitoring comprises comparing content of a computer file opened by the user at the computer with content of an online slide presentation included in the live audio-video data to ascertain whether the loss of attention of the user has occurred, the online slide presentation being available to the user to open at the computer when the computer file is opened by the user and the user is participating in the live meeting.

20. A memory haying computer-executable instructions encoded thereon that upon execution configure a computer to perform operations comprising:

receiving and recording audible live data;

providing playback of at least a subset of recorded data concurrently with recording of any current live data;

monitoring at least one of user behavior, user actions, and user activity to facilitate estimating when a loss of attention has occurred, the monitoring including finding a scheduled activity of a user based on a calendar and comparing an action of the user with the scheduled activity when the scheduled activity is due;

identifying multiple speakers in the recorded data;

selecting a speaker from the multiple speakers whose data recorded has been identified to be interesting to a user; and

suggesting at least one segment of data recorded relating to the speaker to play back based on at least an estimation of when the loss of attention occurred and a selection of the speaker.