Electronic meeting intelligence

• US 10,445,706 B2
• Filed: 08/24/2018
• Issued: 10/15/2019
• Est. Priority Date: 11/10/2015
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Kitada, Hiroshi, Nelson, Steven A., Wong, Lana, Arora, Charchit
• Primary Examiner(s): Ramakrishnaiah, Melur
• Application Number:
  US16/112,361
• Publication Number:
  US 20180365657A1
• Time in Patent Office: 417 Days
• Field of Search: 348 1401- 1416, 705719
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 10/1095 Meeting or appointment
• CPC Class Codes: G10L 25/57 for processing of video signals
• CPC Class Codes: G10L 25/63 for estimating an emotional state
• CPC Class Codes: H04L 12/1822 Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
• CPC Class Codes: H04L 12/1831 Tracking arrangements for later retrieval, e.g. recording contents, participants activities or behavior, network status
• CPC Class Codes: H04L 65/1083 In-session procedures
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04M 2201/40 using speech recognition speech recognition per se G10L15/00
• CPC Class Codes: H04M 3/567 Multimedia conference systems
• CPC Class Codes: H04M 7/0027 Collaboration services where a computer is used for data transfer and the telephone is used for telephonic communication
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 7/15 Conference systems
• CPC Class Codes: H04N 7/152 Multipoint control units therefor

Abstract

Techniques related to electronic meeting intelligence are disclosed. An apparatus receives audio/video data including first meeting content data for an electronic meeting that includes multiple participants. The apparatus extracts the first meeting content data from the audio/video data. The apparatus generates meeting content metadata based on analyzing the first meeting content data. The apparatus includes the meeting content metadata in a report of the electronic meeting. If the apparatus determines that the audio/video data includes a cue for the apparatus to intervene in the electronic meeting, the apparatus generates intervention data including second meeting content data that is different from the first meeting content data. During the electronic meeting, the apparatus sends the intervention data to one or more nodes associated with at least one participant of the multiple participants.

Claims

1. An apparatus comprising:

one or more processors; and

one or more non-transitory computer-readable media storing instructions which, when processed by the one or more processors, cause;

receiving, at the apparatus, first meeting content data for an electronic meeting that includes one or more participants;

determining, by the apparatus analyzing the first meeting content data for the electronic meeting that includes one or more participants, whether there are one or more action items for the electronic meeting that includes one or more participants;

in response to the determining, by the apparatus analyzing the first meeting content data for the electronic meeting that includes one or more participants, that there are one or more actions items for the electronic meeting that includes one or more participants, generating meeting content metadata that specifies the one or more action items.

2. The apparatus of claim 1, wherein the one or more non-transitory computer-readable media store additional instructions which, when processed by the one or more processors, cause one or more of:

transmitting the meeting content metadata to a node associated with a participant of electronic meeting, including the meeting content metadata in a meeting summary or meeting report for the electronic meeting, or providing the meeting content metadata to an external data source.

3. The apparatus of claim 1, wherein the one or more non-transitory computer-readable media store additional instructions which, when processed by the one or more processors, cause:

generating second meeting content data and including, in the second meeting content data, the meeting content metadata that specifies the one or more action items; and

transmitting the second meeting content metadata to a node associated with a participant of electronic meeting.

4. The apparatus of claim 1, wherein:

the first meeting content data includes audio/video data, and

determining, by the apparatus, that the first meeting content data for the electronic meeting that includes one or more participants includes one or more actions items includes identifying, by the apparatus, text contained in the audio/video data.

5. The apparatus of claim 4, wherein the text is identified by one or more of speech or text recognition, or text formatting.

6. The apparatus of claim 4, wherein the text includes a label and a command.

7. The apparatus of claim 6, wherein the command is a task to be completed.

8. The apparatus of claim 7, wherein the task to be completed is included in a meeting summary or meeting report for the electronic meeting.

9. The apparatus of claim 8, wherein the one or more non-transitory computer-readable media store additional instructions which, when processed by the one or more processors, cause transmitting the meeting summary or meeting report for the electronic meeting to a node associated with a participant of electronic meeting.

10. The apparatus of claim 1, wherein:

the first meeting content data includes one or more of hand-written notes or hand-drawn illustrations, and

determining, by the apparatus, that the first meeting content data for the electronic meeting that includes one or more participants includes one or more actions items includes identifying, by the apparatus, the one or more action items from one or more of the hand-written notes or the hand-drawn illustrations.

11. One or more non-transitory computer-readable media storing instructions which, when processed by one or more processors, cause:

receiving, at an apparatus, first meeting content data for an electronic meeting that includes one or more participants;

determining, by the apparatus analyzing the first meeting content data for the electronic meeting that includes one or more participants, whether there are one or more action items for the electronic meeting that includes one or more participants;

in response to the determining, by the apparatus analyzing the first meeting content data for the electronic meeting that includes one or more participants, that there are one or more actions items for the electronic meeting that includes one or more participants, generating meeting content metadata that specifies the one or more action items.

12. The one or more non-transitory computer-readable media of claim 11, further comprising additional instructions which, when processed by the one or more processors, cause one or more of:

transmitting the meeting content metadata to a node associated with a participant of electronic meeting, including the meeting content metadata in a meeting summary or meeting report for the electronic meeting, or providing the meeting content metadata to an external data source.

13. The one or more non-transitory computer-readable media of claim 11, further comprising additional instructions which, when processed by the one or more processors, cause:

generating second meeting content data and including, in the second meeting content data, the meeting content metadata that specifies the one or more action items; and

transmitting the second meeting content metadata to a node associated with a participant of electronic meeting.

14. The one or more non-transitory computer-readable media of claim 11, wherein:

the first meeting content data includes audio/video data, and

determining, by the apparatus, that the first meeting content data for the electronic meeting that includes one or more participants includes one or more actions items includes identifying, by the apparatus, one or more recognized keywords contained in the audio/video data.

15. The one or more non-transitory computer-readable media of claim 14, wherein the recognized keywords are identified by speech or text recognition.

16. The one or more non-transitory computer-readable media of claim 14, wherein the recognized keywords include a label and a command.

17. The one or more non-transitory computer-readable media of claim 16, wherein the command is a task to be completed.

18. The one or more non-transitory computer-readable media of claim 17, wherein the task to be completed is included in a meeting summary or meeting report for the electronic meeting.

19. The one or more non-transitory computer-readable media of claim 18, further comprising additional instructions which, when processed by the one or more processors, cause transmitting the meeting summary or meeting report for the electronic meeting to a node associated with a participant of electronic meeting.

20. A computer-implemented method comprising:

receiving, at an apparatus, first meeting content data for an electronic meeting that includes one or more participants;

determining, by the apparatus analyzing the first meeting content data for the electronic meeting that includes one or more participants, whether there are one or more action items for the electronic meeting that includes one or more participants;

in response to the determining, by the apparatus analyzing the first meeting content data for the electronic meeting that includes one or more participants, that there are one or more actions items for the electronic meeting that includes one or more participants, generating meeting content metadata that specifies the one or more action items.