Meeting visualization system

• US 8,290,776 B2
• Filed: 04/01/2008
• Issued: 10/16/2012
• Est. Priority Date: 04/12/2007
• Status: Active Grant

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Moriwaki, Norihiko, Sato, Nobuo, Imaki, Tsuneyuki, Kashiyama, Toshihiko, Nishizawa, Itaru, Egi, Masashi
• Primary Examiner(s): Armstrong, Angela A
• Application Number:
  US12/078,520
• Publication Number:
  US 20080255847A1
• Time in Patent Office: 1,659 Days
• Field of Search: 704/201, 704/270, 704/270.1, 709/206
• US Class Current: 704/270
• CPC Class Codes: G10L 21/06 Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids G10L15/26 takes precedence
• CPC Class Codes: G10L 25/78 Detection of presence or absence of voice signals switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10

Abstract

Voice of plural participants during a meeting is obtained and dialogue situations of the participants that change every second are displayed in real time, so that it is possible to provide a meeting visualization system for triggering more positive discussions. Voice data collected from plural voice collecting units associated with plural participants is processed by a voice processing server to extract speech information. The speech information is sequentially input to an aggregation server. A query process is performed for the speech information by a stream data processing unit of the aggregation server, so that activity data such as the accumulation value of speeches of the participants in the meeting is generated. A display processing unit visualizes and displays dialogue situations of the participants by using the sizes of circles and the thicknesses of lines on the basis of the activity data.

Claims

1. A meeting visualization system which visualizes and displays dialogue situations among a plurality of participants in a meeting, the system comprising:

a plurality of name-tag type sensor nodes that are associated with the participants, each of the name-tag type sensor nodes including an accelerometer for acquiring motion data of the participants;

a key stroke information input unit with which speech contents are input as key stroke information; and

a stream processing unit to which the motion data extracted by the name-tag type sensor nodes and the key stroke information extracted by the key stroke information input unit are sequentially input, the stream processing unit associating the motion data with the key stroke information;

wherein the stream processing unit calculates importance of the speech contents based on the motion data.

2. The meeting visualization system of claim 1, wherein the stream processing unit is configured to determine when participants have nodded based on the motion data and calculate the importance of the speech contents based on a quantity of participant nods determined based on the motion data associated with the speech contents.

3. The meeting visualization system of claim 1, further comprising a plurality of voice collecting units that obtain voice data from the participants, and wherein the stream processing unit calculates importance of the voice data based on the motion data.

4. The meeting visualization system of claim 3, wherein the stream processing unit is configured to determine when participants have nodded based on the motion data and calculate the importance of the voice data and the importance of the speech contents based on a quantity of participant nods determined based on the motion data.