NOTE-TAKING ASSISTANCE SYSTEM, INFORMATION DELIVERY DEVICE, TERMINAL, NOTE-TAKING ASSISTANCE METHOD, AND COMPUTER-READABLE RECORDING MEDIUM

• US 20160300587A1
• Filed: 02/20/2014
• Published: 10/13/2016
• Est. Priority Date: 03/19/2013
• Status: Active Grant

• Current Assignee: NEC Solution Innovators, Ltd (NEC Corporation)
• Original Assignee: NEC Solution Innovators, Ltd (NEC Corporation)
• Inventors: NISHIMURA, Tomonari
• Granted Patent: US 9,697,851 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G09B 21/009 Teaching or communicating with deaf persons G09B21/04 takes precedence; deaf and dumb persons G09B21/00
• CPC Class Codes: G10L 15/04 Segmentation; Word boundary detection
• CPC Class Codes: G10L 2021/065 Aids for the handicapped in understanding
• CPC Class Codes: G10L 2025/783 based on threshold decision
• CPC Class Codes: G10L 21/10 Transforming into visible information
• CPC Class Codes: G10L 25/78 Detection of presence or absence of voice signals switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10

Abstract

A note-taker terminal (200) and an information delivery device (100) are used. The information delivery device (100) includes a breathing detection unit (104) that specifies breathing sections from silent sections of uttered speech, a data processing unit (105) that determines, for every allocated time period of a note-taker, whether a breathing section exists in a range based on an end point of the allocated time period, and generates, if a breathing section exists, speech data of the utterance from a start point of the allocated time period until the breathing section, and, if a breathing section does not exist, speech data of the utterance from the start point until the end point of the allocated time period, and a data transmission unit (106) that transmits the speech data to the note-taker terminal (200). The note-taker terminal (200) receives the speech data, and transmits input text data to a user terminal (300) of a note-taking user.

Claims

1. A system for assisting note-taking of an utterance of a speaker, comprising:

a terminal for note-takers that is used by a note-taker who performs the note-taking; and

an information delivery device that transmits speech data of the utterance to the terminal,

wherein the information delivery device includes;

a breathing detection unit that specifies silent sections from speech of the utterance, and specifies a silent section that satisfies a set condition, among the specified silent sections, as a breathing section of the speaker;

a data processing unit that determines, for every allocated time period that is allocated to the note-taker, whether the breathing section exists in a range that is based on an end point of the allocated time period, and generates, in a case where the breathing section exists in the range, speech data of the utterance from a start point of the allocated time period until the breathing section, and, in a case where the breathing section does not exist in the range, speech data of the utterance from the start point until the end point of the allocated time period; and

a data transmission unit that transmits the speech data generated by the data processing unit to the terminal of the note-taker to whom the allocated time period is allocated, and

the terminal for note-takers includes;

a data reception unit that receives the speech data transmitted from the information delivery device;

an input unit that accepts input of text data that is input in correspondence to the speech data; and

a data transmission unit that transmits the text data whose input was accepted to a terminal for users that is used by a user of the note-taking.

2. In the note-taking assistance system according to claim 1,

wherein the data transmission unit of the information delivery device further transmits video data corresponding to the allocated time period that is allocated to the note-taker to the terminal,

the terminal for note-takers further includes an image processing unit that extracts a still image from the transmitted video data, according to an instruction from outside, and

the data transmission unit of the terminal for note-takers transmits the text data whose input was accepted and image data of the extracted still image to the terminal for users.

3. In the note-taking assistance system according to claim 1,

wherein the breathing detection unit, in a case where a length of the silent section is less than or equal to a threshold, specifies the specified silent section as the breathing section of the speaker.

4. In the note-taking assistance system according to claim 1,

wherein a length of the allocated time period that is allocated to the note-taker is set according to a note-taking ability of the note-taker.

5. An information delivery device for transmitting speech data of an utterance of a speaker to a terminal for note-takers that is used by a note-taker who performs note-taking of the utterance, comprising:

a breathing detection unit that specifies silent sections from speech of the utterance, and specifies a silent section that satisfies a set condition, among the specified silent sections, as a breathing section of the speaker;

a data processing unit that determines, for every allocated time period that is allocated to the note-taker, whether the breathing section exists in a range that is based on an end point of the allocated time period, and generates, in a case where the breathing section exists in the range, speech data of the utterance from a start point of the allocated time period until the breathing section, and, in a case where the breathing section does not exist in the range, speech data of the utterance from the start point until the end point of the allocated time period; and

a data transmission unit that transmits the speech data generated by the data processing unit to the terminal of the note-taker to whom the allocated time period is allocated.

6. A terminal that is used by a note-taker who performs note-taking of an utterance of a speaker, comprising;

a data reception unit that receives, for every allocated time period that is allocated to the note-taker, speech data of the utterance from an information delivery device that transmits the speech data;

an input unit that accepts input of text data that is input in correspondence to the speech data; and

a data transmission unit that transmits the text data whose input was accepted to a terminal for users that is used by a user of the note-taking.

7. A note-taking assistance method for assisting note-taking using a terminal for note-takers that is used by a note-taker who performs note-taking of an utterance of a speaker and an information delivery device that transmits speech data of the utterance to the terminal, comprising the steps of:

(a) using the information delivery device to specify silent sections from speech of the utterance, and specify a silent section that satisfies a set condition, among the specified silent sections, as a breathing section of the speaker;

(b) using the information delivery device to determine, for every allocated time period that is allocated to the note-taker, whether the breathing section exists in a range that is based on an end point of the allocated time period, and generate, in a case where the breathing section exists in the range, speech data of the utterance from a start point of the allocated time period until the breathing section, and, in a case where the breathing section does not exist in the range, speech data of the utterance from the start point until the end point of the allocated time period;

(c) using the information delivery device to transmit the speech data generated in the step (b) to the terminal of the note-taker to whom the allocated time period is allocated;

(d) using the terminal for note-takers to receive the speech data transmitted from the information delivery device;

(e) using the terminal for note-takers to accept input of text data that is input in correspondence to the speech data; and

(f) using the terminal for note-takers to transmit the text data whose input was accepted in the step (e) to a terminal for users that is used by a user of the note-taking.

8. A computer-readable recording medium storing a computer program for transmitting, by computer, speech data of an utterance of a speaker to a terminal for note-takers that is used by a note-taker who performs note-taking of the utterance, the computer program including a command for causing the computer to execute the steps of:

(a) specifying silent sections from speech of the utterance, and specifying a silent section that satisfies a set condition, among the specified silent sections, as a breathing section of the speaker;

(b) determining, for every allocated time period that is allocated to the note-taker, whether the breathing section exists in a range that is based on an end point of the allocated time period, and generating, in a case where the breathing section exists in the range, speech data of the utterance from a start point of the allocated time period until the breathing section, and, in a case where the breathing section does not exist in the range, speech data of the utterance from the start point until the end point of the allocated time period; and

(c) transmitting the speech data generated in the step (b) to the terminal of the note-taker to whom the allocated time period is allocated.

9. A computer-readable recording medium storing a computer program that includes a command for causing a computer that is used by a note-taker who performs note-taking of an utterance of a speaker to execute the steps of:

(a) receiving, for every allocated time period that is allocated to the note-taker, speech data of the utterance from an information delivery device that transmits the speech data;

(b) accepting input of text data that is input in correspondence to the speech data; and

(c) transmitting the text data accepted in the step (b) to a terminal for users that is used by a user of the note-taking.