SOUND RECOGNITION DEVICE, NON-TRANSITORY COMPUTER READABLE STORAGE MEDIUM STORED THREREOF SOUND RECOGNITION PROGRAM, AND SOUND RECOGNITION METHOD

• US 20140129221A1
• Filed: 03/22/2013
• Published: 05/08/2014
• Est. Priority Date: 03/23/2012
• Status: Abandoned Application

• Current Assignee: Dwango Co., Ltd. (Kadokawa Dwango Corp.)
• Original Assignee: Dwango Co., Ltd. (Kadokawa Dwango Corp.)
• Inventors: KASAI, Wataru
• Application Number:
  US13/848,895
• Publication Number:
  US 20140129221A1
• Time in Patent Office: Days
• US Class Current: 704/240
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

A sound recognition device includes a storage for storing a comment that is input while the user listening to sounds emitted as multimedia data being played. The sound recognition device further includes an extractor for extracting a word that appears in a set of sentences that contains the stored comment, and candidate words that contain co-occurrences of the word in the set of sentences. Furthermore, the sound recognition device includes a sound recognizer for recognizing sounds emitted as the multimedia data being played, based on the extracted candidate words.

Claims

1. A sound recognition device comprising:

a storage for storing a comment that is input by a user while listening to a sound emitted via playing multimedia data;

an extractor for extracting candidate words including a word occurred in a set of sentences that contain the stored comment, and a co-occurrence of the word contained in the set of sentences; and

a sound recognizer for recognizing the sound emitted via playing the multimedia data, recognizing based on the extracted candidate words.

2. The sound recognition device according to claim 1, wherein

the set of sentences comprising a sentence that occurred in a document viewed by the user of the multimedia data.

3. The sound recognition device according to claim 1, wherein

the extractor determines a likelihood of occurrence for the each candidate word, and

the sound recognizer recognizes the sound based on a degree of coincidence between a phoneme that is recognized in the sound and a phoneme that describes the candidate words, and on the likelihood of occurrence of the candidate words.

4. The sound recognition device according to claim 3, wherein

a word among the candidate words, that occurred in the comment, is associated with an input time point at which an input of the comment is made,

as for the candidate words associated with the input time point, the sound recognizer requests to obtain a degree of coincidence between an input time point associated with the candidate words, and a sound emission time point at which the phoneme is emitted, and the sound recognizer further performs a sound recognition based on the obtained degree of coincidence.

5. The sound recognition device according to claim 4, wherein

the input time point and the sound emission time point are depending on a period of play time starting from a multimedia data play start.

6. The sound recognition device according to claim 5, wherein

the degree of coincidence is defined based on a difference between the input time point and the sound emission time point, and a difference between a time point at which the multimedia data is ready to play and a time point at which the user started to play the multimedia data.

7. A non-transitory computer readable storage medium having stored thereof a sound recognition program executable by a computer, causing the computer to realize functions of:

storing a comment that is input by a user while listening to a sound emitted via playing multimedia data;

extracting candidate words including a word occurred in a set of sentences that contain the stored comment, and a co-occurrence of the word contained in the set of sentences; and

recognizing the sound emitted via playing the multimedia data, and recognizing based on the extracted candidate words.

8. A sound recognition method performed by a sound recognition device comprising a storage, an extractor, and a sound recognizer, comprising the steps of:

storing a comment that is input by a user while listening to a sound emitted via playing multimedia data;

extracting candidate words including a word occurred in a set of sentences that contain the stored comment, and a co-occurrence of the word contained in the set of sentences; and

recognizing the sound emitted via playing the multimedia data, and recognizing based on the extracted candidate words.