VOICE RECOGNITION APPARATUS AND CONTROL METHOD THEREOF

• US 20140350933A1
• Filed: 05/27/2014
• Published: 11/27/2014
• Est. Priority Date: 05/24/2013
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: BAK, Eun-sang, KIM, Kyung-duk, RYU, Seong-han, LEE, Geun-bae, NOH, Hyung-jong
• Application Number:
  US14/287,718
• Publication Number:
  US 20140350933A1
• Time in Patent Office: Days
• US Class Current: 704/249
• CPC Class Codes: G10L 15/1822 Parsing for meaning understanding

Abstract

A voice recognition apparatus includes: an extractor configured to extract utterance elements from a user'"'"'s uttered voice; an LSP converter configured to convert the extracted utterance elements into LSP formats; and a controller configured to determine whether an utterance element related to an OOV exists among the utterance elements converted into the LSP formats with reference to vocabulary list information including pre-registered vocabularies, and to determine an OOD area in which it is impossible to provide response information in response to the uttered voice, in response to determining that the utterance element related to the OOV exists. Accordingly, the voice recognition apparatus provides appropriate response information according to a user'"'"'s intent by considering a variety of utterances and possibilities regarding a user'"'"'s uttered voice.

Claims

1. A voice recognition apparatus comprising a processor comprising:

an extractor configured to extract utterance elements from an uttered voice of a user;

a lexico-semantic pattern (LSP) converter configured to convert the extracted utterance elements into LSP formats; and

a controller configured to determine whether an utterance element related to an Out Of Vocabulary (OOV) exists among the utterance elements converted into the LSP formats with reference to vocabulary list information comprising pre-registered vocabularies, and to determine an Out Of Domain (OOD) area in which it is impossible to provide response information in response to the uttered voice, in response to determining that the utterance element related to the OOV exists.

2. The voice recognition apparatus of claim 1, wherein the controller is configured to determine the utterance element, among the utterance elements converted into the LSP formats, which is absent from the pre-registered vocabularies, as the utterance element of the OOV.

3. The voice recognition apparatus of claim 1, wherein the vocabulary list information further comprises reliability values which are set based on a frequency of use of respective pre-registered vocabularies, and

the controller is configured to determine the utterance element, among the utterance elements converted into the LSP formats, which is related to a respective pre-registered vocabulary having a reliability value less than a threshold value, as the utterance element of the OOV.

4. The voice recognition apparatus of claim 1, wherein the controller is configured to determine a final domain for providing response information in response to the uttered voice based on the utterance elements converted into the LSP formats, in response to an absence of the utterance element related to the OOV from the utterance elements converted into the LSP formats.

5. The voice recognition apparatus of claim 4, wherein the controller is configured to determine whether an extended domain, which is a higher level domain of a hierarchical domain model and relates to the utterance elements converted into the LSP formats, is present, determine a candidate domain which is a lower level domain of the hierarchical domain model and relates to the extended domain, as the final domain, in response to the extended domain being present, and determine the candidate domain of the lower level related to the utterance elements converted into the LSP formats, as the final domain, in response to the extended domain being absent.

6. The voice recognition apparatus of claim 5, wherein the candidate domain of the hierarchical domain model is a domain of a lowest concept which matches with a main act corresponding to a first utterance element indicating an executing instruction, and a parameter corresponding to a second utterance element indicating an object, among the utterance elements converted into the LSP formats, and

the extended domain of the hierarchical domain is a virtual extended domain which is a superordinate concept of the candidate domain.

7. The voice recognition apparatus of claim 4, further comprising a communicator configured to communicate with a display apparatus,

wherein the controller is configured to transmit a response information informing about a untransmittable message, to the display apparatus, in response to the OOD area being determined, generate the response information regarding the uttered voice based on the domain determined as the final domain, and control the communicator to transmit the response information to the display apparatus.

8. A voice recognition method performed by a processor, the method comprising:

extracting utterance elements from an uttered voice of a user;

converting the extracted utterance elements into lexico-semantic pattern (LSP) formats;

determining whether an utterance element related to an Out Of Vocabulary (OOV) exists among the utterance elements converted into the LSP formats with reference to vocabulary list information comprising pre-registered vocabularies; and

determining an Out Of Domain (OOD) area in which it is impossible to provide response information in response to the uttered voice, in response to determining that the utterance element related to the OOV exists.

9. The method of claim 8, wherein the determining whether the utterance element related to the OOV exists comprises:

determining the utterance element, among the utterance elements converted into the LSP formats, which is absent in the pre-registered vocabularies, as the utterance element of the OOV.

10. The method of claim 8, wherein the vocabulary list information further comprises reliability values which are set based on a frequency of use of respective pre-registered vocabularies, and the determining whether the utterance element related to the OOV exists comprises:

determining the utterance element, among the utterance elements converted into the LSP formats, which is related to a respective pre-registered vocabulary having a reliability value less than a threshold value, as the utterance element of the OOV.

11. The method of claim 8, further comprising:

determining a final domain for providing response information in response to the uttered voice based on the utterance elements converted into the LSP formats, in response to an absence of the utterance element related to the OOV among the utterance elements converted into the LSP formats.

12. The method of claim 11, wherein the determining the final domain comprises:

determining whether an extended domain, which is a domain of a higher level of a hierarchical domain model and relates to the utterance elements converted into the LSP formats, is present;

determining a candidate domain, which is a domain of a lower level of the hierarchical domain model and relates to the extended domain, as the final domain, in response to the extended domain being present, and

determining the candidate domain of the lower level which relates to the utterance elements converted into the LSP formats, as the final domain, in response to the extended domain being absent.

13. The method of claim 12, wherein the candidate domain of the hierarchical domain model is a domain of a lowest concept which matches with a main act corresponding to a first utterance element indicating an executing instruction, and a parameter corresponding to a second utterance element indicating an object from among the utterance elements converted into the LSP formats, and

the extended domain of the hierarchical domain model is a virtual extended domain which is a superordinate concept of the candidate domain.

14. The method of claim 11, further comprising:

transmitting a response information informing of a untransmittable message to a display, in response to the OOD area being present in the uttered voice, and

generating the response information regarding the uttered voice based on the final domain and transmitting the response information to the display, in response to the final domain being determined.

15. A voice recognition apparatus comprising:

a display; and

a processor which is configured to determine whether voice of a user contains words which are non-matchable to content providing domains by;

extracting utterance elements from the voice;

converting the extracted utterance elements into lexico-semantic pattern (LSP) formats;

determining a presence of an Out Of Vocabulary (OOV) utterance element, among the converted utterance elements, based on pre-registered vocabularies;

determining that the voice contains an Out Of Domain (OOD) area which is non-matchable with the content providing domains, in response to the presence of the OOV utterance element; and

providing a message informing the user of the non-matchable word present in the voice of the user.

16. The voice recognition apparatus of claim 15, wherein the processor is further configured to determine the presence of the OOV utterance element in response to the converted utterance element being absent in the pre-registered vocabularies or in response to the converted utterance element being present in one of the pre-registered vocabularies and having been assigned a reliability value lower than a threshold.

17. The voice recognition apparatus of claim 15, wherein the processor is further configured to determine a final content providing domain corresponding to the voice from the converted utterance elements, in response to an absence of the OOV utterance element, by matching the converted utterance elements to the available content providing domains.

18. The voice recognition apparatus of claim 17, wherein the content providing domains comprise at least one of a television (TV) channel, a TV program, and a video on demand (VOD).