SMART HOME CONTROL METHOD BASED ON EMOTION RECOGNITION AND THE SYSTEM THEREOF

• US 20170270922A1
• Filed: 01/06/2016
• Published: 09/21/2017
• Est. Priority Date: 11/18/2015
• Status: Active Grant

• Current Assignee: Skyworth Electronics Incorporated (Skyworth Group Ltd.)
• Original Assignee: Skyworth Electronics Incorporated (Skyworth Group Ltd.)
• Inventors: FU, Chunyuan
• Granted Patent: US 10,013,977 B2
• Time in Patent Office: Days
• CPC Class Codes: G05B 2219/2642 Domotique, domestic, home control, automation, smart house
• CPC Class Codes: G06F 40/242 Dictionaries
• CPC Class Codes: G06F 40/30 Semantic analysis
• CPC Class Codes: G10L 15/1815 Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 17/06 Decision making techniques; Pattern matching strategies
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 25/63 for estimating an emotional state

Abstract

The present invention discloses a smart home control method based on emotion recognition and the system thereof, wherein, the method comprises: acquiring a user'"'"'s voice information before performing an emotion recognition for a speech tone on the voice information and generating a first emotion recognition result; after converting the said voice information into a text information, performing an emotion recognition for a semantics of the said text information before generating a second emotion recognition, result; based on the said first emotion recognition result and the said second emotion recognition result, a user'"'"'s emotion recognition result is generated according to a preset determination method for emotion recognition result; also, based on the said user'"'"'s emotion recognition result, each smart home device is controlled to perform a corresponding operation. Automatically controlling the smart home devices through analyzing the user'"'"'s current mood, and changing a surrounding environment, it owns a relatively good intelligence degree. Additionally, it adopts an integrated method of combining the speech tone recognition method and the semantic emotion analysis method together to further improve an accuracy of the emotion recognition.

Claims

3-1. The smart home control method based on emotion recognition according to claim 12, wherein, the method further comprises:

when the first emotion recognition result is a commendatory emotion, while the second emotion recognition result is a derogatory emotion, or when the first emotion recognition result is a derogatory emotion, while the second emotion recognition result is a commendatory emotion, recollecting the voice information of the current user;

redoing the speech tone analysis and semantic emotion analysis for the current user'"'"'s voice information, and generating a new first emotion recognition result and a new second emotion recognition result.

7. A smart home control method based on emotion recognition, wherein, the method comprises:

acquiring a voice information from a user, before performing an emotion recognition for a speech tone of the voice information and generating a first emotion recognition result;

converting the voice information into a text information, then performing an emotion recognition for a semantics of the text information before generating a second emotion recognition result;

based on the first emotion recognition result and the second emotion recognition result, a user'"'"'s emotion recognition result is generated according to a preset determination method for emotion recognition result;

also, based on the user'"'"'s emotion recognition result, each smart home device is controlled to perform a corresponding operation;

after converting the voice information into a text information, the step of performing an emotion recognition for a semantics of the text information before generating a second emotion recognition result, comprises specifically;

selecting a plurality of commendatory words acting as seeds and a plurality of derogatory words acting as seeds, before generating an emotion dictionary;

calculating a similarity between the words in the text information and the commendatory-seed-words together with the derogatory-seed-words in the emotion dictionary, respectively;

generating the second emotion recognition result through a preset emotion recognition method for semantics, according to the word similarity.

1. A smart home control method based on emotion recognition, wherein, the method comprises:

acquiring a voice information from a user, before performing an emotion recognition for a speech tone on the voice information and generating a first emotion recognition result;

converting the voice information into a text information, then performing an emotion recognition for a semantics of the text information before generating a second emotion recognition result;

based on the first emotion recognition result and the second emotion recognition result, a user'"'"'s emotion recognition result is generated according to a preset determination method for emotion recognition result;

also, based on the user'"'"'s emotion recognition result, each smart home device is controlled to perform a corresponding operation.

2. The smart home control method based on emotion recognition as claimed in claim 1, wherein, the step of:

acquiring a voice information from a user, before performing an emotion recognition for a speech tone on the voice information and generating a first emotion recognition result, comprises specifically;

after obtaining a user'"'"'s voice information, the speech tones of the voice information is matched according to a Chinese emotional speech database for the detection of emotion variations, and the first emotion recognition result is then generated.

3. The smart home control method based on emotion recognition according to claim 1, wherein, after the step of:

based on the first emotion recognition result and the second emotion recognition result, a user'"'"'s emotion recognition result is generated according to a preset determination method for emotion recognition result;

also, based on the user'"'"'s emotion recognition result, control each smart home device to perform the corresponding operation it further comprises;

based on a preset database for speech feathers, matching the semantic feature of the user'"'"'s voice information to determine a user'"'"'s identity.

4. The smart home control method based on emotion recognition according to claim 1, wherein, the first emotion recognition result comprises five levels of emotion types including a high-level commendatory emotion, a low-level commendatory emotion, a neutral emotion, and a high-level derogatory emotion, as well as a low-level derogatory emotion;

the emotion types included in the second emotion recognition result are the same as that included in the first emotion recognition result.

5. The smart home control method based on emotion recognition according to claim 4, wherein, the method further comprises:

when the first emotion recognition result is a commendatory emotion, while the second emotion recognition result is a derogatory emotion or when the first emotion recognition result is a derogatory emotion, while the second emotion recognition result is a commendatory emotion, recollecting the voice information of the current user;

redoing the speech tone analysis and semantic emotion analysis for the current user'"'"'s voice information, and generating a new first emotion recognition result and a new second emotion recognition result.

6. The smart home control method based on emotion recognition according to claim 4, wherein, the preset emotion recognition result determination method comprises specifically:

when the first emotion recognition result and the second, emotion recognition result have different levels of commendatory emotion, determining the current user emotion recognition result as a low level commendatory emotion;

when the first emotion recognition result and the second emotion recognition result are different levels of derogatory emotion, determining the current user emotion recognition result as a low level derogatory emotion;

when one of the first emotion recognition result and the second emotion recognition result is a neutral emotion, while the other is a derogatory or commendatory emotion, determining the current user emotion recognition result as the said commendatory or derogatory emotion.

8. The smart home control method based on emotion recognition as claimed in claim 7, wherein, the step of calculating a similarity between the words in the text information and the commendatory-seed-words together with the derogatory-seed-words in the emotion dictionary, respectively, comprises specifically:

based on a calculation method for semantic similarity, calculating respectively the word similarity between the words in the text information and the commendatory-seed-words, as well as the word similarity between the words in the text information and the derogatory-seed-words.

9. The smart home control method based on emotion recognition according to claim 8, wherein, the step of:

generating the second emotion recognition result through a preset emotion recognition method for semantics, according to the word similarity, comprises specifically;

Calculating a word emotion tendency value through a word emotion to tendency calculation formula;

10. The smart home control method based on emotion recognition according to claim 7, wherein, the step of:

acquiring a voice information from a user, before performing an emotion recognition for a speech tone on the voice information and generating a first emotion recognition result, comprises specifically;

after acquiring a voice information of the user, based on a Chinese emotional speech database for the detection of emotion variations, the voice intone of the said voice information is matched and thereby the first emotion recognition result is generated.

11. The smart home control method based on emotion recognition according to claim 7, wherein, after the step of:

based on the first emotion recognition result and the second emotion recognition result, a user'"'"'s emotion recognition result is generated according to a preset determination method for emotion recognition result;

also, based on the user'"'"'s emotion recognition result, control each smart home device to perform the corresponding operation, it further comprises;

based on a preset database for speech feathers, matching the semantic feature of the user'"'"'s voice information to determine an identity of the user.

12. The smart home control method based on emotion recognition according to claim 7, wherein, the first emotion recognition result comprises five levels of emotion types including a high-level commendatory emotion and a low-level commendatory emotion, a neutral emotion, as well as a high-level derogatory emotion and a low-level derogatory emotion;

the emotion type included in the second emotion recognition result are the same as that included in the first emotion recognition result.

14. The smart home control method based on emotion recognition according to claim 12, wherein, the preset emotion recognition result determination method comprises specifically:

when the first emotion recognition result and the second emotion recognition result are different levels of commendatory emotion, determining the current user emotion recognition result as a low level commendatory emotion;

when the first emotion recognition result and the second emotion recognition result are different levels of derogatory emotion, determining the current user emotion recognition result as a low level derogatory emotion;

when one of the first emotion recognition result and the second emotion recognition result is a neutral emotion, and the other is a derogatory or commendatory emotion, determining the current user emotion recognition result as the said commendatory or derogatory emotion.

15. A smart home control system based on emotion recognition, wherein, the control system comprises:

a first recognition and acquisition module, applied to acquiring a voice information from a user, generating the first emotion recognition result r the speech tone emotion recognition to the voice information;

a second recognition and acquisition module, applied to converting the voice information into text information;

then generating the second emotion recognition result after the semantic emotion recognition to the text information;

a comprehensive emotion determination and control module, applied to generating the user emotion recognition result according to a preset determination method for emotion recognition result, based on the first emotion recognition result and the second emotion recognition result, and controlling each smart home device to perform the corresponding operation according to the user'"'"'s emotion cognition result.