ELECTRONIC APPARATUS AND METHOD FOR CONTROLLING THE ELECTRONIC APPARATUS

• US 20180005625A1
• Filed: 05/09/2017
• Published: 01/04/2018
• Est. Priority Date: 06/29/2016
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: HAN, Jeong-ho
• Granted Patent: US 10,276,151 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 2203/011 Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06T 7/215 Motion-based segmentation
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: G10L 15/02 Feature extraction for speech recognition; Selection of recognition unit
• CPC Class Codes: G10L 15/06 Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice G10L15/14 takes precedence
• CPC Class Codes: G10L 15/065 Adaptation
• CPC Class Codes: G10L 15/07 to the speaker
• CPC Class Codes: G10L 15/14 using statistical models, e.g. Hidden Markov Models [HMMs] G10L15/18 takes precedence
• CPC Class Codes: G10L 15/20 Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech G10L21/02 takes precedence
• CPC Class Codes: G10L 2015/227 of the speaker; Human-factor methodology
• CPC Class Codes: G10L 21/01 Correction of time axis
• CPC Class Codes: G10L 25/63 for estimating an emotional state
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/44218 : Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45

Abstract

An electronic apparatus is disclosed. The electronic apparatus includes an input unit configured to receive a user input, a storage configured to store a recognition model for recognizing the user input, a sensor configured to sense a surrounding circumstance of the electronic apparatus, and a processor configured to control to recognize the received user input based on the stored recognition model and to perform an operation corresponding to the recognized user input, and update the stored recognition model in response to determining that the performed operation is caused by a misrecognition based on a user input recognized after performing the operation and the sensed surrounding circumstance.

Claims

1. An electronic apparatus comprising:

an input unit configured to receive a user input;

a storage configured to store a recognition model for recognizing the user input;

a sensor configured to sense a surrounding circumstance of the electronic apparatus; and

a processor configured to control to recognize the received user input based on the stored recognition model and to perform an operation corresponding to the recognized user input, and update the stored recognition model in response to determining that the performed operation is caused by a misrecognition based on a user input recognized after performing the operation and the sensed surrounding circumstance.

2. The electronic apparatus of claim 1, wherein the processor does not update the stored recognition model in response to determining that the user is in a predetermined emotional state according to the user input recognized after performing the operation and that the determined predetermined emotional state is caused by the surrounding circumstance by considering the sensed surrounding circumstance.

3. The electronic apparatus of claim 1, wherein the processor determines that the performed operation is caused by a misrecognition in response to receiving a user command corresponding to another control means which is different from the received user input within a predetermined time after performing the operation.

4. The electronic apparatus of claim 1, wherein the processor determines whether a plurality of operations are caused by a misrecognition in response to the plurality of operations being consecutively performed according to a user input within a predetermined time interval.

5. The electronic apparatus of claim 1, wherein the processor determines whether a plurality of operations are caused by a misrecognition in response to the plurality of operations being consecutively performed according to a user input within a predetermined time interval and determining that a degree of a certain emotion of the user gradually increases based on the user input recognized while the plurality of operations are performed.

6. The electronic apparatus of claim 1, wherein the sensor senses at least one of temperature, humidity and noise.

7. The electronic apparatus of claim 1, further comprising:

a communication interface configured to communicate with an external display apparatus,

wherein the processor transmits an image corresponding to the recognized user input to the external display apparatus through the communication interface.

8. The electronic apparatus of claim 1, further comprising:

a display configured to display an image corresponding to the recognized user input,

wherein the processor determines whether the performed operation is caused by a misrecognition by further considering a type of an image being displayed through the display.

9. The electronic apparatus of claim 1, wherein the processor updates the stored recognition model based on information on an operation that is determined as an operation caused by a misrecognition.

10. The electronic apparatus of claim 1, wherein the storage stores recognition models for a plurality of users, each of the recognition models corresponding to a user of the plurality of users,

wherein the processor determines a user corresponding to the received user input, and updates a recognition model corresponding to the determined user among the stored recognition models in response to determining that the operation performed according to the received user input is caused by a misrecognition.

11. The electronic apparatus of claim 1, wherein the input unit comprises at least one of a photographing unit which photographs a user and a microphone which receives a user voice.

12. A control method for controlling an electronic apparatus, the method comprising:

receiving a user input;

recognizing the received user input based on a recognition model for recognizing a user input which is pre-stored in the electronic apparatus and performing an operation corresponding to the recognized user input;

sensing a surrounding circumstance of the electronic apparatus;

determining whether the performed operation is caused by a misrecognition based on a user input recognized after performing the operation and the sensed surrounding circumstance; and

updating the stored recognition model in response to determining that the performed operation is caused by a misrecognition.

13. The method of claim 12, wherein the determining comprises determining that the performed operation is not caused by a misrecognition in response to determining that the user is in a predetermined emotional state according to the user input recognized after performing the operation and that the determined predetermined emotional state is caused by the surrounding circumstance by considering the sensed surrounding circumstance.

14. The method of claim 12, wherein the determining comprises determining that the performed operation is caused by a misrecognition in response to receiving a user command corresponding to a control means which is different from the received user input within a predetermined time after performing the operation.

15. The method of claim 12, wherein the determining comprises determining whether a plurality of operations are caused by a misrecognition in response to the plurality of operations being consecutively performed within a predetermined time interval.

16. The method of claim 12, wherein the determining comprises determining whether a plurality of operations are caused by a misrecognition in response to the plurality of operations being consecutively performed according to a user input within a predetermined time interval and determining that a degree of a certain emotion of the user gradually increases based on the user input recognized while the plurality of operations are performed.

17. The method of claim 12, wherein the performing an operation corresponding to the recognized user input comprises displaying an image corresponding to the recognized user input through a display of the electronic apparatus.

18. The method of claim 12, wherein the determining comprises determining whether the performed operation is caused by a misrecognition by further considering a type of an image being displayed through a display of the electronic apparatus.

19. The method of claim 12, wherein the updating the stored recognition model comprises updating the stored recognition model based on information on an operation determined as an operation caused by a misrecognition.

20. A non-transitory recording medium in which a program for performing a control method for controlling an electronic apparatus is stored, the method comprising:

receiving a user input;

recognizing the received user input based on a recognition model for recognizing a user input which is pre-stored in the electronic apparatus and performing an operation corresponding to the recognized user input;

sensing a surrounding circumstance of the electronic apparatus;

determining whether the performed operation is caused by a misrecognition based on a user input recognized after performing the operation and the sensed surrounding circumstance; and

updating the stored recognition model in response to determining that the performed operation is caused by a misrecognition.