Method for controlling electronic apparatus based on voice recognition and motion recognition, and electronic apparatus applying the same

• US 9,733,895 B2
• Filed: 02/19/2015
• Issued: 08/15/2017
• Est. Priority Date: 08/05/2011
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Han, Sang-jin, Kim, Yoo-tai, Yu, Seung-dong, Kim, Jung-geun, Ryu, Hee-seob
• Primary Examiner(s): MCFADDEN, SUSAN IRIS
• Application Number:
  US14/626,513
• Publication Number:
  US 20150160919A1
• Time in Patent Office: 908 Days
• Field of Search: 704275
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04895 Guidance during keyboard input operation, e.g. prompting
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G08C 2201/31 Voice input
• CPC Class Codes: G08C 2201/32 Remote control based on movements, attitude of remote control device
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/431 Generation of visual interfaces for content selection or interaction; Content or additional data rendering
• CPC Class Codes: H04N 21/439 Processing of audio elementary streams
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/4821 using a grid, e.g. sorted out by channel and broadcast time

Abstract

A method for controlling an electronic apparatus which uses voice recognition, and an electronic apparatus applying the same are provided. The method includes, in response to a voice start command being input through a first microphone included in the electronic apparatus, converting a mode of the electronic apparatus to a first voice task mode and displaying a first icon corresponding to the first voice task mode; in response to the voice start command being input through a second microphone included in a remote control device, converting the mode of the electronic apparatus to a second voice task mode and displaying a second icon corresponding to the second voice task mode; displaying voice guide information; and in response to a user voice being input while the voice guide information is displayed, displaying a list including a plurality of items related to the user voice.

Claims

1. A method for controlling an electronic apparatus, comprising:

in response to a voice start command being input through a first microphone included in the electronic apparatus, converting a mode of the electronic apparatus to a first voice task mode and displaying a first icon corresponding to the first voice task mode;

in response to a voice start command being input through a button included in a remote control device associated with the electronic apparatus, converting the mode of the electronic apparatus to a second voice task mode and displaying a second icon corresponding to the second voice task mode;

displaying voice guide information to perform one of the first voice task mode or the second voice task mode; and

in response to a user voice being input while the voice guide information is displayed, displaying a list including a plurality of items related to the user voice, wherein the user voice is input through the first microphone included in the electronic apparatus while the electronic apparatus is in the first voice task mode, and wherein the user voice is input through a second microphone included in the remote control while the electronic apparatus is in the second voice task mode.

2. The method as claimed in claim 1, further comprising:

in response to a second user voice including one of a plurality of indicators being input, the plurality of indicators corresponding to each of a plurality of items included in the list, executing an item corresponding to an indicator included in the second user voice.

3. The method as claimed in claim 2, wherein the indicator consists of at least one of a number and a character.

4. The method as claimed in claim 1, further comprising:

in response to a second user voice irrelevant to the plurality of items being input, displaying a feedback message including a message for selecting one of the plurality of items.

5. The method as claimed in claim 4, wherein the feedback message is displayed in an area where the voice guide information is displayed.

6. The method as claimed in claim 1, wherein the user voice is for changing a channel, and

wherein the displaying the list comprises displaying the list including a plurality of items corresponding to a plurality of channels related to channel information included in the user voice.

7. The method as claimed in claim 6, wherein the displaying comprises, in response to the user voice including a channel number, displaying the list including the plurality of items corresponding to the plurality of channels including the channel number included in the user voice.

8. An electronic apparatus, comprising:

a display;

a controller configured to;

in response to a voice start command being input through a first microphone included in the electronic apparatus, convert a mode of the electronic apparatus to a first voice task mode and display a first icon corresponding to the first voice task mode,

in response to a voice start command being input through a button included in a remote control device associated with the electronic apparatus, convert the mode of the electronic apparatus to a second voice task mode and display a second icon corresponding to the second voice task mode,

control the display to display voice guide information to perform one of the first voice task mode or the second voice task mode, and

in response to a user voice being input while the voice guide information is displayed on the display, control to display a list including a plurality of items related to the user voice on the display,

wherein the user voice is input through the first microphone included in the electronic apparatus while the electronic apparatus is in the first voice task mode, and

wherein the user voice is input through a second microphone included in the remote control while the electronic apparatus is in the second voice task mode.

9. The apparatus as claimed in claim 8, wherein the controller is further configured to, in response to detecting a second user voice including one of a plurality of indicators corresponding to each of a plurality of items included in the list being input, execute an item corresponding to an indicator included in the second user voice.

10. The apparatus as claimed in claim 9, wherein the indicator consists of at least one from among number and a character.

11. The apparatus as claimed in claim 8, further comprising:

in response to a second user voice irrelevant to the plurality of items being input, displaying a feedback message including a message for selecting one of the plurality of items.

12. The apparatus as claimed in claim 11, wherein the feedback message is displayed in an area where the voice guide information is displayed.

13. The apparatus as claimed in claim 8, wherein the user voice is for changing a channel, and

wherein the controller is further configured to display the list comprising a plurality of items corresponding to a plurality of channels related to channel information included in the user voice.

14. The apparatus as claimed in claim 13, wherein the controller is further configured to, in response to the user voice including a channel number, display the list including the plurality of items corresponding to the plurality of channels including the channel number included in the user voice.