METHOD FOR CONTROLLING ELECTRONIC APPARATUS BASED ON VOICE RECOGNITION AND MOTION RECOGNITION, AND ELECTRONIC APPARATUS APPLYING THE SAME

• US 20130035941A1
• Filed: 08/06/2012
• Published: 02/07/2013
• Est. Priority Date: 08/05/2011
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: KIM, Jung-geun, KIM, Yoo-tai, YU, Seung-dong, HAN, Sang-jin, RYU, Hee-seob
• Application Number:
  US13/567,485
• Publication Number:
  US 20130035941A1
• Time in Patent Office: Days
• US Class Current: 704/275
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04895 Guidance during keyboard input operation, e.g. prompting
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/431 Generation of visual interfaces for content selection or interaction; Content or additional data rendering

Abstract

An electronic apparatus and a method for controlling thereof are provided. The method recognizes one of among a user voice and a user motion through one of among a voice recognition module and a motion recognition module, and if a user voice is recognized through the voice recognition module, performs a voice task corresponding to the recognized user voice, and, if a user motion is recognized through the motion recognition module, performs a motion task corresponding to the recognized user motion.

Claims

1. A method for controlling an electronic apparatus, the method comprising:

recognizing one of among a user voice and a user motion through one of among a voice recognition module and a motion recognition module;

performing a voice task in response to a user voice recognized through the voice recognition module; and

performing a motion task in response to a user motion recognized through the motion recognition module,

wherein the voice task comprises an operation corresponding to one of a plurality of buttons of a remote control apparatus, and

wherein the motion task comprises an operation corresponding to one of the plurality of buttons of the remote control apparatus.

2. The method as claimed in claim 1, wherein the voice task and the motion task are mapped with different buttons on the remote control apparatus, respectively.

3. The method as claimed in claim 1, wherein the voice task comprises at least one of among a channel change and a mute,

wherein the motion task comprises at least one of among a channel change and a volume level change.

4. The method as claimed in claim 3, wherein the voice task comprises channel change to a channel corresponding to a channel identifier included in the user voice,

wherein the channel identifier comprises at least one of among a channel number, a channel name, and a program name.

5. The method as claimed in claim 3, wherein the user motion comprises one of among a slap motion in a vertical direction and a slap motion in a horizontal direction,

wherein the motion task comprises the channel change in response to the slap motion in the vertical direction, and

wherein the motion task comprises the volume level change in response to the slap motion in the horizontal direction.

6. The method as claimed in claim 5, wherein the user motion comprises one of among a slap motion in an upward direction, a slap motion in a downward direction, a slap motion in a leftward direction, and a slap motion in a rightward direction,

wherein the motion task comprises increasing a broadcast channel by a predetermined number in response to the slap motion in the upward direction,

wherein the motion task comprises increasing a broadcast channel by the predetermined number in response to the slap motion in the downward direction,

wherein the motion task comprises a volume level increase by a predetermined amount in response to the slap motion in the rightward direction, and

wherein the motion task comprises a volume level decrease by the predetermined amount in response to the slap motion in the leftward direction.

7. The method as claimed in claim 1, wherein the voice task comprises an operation corresponding to a number button included in the remote control apparatus,

wherein the motion task is an operation corresponding to at least one of among a volume up button, a volume down button, a channel up button, and a channel down button included in the remote control apparatus.

8. The method as claimed in claim 1, further comprising:

displaying a plurality of voice tasks in response to the user voice; and

displaying a plurality of motion tasks in response to the user motion.

9. The method as claimed in claim 8, wherein the plurality of voice tasks and the plurality of motion tasks are displayed on a same area of a display screen.

10. The method as claimed in claim 1, further comprising storing, in a storage unit, a plurality of modules to perform a plurality of voice tasks and a plurality of motion tasks.

11. The method as claimed in claim 1, wherein each of the voice task and the motion task independently changes a setting of the electronic apparatus.

12. A method for controlling an electronic apparatus, the method comprising:

changing a mode to a voice task mode in response to a voice start command recognized through a voice recognition module; and

changing a mode to a motion task mode in response to a motion start command recognized through a motion recognition module,

wherein the voice task mode comprises a mode in which the electronic apparatus is controlled according to user voice recognized through the voice recognition module, and

wherein the motion task mode comprises a mode in which the electronic apparatus is controlled according to user motion recognized through the motion recognition module.

13. A method for controlling an electronic apparatus which is capable of voice recognition and motion recognition, the method comprising:

displaying one of among a voice user interface (UI) comprising a plurality of voice commands and a motion UI comprising a plurality of motion gestures;

performing a voice task in response to one of the plurality of voice commands; and

performing a motion task in response to one of the plurality of motion gestures.

14. A method for controlling an electronic apparatus, the method comprising:

receiving a plurality of video channels, each of the plurality of channels respectively comprising at least one channel identifier;

displaying a current video channel of the plurality of video channels;

recognizing one of among a user voice and a user motion through one of among a voice recognition module and a motion recognition module; and

changing the current video channel in response to the user voice; and

changing the current video channel in response to the user motion,

wherein the changing the current video channel in response to the user voice comprises selecting the video channel of the plurality of video channels comprising the channel identifier corresponding to the user voice,

wherein the changing the current video channel in response to the user motion comprises changing the current video channel in a direction corresponding to a direction of the user motion.

15. The method as claimed in claim 14, wherein the user voice comprises a number, and

wherein the changing the current video channel in response to the user voice comprises selecting the video channel of the plurality of video channels having a channel number corresponding to the number.

16. The method as claimed in claim 14, wherein the user motion comprises one of among a slap motion in an upward direction and a slap motion in a downward direction, and

wherein the changing the current video channel in response to the user motion comprises incrementally changing a number of the current video channel in the direction corresponding to the user motion.

17. A method for controlling an electronic apparatus capable of voice recognition and motion recognition, the method comprising:

recognizing a voice start command through a voice recognition module;

displaying, on a display unit, a plurality of voice commands to perform voice tasks controlled by the voice recognition in response to the voice start command;

recognizing a motion start command through a motion recognition module; and

displaying, on the display unit, a plurality of motion gestures to perform motion tasks controlled by the motion recognition in response to the motion start command.

18. A method for controlling an electronic apparatus capable of voice recognition and motion recognition, the method comprising:

recognizing, by a motion recognition module, a motion start command;

displaying, by a display unit, a plurality of motion gestures to perform a motion tasks in response to the recognized motion start command; and

recognizing, by a voice recognition module, a voice start command; and

displaying, by the display unit, a plurality of voice commands to perform voice tasks in response to the voice start command.

19. An electronic apparatus comprising:

a voice input unit which receives input of a user voice;

a motion input unit which receives input of a user motion; and

a controller which performs a voice task in response to the user voice and performs a motion task in response to the user motion,

wherein the voice task comprises an operation corresponding to one of a plurality of buttons of a remote control apparatus, and

wherein the motion task comprises an operation corresponding to one of the plurality of buttons of the remote control apparatus.

20. The electronic apparatus as claimed in claim 19, wherein the voice task comprises at least one of among a channel change and a mute,

wherein the motion task comprises at least one of among a channel change and a volume level change.

21. An electronic apparatus comprising:

a voice input unit which receives input of a voice start command;

a motion input unit which receives input of a motion start command; and

a controller which changes a mode to a voice task mode in response to the voice start command and changes the mode to a motion task mode in response to the motion start command,

wherein the voice task mode comprises a mode in which the electronic apparatus is controlled according to user voice recognized through the voice recognition module, and

wherein the motion task mode comprises a mode in which the electronic apparatus is controlled according to user motion recognized through the motion recognition module.

22. An electronic apparatus capable of voice recognition and motion recognition, comprising:

a voice input unit which receives input of a user voice for the voice recognition;

a motion input unit which receives input of a user motion for the motion recognition;

a display unit which displays one of among a voice user interface (UI) comprising a plurality of voice commands and a motion UI comprising a plurality of motion gestures; and

a controller which performs a voice task in response to one of the plurality of voice commands and performs a motion task in response to one of the plurality of motion gestures.

23. An electronic apparatus comprising:

a video input unit which receives a plurality of video channels, each of the plurality of channels respectively comprising at least one channel identifier;

a display unit which displays a current video channel of the plurality of video channels;

a voice input unit which receives input of a user voice;

a motion input unit which receives input of a user motion; and

a controller which recognizes one of among the user voice and the user motion, performs changes the current channel in response to the user voice, and changes the current channel in response to the user motion,

wherein the changing the current video channel in response to the user voice comprises selecting the video channel of the plurality of video channels comprising the channel identifier corresponding to the user voice,

wherein the changing the current video channel in response to the user motion comprises changing the current video channel in a direction corresponding to a direction of the user motion.

24. An electronic apparatus capable of voice recognition and motion recognition, comprising:

a display unit;

a voice input unit which receives input of a user voice;

a motion input unit which receives input of a user motion; and

a controller which controls the display unit, the voice input unit, and the motion input unit,

wherein the controller recognizes a voice start command input through the voice input unit, recognizes a motion start command input through the motion input unit, controls the display unit to display a plurality of voice commands to perform voice tasks controlled by the voice recognition in response to the voice start command, and changes a mode to a motion task mode in which operations are performed by motion recognition in response to the motion start command.

25. An electronic apparatus capable of voice recognition and motion recognition, comprising:

a display unit;

a voice input unit which receives input of a user voice;

a motion input unit which receives input of a user motion; and

a controller which controls the display unit, the voice input unit, and the motion input unit,

wherein the controller controls the display unit to display a plurality of motion gestures corresponding to motion tasks in response to a motion start command input through the motion input unit, and controls the display unit to display a plurality of commands corresponding to voice tasks in response to a voice start command input through the voice input unit.