METHOD AND APPARATUS FOR PROCESSING MULTIPLE INPUTS

• US 20140006033A1
• Filed: 05/16/2013
• Published: 01/02/2014
• Est. Priority Date: 06/29/2012
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: JUNG, Howon, Kim, Woomok, Kim, Taehyung, Choi, Yoonjung
• Granted Patent: US 9,286,895 B2
• Time in Patent Office: Days
• US Class Current: 704/275
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue

Abstract

A method of processing multiple inputs in an apparatus having interfaces for interaction with an outside is provided. The method includes detecting a first user input from one of the interfaces, performing a function in response to the first user input, detecting a second user input or a system input from another one of the interfaces, and changing attributes of the function in response to the second user input or the system input.

Claims

1. A method of processing multiple inputs in an apparatus having interfaces for interaction with an outside, the method comprising:

detecting a first input from one of the interfaces;

performing a function in response to the first input;

detecting a second input from another one of the interfaces; and

changing attributes of the function in response to the second input.

2. The method of claim 1, wherein detecting the first input includes detecting a user'"'"'s gesture from a touch screen that is one of the interfaces, wherein performing the function includes performing a function related with a graphic work in response to the user'"'"'s gesture, and wherein detecting the second input includes detecting voice information from a microphone that is one of the interfaces.

3. The method of claim 2, wherein the graphic work is one of handwriting, drawing, painting and erasing.

4. The method of claim 3, wherein changing the attributes of the function includes:

recognizing the user'"'"'s intention by analyzing the voice information;

determining whether correction is needed for an already performed graphic work;

calculating a correction-required portion in the already performed graphic work if correction is needed; and

reflecting the user'"'"'s intention on the correction-required portion.

5. The method of claim 4, wherein determining whether the correction is needed includes determining that correction is needed in the already performed graphic work if the user'"'"'s gesture and the voice information are simultaneously detected.

6. The method of claim 5, wherein calculating the correction-required portion includes including a portion performed for a time period for recognizing the user'"'"'s intention from the already performed graphic work, in the correction-required portion.

7. The method of claim 1, wherein the first input is a first user input and the second input is one of a second user input and a system input.

8. The method of claim 7, wherein the first user input is one of a user'"'"'s gesture, voice information input through a microphone, and motion information sensed in a sensor unit,

wherein the second user input is another one of the user'"'"'s gesture, the voice information input through the microphone, and the motion information sensed in the sensor unit, and

wherein the system input is information related with an external environment of the apparatus.

9. An apparatus for processing multiple inputs, the apparatus comprising:

interfaces for interaction with an outside environment; and

a controller for controlling the interfaces,

wherein the controller detects a first input from one of the interfaces, performs a function in response to the first input, detects a second input from another one of the interfaces, and changes attributes of the function in response to the second input.

10. The apparatus of claim 9, wherein the interfaces include at least a touch screen and a microphone, and

wherein the controller performs a function related with a graphic work in response to a user'"'"'s gesture detected from the touch screen, and if voice information is detected from the microphone, the controller changes the attributes of the graphic work.

11. The apparatus of claim 10, wherein the touch screen includes a hand touch panel for sensing a hand gesture, a pen touch panel for sensing a pen gesture, and a display panel.

12. The apparatus of claim 11, wherein the graphic work is one of handwriting, drawing, painting and erasing by the pen gesture or the hand gesture.

13. The apparatus of claim 12, wherein the controller recognizes a user'"'"'s intention by analyzing the voice information, determines whether correction is needed for an already performed graphic work, and if correction is needed, the controller calculates a correction-required portion from the graphic work and reflects the user'"'"'s intention on the correction-required portion.

14. The apparatus of claim 13, wherein the controller determines that correction is needed for the already performed graphic work if the user'"'"'s gesture and the voice information are simultaneously detected.

15. The apparatus of claim 14, wherein the correction-required portion includes a portion performed for a time period for recognizing the user'"'"'s intention from the already performed graphic work, in the correct-required portion.

16. The apparatus of claim 12, wherein the first input is a first user input, and wherein the second input is one of a second user input and a system input.

17. The apparatus of claim 16, further comprising:

a wireless communication unit connectable to a voice recognition server,

wherein the controller controls the wireless communication unit to transmit a voice recognition request message including the voice information to the wireless communication unit, receives a response message including a result of processing a voice information from the voice recognition server through the wireless communication unit, determines whether correction is needed for an already performed graphic work, calculates a correction-required portion from the graphic work if the correction is needed, and reflects the result on the correction-required portion.

18. A non-transitory recording medium implemented in an apparatus having interfaces for interaction with an outside environment, the recording medium configured to perform a method comprising:

detecting a first input from one of the interfaces;

performing a function in response to the first input;

detecting a second input from another one of the interfaces; and

changing the attributes of the function in response to the second input.

19. The non-transitory recording medium of claim 18, wherein the first input is a first user input and the second input is a second user input.

20. The non-transitory recording medium of claim 18, wherein the first input is a first user input and the second input is a system input.