METHOD AND APPARATUS FOR CONTROLLING APPLICATION BY HANDWRITING IMAGE RECOGNITION

• US 20140019905A1
• Filed: 07/12/2013
• Published: 01/16/2014
• Est. Priority Date: 07/13/2012
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: KIM, Hwa-Kyung, KIM, Sung-Soo, BAE, Joo-Yoon, JUN, Jin-Ha, CHA, Sang-Ok
• Application Number:
  US13/940,962
• Publication Number:
  US 20140019905A1
• Time in Patent Office: Days
• US Class Current: 715/780
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32

Abstract

A method and an apparatus for controlling an application by handwriting image recognition are provided. The method includes displaying an executed application on a touch panel, detecting a predefined user input, displaying a memo window including a handwriting input area and a non-handwriting input area over the application in response to the detected the user input, receiving and recognizing a handwriting image in the handwriting input area of the memo window, and controlling a function of the application according to a recognized result.

Claims

1. A method for controlling an application in an electronic device having a touch panel, the method comprising:

displaying an executed application on the touch panel;

detecting a predefined user input;

displaying a memo window over the application in response to the detected user input, wherein the memo window includes a handwriting input area and a non-handwriting input area;

receiving a handwriting image in the handwriting input area of the memo window; and

recognizing the received handwriting image.

2. The method of claim 1, wherein the user input is one of a gesture on the touch panel, a touch on a virtual button in the touch panel, and a user selection of a physical button.

3. The method of claim 1, wherein at least one of a text and an image received from the application are displayed in the non-handwriting input area of the memo window.

4. The method of claim 3, wherein, when a touch on the non-handwriting input area is detected, the memo window recognizes the handwriting image input to the handwriting input area, converts the recognized handwriting image to text matching the handwriting image, and provides the text to the application.

5. The method of claim 4, further comprising:

separating the text received from the memo window into a command for controlling the function of the application and data related to the command by the application.

6. A method for controlling an application in an electronic device having a touch panel, the method comprising:

displaying a graphic object representing information related to an executed application and a button for controlling a function of the application on the touch panel;

controlling the function of the application corresponding to the button, upon detection of a touch on the button;

displaying a memo window over at least one of the graphic object and the button on the touch panel, upon detection of a predefined input on the touch panel, the memo window including a handwriting input area and a non-handwriting input area;

receiving a handwriting image in the handwriting input area of the memo window;

recognizing the received handwriting image; and

controlling a function of the application according to a recognized result.

7. The method of claim 6, wherein at least one of a text and an image received from the application are displayed in the non-handwriting input area of the memo window.

8. The method of claim 7, wherein, when a touch on the text and the image is detected, the memo window recognizes the handwriting image input to the handwriting input area, converts the recognized handwriting image to text matching the handwriting image, and provides the text to the application.

9. The method of claim 6, wherein, when the memo window is displayed over the button, the button is deactivated.

10. A method for controlling an application in an electronic device having a touch panel, the method comprising:

controlling a function of an executed application, upon detection of a touch input in a first mode; and

identifying a predefined input on the touch panel during execution of the application in progress, displaying a memo window that allows a handwriting input over the application according to the identified input, recognizing a handwriting image input to the memo window, and controlling a function of the executed application according to the recognized handwriting image in a second mode.

11. The method of claim 10, wherein the first mode is deactivated in the second mode.

13. The electronic device of claim 11, wherein the controller controls display of at least one of a text and an image received from the application in the non-handwriting input area of the memo window.

14. The electronic device of claim 13, wherein, upon detecting a touch on the non-handwriting area, the controller recognizes the handwriting image input to the handwriting input area, converts the recognized handwriting image to text matching the handwriting image, and controls a function of the application corresponding to the text.

15. The electronic device of claim 14, wherein the controller separates the text into a command for controlling the function of the application and data related to the command.

12. An electronic device comprising:

a touch panel for detecting a touch; and

a controller for displaying an executed application on the touch panel, for displaying a memo window over the application in response to a predefined input detected from the touch panel, wherein the memo window includes a handwriting input area and a non-handwriting input area, for recognizing a handwriting image to the handwriting input area of the memo window, and for controlling a function of the application according to a recognized result.

16. An electronic device comprising:

a touch panel for detecting a touch; and

a controller for displaying a graphic object representing information related to an executed application and a button for controlling a function of the application on the touch panel, for controlling the function of the application corresponding to the button, upon detection of a touch on the button, for displaying a memo window over at least one of the graphic object and the button on the touch panel, upon detection of a predefined input on the touch panel, wherein the memo window includes a handwriting input area and a non-handwriting input area, for recognizing a handwriting image input to the handwriting input area of the memo window, and for controlling execution of a function of the application according to a recognized result.

17. The electronic device of claim 16, wherein the controller controls display of at least one of a text and an image received from the application in the non-handwriting input area of the memo window.

18. The electronic device of claim 17, wherein, upon detecting a touch on the text and the image, the controller recognizes the handwriting image input to the handwriting input area, converts the recognized handwriting image to text matching the handwriting image, and controls a function of the application corresponding to the text.

19. The electronic device of claim 16, wherein, when the memo window is displayed over the button, the controller controls deactivation of the button.

20. An electronic device comprising:

a touch panel for detecting a touch; and

a controller for operating in a first mode in which the controller controls a function of an executed application, upon detection of a touch input, and for operating in a second mode in which the controller identifies a predefined input on the touch panel during execution of the application in progress, displays a memo window that allows a handwriting input over the application according to the identified input, recognizes a handwriting image input to the memo window, and controls a function of the executed application according to the recognized handwriting image.

21. An electronic device comprising:

a touch panel for detecting a touch; and

a controller for displaying a graphic object representing information related to an executed application and a button for controlling a function of the application on the touch panel, for controlling execution of the function of the application corresponding to the button, upon detection of a touch on the button, for displaying a memo window allowing a handwriting input over a screen displaying the graphic object and the button on the touch panel, upon detection of a predefined input on the touch panel, for recognizing a handwriting image input to the memo window, and for controlling execution of a function of the application according to a recognized result.