METHOD FOR CONTROLLING USER INTERFACE ACCORDING TO HANDWRITING INPUT AND ELECTRONIC DEVICE FOR IMPLEMENTING THE SAME

• US 20180004406A1
• Filed: 12/09/2016
• Published: 01/04/2018
• Est. Priority Date: 07/04/2016
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: JUNG, In-Hyung, KIM, Sangheon, BAEK, Jong-Wu, KIM, Geon-Soo, LEE, Yohan
• Granted Patent: US 10,671,273 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 10/235 based on user input or interaction
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 30/32 Digital ink
• CPC Class Codes: G06V 30/347 Sampling; Contour coding; Stroke extraction

Abstract

An electronic device and a method of the electronic device is provided. The electronic device includes a touch screen display that displays a user interface, a force sensor that detects a pressure with which an external object touches the touch screen display, a wireless communication circuit, and a processor that controls the touch screen display to display the user interface, receives, from at least one of the force sensor and the wireless communication circuit, data representing that the external object is pressing a portion of the user interface with a pressure greater than or equal to a selected pressure, receives a handwriting input through the touch screen display, and displays the handwriting input on the user interface on the touch screen display.

Claims

1. An electronic device comprising:

a touch screen display that displays a user interface;

a force sensor that detects a pressure with which an external object touches the touch screen display;

a wireless communication circuit; and

a processor that;

controls the touch screen display to display the user interface;

receives, from at least one of the force sensor and the wireless communication circuit, data representing that the external object is pressing a portion of the user interface with a pressure greater than or equal to a selected pressure;

receives a handwriting input through the touch screen display; and

displays the handwriting input on the user interface on the touch screen display.

2. The electronic device of claim 1, wherein the external object comprises a stylus pen.

3. The electronic device of claim 2, wherein the touch screen display comprises a touch panel, and

the electronic device further comprises a panel configured to be separated from the touch panel and detect an input by the stylus pen.

4. The electronic device of claim 1, wherein the user interface is configured to display at least one content among an image, a picture, and video, and

wherein the processor:

receives the data and the handwriting input while displaying the at least one content,

merges the handwriting input with the at least one content, and

stores the merged handwriting input and content.

5. The electronic device of claim 1, wherein the user interface is configured to display an input field to receive a text or image input, and

wherein the processor:

receives the data and the handwriting input while displaying the input field; and

uses the handwriting input as the text or image input in the input field.

6. The electronic device of claim 5, wherein the processor recognizes the handwriting input and converts the handwriting input to text.

7. The electronic device of claim 5, wherein the user interface includes a widget.

8. The electronic device of claim 5, further comprises:

a memory,

wherein the memory stores an application program, and

wherein the application program includes at least one of the user interface and a messaging application.

9. The electronic device of claim 1, wherein the processor electronic device further comprises:

a first layer for receiving the handwriting input and a second layer for displaying the handwriting input, wherein the processor activates the first layer.

10. The electronic device of claim 1, wherein the processor:

identifies an object corresponding to a position where the data is detected;

determines a data type based on the identified object; and

converts the handwriting input into text or an image according to the determined data type.

11. The electronic device of claim 10, wherein when the data type is determined as a security text type, the processor converts the handwriting input into text and displays the converted handwriting input as one or more symbols.

12. An electronic device comprising:

a touch screen display that displays a user interface;

a wireless communication circuit; and

a processor that;

controls the touch screen display to display the user interface;

receives, from an external object, data representing that the external object is pressing a portion of the user interface with a pressure greater than or equal to a selected pressure, through the wireless communication circuit;

receives a handwriting input through the touch screen display; and

displays the handwriting input on the user interface on the touch screen display.

13. A method of an electronic device, the method comprising:

detecting a touch input in a user interface;

determining whether the detected touch input corresponds to a pressure input;

when the detected touch input corresponds to the pressure input, receiving a handwriting input; and

processing the user interface to correspond to the handwriting input.

14. The method of claim 13, wherein determining whether the detected first touch input corresponds to the pressure input comprises:

determining whether the touch input moves;

when the touch input does not move, determining whether pressure of the touch input is greater than or equal to a threshold value;

when the pressure of the touch input is greater than or equal to the threshold value, determining whether the touch input is released; and

when the touch input is not released, determining that the touch input corresponds to the pressure input.

15. The method of claim 13, wherein determining whether the detected touch input corresponds to the pressure input comprises:

determining whether the touch input moves;

when the touch input does not move, determining whether another touch input different from the touch input is detected;

when the other touch input is detected, determining whether the touch input is released; and

when the touch input is not released, determining that the touch input corresponds to the pressure input.

16. The method of claim 13, wherein, when the detected touch input corresponds to the pressure input, further comprising:

separating into a first layer for receiving the handwriting input and a second layer for displaying the handwriting input;

receiving the handwriting input through the first layer; and

displaying the handwriting input in the user interface through the second layer.

17. The method of claim 16, further comprising:

displaying, on the first layer, an end button for terminating the reception of the handwriting input; and

when the end button is selected, deactivating the first layer.

18. The method of claim 13, further comprising:

identifying an object corresponding to a position where the touch input is detected;

determining a data type based on the identified object; and

converting the handwriting input into data according to the determined data type.

19. The method of claim 18, wherein processing of the user interface comprises:

displaying the data corresponding to the handwriting input in the user interface in at least one of text and an image.

20. The method of claim 18, wherein processing of the user interface comprises:

when the data type is determined as a security text type, converting the handwriting input into text and displaying the converted handwriting input as one or more symbols.