Method and apparatus for providing user interface

• US 9,335,835 B2
• Filed: 08/27/2013
• Issued: 05/10/2016
• Est. Priority Date: 08/27/2012
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Lee, Yu-Jin, Ku, Han-Jun, Jeon, Han-Kyung, Cho, Seung-Hwan
• Primary Examiner(s): Zhou, Hong
• Application Number:
  US14/011,632
• Publication Number:
  US 20140055399A1
• Time in Patent Office: 987 Days
• Field of Search: 345156-179, 704/246, 704/251, 704/260
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 2203/04807 Pen manipulated menu
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0227 Cooperation and interconnection of the input arrangement with other functional units of a computer G06F3/023 - G06F3/037 take precedence
• CPC Class Codes: G06F 3/03 Arrangements for converting the position or the displacement of a member into a coded form
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

A method of providing a user interface of a portable terminal includes receiving a mode switching request into a handwriting input mode from a user during executing an application, switching into the handwriting input mode according to the mode switching request, recognizing handwritten data received from the user, converting the recognized handwritten data to data with a preset format, processing the converted data through a preset scheme and displaying a result of the processing on a touch screen.

Claims

1. A method for providing a user interface of a portable terminal, the method comprising:

executing a voice recognition application;

in response to receiving a request for activating a handwriting input mode while executing the voice recognition application, activating the handwriting input mode;

recognizing handwritten data received from a user via a touch screen of the voice recognition application;

transmitting, by the voice recognition application, the handwritten data in a preset format as a search word to a server;

receiving, by the voice recognition application, a search result in response to the search word from the server; and

causing the touch screen to display the search result.

2. The method of claim 1, wherein the request is one of an input of a hovering pattern using a touch means, an input of a touch pattern using the touch means, a click of a handwriting input button, and a click of a handwriting input menu item.

3. The method of claim 2, wherein the hovering pattern is performed by maintaining a position of the touch means within a detection threshold distance from a surface of the touch screen for a preset time.

4. The method of claim 1, wherein the handwritten data is displayed on an application window.

5. The method of claim 1, wherein the handwritten data is converted to text data.

6. The method of claim 1, wherein the handwritten data with the preset format and additional data input by the user are transmitted to the server.

7. The method of claim 1, wherein the handwritten data is converted to voice data, and the voice data is transmitted to a voice recognition server.

8. The method of claim 1, wherein the handwritten data is converted to first voice data, the first voice data and second voice data input by the user are transmitted to a voice recognition server.

9. A non-transitory machine-readable storage medium embodied with program instructions for causing a processor to execute a method in a device, the method comprising:

executing a voice recognition application;

in response to receiving a request for activating a handwriting input mode while executing the voice recognition application, activating the handwriting input mode;

recognizing handwritten data received from a user via a touch screen of the voice recognition application;

transmitting, by the voice recognition application, the handwritten data in a preset format as a search word to a server;

receiving a search result in response to the search word from the server by the voice recognition application; and

causing the touch screen to display the search result.

10. A device comprising a non-transitory machine-readable storage medium embodied with program instructions for causing a processor to execute a method, the method comprising:

executing a voice recognition application;

in response to receiving a request for activating a handwriting input mode while executing the voice recognition application, activating the handwriting input mode;

recognizing handwritten data received from a user via a touch screen of the voice recognition application;

transmitting, by the voice recognition application, the handwritten data in a preset format as a search word to a server;

receiving a search result in response to the search word from the server by the voice recognition application; and

causing the touch screen to display the search result.

11. A portable terminal for providing a user interface, the portable terminal comprising:

a storage unit configured to store a voice recognition application;

a touch screen configured to display input data and detect contact or hovering of a touch means; and

a controller configured to;

execute the voice recognition application;

in response to receiving a request for activating a handwriting input mode while executing the voice recognition application, activate the handwriting input mode;

recognize handwritten data received from a user via a touch screen of the voice recognition application;

transmit, by the voice recognition application, the handwritten data in a preset format as a search word to a server;

receive a search result in response to the search word from the server by the voice recognition application; and

cause the touch screen to display the search result.

12. The portable terminal of claim 11, wherein the request is one of an input of a hovering pattern using a touch means, an input of a touch pattern using the touch means, a click of a handwriting input button, and a click of a handwriting input menu item.

13. The portable terminal of claim 12, wherein the hovering pattern is performed by maintaining a position of the touch means within a detection threshold distance from a surface of the touch screen for a preset time.

14. The portable terminal of claim 11, wherein the handwritten data is displayed on an application window.

15. The portable terminal of claim 11, wherein the handwritten data is converted to text data.

16. The portable terminal of claim 11, wherein the handwritten data is converted to voice data, and the voice data is transmitted to a voice recognition server.

17. The portable terminal of claim 11, wherein the handwritten data in the preset format and additional data input by the user are transmitted to the server.