System and method for processing sliding operations on portable terminal devices

• US 9,696,873 B2
• Filed: 07/12/2013
• Issued: 07/04/2017
• Est. Priority Date: 07/13/2012
• Status: Active Grant

• Current Assignee: Shanghai Chule (CooTek) Information Technology Co., Ltd.
• Original Assignee: Shanghai HanXiang (CooTek) Information Technology Co., Ltd., Shanghai
• Inventors: Zhang, Kan, Wang, Jialiang, Wu, Jingshen, Zhang, Meng
• Primary Examiner(s): To, Jennifer
• Assistant Examiner(s): SPRATT, BEAU D
• Application Number:
  US13/940,901
• Publication Number:
  US 20140019912A1
• Time in Patent Office: 1,453 Days
• Field of Search: None
• CPC Class Codes: G06F 3/023 Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H04M 1/724 User interfaces specially adapted for cordless or mobile telephones
• CPC Class Codes: H04M 1/72436 for text messaging, e.g. short messaging services [SMS] or e-mails
• CPC Class Codes: H04M 2250/22 including a touch pad, a touch sensor or a touch detector digitizers for touch screens G06F3/041

Abstract

The invention relates to a system for processing sliding operations on a portable terminal device. The portable terminal device includes a touch screen. The system includes a memory device configured to store data related to sliding operations, and a processor coupled to the memory device. The processor is configured to cause to display, on the touch screen, a communication function interface for receiving user sliding operations. The processor is further configured to receive original messages obtained on the touch screen corresponding to the user sliding operations, and process the original messages to determine possible sliding patterns corresponding to the user sliding operations. The processor is also configured to set a user-defined sliding pattern based on the possible sliding patterns.

Claims

1. A system for processing sliding operations on a portable terminal device, the portable terminal device comprising a touchscreen, the system comprising:

a memory device configured to store data related to sliding operations; and

a processor coupled to the memory device, the processor being configured to;

cause to display a dial pad or a contact list interface on the touchscreen;

receive an original message obtained on the dial pad or the contact list interface;

convert said original message to coordinates for processing;

select a slide-determining mode from a plurality of slide-determining modes based on properties of said original message, wherein to select a slide-determining mode from a plurality of slide-determining modes is further based on a system state of the portable terminal device, wherein the portable terminal device further comprises a SIM card and wherein the system state of the portable terminal device includes a property of the SIM card;

determine whether said original message is a sliding operation based on the selected slide-determining mode, wherein to determine whether said original message is a sliding operation, the processor is further configured to;

determine whether said original message is a sliding operation according to a category of said original message when the selected slide-determining mode is a direct sliding-input on a dial pad mode;

analyze said sliding operation and compare said sliding operation with the data related to sliding patterns stored in a sliding-input database, when said original message is determined as a sliding operation;

identify a result corresponding to said sliding operation according to the comparison;

output the result and trigger a follow-up corresponding operation;

append, if the result is a number, the number to a dialing sequence of the portable terminal device; and

append, if the result is a stroke, the stroke to a search sequence of the portable terminal device, and returning contact information including the stroke sequence.

2. The system of claim 1, wherein to determine whether said original message is a sliding operation, the processor is further configured to perform one or more of the following processes:

determine said original message as a sliding operation in an independent sliding identification mode, if said original message is drawn in a drawing area between a first predetermined operation for entering the independent sliding identification mode and before a second predetermined operation for exiting the independent sliding identification mode; and

determine said original message in a special starting area identification mode, from touching the screen to lifting from the screen, as a sliding operation, if the user'"'"'s action starts from a designated area.

3. The system of claim 2, wherein to determine whether said original message is a sliding operation, the processor is further configured to determine, when said original message intersects with a boundary line between two keys on the dial pad, or appears in two key areas at one time, or the sliding pattern covers at least two key areas, said original message as a sliding operation.

4. The system of claim 2, wherein the first predetermined operation is one or more of following operations:

(1) tapping a button on the touch screen;

(2) sending a voice command to said portable terminal device;

(3) shaking said portable terminal device;

(4) pressing a hardware button of said portable terminal device;

(5) sending an instruction to the portable terminal device through other input devices; and

(6) drawing a sliding-pattern with a specific shape, and wherein the second predetermined operation is one or more of following operations;

(1) tapping an exit button;

(2) inputting an exit order to the portable terminal device through voice or other input devices;

(3) pressing a specific functional button; and

(4) performing a specific motion while holding the portable terminal device.

5. The system of claim 1, wherein the processor is further configured to determine a category of said sliding operation.

6. The system of claim 5, wherein the category of said sliding operation includes one or more of the following:

(1) numbers;

(2) letters;

(3) strokes;

(4) Chinese characters;

(5) handwritten characters of other languages;

(6) system predefined sliding-input; and

(7) user defined sliding-input.

7. The system of claim 6, wherein said handwritten characters of other languages include one or more of:

Japanese characters, Korean characters, Thai characters, Arabic characters, Hebrew characters, and other minor language characters.

8. The system of claim 6, wherein the processor is further configured to determine a category of said sliding operation by using a Support Vector Machine method.

9. The system of claim 1, wherein to determine whether, the processor is further configured to analyze said sliding operation and compare it with the data related to sliding operation stored in the sliding-input database in order to obtain the category of said sliding operation, the processor is further configured to perform one or more of following processes:

analyzing said received sliding operation;

determine whether it is a single-stroke input or a multi-stroke input; and

processing said relative coordinates transferred by said original message based on the classification boundary method and comparing said sliding operation with the stored data related to sliding operation, in order to obtain the category of said sliding operation.

10. The system of claim 1, wherein said comparing includes a sliding-input classifier to remove the noise of a path, to output a noise-free path and to transform said noise-free path into spatial coordinates.

11. The system of claim 10, wherein said classifier uses Lagrange function to joint-optimize problems and constraints.

12. The system of claim 1, wherein said identifying includes matching the sliding operation with the pre-defined sliding patterns stored in said sliding-input database and taking one or more pre-defined sliding patterns matched as the sliding-identification results;

and in the case of nothing matched, prompting user whether to set a new sliding operation.

13. The system of claim 1, wherein the processor is further configured to perform one or more of following processes before outputting sliding identification results:

calculating possibility weights corresponding to the possible matching sliding patterns according to predefined influence factors;

sorting the possibility weights; and

providing one or more possible sliding patterns in a sorted order for user to select, or automatically identifying the sliding-identification result with the largest possibility weight as the matching sliding pattern.

14. The system of claim 13, wherein said automatic identification is performed if a difference between the largest possibility weight and any other remaining possibility weights exceeds a predetermined weight difference threshold.

15. The system of claim 13, wherein the influence factors include a frequency of calling a contact and a similarity between said sliding operation and said possible matching sliding patterns.

16. The system of claim 1, wherein to output sliding identification results and trigger a follow-up corresponding operation, the processor is further configured to perform one or more of following processes:

appending the letter to a search query on the portable terminal device, and returning contact information including the letter, if the sliding-identification result is a letter; and

appending the Chinese character or the handwritten character to a search query of the portable terminal device, and returning contact information including the Chinese characters or the handwritten character sequence, if the sliding-identification result is a Chinese character or a handwritten character.

17. The system of claim 1, wherein the processor is further configured to perform one or more of following processes so as to output said sliding-identification result and to trigger follow-up corresponding operations, when said sliding-identification result, which is a complex sliding-operation including several sliding operations of different categories, includes at least one first sliding operation including a letter or a stroke or a character or a hand-written character or the combination herein, and at least one second sliding operation including the predefined sliding-input:

identifying said first sliding operation, wherein corresponding letter or stroke or character or hand-written character or the combination herein is appended to the search sequence, and all the contact information including said first sliding operation is returned; and

identifying said second sliding operation, and based on the sliding-identification result, performing follow-up triggered operations predetermined by the system or operations predetermined by the user on said returned contact information including said first sliding operation.

18. The system of claim 1, wherein the processor is further configured to perform a sliding-operation user-defined process with one or more of the following operations:

setting a user-defined sliding pattern; and

setting a follow-up trigger operation corresponding to a user-defined sliding pattern.

19. The system of claim 18, wherein said sliding-operation user-defined process includes one or more of the following operations:

prompting the user to draw a sliding pattern on said contact list interface or said dial pad;

comparing the drawn sliding pattern with a set of sliding patterns stored in the sliding-input database;

displaying the similar sliding-patterns and prompting user to re-draw a sliding-pattern, if the similarity exceeds a threshold predetermined by the system; and

otherwise, storing said drawn sliding-pattern.

20. The system of claim 18, wherein said follow-up triggered operations include one or more of the following operations:

making a call to a designated contact;

sending a text message to a designated contact;

sending an email to a designated contact;

sending an instant message to a designated contact via a network; and

visiting the SNS homepage of a designated contact.

21. The system of claim 1, wherein said category of said original message includes one or more of the following types:

a static action, corresponding to a point on said touch screen; and

a dynamic sliding-operation, corresponding to one or more sliding patterns on said touchscreen.

22. The system of claim 21, wherein said static action is one of the following actions:

single-tapping, short-time pressing, and long-time pressing; and

said dynamic sliding-operation is one of the following actions;

sliding movement, multiple sliding movements, and multi-finger sliding movement.

23. The system of claim 1, wherein said data related to sliding operations includes predefined sliding input, user-defined sliding input, letters, numbers, strokes, and handwritten characters.

24. The system of claim 1, wherein said system further comprises a network storage device, and said network storage device establishes an interaction relationship between a network and said portable terminal based on a contact list, uploads and stores user-defined setting information of said sliding-operation and said data stored in said sliding-input database to a server.

25. The system of claim 24, wherein said network storage device is deployed in the network cloud.

26. The system of claim 2, wherein to determine whether said original message is a sliding operation, the processor is further configured to follow one or more of the following rules:

(a) a linear distance between a start point and an end point of the sliding pattern, according to said original message, exceeds a predetermined distance threshold;

(b) a length of the sliding pattern, according to said original message, exceeds a predetermined length threshold;

(c) a time duration for which a finger contacts the touch screen during said original message exceeds a predetermined time threshold; and

(d) two or more touch points are pressed simultaneously in said original message.

27. A method for processing sliding operations on a portable terminal device, the portable terminal device comprising a touchscreen, the method comprising:

displaying a dial pad or a contact list interface on the touchscreen;

receiving an original message obtained on the dial pad or the contact list interface;

converting said original message to coordinates for processing;

selecting a slide-determining mode from a plurality of slide-determining modes based on properties of said original message, wherein selecting a slide-determining mode from a plurality of slide-determining modes is further based on a system state of the portable terminal device, wherein the portable terminal device further comprises a SIM card and wherein the system state of the portable terminal device includes a property of the SIM card;

determining whether said original message is a sliding operation based on the selected slide-determining mode, wherein the determining includes determining whether said original message is a sliding operation according to a category of said original message when the selected slide-determining mode is a direct sliding-input on a dial pad mode;

analyzing said sliding operation and comparing said sliding operation with data related to sliding patterns stored in a sliding-input database, when said original message is determined as a sliding operation;

identifying a result corresponding to said sliding operation according to the comparison;

outputting the result and trigger a follow-up corresponding operation;

appending, if the result is a number, the number to a dialing sequence of the portable terminal device; and

appending, if the result is a stroke, the stroke to a search sequence of the portable terminal device, and returning contact information including the stroke sequence.

28. The method of claim 27, further comprising a sliding-operation user-defined process with one or more of the following operations:

setting a user-defined sliding pattern; and

setting a follow-up trigger operation corresponding to a user-defined sliding pattern.

29. The method of claim 27, wherein said follow-up triggered operations include one or more of the following operations:

making a call to a designated contact;

sending a text message to a designated contact;

sending an email to a designated contact;

sending an instant message to a designated contact via a network; and

visiting the SNS homepage of a designated contact.

30. The method of claim 27, wherein determining whether said original message is a sliding operation in one or more of the following ways:

determining said original message as a sliding operation in an independent sliding identification mode, if said original message is drawn in a drawing area between a predetermined operation for entering the independent sliding identification mode and before another predetermined operation for exiting the independent sliding identification mode; and

determining said original message in a special starting area identification mode, from touching the screen to lifting from the screen, as a sliding operation, if the user'"'"'s action starts from a designated area.

31. The method of claim 27, further comprising one or more of the following processes before outputting sliding identification results:

calculating possibility weights corresponding to the possible matching sliding patterns according to predefined influence factors;

sorting the possibility weights; and

providing one or more possible sliding patterns in a sorted order for user to select, or automatically identifying the sliding-identification result with the largest possibility weight as the matching sliding pattern.

32. The method of claim 31, wherein said automatic identification is performed if a difference between the largest possibility weight and any other remaining possibility weights exceeds a predetermined weight difference threshold.

33. The method of claim 27, wherein said identifying includes matching the sliding operation with the pre-defined sliding patterns stored in said sliding-input database and taking one or more pre-defined sliding patterns matched as the sliding-identification results;

and in the case of nothing matched, prompting user whether to set a new sliding operation.

34. A system for processing sliding operations on a portable terminal device, the portable terminal device comprising a touchscreen, the system comprising:

a memory device configured to store data related to sliding operations; and

a processor coupled to the memory device, the processor being configured to;

cause to display a dial pad or a contact list interface on the touchscreen;

receive an original message obtained on the dial pad or the contact list interface;

convert said original message to coordinates for processing,

select a slide-determining mode from a plurality of slide-determining modes based on properties of said original message, wherein to select a slide-determining mode from a plurality of slide-determining modes is further based on a system state of the portable terminal device, wherein the portable terminal device further comprises a SIM card and wherein the system state of the portable terminal device includes a property of the SIM card;

determine whether said original message is a sliding operation, when said original message intersects with a boundary line between two keys on the dial pad, or appears in two key areas at one time, or the sliding pattern covers at least two key areas;

analyze said sliding operation and compare said sliding operation with the data related to sliding patterns stored in a sliding-input database, when said original message is determined as a sliding operation;

identify a result corresponding to said sliding operation according to the comparison;

output the result and trigger a follow-up corresponding operation;

append, if the result is a number, the number to a dialing sequence of the portable terminal device; and

append, if the result is a stroke, the stroke to a search sequence of the portable terminal device, and returning contact information including the stroke sequence.

35. The system of claim 34, wherein the first predetermined operation is one or more of following operations:

(1) tapping a button on the touch screen;

(2) sending a voice command to said portable terminal device;

(3) shaking said portable terminal device;

(4) pressing a hardware button of said portable terminal device;

(5) sending an instruction to the portable terminal device through other input devices; and

(6) drawing a sliding-pattern with a specific shape, and wherein the second predetermined operation is one or more of following operations;

(1) tapping an exit button;

(2) inputting an exit order to the portable terminal device through voice or other input devices;

(3) pressing a specific functional button; and

(4) performing a specific motion while holding the portable terminal device.

36. The system of claim 34, wherein the processor is further configured to perform following processes so as to output said sliding-identification result and to trigger follow-up corresponding operations, when said sliding-identification result, which is a complex sliding-operation including several sliding operations of different categories, includes at least one first sliding operation including a letter or a stroke or a character or a hand-written character or the combination herein, and at least one second sliding operation including the predefined sliding-input:

identifying said first sliding operation, wherein corresponding letter or stroke or character or hand-written character or the combination herein is appended to the search sequence, and all the contact information including said first sliding operation is returned; and

identifying said second sliding operation, and based on the sliding-identification result, performing follow-up triggered operations predetermined by the system or operations predetermined by the user on said returned contact information including said first sliding operation.

37. The system of claim 34, wherein said category of said original message includes one or more of the following types:

a static action, corresponding to a point on said touch screen, wherein said static action is one of the following actions;

single-tapping,

short-time pressing, and

long-time pressing;

a dynamic sliding-operation, corresponding to one or more sliding patterns on said touchscreen, wherein said dynamic sliding-operation is one of the following actions;

sliding movement,

multiple sliding movements, and

multi-finger sliding movement.