Touch processing method and system using a GUI image

• US 9,489,125 B2
• Filed: 11/03/2011
• Issued: 11/08/2016
• Est. Priority Date: 10/06/2011
• Status: Active Grant

• Current Assignee: Rich IP Technology, Inc.
• Original Assignee: Rich IP Technology, Inc.
• Inventors: Tu, Yen-Hung, Chia, Chung-Lin, Chen, Han-Chang, Pan, Wen-Chieh
• Primary Examiner(s): Wiener, Eric
• Application Number:
  US13/288,370
• Publication Number:
  US 20130091449A1
• Time in Patent Office: 1,832 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A touch processing method and system using a GUI image, the method including the steps of: reading a sensed data array from a touch panel; performing a conversion procedure on a GUI to generate a GUI image; and performing a touch processing procedure according to the sensed data array and the GUI image.

Claims

1. A touch processing method for a graphical user interface, the method including the steps of:

using a processing unit including at least one CPU or GPU to read a sensed data array from a touch panel, wherein said sensed data array is generated in the touch panel without going through a process for calculating touch coordinates;

using said processing unit to perform a conversion procedure on a GUI to generate a GUI image, wherein said GUI image has a background area corresponding to a touch plane of said touch panel, and said background area contains a plurality of icons with each of said icons representing an object; and

using said processing unit for performing a touch processing procedure, wherein said touch processing procedure uses said sensed data array to get touched position information or uses both said sensed data array and said icons of said GUI image to get touched icon information for locating or indicating at least one of said icons and activate the object function thereof.

2. The touch processing method for a graphical user interface using a GUI imago of claim 1, wherein said touch panel has a touch sensor array selected from a group consisting of resistive type, capacitive type, surface acoustic wave type, and electromagnetic type.

3. The touch processing method for a graphical user interface of claim 1, wherein said conversion procedure is selected from a group consisting of a color conversion procedure and a resolution conversion procedure.

4. The touch processing method for a graphical user interface of claim 1, wherein said touch processing procedure performed in the processing unit has a first function for mapping at least one touch coordinate, which is derived by processing said sensed data array in the processing unit, onto said icons of said GUI image, so as to activate the object function of at least one of said icons corresponding to said at least one touch coordinate.

5. The touch processing method for a graphical user interface of claim 1, wherein said touch processing procedure performed in the processing unit has a first function and a second function, wherein said first function is used for mapping at least one touch coordinate, which is derived by processing said sensed data array in the processing unit, onto said icons of said GUI image, so as to activate the object function of at least one of said icons corresponding to said at least one touch coordinate;

and said second function is used for performing an image operation on said sensed data array according to said icons of said GUI image, so as to locate at least one of said icons and activate the object function thereof.

6. The touch processing method for a graphical user interface of claim 1, wherein said touch processing procedure performed in the processing unit has a first function and a third function, wherein said first function is used for mapping at least one touch coordinate, which is derived by processing said sensed data array in the processing unit, onto said icons of said GUI image, so as to activate the object function of at least one of said icons corresponding to said at least one touch coordinate;

and said third function is used for executing an image processing procedure to combine said sensed data array and said GUI image, and thereby generate an output image.

7. The touch processing method for a graphical user interface of claim 1, wherein said touch processing procedure performed in the processing unit has a second function and a third function, wherein said second function is used for performing an image operation on said sensed data array according to said icons of said GUI image, so as to locate at least one of said icons and activate the object function thereof;

and said third function is used for executing an image processing procedure to combine said sensed data array and said GUI image, and thereby generate an output image.

8. The touch processing method for a graphical user interface of claim 1, wherein said touch processing procedure performed in the processing unit has a first function, a second function, and a third function, wherein said first function is used for mapping at least one touch coordinate, which is derived by processing said sensed data array in the processing unit, onto said icons of said GUI image, so as to activate the object function of at least one of said icons corresponding to said at least one touch coordinate;

said second function is used for performing an image operation on said sensed data array according to said icons of said GUI image, so as to locate at least one of said icons and activate the object function thereof; and

said third function is used for executing an image processing procedure to combine said sensed data array and said GUI image, and thereby generate an output image.

9. The touch processing method for a graphical user interface claim 1, wherein said touch processing procedure performed in the processing unit has a second function for performing an image operation on said sensed data array according to said icons of said GUI image, so as to locate at least one of said icons and activate the object function thereof.

10. The touch processing method for a graphical user interface of claim 9, wherein said image operation includes a convolution operation and a comparison operation, wherein the convolution operation will generate a convolution integral, and the comparison operation will compare the convolution integral with a threshold.

11. The touch processing method for a graphical user interface of claim 1, wherein said touch processing procedure performed in the processing unit has a third function for executing an image processing procedure to combine said sensed data array and said GUI image, and thereby generate an output image.

12. The touch processing method for a graphical user interface of claim 11, wherein said image processing procedure includes a filtering operation.

13. The touch processing method for a graphical user interface of claim 11, wherein said third function is used for an application selected from the group consisting of:

a multi-touch drawing application, a handwriting input application, a palm-touch control application, and a multi-finger music performing application.

14. A touch processing system using a graphical user interface, comprising:

a touch panel for outputting a sensed data array corresponding to user interaction therewith, wherein said sensed data array is generated in the touch panel without going through a process for calculating touch coordinates; and

a processing unit for reading said sensed data array from said touch panel;

performing a conversion procedure on a GUI to generate a GUI image; and

performing a touch processing procedure, wherein said touch processing procedure uses said sensed data array to get touched position information or uses both said sensed data array and said icons of said GUI image to get touched icon information for locating or indicating at least one of said icons and activate the object function thereof.

15. The touch processing system using a graphical user interface of claim 14, further comprising an object function execution unit, used for executing an object function under the control of said touch processing unit.

16. The touch processing system using a graphical user interface of claim 14, wherein said sensed data array is generated from a sensing operation of a touch plane of said touch panel, and is used for said processing unit to derive touched information or approached information of said touch plane;

said conversion procedure is selected from the group consisting of a color conversion procedure and a resolution conversion procedure; and

said GUI image has a background area corresponding to said touch plane, wherein said background area contains a plurality of icons, with each of said icons representing an object.

17. The touch processing system using a graphical user interface of claim 16, wherein said touch processing procedure has a function selected from a group consisting of a first function, a second function, and a third function, wherein said first function is used for mapping at least one touch coordinate, which is derived by processing said sensed data array in the processing unit, onto said icons of said GUI image, so as to activate the object function of at least one of said icons corresponding to said at least one touch coordinate;

said second function is used for performing an image operation on said sensed data array according to said icons of said GUI image, so as to locate at least one of said icons and activate the object function thereof; and

said third function is used for executing an image processing procedure to combine said sensed data array and said GUI image, and thereby generate an output image.

18. The touch processing system using a graphical user interface of claim 17, wherein said image operation includes a convolution operation and a comparison operation, and said image processing procedure includes a filtering operation.

19. The touch processing system using a graphical user interfaces of claim 17, wherein said image processing procedure is used for an application selected from the group consisting of a multi-touch drawing application, a handwriting input application, a palm-touch control application, and a multi-finger music performing application.