EXTRACTION METHOD FOR MULTI-TOUCH FEATURE INFORMATION AND RECOGNITION METHOD FOR MULTI-TOUCH GESTURES USING MULTI-TOUCH FEATURE INFORMATION

• US 20130215034A1
• Filed: 11/22/2010
• Published: 08/22/2013
• Est. Priority Date: 10/29/2010
• Status: Abandoned Application

• Current Assignee: Industry Foundation Of Chonnam National University (Chonnam National University)
• Original Assignee: Industry Foundation Of Chonnam National University (Chonnam National University)
• Inventors: Oh, Chi Min, Lee, Chil Woo, Seo, Yung Ho, Lee, Jun Sung, Kim, Jong Gu
• Application Number:
  US13/882,157
• Publication Number:
  US 20130215034A1
• Time in Patent Office: Days
• US Class Current: 345/163
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04166 Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving Synchronisation with the driving of the display or the backlighting unit to avoid interferences generated internally G06F3/04184
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

The present invention relates to an extraction method for multi-touch feature information and a recognition method for multi-touch gestures using the multi-touch feature information, and more specifically, to the extraction method for multi-touch feature information and recognition method for multi-touch gestures using the multi-touch feature information, wherein: multi-touch feature information, which does not depend on the number of touch points, is extracted; and the accuracy in gesture recognition is improved by using the extracted multi-touch feature information.

Claims

1. A method of extracting multi-touch feature information indicating features of changes in a plurality of touch points, comprising:

receiving location information of touch points from a touch panel;

connecting touch points located within a predetermined radius around each touch point to each other in a one-to-one correspondence, and generating pieces of edge information, each comprised of pieces of location information of two touch points connected to each other;

generating touch graph information having the pieces of location information and the pieces of edge information of all touch points connected to each other as elements, and extracting the touch graph information as the multi-touch feature information; and

receiving updated location information from the touch panel, and updating the touch graph information based on the updated location information.

2. The method of claim 1, wherein the updated touch graph information includes the touch graph information before the updating.

3. The method of claim 1, wherein said receiving the location information of the touch points from the touch panel comprises:

receiving a touch image, in which the touch points are indicated, from the touch panel; and

extracting touch vertices indicative of locations of points having highest touch strengths from an area in which the touch points are indicated, and obtaining locations of the touch vertices as pieces of location information of the respective touch points.

4. The method of claim 1, wherein the predetermined radius at the second step is set to a distance corresponding to one of values ranging from 7 cm to 13 cm.

5. The method of claim 1, wherein the touch graph information is generated and updated by the calculation with the following Equation 1:

G=(V, E)

V={X_i,t}

E={(X_i,t, X_j,t) } 

 

[Equation 1]

where G denotes the touch graph information, V denotes a set of pieces of location information of all touch points located in the touch graph information, E denotes a set of pieces of edge information located in the touch graph information, and X_i,t and X_j,t denote location coordinate values of the touch points connected to each other within the radius.

6. A computer-readable storage medium for storing a program for executing the multi-touch feature information extraction method of claim 1 on a computer.

7. A method of recognizing multi-touch gestures., comprising:

extracting touch graph information using the method claim 1, and obtaining movement distances at which individual touch points are moved and movement directions in which the touch points are moved by accessing the touch graph information; and

determining if individual touch points in identical touch graph information are moved in an identical direction within an identical range to recognize that the touch points in the identical touch graph information are moved.

8. The method of claim 7, wherein:

said extracting the touch graph information is configured to calculate X-axis movement distances and Y-axis movement distances of the respective touch points and then obtain motion vectors of the respective touch points, and

the determining is configured to obtain an inner product of the motion vectors of the respective touch points in the identical touch graph information, and if the inner product is ‘

1’

within the identical range, recognize that the touch points in the identical touch graph information are moved.

9. A computer-readable storage medium for storing a program for executing the multi-touch gesture recognition method set forth in claim 8 on a computer.

10. A method of recognizing multi-touch gestures, comprising:

extracting touch graph information using the multi-touch feature information extraction method of claim 1, and obtaining edge distances indicative of distances between touch points of each piece of edge information in identical touch graph information by accessing the touch graph information; and

determining if all of the edge distances are increased or decreased by a critical value or more, to recognize that the touch points in the identical touch graph information make a zoom-in gesture of moving far away from each other if increased by critical value or more, and that the touch points in the identical touch graph information make a zoom-out gesture of being close to each other if decreased by the critical value or more.

11. A computer-readable storage medium for storing a program for executing the multi-touch gesture recognition method set forth in claim 10 on a computer.

12. A method of recognizing multi-touch gestures comprising:

extracting touch graph information using the multi-touch feature information extraction method of claim 1, and averaging coordinate values of touch points in identical touch graph information to obtain center coordinates by accessing the touch graph information;

aligning an X axis with the center coordinates and obtaining direction angles of the touch points with respect to a direction of the X axis corresponding to ‘

0’

degree; and

determining if all of the direction angles of the touch points are increased or decreased by a critical angle or more to recognize that the touch points are rotated in a counterclockwise direction if increased by the critical angle or more, and that the touch points are rotated in a clockwise direction if decreased by the critical angle or more.

13. A computer-readable storage medium for storing a program for executing the multi-touch gesture recognition method set forth in claim 12 on a computer.

14. A method of recognizing multi-touch gestures, comprising:

extracting touch graph information using the multi-touch feature information extraction method of claim 1, and counting a number of touch points in identical touch graph information by accessing the touch graph information; and

determining whether touch points have been newly generated or eliminated in the identical touch graph information to recognize that a click gesture of a mouse is made based on a number of touch points that have been generated or eliminated.

15. The multi-touch gesture recognition method of claim 14, wherein:

said extracting the touch graph information further comprises determining whether there are changes in locations of the touch points in the identical touch graph information

to recognize that a drag gesture of the mouse is made if the number of touch points is not changed and there are changes in locations of the touch points.

16. A computer-readable storage medium for storing a program for executing the multi-touch gesture recognition method set forth in claim 15 on a computer.