Apparatus and method recognizing touch gesture

• US 9,218,121 B2
• Filed: 03/25/2010
• Issued: 12/22/2015
• Est. Priority Date: 03/27/2009
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Chang, Wook, Park, Joon-ah, Han, Seung-ju, Lee, Hyun-jeong
• Primary Examiner(s): HOFFNER, LINH NGUYEN
• Application Number:
  US12/659,942
• Publication Number:
  US 20100259493A1
• Time in Patent Office: 2,098 Days
• Field of Search: 345/173
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04106 Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0418 for error correction or compensation, e.g. based on parallax, calibration or alignment
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Disclosed are a touch gesture recognition apparatus and method that can be, or applied to, both a single-touch system and a multi-touch system. The touch gesture recognition method recognizes touch gestures using the diagonal-line length of a bounding box created based on touch location information and variations in the diagonal-line length. After a gesture is recognized, the recognized gesture is mapped to an input event of a user input device and feedback according to the input event is provided.

Claims

1. A touch gesture recognition apparatus comprising:

a gesture recognizing unit configured

to detect a touch thereon, to create a bounding box surrounding a location where the touch occurs,

to determine a calculated distance to be a length of the diagonal line of the bounding box,

to recognize a gesture as a single-touch gesture or a multi-touch gesture by comparing the determined length of the diagonal line of the bounding box with a range of a threshold diagonal-line length, and

to distinguish between the single-touch gesture and the multi-touch gesture touched consecutively using touch signals collected for a predetermined time period; and

an input event processing unit configured to map the recognized gesture to a user input event.

2. The touch gesture recognition apparatus of claim 1, wherein the gesture recognizing unit is further configured to calculate a distance between a minimal point having a smallest x-axis value and a smallest y-axis value and a maximal point having a greatest x-axis value and a greatest y-axis value on a 2-dimensional coordinate system within the location where the touch occurs.

3. The touch gesture recognition apparatus of claim 1, wherein the gesture recognizing unit recognizes the gesture using a determined variation in the diagonal line length in addition to using the diagonal line length.

4. The touch gesture recognition apparatus of claim 3, wherein the gesture recognizing unit recognizes the gesture to be a 2-finger pinching gesture when a determined variation in the diagonal-line length of the bounding box exceeds a first threshold change amount.

5. The touch gesture recognition apparatus of claim 3, wherein the gesture recognizing unit recognizes the gesture to be a spreading in and out gesture when the diagonal-line length is determined to be longer than a threshold diagonal-line length for multi-touch and a determined variation in the diagonal-line length of the bounding box exceeds a second threshold change amount.

6. The touch gesture recognition apparatus of claim 1, wherein the gesture recognizing unit recognizes, when the diagonal-line length is determined to be less than a threshold diagonal-line length for single-touch, the gesture as the single-touch gesture.

7. The touch gesture recognition apparatus of claim 1, wherein the gesture recognizing unit recognizes, when the diagonal-line length is determined to be longer than a threshold diagonal-line length for single-touch and less than a threshold diagonal-line length for multi-touch which is longer than the threshold diagonal-line length for single-touch, the gesture as the multi-touch gesture.

8. The touch gesture recognition apparatus of claim 1, wherein when recognizing the gesture to be one of the single-touch gesture and the multi-touch gesture, the gesture recognizing unit determines whether a determined variation in a location of a center point of the bounding box exceeds a predetermined threshold value, and recognizes the gesture as one of a single-touch scroll and a multi-touch scroll if the determined variation in the location of the center point of the bounding box exceeds the predetermined threshold value.

9. The touch gesture recognition apparatus of claim 1, wherein the input event processing unit maps the recognized gesture to at least one input event corresponding to at least one of a pressing of a left mouse button, pressing of a right mouse button, moving of a mouse cursor, rotation of a scroll wheel, release of a left mouse button, and release of a right button.

10. The touch gesture recognition apparatus of claim 1, further comprising a display to provide a user interface screen, wherein the input event processing unit executes the mapped user input event and outputs a result of the execution on the user interface screen.

18. The touch gesture recognition apparatus of claim 1, wherein the gesture recognizing unit creates the bounding box based on touch location information collected for an initial determination time for gesture recognition, and recognizes the gesture using the diagonal-line length of the bounding box.

19. The touch gesture recognition apparatus of claim 18, wherein the gesture recognizing unit maintains the gesture, recognized based on the touch location information collected for the initial determination time for gesture recognition, until it is determined that the touch has been released with the touch not being detected for a time longer than a threshold touch release time.

20. The touch gesture recognition apparatus of claim 18, wherein the gesture recognizing unit recognizes the gesture as a spreading in and out gesture when the diagonal-line length of the bounding box is determined to be longer than a threshold diagonal-line length for multi-touch which is a reference value to determine the multi-touch gesture when the initial determination time has not elapsed.

11. A touch gesture recognition method comprising:

recognizing a touch, creating a bounding box surrounding a location where the touch occurs;

determining a calculated distance to be a length of the diagonal line of the bounding box;

recognizing a gesture as a single-touch gesture or a multi-touch gesture by comparing the determined length of the diagonal line of the bounding box with a range of a threshold diagonal-line length;

distinguishing between the single-touch gesture and the multi-touch gesture touched consecutively using touch signals collected for a predetermined time period; and

mapping the recognized gesture to a user input event.

12. The touch gesture recognition method of claim 11, wherein the recognizing of the gesture comprises calculating a distance between a minimal point having a smallest x-axis value and a smallest y-axis value and a maximal point having a greatest x-axis value and a greatest y-axis value on a 2-dimensional coordinate system within the location where the touch occurs.

13. The touch gesture recognition method of claim 11, wherein the recognizing of the gesture comprises recognizing the gesture using a determined variation in the diagonal-line length in addition to using the diagonal line length.

14. The touch gesture recognition method of claim 13, wherein the recognizing of the gesture comprises recognizes the gesture as a 2-finger pinching gesture, when a determined variation in a location of a center point of the bounding box is less than a predetermined threshold value and a determined variation in the diagonal-line length of the bounding box exceeds a first threshold change amount.

15. The touch gesture recognition method of claim 13, wherein the recognizing of the gesture comprises recognizing the gesture as a spreading in and out gesture when the diagonal-line length is determined to be longer than a threshold diagonal-line length for multi-touch and a determined variation in the diagonal-line length of the bounding box exceeds a second threshold change amount.

16. The touch gesture recognition method of claim 11, wherein the recognizing of the gesture comprises recognizing the gesture as a single-touch scroll gesture when the diagonal-line length is determined to be less than a threshold diagonal-line length for single-touch and a determined variation in a location of a center point of the bounding box exceeds a predetermined threshold value.

17. The touch gesture recognition method of claim 11, wherein the recognizing of the gesture comprises recognizing the gesture as a multi-touch scroll gesture, when the diagonal-line length is determined to be longer than a threshold diagonal-line length for single-touch and less than a threshold diagonal-line length which is longer than the threshold diagonal-line length for single-touch, and a determined variation in a location of a center point of the bounding box exceeds a predetermined threshold value.