Gesture Interactive Operation Method

• US 20170068321A1
• Filed: 06/20/2016
• Published: 03/09/2017
• Est. Priority Date: 09/08/2015
• Status: Abandoned Application

• Current Assignee: Coretronic Corporation
• Original Assignee: Coretronic Corporation
• Inventors: Kuo, Pen-Ning, Yang, Chung-Lung
• Application Number:
  US15/186,821
• Publication Number:
  US 20170068321A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A gesture interactive operation method includes: receiving image information, about a hand part and provided by an image sensor, when the hand part is located within a sensing range of the image sensor; defining, through an image processor, a space relationship among sequentially-adjacent first, second and third fingers of the hand part in the image information; and analyzing the image information to generate first or second initiation signal and initiating to execute first or second operating mode on the display screen, respectively. The first initiation signal corresponds to the image information indicating that the second and third fingers are physically contacted with each other and the second finger is not physically contacted with the first finger. The second initiation signal corresponds to the image information indicating that the first and second fingers are physically contacted with each other and the second finger is not physically contacted with the third finger.

Claims

1. A gesture interactive operation method, comprising:

receiving a plurality pieces of image information, about a user'"'"'s hand part and provided by an image sensor, when the hand part of the user approaches to a display screen of a touch interactive device and is located within a sensing range of the image sensor;

defining, through an image processor, a space relationship among sequentially-adjacent first, second and third fingers of the hand part of the user in each piece of image information; and

analyzing the plurality pieces of image information to generate first initiation signal or second initiation signal and initiating the touch interactive device to execute a first operating mode or a second operating mode on the display screen, respectively,

wherein the first initiation signal corresponds to the plurality pieces of image information which indicate that the second and third fingers approach to and are physically contacted with each other and the second finger is not physically contacted with the first finger, wherein the second initiation signal corresponds to the plurality pieces of image information which indicate that the first and second fingers approach to and are physically contacted with each other and the second finger is not physically contacted with the third finger.

2. The gesture interactive operation method according to claim 1, further comprising:

when the touch interactive device executes the first operating mode on the display screen, making the second finger continuously physically contact with the third finger and making a fingertip of any one of the second or third finger approach to or touch the display screen.

3. The gesture interactive operation method according to claim 1, further comprising:

when the touch interactive device executes the first operating mode on the display screen, analyzing the plurality pieces of image information to generate first termination signal and the touch interactive device terminating the execution of the first operating mode on the display screen according to the first termination signal, wherein the first termination signal corresponds to the plurality pieces of image information which indicate that the second and third fingers are separated from and not physically contacted with each other.

4. The gesture interactive operation method according to claim 1, further comprising:

when the touch interactive device executes the second operating mode on the display screen, analyzing the plurality pieces of image information to generate second termination signal and the touch interactive device terminating the execution of the second operating mode on the display screen according to the second termination signal, wherein the second termination signal corresponds to the plurality pieces of image information which indicate that the first and second fingers are separated from and not physically contacted with each other.

5. The gesture interactive operation method according to claim 1, wherein the hand part comprises a right hand and a left hand of the user, and the second initiation signal corresponds to the plurality pieces of image information which indicate that the right hand'"'"'s first finger and the respective second finger approach to and are physically contacted with each other and the second finger is not physically contacted with the respective third finger and at the same time the left hand'"'"'s first finger and the respective second finger approach to and are physically contacted with each other and the second finger is not physically contacted with the respective third finger.

6. The gesture interactive operation method according to claim 5, further comprising:

when the touch interactive device executes the second operating mode on the display screen, making the right hand'"'"'s first finger continuously physically contact with the respective second finger and making the left hand'"'"'s first finger continuously physically contact with the respective second finger.

7. The gesture interactive operation method according to claim 5, further comprising:

when the touch interactive device executes the second operating mode on the display screen, analyzing the plurality pieces of image information to generate second termination signal and the touch interactive device terminating the execution of the second operating mode on the display screen according to the second termination signal, wherein the second termination signal corresponds to the plurality pieces of image information which indicate that the first and second fingers of any one of the right and left hands are separated from and not physically contacted with each other.

8. The gesture interactive operation method according to claim 1, further comprising:

when the touch interactive device executes the first operating mode on the display screen, analyzing the plurality pieces of image information to generate click signal and the touch interactive device executing an application program of a corresponding icon on the display screen according to the click signal, wherein the click signal corresponds to the plurality pieces of image information which indicate that the second finger is continuously physically contacted with the third finger, the first finger successively touches the second finger and then moves away from the second finger two times within a preset time period, and a fingertip of the second finger or the third finger touches the icon on the display screen.

9. The gesture interactive operation method according to claim 1, wherein the first operating mode is a touch mode, and in the touch mode, the user can have a touch operation by making the physically-contacted second and third fingers approach to or touch the display screen, wherein the second operating mode is a gesture mode, and in the gesture mode, the user can have a gesture operation by making the first and second fingers locate within a certain distance range relative to the display screen.

10. The gesture interactive operation method according to claim 1, further comprising:

when the touch interactive device executes the first operating mode on the display screen, not receiving the second initiation signal; and

when the touch interactive device executes the second operating mode on the display screen, not receiving the first initiation signal.

11. The gesture interactive operation method according to claim 1, further comprising:

when the touch interactive device executes the first operating mode on the display screen, forming a display point on the display screen by making the second finger continuously physically contact with the third finger and a fingertip of any one of second and third fingers approach to or touch the display screen, wherein the display point is located at a middle position of two points which are respectively projected on the display screen by the fingertips of the second and third fingers.

12. The gesture interactive operation method according to claim 1, further comprising:

receiving a plurality pieces of image information, about the user'"'"'s hand part and provided by the image sensor, when an end of a sensing element hold by the hand part approaches to the display screen and is located within the sensing range of the image sensor;

defining, through the image processor, the sensing element and the adjacent first finger of the hand part holding with the sensing element in each piece of the image information; and

analyzing the plurality pieces of image information to generate third initiation signal and the touch interactive device executing the first operating mode on the display screen according to the third initiation signal, wherein the third initiation signal corresponds to the plurality pieces of image information which indicate that the first finger successively physically contacts with the sensing element and then moves away from the sensing element two times within a preset time period and the end of the sensing element approaches to or touches the display screen.

13. The gesture interactive operation method according to claim 12, wherein the first operating mode is a touch mode, and in the touch mode, the user can have a touch operation by making the sensing element approach to or touch the display screen.

14. The gesture interactive operation method according to claim 12, further comprising:

when the touch interactive device executes the first operating mode on the display screen, analyzing the plurality pieces of image information to generate third termination signal and the touch interactive device terminating the execution of the first operating mode on the display screen according to the third termination signal, wherein the third termination signal corresponds to the plurality pieces of image information which indicate that the first finger successively physically contacts with the sensing element and then moves away from the sensing element two times within a preset time period.