USER ADAPTIVE GESTURE RECOGNITION METHOD AND USER ADAPTIVE GESTURE RECOGNITION SYSTEM

• US 20100275166A1
• Filed: 08/29/2008
• Published: 10/28/2010
• Est. Priority Date: 12/03/2007
• Status: Abandoned Application

• Current Assignee: Electronics and Telecommunications Research Institute
• Original Assignee: Electronics and Telecommunications Research Institute
• Inventors: Lee, Seung Yun, Kim, Sung Han, Lee, Kang Chan, Jeon, Jong Hong
• Application Number:
  US12/745,800
• Publication Number:
  US 20100275166A1
• Time in Patent Office: Days
• US Class Current: 715/863
• CPC Class Codes: G06F 2200/1638 Computer housing designed to operate in both desktop and tower orientation
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: H04M 1/00 Substation equipment, e.g. for use by subscribers subscriber services or facilities provided at exchanges H04M3/00; prepayment telephone coin boxes H04M17/00; current supply arrangements H04M19/08

Abstract

The present invention relates to a user adaptive gesture recognition method and a user adaptive gesture recognition system. The present invention relates to a user adaptive gesture recognition method and a user adaptive gesture recognition system that, by using a terminal equipped with an acceleration sensor, can drive mobile application software in the terminal or can process a function of an application program for browsing to be displayed on the terminal based on acceleration information. Accordingly, the user gesture can be recognized and processed by using an acceleration sensor installed in a mobile apparatus. In addition, the user adaptive gesture can be stored in the mobile apparatus by using the acceleration sensor, and thus a mobile application can be easily utilized with a simple gesture.

Claims

1. A user adaptive gesture recognition system that recognizes a user gesture based on information collected by a terminal equipped with a sensor, the system comprising:

a sensing information processing unit that extracts a coordinate value from sensing information collected by the sensor;

a user adaptive gesture processing unit that extracts position conversion information from the extracted coordinate value to recognize a user gesture, and outputs association information for driving one of a browser function and application program functions in association with the user gesture or stores the user gesture; and

an association unit that associates an interface with the user gesture based on the output association information.

2. The system of claim 1, further comprising

a button recognition unit that, when the user presses one of a button assigned with a user gesture recognition request function and a button assigned with a user gesture registration request function, confirms recognition of the corresponding button.

3. The system of claim 2, wherein the button recognition unit confirms the recognition of the corresponding button when the user touches a touch screen-based virtual button.

4. The system of claim 2, wherein the association unit includes:

an in-terminal function association unit that performs association with a function in the terminal;

a mobile browser association unit that performs association with a browser; and

a mobile application association unit that performs association with a mobile application.

5. The system of claim 1, wherein the user adaptive gesture processing unit includes:

a user adaptive gesture recognition unit that recognizes the user gesture from the position conversion information;

a user gesture learning unit that searches interface association information corresponding to the user gesture, and determines whether or not to register the user gesture;

a user gesture-application program association processing unit that generates interface information corresponding to the user gesture, and outputs the interface information for association by the association unit; and

an information storage unit that stores information on the user gesture, the interface association information corresponding to the user gesture, and pre-defined standard gesture information.

6. The system of claim 5, wherein the information storage unit includes:

a user gesture-interface association information registration unit that stores the interface association information corresponding to the user gesture and basic interface information provided from the terminal;

a user gesture registration storage unit that stores the user gesture recognized by the user adaptive gesture recognition unit;

a user gesture-interface association information storage unit that stores the interface association information corresponding to the user gesture stored in the user gesture registration storage unit; and

a standard gesture registration storage unit that stores, in addition to the user adaptive gesture stored by the user, pre-defined standard gestures.

7. The system of claim 1, wherein the sensor is an acceleration sensor.

8. A user adaptive gesture recognition method that recognizes a user gesture based on information collected by a terminal equipped with a sensor, the method comprising:

extracting a coordinate value from sensing information collected by the sensor;

extracting position conversion information from the extracted coordinate value, and recognizing a user gesture based on the extracted position conversion information;

determining whether or not interface information corresponding to the recognized user gesture is stored; and

if it is determined in the determining that the interface information corresponding to the user gesture is stored, generating interface information for associating the corresponding interface with the gesture and associating the interface with the gesture.

9. The method of claim 8, further comprising, if it is determined that the interface information corresponding to the user gesture is not stored:

confirming whether or not to define interface information corresponding to the user gesture; and

if it is confirmed to define the interface information, associating the user gesture with one of an in-terminal function, a mobile browser, and a mobile application.

10. The method of claim 8, further comprising, before the extracting of the coordinate value,

determining whether or not an input for gesture recognition is received.

11. A user adaptive gesture recognition method that recognizes a user gesture based on information collected by a terminal equipped with a sensor, the method comprising:

determining whether or not a gesture registration request is input;

when the gesture registration request is input, extracting a coordinate value from sensing information collected by the sensor;

extracting position conversion information from the extracted coordinate value, and recognizing a user gesture based on the extracted position conversion information;

determining whether or not standard gesture information corresponding to the recognized user gesture is stored; and

if it is determined that the standard gesture information is not stored, defining and storing a command of the user gesture and interface information corresponding to the user gesture.

12. The method of claim 11, wherein the extracting of the coordinate value includes:

determining whether or not the input for the registration request is interrupted; and

extracting a coordinate value from when the registration request is input until the input is interrupted.

13. The method of claim 12, further comprising, if it is determined that the standard gesture information is stored:

determining whether or not to define the interface information corresponding to the user gesture as new interface information; and

if it is determined to define the interface information as the new interface information, defining and storing the interface information as the new interface information.