Indeterminable gesture recognition using accumulated probability factors

• US 9,524,029 B2
• Filed: 07/16/2013
• Issued: 12/20/2016
• Est. Priority Date: 08/23/2012
• Status: Active Grant

• Current Assignee: Casio Computer Company Limited
• Original Assignee: Casio Computer Company Limited
• Inventors: Kanno, Hiroki
• Primary Examiner(s): Vu, Kieu
• Assistant Examiner(s): Borja, Roberto
• Application Number:
  US13/942,896
• Publication Number:
  US 20140059500A1
• Time in Patent Office: 1,253 Days
• Field of Search: 715/863
• US Class Current: 1/1
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

The present invention is to appropriately determine a gesture operation detected to perform data processing according thereto. In the present invention, a CPU judges a processing status at the time of the detection of a gesture operation performed on a touch panel, and after determining its gesture operation type according to the processing status, performs data processing according to the operation type. In this case, the CPU determines and evaluates a gesture operation type for each processing status, and updates values (evaluation accumulation values) of a flick priority pointer and a tap priority pointer. Then, based on these values of the flick priority pointer and the tap priority pointer, the CPU determines one of the gesture operation types (flick operation/tap operation).

Claims

1. A data processing device including a detection section which detects a plurality of gesture operations including gesture operations of types of flick operations or gesture operations of types of tap operations, comprising:

a judging section which, when a new gesture operation by the detection section is detected, judges whether the detection is detection after a first time is elapsed since predetermined data is displayed on the data processing device, or is detection after a second time is elapsed since a previous gesture operation is detected in the data processing device, or is detection after a third time is elapsed since a display size of an image displayed on the data processing device is changed;

an updating section which updates any of a first pointer in which the types of flick operations are prioritized and a second pointer in which the types of tap operations are prioritized according to a result of one type of judgment of the judging section, and, when plural types of judgments are detected in the judging section, updates by respectively accumulating the first pointer and the second pointer for each of the plural types of judgments;

a data processing section which performs a comparison of the first pointer and the second pointer accumulated and updated in the updating section and determines whether the types of flick operations or the types of tap operations are used as a type of the gesture operation based on a result of the comparison;

a reading section to read an attribute of the image displayed on the data processing device from an image memory and, according to the attribute, judging whether the image is a printed image, a non-extended image, or an extension error image; and

if the image is a printed image, a non-extended image, or an extension error image, determining that the image has a low possibility of being selected.

2. The data processing device according to claim 1, wherein the updating section,

when judged that the detection of the gesture operation is detection within the first time, updates the first pointer in which the types of flick operations are prioritized;

and

when judged that the detection of the gesture operation is detection after the first time, updates the second pointer in which the types of tap operations are prioritized.

3. The data processing device according to claim 1, wherein the updating section,

when judged that the detection of the gesture operation is detection within the second time, updates the first pointer in which the types of flick operations are prioritized;

and

when judged that the detection of the gesture operation is detection after the second time, updates the second pointer in which the types of tap operations are prioritized.

4. The data processing device according to claim 1,

wherein the judgment in the judging section is performed when a type of the gesture operation detected by the detection section is narrowed to a plurality of gesture operation types.

5. The data processing device according to claim 1, wherein the updating section performs an analysis of details of the detected gesture operation, and, when possibilities cannot be narrowed to one gesture operation type based on a result of the analysis, updates any of the first pointer and the second pointer according to a judgment result of the judging section.

6. The data processing device according to claim 1, wherein the updating section performs an analysis of details of the detected gesture operation and designates a combination of a plurality of gesture operation types as an update candidate, based on a result of the analysis, and updates any of the first pointer and the second pointer according to a judgment result of the judging section.

7. A method for a data processing device including a detection section which detects a plurality of gesture operations including gesture operations of types of flick operations or gesture operations of types of tap operations, comprising:

a judging step of, when a new gesture operation by the detection section is detected, judging whether the detection is detection after a first time is elapsed since predetermined data is displayed on the data processing device, is detection after a second time is elapsed since a previous gesture operation is detected in the data processing device, or is detection after a third time is elapsed since a display size of an image displayed on the data processing device is changed;

an updating step of updating any of a first pointer in which the types of flick operations are prioritized and a second pointer in which the types of tap operations are prioritized according to a result of one type of judgment of the judging, and, when plural types of judgments are detected in the judging, updating by respectively accumulating the first pointer and the second pointer for each of the plural types of judgments; and

a data processing step of performing a comparison of the first pointer and the second pointer accumulated and updated in the updating section and determining whether the types of flick operations or the types of tap operations are used as a type of the gesture operation based on a result of the comparison;

a reading step of reading an attribute of the image displayed on the data processing device from an image memory and, according to the attribute, judging whether the image is a printed image, a non-extended image, or an extension error image; and

if the image is a printed image, a non-extended image, or an extension error image, determining that the image has a low possibility of being selected.