DATA PROCESSING DEVICE AND METHOD OF PERFORMING DATA PROCESSING ACCORDING TO GESTURE OPERATION

• US 20140059500A1
• Filed: 07/16/2013
• Published: 02/27/2014
• Est. Priority Date: 08/23/2012
• Status: Active Grant

• Current Assignee: Casio Computer Company Limited
• Original Assignee: Casio Computer Company Limited
• Inventors: Kanno, Hiroki
• Granted Patent: US 9,524,029 B2
• Time in Patent Office: Days
• US Class Current: 715/863
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

The present invention is to appropriately determine a gesture operation detected to perform data processing according thereto. In the present invention, a CPU judges a processing status at the time of the detection of a gesture operation performed on a touch panel, and after determining its gesture operation type according to the processing status, performs data processing according to the operation type. In this case, the CPU determines and evaluates a gesture operation type for each processing status, and updates values (evaluation accumulation values) of a flick priority pointer and a tap priority pointer. Then, based on these values of the flick priority pointer and the tap priority pointer, the CPU determines one of the gesture operation types (flick operation/tap operation).

Claims

1. A data processing device including a detection section which detects a gesture operation, comprising:

a judging section which judges a processing status of the data processing device based on time of detection of the gesture operation by the detection section;

a determining section which determines one of a plurality of gesture operation types according to the processing status judged by the judging section; and

a data processing section which performs data processing according to a gesture operation type determined by the determining section.

2. The data processing device according to claim 1, further comprising:

an evaluation point storage section which stores, for each of the gesture operation types, an evaluation point obtained by determining and evaluating a gesture operation type for each of plural types of processing statuses of the data processing device,

wherein the judging section determines and evaluates the gesture operation type for each of the plural types of processing statuses and updates the evaluation point for each of the gesture operation types, and

wherein the determining section determines one of the plurality of gesture operation types based on the evaluation point for each of the gesture operation types updated by the judging section.

3. The data processing device according to claim 1, wherein the judging section judges a time-elapsed status after predetermined data is displayed, as the processing status of the data processing device, and

wherein the determining section determines one of the gesture operation types according to the time-elapsed status judged by the judging section.

4. The data processing device according to claim 1, wherein the judging section judges, as the processing status of the data processing device, a display data status indicating whether data displayed on a display screen is being processed or has just been processed, and

wherein the determining section determines one of the gesture operation types according to the display data status judged by the judging section.

5. The data processing device according to claim 1, wherein the judging section judges, as the processing status of the data processing device, an attribute status of display data in an operated area at the time of the detection of the gesture operation, and

wherein the determining section determines one of the gesture operation types according to the attribute status of the display data judged by the judging section.

6. The data processing device according to claim 1, wherein the judging section judges, as the processing status of the data processing device, an operation position status indicating whether the gesture operation has been performed on an image, and

wherein the determining section determines one of the gesture operation types according to the operation position status judged by the judging section.

7. The data processing device according to claim 1, wherein the detection section detects the gesture operation based on details of an operation performed on a display screen or an image of a user captured by an imaging section.

8. The data processing device according to claim 1, wherein the determining section analyzes details of the detected gesture operation and, when narrowing down to one gesture operation type based on an analytical result is impossible, determines one of the gesture operation types according to the processing status judged by the judging section.

9. The data processing device according to claim 1, wherein the determining section analyzes details of the detected gesture operation and, after designating a combination of the plurality of the gesture operation types as a determination candidate based on an analytical result, determines one of the gesture operation types from the determination candidate according to the processing status judged by the judging section.

10. A data processing device including a detection section which detects a gesture operation, comprising:

a judging section which judges an attribute of an operation target at time of detection of the gesture operation by the detection section;

a determining section which determines one of a plurality of gesture operation types according to the attribute of the operation target judged by the judging section; and

a data processing section which performs data processing according to a gesture operation type determined by the determining section.

11. The data processing device according to claim 10, wherein the detection section detects the gesture operation based on details of an operation performed on a display screen.

12. The data processing device according to claim 10, wherein the operation target is image data being displayed on a display screen,

wherein the judging section judges an attribute of the image data, and

wherein the determining section determines one of a tap operation and a flick operation as type of the gesture operation performed on the display screen, according to the attribute of the image data judged by the judging section.

13. The data processing device according to claim 10, wherein the operation target is display data being displayed on a display screen,

wherein the judging section judges whether the display data is entirely within the display screen, as an attribute of the display data, and

wherein the determining section determines one of a tap operation and a flick operation as type of the gesture operation performed on the display screen, according to the attribute of the display data judged by the judging section.

14. The data processing device according to claim 10, wherein the operation target is a display object being displayed on a display screen,

wherein the judging section judges type of the display object as an attribute of the display object, and

wherein the determining section determines one of a tap operation and a flick operation as type of the gesture operation performed on the display screen, according to the attribute of the display object judged by the judging section.

15. The data processing device according to claim 10, wherein the operation target is a display area on a display screen,

wherein the judging section judges an attribute of the display area, and

wherein the determining section determines one of a tap operation and a flick operation as type of the gesture operation performed on the display area on the display screen, according to the attribute of the display area judged by the judging section.

16. A method for a data processing device including a detection section which detects a gesture operation, comprising:

a judging step of judging a processing status of the data processing device based on time of detection of the gesture operation by the detection section;

a determining step of determining one of a plurality of gesture operation types according to the processing status judged in the judging step; and

a data processing step of performing data processing according to a gesture operation type determined in the determining step.

17. A method for a data processing device including a detection section which detects a gesture operation, comprising:

a judging step of judging an attribute of an operation target at time of detection of the gesture operation by the detection section;

a determining step of determining one of a plurality of gesture operation types according to the attribute of the operation target judged in the judging step; and

a data processing step of performing data processing according to a gesture operation type determined in the determining step.