INFORMATION PROCESSING DEVICE AND INPUT CONTROL METHOD

• US 20160077646A1
• Filed: 11/20/2015
• Published: 03/17/2016
• Est. Priority Date: 06/28/2013
• Status: Abandoned Application

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Matsuzaki, Eiichi
• Application Number:
  US14/947,221
• Publication Number:
  US 20160077646A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0418 for error correction or compensation, e.g. based on parallax, calibration or alignment
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

An information processing device determines whether to update horizontal correction information, vertical correction information, both the horizontal correction information and the vertical correction information, or neither the horizontal correction information nor the vertical correction information, on the basis of a geometric relationship between a first object area, a second object area, a first contact area and a second contact area, the first and second object areas having been identified respectively in response to a first touch manipulation and a second touch manipulation and a first and a second contact areas respectively having been detected and having had positions corrected in response to the first touch manipulation and the second touch manipulation, when the first touch manipulation, a cancellation manipulation for cancelling the first touch manipulation, and the second touch manipulation were performed sequentially.

Claims

1. An information processing device comprising:

a touch screen;

a storage device; and

a processor that

detects an area, touched in a touch manipulation, on the touch screen;

reads, from the storage device, horizontal correction information and vertical correction information for correcting a position of the detected area in a horizontal direction and a vertical direction, respectively;

corrects the position of the detected area by using the horizontal correction information and the vertical correction information;

identifies an area occupied by a graphical user interface object that is a target of the touch manipulation on the touch screen, on the basis of the corrected position;

determines whether to update the horizontal correction information, the vertical correction information, both the horizontal correction information and the vertical correction information, or neither the horizontal correction information nor the vertical correction information, on the basis of a geometric relationship between a first object area, a second object area, a first contact area and a second contact area, the first and second object areas having been identified respectively in response to a first touch manipulation and a second touch manipulation and the first and second contact areas respectively having been detected and having had positions corrected in response to the first touch manipulation and the second touch manipulation, when the first touch manipulation, a cancellation manipulation for cancelling the first touch manipulation, and the second touch manipulation were performed sequentially; and

operates in accordance with the determination.

2. The information processing device according to claim 1, wherein

the processor

determines whether to update the horizontal correction information and whether to update the vertical correction information on the basis of a direction that is a direction of the second touch manipulation relative to the first touch manipulation and that is a direction determined on the basis of the geometric relationship and on the basis of a size of the second object area when the first contact area and the second contact area are close to each other according to a prescribed criterion;

and

updates neither the horizontal correction information nor the vertical correction information when the first contact area and the second contact area are far apart according to the prescribed criterion.

3. The information processing device according to claim 2, wherein

the processor

determines whether to update the horizontal correction information on the basis of a width of the second object area in the horizontal direction and does not update the vertical correction information in a first case where the first contact area and the second contact area are close to each other according to the prescribed criterion, and the first object area, the second object area, the first contact area, and the second contact area meet a horizontal arrangement condition for determining whether the second touch manipulation was performed in a direction close to the horizontal direction relative to the first touch manipulation;

and

determines whether to update the vertical correction information on the basis of a height of the second object area in the vertical direction and does not update the horizontal correction information in a second case where the first contact area and the second contact area are close to each other according to the prescribed criterion, and the first object area, the second object area, the first contact area and the second contact area meet a vertical arrangement condition for determining whether the second touch manipulation was performed in a direction close to the vertical direction relative to the first touch manipulation.

4. The information processing device according to claim 3, wherein

in the first case, the processor

updates the horizontal correction information when the width of the second object area is equal to or smaller than a first threshold that is determined in accordance with a width, in the horizontal direction, of one or both of the first and second contact areas;

and

does not update the horizontal correction information when the width of the second object area is greater than the first threshold, and

in the second case, the processor

updates the vertical correction information when the height of the second object area is equal to or smaller than a second threshold that is determined in accordance with a height, in the vertical direction, of one or both of the first and second contact areas; and

does not update the vertical correction information when the height of the second object area is greater than the second threshold.

5. The information processing device according to claim 3, wherein

the processor

determines whether to update the horizontal correction information and the vertical correction information on the basis of the width and the height of the second object area in a third case where the first contact area and the second contact area are close to each other according to the prescribed criterion, and the first object area, the second object area, the first contact area and the second contact area meet neither the horizontal arrangement condition nor the vertical arrangement condition.

6. The information processing device according to claim 5, wherein

in the third case, the processor

updates both the horizontal correction information and the vertical correction information when the width of the second object area is equal to or smaller than a third threshold that is determined in accordance with a width, in the horizontal direction, of one or both of the first and second contact areas and the height of the second object area is equal to or smaller than a fourth threshold that is determined in accordance with a height, in the vertical direction, of one or both of the first and second contact areas;

and

updates neither the horizontal correction information nor the vertical correction information when the width of the second object area is greater than the third threshold or the height of the second object area is greater than the fourth threshold.

7. The information processing device according to claim 3, wherein

whether the first object area, the second object area, the first contact area and the second contact area meet the horizontal arrangement condition is determined by an angle formed by the horizontal direction and a line connecting a point representing a first overlapping area in which the first object area and the first contact area are overlapping and a point representing a second overlapping area in which the second object area and the second contact area are overlapping;

and

whether the first object area, the second object area, the first contact area and the second contact area meet the vertical arrangement condition is determined by the angle.

8. The information processing device according to claim 2, wherein

the prescribed criterion is:

a criterion that at least part of the first contact area and at least part of the second contact area overlap;

a criterion that a distance between a point representing the first contact area and a point representing the second contact area is equal to or shorter than a threshold based on a size of one or both of the first and second contact areas;

or

a criterion that at least part of a union of the first contact area and a first margin area set around the first contact area and at least part of a union of the second contact area and a second margin area set around the second contact area overlap.

9. The information processing device according to claim 1, wherein

the processor

determines how much to update the horizontal correction information on the basis of a position of the second contact area in the horizontal direction;

and

determines how much to update the vertical correction information on the basis of a position of the second contact area in the vertical direction.

10. The information processing device according to claim 9, wherein

the processor

calculates a new horizontal correction value by using a current horizontal correction value represented by the horizontal correction information and a first difference between a position of the second contact area in the horizontal direction and a position of the first contact area in the horizontal direction when the horizontal correction information is to be updated;

and

calculates a new vertical correction value by using a current vertical correction value represented by the vertical correction information and a second difference between a position of the second contact area in the vertical direction and a position of the first contact area in the vertical direction when the vertical correction information is to be updated.

11. The information processing device according to claim 10, wherein

the processor

calculates the new horizontal correction value by adding a product of the first difference and a first coefficient to the current horizontal correction value;

and

calculates the new vertical correction value by adding a product of the second difference and a second coefficient to the current vertical correction value, wherein

the first coefficient is a constant, a value dependent upon the first difference or a value dependent upon the number of times that the horizontal correction information that is an update target has been updated up to the present, and

the second coefficient is a constant, a value dependent upon the second difference, or a value dependent upon the number of times that the vertical correction information that is an update target has been updated up to the present.

12. The information processing device according to claim 1, wherein

the storage device stores the horizontal correction information and the vertical correction information so that the horizontal correction information and the vertical correction information respectively correspond to a plurality of determined correction conditions;

and

the processor

corrects the position of the detected area by using the horizontal correction information and the vertical correction information that correspond to a correction condition that is met from among the plurality of correction conditions;

updates the horizontal correction information corresponding to a specific correction condition that was met at the time of the first touch manipulation from among the plurality of correction conditions when the horizontal correction information is to be updated; and

updates the vertical correction information corresponding to the specific correction condition when the vertical correction information is to be updated.

13. The information processing device according to claim 12, wherein

the plurality of correction conditions are:

a plurality of positional conditions related to what portion was touched on the touch screen;

a plurality of orientational conditions related to orientation of the touch screen;

a plurality of application conditions related to what piece of application software the touch manipulation was performed on;

a plurality of object conditions related to a property of a graphical user interface object occupying an area that is at least partially overlapping the area detected by the process of detecting performed by the processor;

or

a plurality of conditions expressed by a combination of at least two types of the plurality of positional conditions, the plurality of orientational conditions, the plurality of application conditions and the plurality of object conditions.

14. An input control method performed by an information processing device that includes a touch screen, a storage device and a processor, the input control method comprising:

detecting an area, touched in a touch manipulation, on the touch screen, by the processor;

reading, from the storage device, horizontal correction information and vertical correction information for correcting a position of the detected area in a horizontal direction and a vertical direction, respectively, by the processor;

correcting the position of the detected area by using the horizontal correction information and the vertical correction information, by the processor;

identifying an area occupied by a graphical user interface object that is a target of the touch manipulation on the touch screen, on the basis of the corrected position, by the processor;

determining whether to update the horizontal correction information, the vertical correction information, both the horizontal correction information and the vertical correction information, or neither the horizontal correction information nor the vertical correction information, on the basis of a geometric relationship between a first object area, a second object area, a first contact area and a second contact area, the first and second object areas having been identified respectively in response to a first touch manipulation and a second touch manipulation and the first and second contact areas respectively having been detected and having had positions corrected in response to the first touch manipulation and the second touch manipulation, when the first touch manipulation, a cancellation manipulation for cancelling the first touch manipulation, and the second touch manipulation were performed sequentially, by the processor; and

operating in accordance with the determination, by the processor.

15. A computer-readable recording medium having stored therein a program for causing a computer that includes a touch screen to execute a process comprising:

detecting an area, touched in a touch manipulation, on the touch screen;

reading, from the storage device, horizontal correction information and vertical correction information for correcting a position of the detected area in a horizontal direction and a vertical direction, respectively;

correcting the position of the detected area by using the horizontal correction information and the vertical correction information;

identifying an area occupied by a graphical user interface object that is a target of the touch manipulation on the touch screen, on the basis of the corrected position;

determining whether to update the horizontal correction information, the vertical correction information, both the horizontal correction information and the vertical correction information, or neither the horizontal correction information nor the vertical correction information, on the basis of a geometric relationship between a first object area, a second object area, a first contact area and a second contact area, the first and second object areas having been identified respectively in response to a first touch manipulation and a second touch manipulation and the first and second contact areas respectively having been detected and having had positions corrected in response to the first touch manipulation and the second touch manipulation, when the first touch manipulation, a cancellation manipulation for cancelling the first touch manipulation, and the second touch manipulation were performed sequentially; and

operating in accordance with the determination.