Information processing device and method for multi-touch user interface

• US 10,216,401 B2
• Filed: 01/24/2013
• Issued: 02/26/2019
• Est. Priority Date: 06/29/2012
• Status: Active Grant

• Current Assignee: Rakuten Group, Inc.
• Original Assignee: Rakuten, Inc. (Rakuten Group, Inc.)
• Inventors: Kirkpatrick, Eric, Ogai, Takia
• Primary Examiner(s): Klicos, Nicholas
• Application Number:
  US14/374,328
• Publication Number:
  US 20150046861A1
• Time in Patent Office: 2,224 Days
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

An information processing device includes an acquiring unit and a processing executing unit. The acquiring unit acquires an initial position and a present position relating to a move of a first object and an initial position and a present position relating to a move of a second object. The processing executing unit executes certain processing on the first and the second objects based on the positional relations between the initial positions and the present positions of the first and the second objects. With this configuration, a user can execute processing on the objects with such a simple operation that moves the first and the second objects displayed. Furthermore, a user can execute desired processing by performing an operation to move the objects to adjust the respective initial positions and the present positions of the objects. This reduces incorrect operations.

Claims

1. An information processing device comprising:

at least one display;

at least one memory operable to store program code; and

at least one processor operable to read the program code and operate as instructed by the program code, wherein at least one of said at least one processor is configured to;

display a plurality of objects on a display screen of the at least one display;

detect a plurality of user designated positions on the display screen;

when one of the plurality of user designated positions is included in a determination area set based on a position of an object among the plurality of objects in a state where the one of the plurality of user designated positions is under detection, move the object in response to a move of the one of the plurality of user designated positions;

in response to detecting the plurality of user designated positions on the display screen, acquire a position of a first object and a position of a second object as an initial position of the first object and an initial position of the second object when a first user designated position and a second user designated position are concurrently included in respective determination areas of the first object and the second object;

acquire the positions of the first object and the second object as a present position of the first object and a present position of the second object after the initial positions of the first object and the second object are acquired, when at least one of the first object and the second object is moved in a state where the first user designated position and the second user designated position are kept under detection;

in response to the initial position of the first object being different from the present position of the first object, determine a first distance from the initial position of the first object to the present position of the first object;

in response to the initial position of the second object being different from the present position of the second object, determine a second distance from the initial position of the second object to the present position of the second object;

determine a third distance between the present position of the first object and the present position of the second object;

execute a first processing on the first object and the second object when the first distance from the initial position of the first object to the present position of the first object is less than a first predetermined value, the second distance from the initial position of the second object to the present position of the second object is equal to or greater than a second predetermined value, and the third distance between the present position of the first object and the present position of the second object is equal to or less than a third predetermined value; and

execute a second processing different from the first processing on the first object and the second object when the initial position and the present position of the first object are different and the initial position and the present position of the second object are different, wherein

the present position is determined at an end of movement of the at least one of the first object and the second object, and

the at least one of said at least one processor is further configured to execute the second processing on the first object and the second object when the first distance from the initial position of the first object to the present position of the first object is equal to or greater than a fourth predetermined value, the second distance from the initial position of the second object to the present position of the second object is equal to or greater than a fifth predetermined value, a first line segment connecting the initial position of the first object and the initial position of the second object intersects with a second line segment connecting the present position of the first object and the present position of the second object at a movement center point, and a rotation angle, which is made by a third line segment connecting the initial position of the first object and the movement center point and a fourth line segment connecting the present position of the first object and the movement center point and indicates a move of the first object from the initial position to the present position thereof with the movement center point as a center, is equal to or greater than a predetermined angle.

2. The information processing device according to claim 1, wherein the at least one of said at least one processor is further configured to:

execute the second processing, when the first object moves clockwise or counterclockwise from the initial position to the present position thereof with the movement center point as the center.

3. The information processing device according to claim 1, wherein the at least one of said at least one processor is further configured to:

execute the second processing on the first object and the second object when the first distance from the initial position of the first object to the present position of the first object is equal to or greater than the first predetermined value, and the second distance from the initial position of the second object to the present position of the second object is equal to or greater than the second predetermined value different from the first predetermined value.

4. The information processing device according to claim 1, wherein the at least one of said at least one processor is further configured to:

execute a third processing, instead of the second processing, on the first object and the second object when the first distance from the initial position of the first object to the present position of the first object is equal to or greater than a sixth predetermined value, the second distance from the initial position of the second object to the present position of the second object is equal to or greater than a seventh predetermined value, the third distance between the present position of the first object and the present position of the second object is equal to or less than an eighth predetermined value, a fourth distance from the initial position of the second object to the present position of the first object is less than a distance from the initial position of the second object to the initial position of the first object, and a fifth distance from the initial position of the first object to the present position of the second object is less than a distance from the initial position of the first object to the initial position of the second object.

5. An authentication device that comprises the information processing device according to claim 1, wherein

the at least one of said at least one processor is further configured to execute authentication processing on a user input by determining whether predetermined processing on present objects has been executed in the information processing device.

6. An authentication device that comprises the information processing device according to claim 1, wherein

the second processing is interchange processing that interchanges display positions of the first object and the second object with each other, and

the at least one of said at least one processor is further configured to execute authentication processing on a user input by determining whether the interchange processing has been executed on preset objects in the information processing device.

7. An information processing method performed by a computer, comprising:

displaying a screen including a plurality of objects on at least one display;

detecting a plurality of positions designated by a user on the screen;

acquiring positions of a first object and a second object as an initial position of the first object and an initial position of the second object when a first designated position and a second designated position are concurrently included in respective determination areas set based on the positions of the first object and the second object;

moving at least one of the first object and the second object in response to a move of at least one of the first designated position and the second designated position in a state where the first designated position and the second designated position in the respective determination areas of the first object and the second object are kept under detection;

acquiring the positions of the first object and the second object as a present position of the first object and a present position of the second object after the moving of at least one of the first object and the second object;

in response to the initial position of the first object being different from the present position of the first object, determine a first distance from the initial position of the first object to the present position of the first object;

in response to the initial position of the second object being different from the present position of the second object, determine a second distance from the initial position of the second object to the present position of the second object;

determine a third distance between the present position of the first object and the present position of the second object;

execute the first processing on the first object and the second object when the first distance from the initial position of the first object to the present position of the first object is less than a first predetermined value, the second distance from the initial position of the second object to the present position of the second object is equal to or greater than a second predetermined value, and the third distance between the present position of the first object and the present position of the second object is equal to or less than a third predetermined value; and

execute a second processing different from the first object and the second object when the initial position and the present position of the first object are different and the initial position and the present position of the second object are different, wherein

the present position is determined at an end of movement of the at least one of the first object and the second object, and

execution of the second processing comprises executing the second processing on the first object and the second object when the first distance from the initial position of the first object to the present position of the first object is equal to or greater than a fourth predetermined value, the second distance from the initial position of the second object to the present position of the second object is equal to or greater than a fifth predetermined value, a first line segment connecting the initial position of the first object and the initial position of the second object intersects with a second line segment connecting the present position of the first object and the present position of the second object at a movement center point, and a rotation angle, which is made by a third line segment connecting the initial position of the first object and the movement center point and a fourth line segment connecting the present position of the first object and the movement center point and indicates a move of the first object from the initial position to the present position thereof with the movement center point as a center, is equal to or greater than a predetermined angle.

8. A non-transitory computer-readable storage medium having stored thereon a program which, when executed by a computer, causes the computer to:

display a screen including a plurality of objects on at least one display;

detect a plurality of positions designated by a user on the screen;

acquire positions of a first object and a second object as an initial position of the first object and an initial position of the second object when a first designated position and a second designated position are concurrently included in respective determination areas set based on the positions of the first object and the second object;

move at least one of the first object and the second object in response to a move of at least one of the first designated position and the second designated position in a state where the first designated position and the second designated position in the respective determination areas of first object and the second object are kept under detection;

acquire the positions of the first object and the second object as a present position of the first object and a present position of the second object after the move of at least one of the first object and the second object;

in response to the initial position of the first object being different from the present position of the first object, determine a first distance from the initial position of the first object to the present position of the first object;

in response to the initial position of the second object being different from the present position of the second object, determine a second distance from the initial position of the second object to the present position of the second object;

determine a third distance between the present position of the first object and the present position of the second object;

execute the first processing on the first object and the second object when the first distance from the initial position of the first object to the present position of the first object is less than a first predetermined value, the second distance from the initial position of the second object to the present position of the second object is equal to or greater than a second predetermined value, and the third distance between the present position of the first object and the present position of the second object is equal to or less than a third predetermined value; and

execute a second processing different from the first processing on the first object and the second object when the initial position and the present position of the first object are different and the initial position and the present position of the second object are different, wherein

the present position is determined at an end of movement of the at least one of the first object and the second object, and

execution of the second processing comprises executing the second processing on the first object and the second object when the first distance from the initial position of the first object to the present position of the first object is equal to or greater than a fourth predetermined value, the second distance from the initial position of the second object to the present position of the second object is equal to or greater than a fifth predetermined value, a first line segment connecting the initial position of the first object and the initial position of the second object intersects with a second line segment connecting the present position of the first object and the present position of the second object at a movement center point, and a rotation angle, which is made by a third line segment connecting the initial position of the first object and the movement center point and a fourth line segment connecting the present position of the first object and the movement center point and indicates a move of the first object from the initial position to the present position thereof with the movement center point as a center, is equal to or greater than a predetermined angle.