Information processing device, control method for information processing device, program, and information storage medium for determining collision between objects on a display screen

• US 9,423,948 B2
• Filed: 06/29/2012
• Issued: 08/23/2016
• Est. Priority Date: 08/31/2011
• Status: Active Grant

• Current Assignee: Rakuten Group, Inc.
• Original Assignee: Rakuten, Inc. (Rakuten Group, Inc.)
• Inventors: Takeda, Seiichi
• Primary Examiner(s): Duong, Hien
• Application Number:
  US13/819,997
• Publication Number:
  US 20130275896A1
• Time in Patent Office: 1,516 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 21/36 by graphic or iconic representation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces

Abstract

To provide an information processing device capable of ensuring not to execute processing not intended by a user in a case of stopping the ongoing operation after selecting an object (for example, in selecting again an object other than the object already selected, or the like). In a case where one of a user'"'"'s designated position is included in a determination area based on the position of one of the plurality of objects displayed in a screen, an object moving unit (56) moves the one object based on the one designated position. In a case where the object moving unit (56) moves first and second objects, a collision determination unit (58) determines whether or not the first and second objects have collided. A processing executing unit (60) executes processing relevant to the first and second objects based on a result of determination by the collision determination unit (58).

Claims

1. An information processing device, comprising:

at least one non-transitory memory operable to store program code; and

at least one processor operable to read said program code and operate as instructed by said program code, said program code causing said at least one processor to;

display a screen including a plurality of objects on a display;

obtain a result of detecting a plurality of a user'"'"'s designated positions in the screen;

in a case where one of the user'"'"'s designated position is detected and the one designated position is included in a determination area that is set based on a position of one object among the plurality of objects, move the one object in accordance with movement of the one designated position;

in a case where at least one of a first object and a second object is moved, determine whether or not the first object and the second object collide with each other in a state that the user'"'"'s first designated position by a first finger is included in a determination area set based on a position of the first object and the user'"'"'s second designated position by a second finger is included in a determination area set based on a position of the second object; and

execute processing relevant to the first object and the second object, based on a result of the collision determination,

wherein in a case where the user'"'"'s first designated position is included in the determination area set based on the position of the first object, the user'"'"'s second designated position is included in the determination area set based on the position of the second object, the at least one of the first object and the second object is moved, and the distance between the first designated position and the second designated position is equal to or smaller than a threshold, it is determined that the first object and the second object collide with each other, whereas in a case where the distance is larger than the threshold, even if the first object and the second object contact or overlap with each other, it is determined that the first object and the second object does not collide with each other.

2. The information processing device according to claim 1, wherein in a case where the first object and the second object are moved, and a state in which the distance between the first designated position and the second designated position is equal to or smaller than the threshold lasts for a predetermined period of time, it is determined that the first object and the second object collide with each other.

3. The information processing device according to claim 1,

wherein the threshold is dynamically changed based on a distance between a previous first designated position and a previous second designated position when it was determined that the first object and the second object collided with each other.

4. The information processing device according to claim 1, wherein in a case where it is determined that the first object and the second object collide with each other, the processing relevant to the first object and the second object is executed based on a collision manner of the first object and the second object.

5. The information processing device according to claim 4, wherein in the case where it is determined that the first object collides against the second object, any of a plurality of kinds of processing relevant to the first object and the second object is selected based on the collision manner of the first object and the second object, and then executes the selected processing.

6. The information processing device according to claim 4, further comprising a reference information storage that stores reference combination information indicating a combination of two objects among the plurality of objects designated in advance by the user, and reference manner information indicating a manner designated in advance by the user as the collision manner of the two objects,

wherein said program code causes said at least one processor to:

display the plurality of objects in mutually different display manners in the screen,

determine whether or not a combination of the first object and the second object is identical to the combination indicated by the reference combination information in the case where it is determined that the first object and the second object collide with each other,

compare a collision manner of the first object and the second object and the manner indicated by the reference manner information in the case where it is determined that the first object and the second object collide with each other, and

execute authentication processing based on a result of determination of whether or not the combination of the first object and the second object is identical to the combination indicated by the reference combination information, and a result of comparison of the collision manner of the first object and the second object and the manner indicated by the reference manner information.

7. The information processing device according to claim 6, wherein

the reference manner information includes reference direction information indicating a direction designated in advance by the user,

said program code causes said at least one processor to:

determine whether or not an angle between a direction from one to another of the first object or the first designated position and the second object or the second designated position and the direction indicated by the reference direction information is equal to or smaller than a reference angle, and

execute the authentication processing based on the result of determination of whether or not the combination of the first object and the second object is identical to the combination indicated by the reference combination information, and a result of determination of the angle is equal to or smaller than the reference angle.

8. The information processing device according to claim 6, wherein

the reference manner information includes reference relative speed information indicating a relative speed designated in advance by the user,

said program code causes said at least one process to:

determine whether or not a speed difference between a relative speed of one relative to another of the first object or the first designated position and the second object or the second designated position and the relative speed indicated by the reference relative speed information is equal to or smaller than a reference difference, and

execute the authentication processing based on the result of determination of whether or not the combination of the first object and the second object is identical to the combination indicated by the reference combination information, and a result of determination of whether or not the speed difference is equal to or smaller than the reference difference.

9. The information processing device of claim 1, wherein

said program code further causes said at least one processor to:

in a case where the user'"'"'s first designated position is included in the determination area that is set based on the position of the first object, move the first object in accordance with movement of the user'"'"'s first designated position;

in a case where the user'"'"'s second designated position is included in the determination area that is set based on the position of the second object, move the second object in accordance with movement of the user'"'"'s second designated position; and

in a case where both the first object and the second object are moved, determine whether or not the first object and the second object collide with each other in a state that the user'"'"'s first designated position is included in the determination area set based on the position of the first object and the user'"'"'s second designated position is included in the determination area set based on the position of the second object.

10. An information processing device, comprising:

at least one non-transitory memory operable to store program code; and

at least one processor operable to read said program code and operate as instructed by said program code, said program code causing said at least one processor to;

display a screen including a plurality of objects on a display;

obtain a result of a plurality of a user'"'"'s designated positions in the screen;

in a case where one of the user'"'"'s designated positions is detected and the one designated position is included in a determination area that is set based on a position of one object among the plurality of objects, move the one object in accordance with movement of the one designated position;

in a case where at least one of a first object and a second object is moved determine whether or not the first object and the second object collide with each other; and

execute processing relevant to the first object and the second object based on a result of the collision determination;

wherein

said program code causes said at least one processor to;

obtain at least a part of content stored in a reference information storage that stores reference combination information indicating a combination of two objects among the plurality of objects designated in advance by the user, and reference manner information indicating a manner designated in advance by the user as the collision manner of the two objects,

display the plurality of objects in mutually different display manners in the screen,

determine whether or not a combination of the first object and the second object is identical to the combination indicated by the reference combination information in a case where it is determined that the first object and the second object collide with each other,

compare a collision manner of the first object and the second object and the manner indicated by the reference manner information in the case where it is determined that the first object and the second object collide with each other, and

execute authentication processing based on a result of determination of whether or not the combination of the first object and the second object is identical to the combination indicated by the reference combination information, and a result of comparison of the collision manner of the first object and the second object and the manner indicated by the reference manner information,

wherein

the reference manner information includes reference direction information indicating a direction designated in advance by the user,

said program code causes said at least one processor to;

compare the collision manner of the first object and the second object and the manner indicated by the reference manner information by determining whether or not an angle between a direction from one to another of the first object and the second object and the direction indicated by the reference direction information is equal to or smaller than a reference angle, and

execute the authentication processing based on the result of determination of whether or not the combination of the first object and the second object is identical to the combination indicated by the reference combination information, and a result of determination of whether or not the angle is equal to or smaller than the reference angle.

11. An information processing device, comprising:

at least one non-transitory memory operable to store program code;

at least one processor operable to read said program code and operate as instructed by said program code, said program code causing said at least one processor to;

display a screen including a plurality of objects on a display;

obtain a result of detecting a plurality of a user'"'"'s designated positions in the screen;

in a case where one of the user'"'"'s designated positions is detected and the one designated position is included in a determination area that is set based on a position of one object among the plurality of objects, move the one object in accordance with movement of the one designated position;

in a case where at least one of a first object and a second object is moved determine whether or not the first object and the second object collide with each other; and

execute processing relevant to the first object and the second object based on a result of the collision determination;

wherein

said program code causes said at least one processor to;

obtain at least a part of content stored in a reference information storage that stores reference combination information indicating a combination of two objects among the plurality of objects designated in advance by the user, and reference manner information indicating a manner designated in advance by the user as the collision manner of the two objects,

display the plurality of objects in mutually different display manners in the screen,

determine whether or not a combination of the first object and the second object is identical to the combination indicated by the reference combination information in a case where it is determined that the first object and the second object collide with each other,

compare a collision manner of the first object and the second object and the manner indicated by the reference manner information in the case where it is determined that the first object and the second object collide with each other, and

execute authentication processing based on a result of determination of whether or not the combination of the first object and the second object is identical to the combination indicated by the reference combination information and a result of comparison of the collision manner of the first object and the second object and the manner indicated by the reference manner information,

wherein

the reference manner information includes reference relative speed information indicating a relative speed designated in advance by the user,

said program code causes said at least one processor to;

compare the collision manner of the first object and the second object and the manner indicated by the reference manner information by determining whether or not a speed difference between a relative speed of one of the first object and the second object relative to another of the first object and the second object and the relative speed indicated by the reference relative speed information is equal to or smaller than a reference difference, and

execute the authentication processing based on the result of determination of whether or not the combination of the first object and the second object is identical to the combination indicated by the reference combination information, and a result of determination of whether or not the speed difference is equal to or smaller than the reference difference.

12. A control method for an information processing device, the control method comprising:

displaying a screen including a plurality of objects on a display;

obtaining a result of detecting a plurality of a user'"'"'s designated positions in the screen;

in a case where one of the user'"'"'s designated positions is detected and the one designated position is included in a determination area that is set based on a position of one object among the plurality of objects, moving the one object in accordance with movement of the one designated position;

in a case where at least one of a first object and a second object is moved, determining whether or not the first object and the second object collide with each other in a state that the user'"'"'s first designated position by a first finger is included in a determination area set based on a position of the first object and the user'"'"'s second designated position by a second finger is included in a determination area set based on a position of the second object; and

executing processing relevant to the first object and the second object, based on a result of the collision determination,

wherein in a case where the user'"'"'s first designated position is included in the determination area set based on the position of the first object, the user'"'"'s second designated position is included in the determination area set based on the position of the second object, the at least one of the first object and the second object is moved, and the distance between the first designated position and the second designated position is equal to or smaller than a threshold, it is determined that the first object and the second object collide with each other, whereas in a case where the distance is larger than the threshold, even if the first object and the second object contact or overlap with each other, it is determined that the first object and the second object does not collide with each other.

13. A non-transitory computer readable information storage medium storing program code for causing a computer to:

display a screen including a plurality of objects on a display;

obtain a result of detecting a plurality of a user'"'"'s designated positions in the screen;

in a case where one of the user'"'"'s designated positions is detected and the one designated position is included in a determination area that is set based on a position of one object among the plurality of objects, move the one object in accordance with movement of the one designated position;

in a case where at least one of a first object and a second object is moved determine, whether or not the first object collides against the second object in a state that the user'"'"'s first designated position by a first finger is included in a determination area set based on a position of the first object and the user'"'"'s second designated position by a second finger is included in a determination area set based on a position of the second object; and

execute processing relevant to the first object and the second object, based on a result of the collision determination,

wherein in a case where the user'"'"'s first designated position is included in the determination area set based on the position of the first object, the user'"'"'s second designated position is included in the determination area set based on the position of the second object, the at least one of the first object and the second object is moved, and the distance between the first designated position and the second designated position is equal to or smaller than a threshold, it is determined that the first object and the second object collide with each other, whereas in a case where the distance is larger than the threshold, even if the first object and the second object contact or overlap with each other, it is determined that the first object and the second object does not collide with each other.

14. A control method for an information processing device, the control method comprising:

displaying a screen including a plurality of objects on a display;

obtaining a result of detecting a plurality of a user'"'"'s designated positions in the screen;

in a case where one of the user'"'"'s designated positions is detected and the one designated position is included in a determination area that is set based on a position of one object among the plurality of objects, moving the one object in accordance with movement of the one designated position;

in a case where at least one of a first object and a second object is moved, determining whether or not the first object and the second object collide with each other;

executing processing relevant to the first object and the second object based on a result of the collision determination; and

obtaining at least a part of content stored in a reference information storage that stores reference combination information indicating a combination of two objects among the plurality of objects designated in advance by the user, and reference manner information indicating a manner designated in advance by the user as the collision manner of the two objects,

wherein

the plurality of objects are displayed in mutually different display manners in the screen,

the executing comprises;

determining whether or not a combination of the first object and the second object is identical to the combination indicated by the reference combination information in a case where it is determined that the first object and the second object collide with each other,

comparing a collision manner of the first object and the second object and the manner indicated by the reference manner information in the case where it is determined that the first object and the second object collide with each other, and

executing authentication processing based on a result of determination of whether or not the combination of the first object and the second object is identical to the combination indicated by the reference combination information, and a result of comparison of the collision manner of the first object and the second object and the manner indicated by the reference manner information,

the reference manner information includes reference direction information indicating a direction designated in advance by the user,

the comparing comprises determining whether or not an angle between a direction from one to another of the first object and the second object and the direction indicated by the reference direction information is equal to or smaller than a reference angle, and

the authentication processing is executed based on the result of determination of whether or not the combination of the first object and the second object is identical to the combination indicated by the reference combination information, and a result of determination of whether or not the angle is equal to or smaller than the reference angle.

15. A non-transitory computer readable information storage medium storing program code for causing a computer to

display a screen including a plurality of objects on a display;

obtain a result of detecting a plurality of a user'"'"'s designated positions in the screen;

in a case where one of the user'"'"'s designated positions is detected and the one designated position is included in a determination area that is set based on a position of one object among the plurality of objects, move the one object in accordance with movement of the one designated position;

in a case where at least one of a first object and a second object is moved, determine whether or not the first object and the second object collide with each other; and

execute processing relevant to the first object and the second object based on a result of the collision determination;

wherein

said program code causes the computer to;

obtain at least a part of content stored in a reference information storage that stores reference combination information indicating a combination of two objects among the plurality of objects designated in advance by the user, and reference manner information indicating a manner designated in advance by the user as the collision manner of the two objects,

display the plurality of objects in mutually different display manners in the screen,

determine whether or not a combination of the first object and the second object is identical to the combination indicated by the reference combination information in a case where it is determined that the first object and the second object collide with each other,

compare a collision manner of the first object and the second object and the manner indicated by the reference manner information in the case where it is determined that the first object and the second object collide with each other, and

execute authentication processing, based on a result of determination of whether or not the combination of the first object and the second object is identical to the combination indicated by the reference combination information, and a result of comparison of the collision manner of the first object and the second object and the manner indicated by the reference manner information,

wherein

the reference manner information includes reference direction information indicating a direction designated in advance by the user,

said program code causes the computer to;

compare the collision manner of the first object and the second object and the manner indicated by the reference manner information by determining whether or not an angle between a direction from one to another of the first object and the second object and the direction indicated by the reference direction information is equal to or smaller than a reference angle, and

execute the authentication processing based on the result of determination of whether or not the combination of the first object and the second object is identical to the combination indicated by the reference combination information, and a result of determination of whether or not the angle is equal to or smaller than the reference angle.

16. A control method for an information processing device, the control method comprising:

displaying a screen including a plurality of objects on a display;

obtaining a result of detecting a plurality of a user'"'"'s designated positions in the screen;

in a case where one of the user'"'"'s designated positions is detected and the one designated position is included in a determination area that is set based on a position of one object among the plurality of objects, moving the one object in accordance with movement of the one designated position;

in a case where at least one of a first object and a second object is moved, determining whether or not the first object and the second object collide with each other; and

executing processing relevant to the first object and the second object, based on a result of the collision; and

obtaining at least a part of content stored in reference information storage that stores reference combination information indicating a combination of two objects among the plurality of objects designated in advance by the user, and reference manner information indicating a manner designated in advance by the user as the collision manner of the two objects,

wherein

the plurality of objects are displayed in mutually different display manners in the screen,

the executing comprises;

determining whether or not a combination of the first object and the second object is identical to the combination indicated by the reference combination information in a case where it is determined that the first object and the second object collide with each other,

comparing a collision manner of the first object and the second object and the manner indicated by the reference manner information in the case where it is determined that the first object and the second object collide with each other, and

executing authentication processing, based on a result of determination of whether or not the combination of the first object and the second object is identical to the combination indicated by the reference combination information, and a result of comparison of the collision manner of the first object and the second object and the manner indicated by the reference manner information,

the reference manner information includes reference relative speed information indicating a relative speed designated in advance by the user,

the comparing comprises determining whether or not a speed difference between a relative speed of one of the first object and the second object relative to another of the first object and the second object and the relative speed indicated by the reference relative speed information is equal to or smaller than a reference difference in the case where it is determined that the first object and the second object collide with each other, and

the authentication processing is executed based on the result of determination of whether or not the combination of the first object and the second object is identical to the combination indicated by the reference combination information, and a result of determination of whether or not the speed difference is equal to or smaller than the reference difference.

17. A non-transitory computer readable information storage medium storing program code for causing a computer to:

display a screen including a plurality of objects on a display;

obtain a result of detecting a plurality of a user'"'"'s designated positions in the screen;

in a case where one of the user'"'"'s designated positions is detected and the one designated position is included in a determination area that is set based on a position of one object among the plurality of objects, move the one object in accordance with movement of the one designated position;

in a case where at least one of a first object and a second object is moved determine whether or not the first object and the second object collide with each other; and

execute processing relevant to the first object and the second object, based on a result of the collision determination,

wherein

the program code causes the computer to;

obtain at least a part of content stored in a reference information storage that stores reference combination information indicating a combination of two objects among the plurality of objects designated in advance by the user, and reference manner information indicating a manner designated in advance by the user as the collision manner of the two objects,

display the plurality of objects in mutually different display manners in the screen,

determine whether or not a combination of the first object and the second object is identical to the combination indicated by the reference combination information in a case where it is determined that the first object and the second object collide with each other,

compare a collision manner of the first object and the second object and the manner indicated by the reference manner information in the case where it is determined that the first object and the second object collide with each other, and

execute authentication processing, based on a result of determination of whether or not the combination of the first object and the second object is identical to the combination indicated by the reference combination information, and a result of comparison of the collision manner of the first object and the second object and the manner indicated by the reference manner information,

wherein

the reference manner information includes reference relative speed information indicating a relative speed designated in advance by the user,

the program code causes the computer to;

compare the collision manner of the first object and the second object and the manner indicated by the reference manner information by determining whether or not a speed difference between a relative speed of one of the first object and the second object relative to another of the first object and the second object and the relative speed indicated by the reference relative speed information is equal to or smaller than a reference difference in the case where it is determined that the first object and the second object collide with each other, and

execute the authentication processing, based on the result of determination of whether or not the combination of the first object and the second object is identical to the combination indicated by the reference combination information, and a result of determination of whether or not the speed difference is equal to or smaller than the reference difference.