Information processing device and information processing method for improving operability in selecting graphical user interface by generating multiple virtual points of contact

• US 9,841,890 B2
• Filed: 09/12/2012
• Issued: 12/12/2017
• Est. Priority Date: 11/28/2011
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Inventors: Kitao, Takashi, Hyodo, Katsuya, Mochizuki, Arito
• Primary Examiner(s): To, Jennifer
• Assistant Examiner(s): Molina, Hugo
• Application Number:
  US13/611,239
• Publication Number:
  US 20130139079A1
• Time in Patent Office: 1,917 Days
• Field of Search: 715764
• CPC Class Codes: G06F 3/00 Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

A plurality of GUIs are displayed on the screen of a display. A hit determination area of each GUI is defined within a graphic of the GUI. When a user touches a point of contact, four virtual points of contact are generated in the shape of a ‘V’ within the screen. A GUI desired to be selected by the user is identified according to a predetermined rule by referring to whether points of contact are located within each hit determination area, the number of points of contact, the priority level defined for each GUI, etc.

Claims

1. An information processing device having a processor comprising:

an input and output control unit configured to acquire, using the processor, a position of a single point of designation designated by a user in a display image including graphical user interfaces (GUIs) shown on a display screen;

a user operation content identification unit configured to simultaneously generate multiple points which are not displayed with a predetermined pattern at positions determined according to the position of the single point of designation on a plane that forms the display image, to acquire a hit score for each GUI, the hit score being a number of the multiple points and the single point of designation inside hit determination areas defined for respective GUIs, and to select a single GUI with a highest score as a selected GUI; and

a content processing unit is configured to execute a process mapped to the selected GUI,

wherein the user operation content identification unit distributes the multiple points in a shape of a ‘

V’

having an apex on the single point of designation when the information processing device is held by the user, and distributes the multiple points circularly and evenly around the single point of designation when the information processing device is not held by the user,

wherein, when the information processing device is held by the user, the input and output control unit acquires the single point of designation as a single point of contact on the touch panel by a finger of a hand holding the information processing device, and

wherein the user operation content identification unit refers to a position at a base of the finger of the hand holding the information processing device and defines a direction of a vector, extending from the position at the base of the finger to the single point of contact, as the direction of a tip of the finger and distributes the multiple points around a line extended from the vector in the direction of the vector.

2. The information processing device according to claim 1, wherein the user operation content identification unit arranges the multiple points with the predetermined pattern defined in association with the device or the display image.

3. The information processing device according to claim 1, further comprising:

a rear touch panel configured to sense a position of a finger supporting the information processing device from behind, wherein the user operation content identification unit identifies the position of the base of the finger, based on the position sensed by the rear touch panel and a size of the hand holding the information processing device.

4. The information processing device according to claim 1, further comprising:

a sensor configured to acquire an angle of tilt of the display screen, wherein the user operation content identification unit changes the distribution of the multiple points in accordance with the angle of the tilt of the display screen by referring to a file where the angle of tilt and an optimum distribution shape are mapped together.

5. The information processing device according to claim 1, further comprising:

a sensor configured to acquire an image of the finger on the display screen, wherein the user operation content identification unit identifies a direction of the tip of the finger based on the image of the finger and distributes the multiple points around the identified direction.

6. The information processing device according to claim 1, wherein the user operation content identification unit switches the position at the base of the finger depending on a region including the single point of contact on the touch panel.

7. The information processing device according to claim 1, wherein the position at the base of the finger is marked on the information processing device so that a user adjusts the position of the hand holding accordingly.

8. The information processing device according to claim 1,

wherein the user operation content identification unit distributes the multiple points in a shape of ‘

Y’

, a straight line or a curved line that passes through the single point of contact on the touch panel depending on an information processing device or screen configuration.

9. The information processing device according to claim 1, wherein the user operation content identification unit changes an orientation and a size of the ‘

V’

depending on a relation between the single point of contact and an edge of the touch panel.

10. The information processing device according to claim 1, wherein the user operation content identification unit changes a width of the ‘

V’

depending on a relation between positions of the single point of contact, GUIs, and an edge of the touch panel.

11. An information processing method comprising:

acquiring a position of a single point of designation designated by a user in a display image including graphical user interfaces (GUIs);

simultaneously generating multiple points which are not displayed with a predetermined pattern at positions determined according to the single position of the point of designation on a plane that forms the display image,

acquiring a hit score for each GUI, the hit score being a number of the multiple points and the single point of designation inside hit determination areas defined for respective GUIs,

selecting a single GUI with a highest score as a selected GUI; and

executing information processing mapped to the selected GUI,

wherein the generating distributes the multiple points in a shape of ‘

V’

having an apex on the single point of designation when an information processing device is held by the user, and distributes the multiple points circularly and evenly around the single point of designation when the information processing device is not held by the user,

wherein, when the information processing device is held by the user, the single point of designation is set as a single point of contact on the touch panel of a finger of a hand holding the information processing device, and

wherein the generating refers to a position at a base of the finger of the hand holding the information processing device and defines a direction of a vector, extending from the position at the base of the finger to the single point of contact, as the direction of a tip of the finger and distributes the multiple points around a line extended from the vector in the direction of the vector.

12. A non-transitory computer-readable recording medium encoded with a computer program comprising:

a module configured to acquire a position of a single point of designation designated by a user in a display image including graphical user interfaces (GUIs);

a module configured to simultaneously generate multiple points which are not displayed with a predetermined pattern at positions determined according to the position of the single point of designation on a plane that forms the display image, to acquire a hit score for each GUI, the hit score being a number of the multiple points and the single point of designation inside hit determination areas defined for respective GUIs, and to select a single GUI with a highest score as a selected GUI; and

a module configured to execute information processing mapped to the selected GUI, wherein

the module configured to generate the multiple points distributes the multiple points in a shape of ‘

V’

having an apex on the single point of designation when the computer is held by the user, and distributes the multiple points circularly and evenly around the single point of designation when the computer is not held by the user,

wherein, when the information processing device is held by the user, the module configured to acquire the position of the single point of designation acquires the single point of designation as a single point of contact on the touch panel by a finger of a hand holding the information processing device, and

wherein the module configured to generate the multiple points refers to a position at a base of the finger of the hand holding the information processing device and defines a direction of a vector, extending from the position at the base of the finger to the single point of contact, as the direction of a tip of the finger and distributes the multiple points around a line extended from the vector in the direction of the vector.

13. A non-transitory computer-readable recording medium in which data of a content file is recorded, the data having a structure configured to map:

a program of content executed in an information processing device;

to

a contact point generation rule configuration file configured to define a rule for simultaneously generating multiple points which are not displayed with a predetermined pattern at positions determined according to a position of a single point of designation, on a plane that forms a display image including graphical user interfaces (GUIs) displayed while content is being executed in the information processing device, the contact point generation rule configuration file being used to acquire a hit score for each GUI, the hit score being a number of the multiple points and the single point of designation inside hit determination areas defined for respective GUIs, to select a single GUI with a highest score as a selected GUI and to execute a process mapped to the selected GUI, wherein

the multiple points are distributed in a shape of ‘

V’

having on apex at the single point of designation when the information processing device is held by the user, and are distributed the multiple points circularly and evenly around the single point of designation when the information processing device is not held by the user,

wherein, when the information processing device is held by the user, the single point of designation is set as a single point of contact on the touch panel of a finger of a hand holding the information processing device, and

wherein the contact point generating rule refers to a position at a base of the finger of the hand holding the information processing device and defines a direction of a vector, extending from the position at the base of the finger to the single point of contact, as the direction of a tip of the finger and distributes the multiple points around a line extended from the vector in the direction of the vector.