Method and apparatus for area-efficient graphical user interface

• US 9,122,394 B2
• Filed: 01/19/2012
• Issued: 09/01/2015
• Est. Priority Date: 02/10/2011
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.), Sony Corporation (Sony Group Corp.)
• Inventors: Funabashi, Yoshimitsu, Kunieda, Shunsuke, Johnson, Brian, Furuya, Jorge
• Primary Examiner(s): To, Jennifer
• Assistant Examiner(s): Sundar, Sunil
• Application Number:
  US13/353,801
• Publication Number:
  US 20130031515A1
• Time in Patent Office: 1,321 Days
• Field of Search: 715/863, 715/771
• US Class Current: 1/1
• CPC Class Codes: A63F 2300/1075 using a touch screen
• CPC Class Codes: G06F 2203/04804 Transparency, e.g. transparent or translucent windows
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 8/34 Graphical or visual programming

Abstract

A GUI screen image is a standard screen image, and displays a first combined GUI area, which is a combination of a GUI of the directional keys and a GUI of a joystick, and a second combined GUI area, which is a combination of a GUI of the four-type operation buttons and a GUI of a joystick, at the lower left and at the lower right on the screen image, respectively. Depending on an area in the first combined GUI area or in the second combined GUI area to which a user newly touches, which of the combined GUI to be used is determined and a screen image is switched, and if a finger or a thumb detaches, the screen image switches back.

Claims

1. An apparatus implementing an input device, comprising:

at least one microprocessor and at least one computer memory containing computer code that is executed by the microprocessor to carry out one or more of the following elements;

a GUI image generating unit operative to generate a GUI (Graphical User Interface) image, including at least one combined GUI image area, wherein the combined GUI image area includes at least a first GUI graphic and a second GUI graphic, representing at least a first GUI operation area and a second GUI operation area, respectively, wherein;

(i) the second GUI graphic includes a directional keys graphic that corresponds to the second GUI operational area, which includes directional keys, wherein a plurality of direction instruction keys are disposed on the circumference of a circle, (ii) the first GUI graphic includes a joystick graphic that corresponds to the first GUI operational area, which includes a pseudo-joystick receiving an input of an arbitrary direction and an arbitrary quantity, and (iii) the joystick graphic is disposed at the center of the directional keys graphic in the combined GUI image area;

a display device operative to display the combined GUI image, and the at least first and second GUI operation areas;

a touch panel operative to cover the display device and operative to detect a position where a user makes contact with the display device; and

an operation information converting unit operative to identify an operation performed by the user based on a correspondence relationship between a contact point detected by the touch panel and the GUI image being displayed, such that when the user makes contact with one of the at least first and second GUI graphics within the combined GUI image area on the touch panel, the corresponding one of the at least first and second GUI operation areas is selected and is displayed in place of the combined GUI image area, wherein;

when the user selects the second GUI graphic within the combined GUI image area and the second GUI operation area is displayed in place of the combined GUI image area, the GUI image generating unit operates to display at least a portion of the first GUI graphic from the combined GUI image area within the second GUI operation area, such that a touch selection by the user of the at least a portion of the first GUI graphic causes the first GUI operation area to be displayed in place of the second GUI operation area, and

when the user selects the first GUI graphic within the combined GUI image area and the first GUI operation area is displayed in place of the combined GUI image area, the GUI image generating unit operates to prohibit display of any graphic that would permit a touch selection by the user to cause the second GUI operation area to be displayed in place of the first GUI operation area.

2. The apparatus according to claim 1, wherein

at least the first GUI operation area requires a continuous touch by the user in order to produce an analogue value in accordance with the continuous touch and movement of the contact point, and

a detection area in the combined GUI image area is provided for switching to the first GUI operation area and is smaller than a detection area of the first GUI operation area after the switching from the combined GUI image area.

3. The apparatus according to claim 2, wherein at least the second GUI operation area includes a function provided at the contact point to be on or off through contact/non-contact.

4. The apparatus according to claim 1, wherein, when a continuous contact to the selected one of the at least first and second GUI operation areas is terminated, the GUI image generating unit switches back to the combined GUI image area.

5. The apparatus according to claim 1, wherein:

the first GUI operation area includes an analogue input GUI operation area that receives an analogue value in accordance with the contact point, and

the second GUI operation area includes an on/off input GUI operation area that switches a function provided at the contact point to be on or off through contact/non-contact.

6. The apparatus according to claim 1, wherein the operation information converting unit sequentially acquires the direction and distance from the point where the contact is started to a current contact point, and sets the acquired value as input values of direction and quantity, during a time period when the first GUI operation area of the pseudo-joystick is selected.

7. The apparatus according to claim 1, wherein the display device displays the GUI image generated by the GUI image generating unit as an on-screen display on an output image generated as a result of information processing performed in an information processing device with which the input device is connected.

8. The apparatus according to claim 1, wherein the GUI image generating unit provides a plurality of separate combined GUI image areas on one screen image.

9. The apparatus according to claim 1, wherein the GUI image generating unit displays an indicator that represents a point currently in contact by a user, during a time period when the first GUI operation area of the pseudo-joystick is selected.

13. The apparatus according to claim 1, wherein the combined GUI image area is represented such that the first GUI graphic is surrounded by the second GUI graphic.

14. The apparatus according to claim 1, wherein the GUI image generating unit operates to cause the combined GUI image area to at least one of fade away and disappear when the user selects at least one of the first and second GUI graphics within the combined GUI image area.

10. An apparatus implementing an information processing device, comprising:

at least one microprocessor and at least one computer memory containing computer code that is executed by the microprocessor to carry out one or more of the following elements;

a GUI image generating unit operative to generate a GUI (Graphical User Interface) image, including at least one combined GUI image area, wherein the combined GUI image area includes at least a first GUI graphic and a second GUI graphic, representing at least a first GUI operation area and a second GUI operation area, respectively, wherein;

(i) the second GUI graphic includes a directional keys graphic that corresponds to the second GUI operational area, which includes directional keys, wherein a plurality of direction instruction keys are disposed on the circumference of a circle, (ii) the first GUI graphic includes a joystick graphic that corresponds to the first GUI operational area, which includes a pseudo-joystick receiving an input of an arbitrary direction and an arbitrary quantity, and (iii) the joystick graphic is disposed at the center of the directional keys graphic in the combined GUI image area;

an information processing unit operative to perform information processing in accordance with an operation made to the at least one of the first and second GUI operation areas by a user;

a display device operative to display the combined GUI image, and the at least first and second GUI operation areas as an on-screen display on an output image generated as a result of information processing performed in the information processing device;

a touch panel operative to cover the display device and operative to detect a position where a user makes contact with the display device; and

an operation information converting unit operative to identify an operation performed by the user based on a correspondence relationship between a contact point detected by the touch panel and the GUI image being displayed, such that when the user makes contact with one of the at least first and second GUI graphics within the combined GUI image area on the touch panel, the corresponding one of the at least first and second GUI operation areas is selected and is displayed in place of the combined GUI image area, wherein;

when the user selects the second GUI graphic within the combined GUI image area and the second GUI operation area is displayed in place of the combined GUI image area, the GUI image generating unit operates to display at least a portion of the first GUI graphic from the combined GUI image area within the second GUI operation area, such that a touch selection by the user of the at least a portion of the first GUI graphic causes the first GUI operation area to be displayed in place of the second GUI operation area, and

when the user selects the first GUI graphic within the combined GUI image area and the first GUI operation area is displayed in place of the combined GUI image area, the GUI image generating unit operates to prohibit display of any graphic that would permit a touch selection by the user to cause the second GUI operation area to be displayed in place of the first GUI operation area.

11. An input value acquiring method comprising:

generating a GUI (Graphical User Interface) image, including at least one combined GUI image area, wherein the combined GUI image area includes at least a first GUI graphic and a second GUI graphic, representing at least a first GUI operation area and a second GUI operation area, respectively, wherein;

(i) the second GUI graphic includes a directional keys graphic that corresponds to the second GUI operational area, which includes directional keys, wherein a plurality of direction instruction keys are disposed on the circumference of a circle, (ii) the first GUI graphic includes a joystick graphic that corresponds to the first GUI operational area, which includes a pseudo-joystick receiving an input of an arbitrary direction and an arbitrary quantity, and (iii) the joystick graphic is disposed at the center of the directional keys graphic in the combined GUI image area;

displaying the combined GUI image, and the at least first and second GUI operation areas on a display device as an on-screen display on an output image generated as a result of information processing;

detecting, by the touch panel that cover the display device, a position where a user makes contact; and

identifying an operation performed by the user based on a correspondence relationship between a detected contact point and a GUI image being displayed, such that when the user makes contact with one of the at least first and second GUI graphics within the combined GUI image area on the touch panel, the corresponding one of the at least first and second GUI operation areas is selected and is displayed in place of the combined GUI image area, wherein;

when the user selects the second GUI graphic within the combined GUI image area and the second GUI operation area is displayed in place of the combined GUI image area, at least a portion of the first GUI graphic from the combined GUI image area is displayed within the second GUI operation area, such that a touch selection by the user of the at least a portion of the first GUI graphic causes the first GUI operation area to be displayed in place of the second GUI operation area, and

when the user selects the first GUI graphic within the combined GUI image area and the first GUI operation area is displayed in place of the combined GUI image area, no graphic is displayed that would permit a touch selection by the user to cause the second GUI operation area to be displayed in place of the first GUI operation area.

12. A non-transitory computer-readable recording medium containing a computer program, the computer program being executable by, and causing, a computer to carry out one or more actions, comprising:

generating a GUI (Graphical User Interface) image, including at least one combined GUI image area, wherein the combined GUI image area includes at least a first GUI graphic and a second GUI graphic, representing at least a first GUI operation area and a second GUI operation area, respectively, wherein;

(i) the second GUI graphic includes a directional keys graphic that corresponds to the second GUI operational area, which includes directional keys, wherein a plurality of direction instruction keys are disposed on the circumference of a circle, (ii) the first GUI graphic includes a joystick graphic that corresponds to the first GUI operational area, which includes a pseudo-joystick receiving an input of an arbitrary direction and an arbitrary quantity, and (iii) the joystick graphic is disposed at the center of the directional keys graphic in the combined GUI image area;

displaying the combined GUI image, and the at least first and second GUI operation areas on a display device as an on-screen display on an output image generated as a result of information processing;

identifying an operation performed by the user based on a correspondence relationship between a contact point detected by the touch panel that covers the display device and a GUI image being displayed, such that when the user makes contact with one of the at least first and second GUI graphics within the combined GUI image area on the touch panel, the corresponding one of the at least first and second GUI operation areas is selected and is displayed in place of the combined GUI image area, wherein;

when the user selects the second GUI graphic within the combined GUI image area and the second GUI operation area is displayed in place of the combined GUI image area, the module configured to generate a GUI image operates to display at least a portion of the first GUI graphic from the combined GUI image area within the second GUI operation area, such that a touch selection by the user of the at least a portion of the first GUI graphic causes the first GUI operation area to be displayed in place of the second GUI operation area, and

when the user selects the first GUI graphic within the combined GUI image area and the first GUI operation area is displayed in place of the combined GUI image area, the module configured to generate a GUI image prohibits display of any graphic that would permit a touch selection by the user to cause the second GUI operation area to be displayed in place of the first GUI operation area.