Adaptive touch panel display

• US 9,569,019 B2
• Filed: 11/27/2012
• Issued: 02/14/2017
• Est. Priority Date: 12/01/2011
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Maruyama, Daisuke, Kawase, Takaaki, Kinoshita, Satoko, Horiuchi, Yoshio, Yanagawa, Tetsuya
• Primary Examiner(s): Eisen, Alexander
• Assistant Examiner(s): Almeida, Cory
• Application Number:
  US13/685,858
• Publication Number:
  US 20130141367A1
• Time in Patent Office: 1,540 Days
• Field of Search: 345173-179
• US Class Current: 1/1
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display

Abstract

An aspect of the invention includes a display device that operates controls on a display surface independent of a size of the display surface. A touch panel displays a screen on a display surface and inputs a user operation point on the display surface. An extracting part extracts controls that receive a touch operation of a user from content to be displayed on the display surface. A display controller displays auxiliary buttons for providing instructions for input of an extracted control, together with the content on the display surface.

Claims

1. A display device, comprising:

a touch panel that displays a screen on a display surface and inputs a user operation point on the display surface;

an extracting part that extracts controls that receive a touch operation of a user from content to be displayed on the display surface, wherein auxiliary buttons are created responsive to extraction of the controls; and

a display controller that displays the auxiliary buttons on edge parts of the display surface and provides instructions for input of an extracted one of the controls, together with the content, on the display surface;

wherein the display controller displays the controls on non-edge parts of the same display surface, the display device further comprising;

an input controller that provides instruction for inputting a corresponding control based on the user operating the auxiliary buttons;

wherein the extracting part extracts row and column position information of the controls on the display surface;

the display controller places the auxiliary buttons in a horizontal direction and a vertical direction of the display surface based on the row and column position information of the controls; and

the input controller provides instructions for inputting the control located at an intersecting point of a row and column corresponding to the auxiliary buttons operated by the user.

2. The display device according to claim 1, wherein the display controller displays the auxiliary buttons on the edge parts of the display surface at a predetermined size and a predetermined distance apart from each other and the controls.

3. The display device according to claim 1, wherein the display controller displays a plurality of the auxiliary buttons in a color that is the same as a color displayed on the display surface for the corresponding controls.

4. The display device according to claim 1, wherein the input controller:

causes one of the controls to be in a tentatively selected condition based on operation of a first auxiliary button by the user; and

transitions the tentatively selected condition of the control to another successive control based on operation of a second auxiliary button by the user.

5. The display device according to claim 1, wherein the display controller places the auxiliary buttons at positions on the display surface that are more than a predetermined distance from a display position of a plurality of the controls on the same display surface.

6. The display device according to claim 1, wherein the touch panel invalidates input from the user for controls on the display surface having corresponding auxiliary buttons that are placed on the edge parts of the display surface.

7. The display device according to claim 1, wherein the extracting part is prevented from extracting controls that are placed on the edge parts of the display surface.

8. The display device according to claim 1, wherein the extracting part extracts the controls from image information of the content.

9. The display device according to claim 1, wherein the extracting part extracts the controls from source code of the content.

10. The display device according to claim 1, wherein the extracting part receives information for the controls from an application that displays the content.

11. The display device according to claim 1, wherein the display controller displays a line on the display surface that connects between the auxiliary button and corresponding control based on touch input by the user of the auxiliary button.

12. The display device according to claim 1, wherein a set of the auxiliary buttons shares a one-to-one correspondence with a corresponding control based on the intersecting point, the intersecting point defined by the row and column position information.

17. The display device according to claim 1, wherein the extraction of the controls includes extracting information of the controls including a type, label, size, and position of the controls, wherein the extracting part sends the information to the display controller.

13. A display device, comprising:

a touch panel with a display surface; and

a display controller that displays controls and auxiliary buttons on the display surface, the auxiliary buttons call out functions that are the same as functions of the controls, the auxiliary buttons displayed on edge parts of the display surface, wherein the auxiliary buttons are created responsive to extraction of the controls;

wherein the display controller displays the controls on non-edge parts of the same display surface;

an input controller that provides instruction for inputting a corresponding control based on a user operating the auxiliary buttons; and

an extracting part that extracts row and column position information of the controls on the display surface;

wherein the display controller places the auxiliary buttons in a horizontal direction and a vertical direction of the display surface based on the row and column position information of the controls; and

the input controller provides instructions for inputting the control located at an intersecting point of a row and column corresponding to the auxiliary buttons operated by the user.

14. A display method, comprising:

displaying content on a display surface;

inputting user operation points on the display surface;

extracting controls that receive touch operations of a user from the content to be displayed on the display surface, wherein auxiliary buttons are created responsive to extraction of the controls; and

displaying the auxiliary buttons on edge parts of the display surface and providing instructions for input to an extracted control, together with the content on the display surface;

displaying the controls on non-edge parts of the display surface;

providing instruction for inputting a corresponding control based on the user operating the auxiliary buttons;

extracting row and column position information of the controls on the display surface;

placing the auxiliary buttons in a horizontal direction and a vertical direction of the display surface based on the row and column position information of the controls; and

providing instructions for inputting the control located at an intersecting point of a row and column corresponding to the auxiliary buttons operated by the user.

15. The display method according to claim 14, further comprising displaying the auxiliary buttons on the edge parts of the display surface at a predetermined size and a predetermined distance apart from each other and the controls.

16. A computer program product comprising a computer readable storage medium having computer readable program code embodied therewith, the computer readable program code, which when executed by a computer processor, causes the computer processor to perform a method, the method comprising:

displaying content on a display surface of a display device;

inputting user operation points on the display surface;

extracting controls that receive touch operations of a user from the content to be displayed on the display surface, wherein auxiliary buttons are created responsive to extraction of the controls; and

displaying the auxiliary buttons on edge parts of the display surface and providing instructions for input to an extracted control, together with the content on the display surface;

displaying the controls on non-edge parts of the display surface;

providings instruction for inputting a corresponding control based on the user operating the auxiliary buttons;

extracting row and column position information of the controls on the display surface;

placing the auxiliary buttons in a horizontal direction and a vertical direction of the display surface based on the row and column position information of the controls; and

providing instructions for inputting the control located at an intersecting point of a row and column corresponding to the auxiliary buttons operated by the user.