Operating touch screen interfaces

• US 7,692,629 B2
• Filed: 12/07/2006
• Issued: 04/06/2010
• Est. Priority Date: 12/07/2006
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Vogel, Daniel, Cutrell, Edward B., Wilson, Andrew D., Baudisch, Patrick, Hinckley, Kenneth P., Sarin, Raman
• Primary Examiner(s): Liang; Regina
• Application Number:
  US11/635,730
• Publication Number:
  US 20080136785A1
• Time in Patent Office: 1,216 Days
• Field of Search: 345/156, 345/157, 345/173
• US Class Current: 345/157
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

Techniques and technologies are provided which can allow for touch input with a touch screen device. In response to an attempt to select a target displayed on a screen, a callout can be rendered in a non-occluded area of the screen. The callout includes a representation of the area of the screen that is occluded by a selection entity when the attempt to select the target is made.

Claims

1. In a touch screen device comprising a screen, a method for touch input comprising:

displaying a target on the screen;

conditionally rendering a callout on the screen in response to an attempt by a user to select the target with a selection entity, wherein the callout comprises a representation of an occluded area of the screen in a non-occluded area of the screen, the callout is rendered when it is determined based on interaction with the user that occlusion is a problem for the target entity under the selection entity, the callout is not rendered when it is determined that occlusion is not a problem for the target under the selection entity, and the interaction with the user comprises contacting the occluded area of the screen with the selection entity to attempt to select the target displayed on the screen under the selection entity; and

determining that occlusion is a problem for the target under the selection entity if the selection entity is in contact with the display for more than a threshold time.

2. A method according to claim 1, further comprising:

rendering a pointer representing an actual contact point on the screen.

3. A method according to claim 2, further comprising:

guiding the pointer over a representation of the target displayed in the non-occluded area of the screen.

4. A method according to claim 3, further comprising:

committing to target acquisition when the pointer is over the representation of the target displayed in the non-occluded area of the screen.

5. A method according to claim 1, wherein the occluded area comprises an area of the screen which includes the target and which is covered by a selection entity.

6. A method according to claim 1, wherein determining if occlusion is not a problem for the target under the selection entity is based on size of the target.

7. A method according to claim 6, wherein the callout is not rendered when the target comprises a target which is relatively large with respect to the occluded area.

8. A computer-readable storage medium having computer-executable instructions stored thereon causing a computer to perform the method recited in claim 1.

9. A method according to claim 1, wherein the interaction with the user comprises a command to render the callout that is received from a user.

10. A method according to claim 1, wherein the actual contact point is a current selection point of the selection entity on the screen, and wherein rendering a callout comprises:

displaying the callout in the non-occluded area responsive to contact with the occluded area of the screen, wherein the callout comprises the representation of the occluded area of the screen in the non-occluded area of the screen.

11. A method according to claim 10, wherein guiding the pointer over a representation of the target displayed in the non-occluded area of the screen comprises:

keeping the selection entity on the screen; and

guiding the pointer, based on visual feedback provided by the callout, over the representation of the target displayed in the non-occluded area of the screen by moving the selection entity on the surface of the screen.

12. A method according to claim 11, wherein committing to target acquisition when the pointer is over the representation of the target displayed in the non-occluded area of the screen, comprises:

lifting the selection entity off the surface of the screen to define the selection point when the pointer is over the representation of the target displayed in the non-occluded area to select the target; and

removing the callout when the selection entity is lifted off the screen.

13. In a touch screen device comprising a screen, a method for touch input comprising:

displaying a target on the screen;

rendering a callout on the screen in response to an attempt to select the target, wherein the callout comprises a representation of an occluded area of the screen in a non-occluded area of the screen, wherein the attempt to select the target comprises contacting the occluded area of the screen with a selection entity to attempt to select the target displayed on the screen under the selection entity;

determining if occlusion is a problem for the target under the selection entity, wherein the callout is rendered if occlusion is a problem for the target under the selection entity and the callout is not rendered if occlusion is not a problem for the target under the selection entity, wherein determining if occlusion is a problem for the target under the selection entity comprises determining if occlusion is a problem for the target under the selection entity based on a dwell timeout period;

rendering a pointer representing an actual contact point on the screen;

guiding the pointer over a representation of the target displayed in the non-occluded area of the screen; and

committing to target acquisition when the pointer is over the representation of the target displayed in the non-occluded area of the screen.

14. A computer-readable storage medium having computer-executable instructions stored thereon causing a computer to perform the method recited in claim 13.

15. In a touch screen device comprising a screen, a method for touch input comprising:

displaying a target on the screen;

rendering a callout on the screen in response to an attempt to select the target, wherein the callout comprises a representation of an occluded area of the screen in a non-occluded area of the screen, wherein the attempt to select the target comprises contacting the occluded area of the screen with a selection entity to attempt to select the target displayed on the screen under the selection entity;

determining if occlusion is a problem for the target under the selection entity, wherein the callout is rendered if occlusion is a problem for the target under the selection entity and the callout is not rendered if occlusion is not a problem for the target under the selection entity, wherein determining if occlusion is a problem for the target under the selection entity comprises determining that occlusion is a problem for the target under the selection entity based on a command received from a user;

rendering a pointer representing an actual contact point on the screen;

guiding the pointer over a representation of the target displayed in the non-occluded area of the screen; and

committing to target acquisition when the pointer is over the representation of the target displayed in the non-occluded area of the screen.

16. A computer-readable storage medium having computer-executable instructions stored thereon causing a computer to perform the method recited in claim 15.

17. A touch screen device comprising:

a touch screen for displaying information comprising a target;

a computer-readable storage medium having stored computer-executable instructions for conditionally rendering a callout on a non-occluded area of the touch screen responsive to an attempt by a user to select a target displayed on the touch screen with a selection entity, wherein the screen includes an occluded area which includes the target and which is covered by the selection entity, and wherein the callout comprises a representation of the occluded area of the screen in the non-occluded area of the screen, the callout is rendered when it is determined based on interaction with the user that occlusion is a problem for the target entity under the selection entity, and the callout is not rendered when it is determined that occlusion is not a problem for the target under the selection entity;

a computer-readable storage medium having stored computer-executable instructions for rendering a pointer on the non-occluded area of the touch screen responsive to the attempt to select the target displayed on the touch screen, wherein the pointer represents an actual contact point of the selection entity on the screen and wherein the pointer is movable over the representation of the target displayed in the non-occluded area of the touch screen, wherein the target is selected by lifting the selection entity off the surface of the screen while the pointer is over the representation of the target displayed in the non-occluded area;

a computer-readable storage medium having stored computer-executable instructions for determining if occlusion is a problem for the target under the selection entity when the selection entity presses on a surface of the touch screen to attempt to select the target displayed on the screen for more than a threshold time; and

a computer-readable storage medium having stored computer-executable instructions for removing the callout when the selection entity is lifted off the touch screen.

18. A touch screen device according to claim 17, wherein the interaction with the user comprises a command to render the callout that is received from a user.

19. A display device comprising a screen designed to display at least one target which can be selected by pressing on a surface of the screen using a selection entity, the display device comprising:

a callout, conditionally rendered in a non-occluded area of the screen responsive to an attempt by a user to select the target using a selection entity, wherein the callout comprises a representation of an occluded area of the screen which includes the target and which is covered by the selection entity, wherein the representation of the occluded area comprises a representation of the target, the callout is rendered when it is determined based on interaction with the user that occlusion is a problem for the target entity under the selection entity, the callout is not rendered when it is determined that occlusion is not a problem for the target under the selection entity, the interaction with the user comprises contacting the occluded area of the screen with the selection entity to attempt to select the target displayed on the screen under the selection entity, and wherein it is determined that occlusion is a problem for the target under the selection entity if the selection entity is in contact with the display for more than a threshold time.

20. A display device according to claim 19, wherein the callout is not displayed when the user attempts to select a target on the screen of the display device which is larger than the occluded area.

21. A display device according to claim 19, further comprising:

a pointer representing an actual contact point of the selection entity on the screen, wherein the pointer is displayed in the non-occluded area, and wherein the actual contact point represents an actual current actual contact point within the occluded area, and

wherein the pointer is movable by moving the selection entity on the surface of the screen, and wherein visual feedback provided to the user by the callout allows a user to move the pointer over the representation of the target displayed in the non-occluded area of the screen.

22. A display device according to claim 19, wherein the interaction with the user comprises a command to render the callout that is received from a user.