BIMODAL USER INTERFACE PARADIGM FOR TOUCH SCREEN DEVICES

• US 20070097096A1
• Filed: 01/23/2007
• Published: 05/03/2007
• Est. Priority Date: 03/25/2006
• Status: Abandoned Application

• Current Assignee: Outland Research LLC
• Original Assignee: Outland Research LLC
• Inventors: Rosenberg, Louis
• Application Number:
  US11/626,353
• Publication Number:
  US 20070097096A1
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1643 the display being associated to a digitizer, e.g. laptops that can be used as penpads details related to the relative motion of the display enclosure with respect to the body enclosure, e.g. to move between laptop and tablet PC configuration G06F1/1615
• CPC Class Codes: G06F 3/0418 for error correction or compensation, e.g. based on parallax, calibration or alignment
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

A touch screen device provides bi-modal user interaction. The touch screen device includes (a) a touch screen interface, (b) a detector to detect an area of finger interaction with the touch screen surface, and (c) a processor. The processor determines, based on at least one of a size, a shape, and an orientation of the detected area of finger interaction, whether a current finger interaction is of one of: a finger-tip interaction type and a finger-pad interaction type. The processor also selects and implements, based on a determined interaction type, one of two different targeting modes, including a first targeting mode selected and implemented in response to a determined finger-tip interaction type and a second targeting mode selected and implemented in response to a determined finger-pad interaction type. In a preferred embodiment, the first targeting mode is direct-targeting mode and the second targeting mode is an offset-targeting mode.

Claims

1. A method of bi-modal touch screen interaction for a touch screen device, the method comprising:

detecting an area of finger interaction upon a touch screen surface;

determining, based on at least one of a size, a shape, and an orientation of the detected area of finger interaction, whether the finger interaction is one of;

a finger-tip interaction type and a finger-pad interaction type; and

implementing, based on the determined interaction type, one of two different targeting modes, including a first targeting mode implemented in response to a determined finger-tip interaction type and a second targeting mode implemented in response to a determined finger-pad interaction type.

2. The method as recited in claim 1 wherein the first targeting mode provides a targeting location within the area of finger interaction, and the second targeting mode provides a targeting location outside of the area of finger interaction.

3. The method as recited in claim 2 wherein the first targeting mode provides the targeting location under a user'"'"'s finger and thereby permits a user to target graphical user interface elements located under the user'"'"'s finger.

4. The method as recited in claim 2 wherein the second targeting mode provides the targeting location forward of a user'"'"'s finger and thereby permits a user to target graphical user interface elements located forward of the user'"'"'s finger.

5. The method as recited in claim 4 wherein a graphical cursor element is displayed during the second targeting mode to indicate visually to the user the targeting location forward of the user'"'"'s finger.

6. The method as recited in claim 4 wherein the targeting location forward of the user'"'"'s finger is located a distance forward of the user'"'"'s finger, the distance being determined at least in part based on the size of the detected area of finger interaction.

7. The method as recited in claim 3 wherein the targeting location used by the first targeting mode is located substantially near a geometric center of the detected area of finger interaction.

8. The method as recited in claim 1 wherein a first graphical cursor element type is displayed during the first targeting mode and a second graphical cursor element type is displayed during the second targeting mode.

9. The method as recited in claim 1 wherein a graphical cursor is displayed only during the second targeting mode.

10. The method as recited in claim 1 wherein the detected area of finger interaction is approximately a shape of an ellipse and wherein the determination of the finger interaction is performed based at least in part on an assessment of at least one of a major axis of the ellipse, a minor axis of the ellipse, and an orientation of the ellipse.

11. The method as recited in claim 1 further comprising dynamically changing from the first targeting mode to the second targeting mode in response to determining that a user has rolled a finger from the finger-tip interaction type to the finger-pad interaction type.

12. The method as recited in claim 1 further comprising dynamically changing from the second targeting mode to the first targeting mode in response to determining that a user has rolled a finger from the finger-pad interaction type to the finger-tip interaction type.

13. The method as recited in claim 1 wherein the determining is based on at least two of the size, shape, and orientation of the area of finger interaction.

14. The method as recited in claim 2 wherein the targeting location employed by the second targeting mode is determined at least in part based on a substantially current orientation of the area of finger interaction.

15. The method as recited in claim 2 wherein the targeting location employed by the second targeting mode is determined at least in part based on data from an orientation sensor responsive to a spatial orientation of the touch screen device.

16. The method as recited in claim 1 wherein implementing the second targeting mode is further dependent upon an elapsed time of finger interaction exceeding a time threshold.

17. A touch screen device for providing bi-modal user interaction, the touch screen device comprising:

a display screen;

a detector to detect an area of finger interaction with the display screen; and

a processor to

determine, based on at least one of a size, a shape, and an orientation of the detected area of finger interaction, whether a current finger interaction is one of;

a finger-tip interaction type and a finger-pad interaction type, and

implement, based on a determined interaction type, one of two different targeting modes, including a first targeting mode implemented in response to a determined finger-tip interaction type and a second targeting mode implemented in response to a determined finger-pad interaction type.

18. The touch screen device of claim 17 wherein the first targeting mode provides a targeting location within the area of finger interaction, and the second targeting mode provides the targeting location outside of the area of finger interaction.

19. The touch screen device of claim 18 wherein the second targeting mode provides the targeting location forward of a user'"'"'s finger and wherein a graphical cursor element is displayed upon the display screen during the second targeting mode to indicate visually to the user the targeting location forward of the user'"'"'s finger.

20. The touch screen device of claim 19 wherein the targeting location forward of the user'"'"'s finger is located a distance forward of the user'"'"'s finger, and the distance is determined, at least in part, based on the size of the detected area of finger interaction.

21. The touch screen device of claim 18 wherein the first targeting mode provides the targeting location that comprises a point or area substantially near a geometric center of the detected area of finger interaction.

22. The touch screen device of claim 17 wherein a first graphical cursor element type is displayed during the first targeting mode and a second graphical cursor element type is displayed during the second targeting mode.

23. The touch screen device of claim 17 wherein the processor is adapted to dynamically change from the first targeting mode to the second targeting mode in response to a determination that a user has rolled a finger from the finger-tip interaction type to the finger-pad interaction type.

24. The touch screen device of claim 18 wherein the targeting location employed by the second targeting mode is determined, at least in part, based on a substantially current orientation of the area of finger interaction.

25. The touch screen device of claim 17 wherein implementing the second targeting mode is further dependent upon an elapsed time of finger interaction exceeding a time threshold.

26. The touch screen device of claim 18 wherein the processor is adapted to enable a user to select a targeted graphical element when engaged in the second targeting mode by momentarily lifting and tapping the finger of detected interaction upon the touch screen surface.

27. The touch screen device of claim 17 wherein the processor is adapted to enable a user to select a targeted graphical element when engaged in the second targeting mode by touching an additional finger upon the touch screen surface to indicate a click event.

28. A method of bi-modal user interaction for a touch screen device, the method comprising:

detecting an area of finger interaction upon a touch screen surface;

repeatedly determining, for the detected area of finger interaction, an elapsed time of continuous interaction with the touch screen surface; and

implementing, based upon a currently determined elapsed time, one of two different targeting modes, including a first targeting mode to implement in response to an elapsed time being less than threshold value and a second targeting mode to implement in response to the elapsed time being greater than the threshold value.

29. The method as recited in claim 28 wherein the first targeting mode provides a targeting location within the area of finger interaction, and the second targeting mode provides the targeting location outside of the area of finger interaction.

30. The method as recited in claim 29 wherein the first targeting mode provides the targeting location under a user'"'"'s finger and thereby permits the user to target graphical user interface elements located under the user'"'"'s finger.

31. The method as recited in claim 29 wherein the second targeting mode provides the targeting location forward of the user'"'"'s finger and thereby permits the user to target graphical user interface elements located forward of the user'"'"'s finger.

32. The method as recited in claim 31 wherein a graphical cursor element is displayed during the second targeting mode to indicate visually to the user the targeting location forward of the user'"'"'s finger.

33. The method as recited in claim 31 wherein the targeting location forward of the user'"'"'s finger is located a distance forward of the user'"'"'s finger, the distance being determined at least in part based on the size of the detected area of finger interaction.

34. The method as recited in claim 30 wherein the targeting location used by the first targeting mode is located substantially near a geometric center of the detected area of finger interaction.

35. The method as recited in claim 29 wherein a first graphical cursor element type is displayed during the first targeting mode and a second graphical cursor element type is displayed during the second targeting mode.

36. The method as recited in claim 29 wherein the targeting location employed by the second targeting mode is determined at least in part based on a substantially current orientation of the area of finger interaction.

37. The method as recited in claim 29 wherein the targeting location employed by the second targeting mode is determined at least in part based on data from an orientation sensor responsive to a spatial orientation of the touch screen device.

38. The method of claim 29 wherein a user is enabled to select a targeted graphical element when engaged in the second targeting mode by momentarily lifting and tapping a finger of detected interaction upon the touch screen surface.

39. The method of claim 29 wherein a user is enabled select a targeted graphical element when engaged in the second targeting mode by pressing down with an interaction finger to impart a force level that exceeds a threshold value.

40. The method of claim 29 wherein a user is enabled to select a targeted graphical element when engaged in the second targeting mode by touching an additional finger upon the touch screen surface to indicate a click event.