Augmented I/O for limited form factor user-interfaces

• US 8,237,666 B2
• Filed: 10/10/2008
• Issued: 08/07/2012
• Est. Priority Date: 10/10/2008
• Status: Active Grant

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Soo, Armstrong, Brandt, Jeffrey, Ku, Bernard
• Primary Examiner(s): Mengistu, Amare
• Assistant Examiner(s): Bolotin, Dmitriy
• Application Number:
  US12/249,064
• Publication Number:
  US 20100090964A1
• Time in Patent Office: 1,397 Days
• Field of Search: 345173-178, 345660-671, 715/863, 715/700, 715/864, 178 1801- 1904
• US Class Current: 345/173
• CPC Class Codes: G06F 2203/04805 Virtual magnifying lens, i.e. window or frame movable on top of displayed information to enlarge it for better reading or selection
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

The claimed subject matter relates to an architecture that can enhance and/or simplify tactile-based I/O transactions in connection with a user-interface (UI) of limited form factor. In particular, the architecture can monitor a position of a selector object such as an operator'"'"'s finger relative to a UI display as the selector object hovers or moves above the UI display. Based upon this position, an analogous coordinate in the UI display can be determined, and a portion of the UI display substantially centered at the coordinate can be modified. As one example, the UI display can be modified to increase the magnification scale (e.g., a virtual magnifying glass) of the portion of the display indicated by the selector object.

Claims

1. A system that enhances tactile-related input/output in connection with a user-interface, comprising:

a tracking component that monitors a position of a selector object relative to a user interface display and that utilizes a distance parameter to effectuate a pseudo-surface at a distance from a surface of the user interface display set by the distance parameter, wherein the pseudo-surface emulates a touch-sensitive display surface;

an augmentation component that updates an output of the user interface display based upon the position of the selector object; and

an activation component that initiates the augmentation component to update the output based upon a complexity of graphical elements included in the user interface display.

2. The system of claim 1, the selector object is an operator'"'"'s finger.

3. The system of claim 1, the position includes x-y values for a coordinate plane that is substantially parallel to a surface of the user interface display, and further includes a distance between the user interface display and the position of the selector object.

4. The system of claim 1, the augmentation component provides a virtual magnifying glass that increases a magnification scale of a portion of the user interface display such that the portion is displayed at a different scale within an area of effect of the virtual magnifying glass.

5. The system of claim 4, the portion of the user interface display is further biased toward a central location of an element in the user interface display.

6. The system of claim 4, the augmentation component updates a location of the virtual magnifying glass as the position of the selector object changes.

7. The system of claim 4, the magnification scale is a function of a distance between the selector object and the user interface display.

8. The system of claim 4, the portion displayed at a different scale occludes neighboring elements in the user interface display proximal to the portion and within the area of effect of the virtual magnifying glass.

9. The system of claim 8, the augmentation component decreases the magnification scale for occluded neighboring elements and displays within a secondary area of effect the neighboring elements in a crowded fashion beyond the area of effect of the virtual magnifying glass.

10. The system of claim 4, the elements in the user interface display proximal to the portion and within the area of effect of the virtual magnifying glass are updated to become semi-transparent in order to prevent occlusion.

11. The system of claim 1, the augmentation component updates the output of the user interface display by affecting a change in a red-green-blue attribute of a pixel included in the user interface display.

12. The system of claim 1, wherein contact with the surface of a touch-sensitive display that accepts an input based upon contact is simulated when the selector object breaks a plane associated with the pseudo-surface.

13. The system of claim 12, the tracking component facilitates feedback signaling when the selector object breaks the plane associated with the pseudo-surface.

14. The system of claim 13, wherein the feedback signaling is an audible output representative of a selection of an element included in the user interface display.

15. The system of claim 1, further comprising:

at least one memory; and

at least one processor that facilitates execution of at least one computer-executable component stored in the at least one memory, the at least one computer-executable component being executed to implement, at least in part, the tracking component.

16. A method for enhancing tactile-related input/output for a user interface, comprising:

tracking a position of a selector object hovering over a user interface display;

associating the position with a coordinate for the user interface display that is substantially along a line adjoining a surface of the user interface display to the selector object that is perpendicular to the surface;

creating a pseudo-surface at a specified distance from the surface for simulating a touch-sensitive user interface display;

issuing an activation in response to detection of complexity of graphical elements included in the user interface display; and

providing, in response to the activation, an augmented output for the user interface display in an area of effect substantially centered at the coordinate.

17. The method of claim 16, further comprising:

implementing a virtual magnifying glass for the augmented output whereby a magnified area around the coordinate is expanded to fit the area of effect; and

displaying elements of the user interface display that are included within the area of effect but not included within the magnified area in a semi-transparent manner.

18. The method of claim 16, further comprising:

employing an activation message for initiating activity associated with providing the augmented output; and

generating the activation message based upon a predefined gesture associated with the selector object.

19. The method of claim 16, wherein the tracking includes tracking the position by at least one computing device comprising at least one processor.

20. A system that provides a pseudo-surface for a user interface to emulate a touch-sensitive user interface, comprising:

a tracking component that monitors a position of a selector object relative to a user interface display, the position includes planar coordinates associated with the user interface display and a distance between the user interface display and the selector object;

a designation component that identifies a pseudo-surface plane substantially parallel to, and at an offset distance from, a surface of the user interface display, wherein the pseudo-surface plane emulates a touch-sensitive user interface display;

an emulation component that identifies a gesture performed by the selector object in response to the distance being less than the offset distance and converts the gesture into input to a device associated with the user interface display; and

an activation component that initiates the emulation component to identify the gesture based upon a complexity of graphical elements included in the user interface display.