Device, method, and graphical user interface for management and manipulation of user interface elements

• US 8,358,281 B2
• Filed: 12/15/2009
• Issued: 01/22/2013
• Est. Priority Date: 12/15/2009
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: McCullough, Ian Patrick, Berger, Peter Glen
• Primary Examiner(s): Tzeng, Fred
• Application Number:
  US12/638,736
• Publication Number:
  US 20110141031A1
• Time in Patent Office: 1,134 Days
• Field of Search: 345/173
• US Class Current: 345/173
• CPC Class Codes: G06F 2203/04805 Virtual magnifying lens, i.e. window or frame movable on top of displayed information to enlarge it for better reading or selection
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Context-sensitive, automated use of a magnification loupe is disclosed to facilitate management and manipulation of user interface content and small user interface elements via gestures on a touch-sensitive surface. In one embodiment, a magnifying loupe is displayed based on the context associated with a finger-based gesture on a touch-sensitive surface. For example, a magnification loupe is displayed when one or more user interface elements corresponding to the location of the gesture on the touch-sensitive surface is smaller than a predefined size threshold, but the loupe is not displayed when the user interface elements corresponding to the location of the gesture on the touch-sensitive surface are larger than the predefined size threshold. In another embodiment, the magnification power of the loupe varies based on the size of the one or more user interface elements corresponding to the location of the gesture on the touch-sensitive surface.

Claims

1. A method, comprising:

at a computing device with a display and a touch-sensitive surface;

displaying on the display a plurality of user interface elements;

detecting a point of contact by a user on the touch-sensitive surface, wherein;

the point of contact on the touch-sensitive surface corresponds to a location on the display of one or more of the plurality of user interface elements, and,

the one or more of the plurality of user interface elements have a feature size;

while detecting the point of contact by the user on the touch-sensitive surface;

determining whether the feature size of the one or more of the plurality of user interface elements exceeds a first predefined size threshold;

when the feature size of the one or more of the plurality of user interface elements is greater than the first predefined size threshold, maintaining the display at a constant magnification; and

when the feature size of the one or more of the plurality of user interface elements is less than the first predefined size threshold, displaying on the display a loupe that depicts a magnified image of at least one of the one or more of the plurality of user interface elements, wherein the magnified image corresponds to the area of the display corresponding to the location surrounding the point of contact on the touch-sensitive surface,

while continuing to detect the point of contact by the user on the touch-sensitive surface;

displaying within the loupe a selection indicia in conjunction with at least one of the plurality of user interface elements displayed within the loupe, the selection indicia corresponding to a selected user interface element displayed on the display at a location corresponding to the point of contact on the touch-sensitive surface;

detecting an action gesture on the touch-sensitive surface; and

performing an action associated with the action gesture on the selected user interface element.

2. The method of claim 1, further comprising:

while continuing to detect the point of contact by the user on the touch-sensitive surface;

detecting a movement of the point of contact by the user on the touch-sensitive surface; and

in response to detecting the movement, continuously changing a respective displayed location of the loupe in accordance with the movement of the point of contact on the touch-sensitive surface.

3. The method of claim 1, further comprising:

detecting movement of the point of contact by the user on the touch-sensitive surface; and

in response to detecting the movement, updating the selection indicia to correspond to respective user interface elements in accordance with the movement of the point of contact when the point of contact on the touch-sensitive surface corresponds to respective locations of respective user interface elements displayed on the display.

4. The method of claim 1, wherein the loupe uses a magnification factor that scales in accordance with the feature size of the one or more of the plurality of user interface elements.

5. The method of claim 1, wherein the display and the touch-sensitive surface comprise a touch-screen display.

6. The method of claim 1, wherein the plurality of user interface elements includes displayed features within an electronic document.

7. The method of claim 1, wherein the magnified image is displayed at a location on the display corresponding to a location proximate to the point of contact by the user on the touch-sensitive surface.

8. The method of claim 1, wherein the magnified image is displayed at a respective location on the display corresponding to a location offset from the point of contact by the user on the touch-sensitive surface.

9. A computing device, comprising:

a display;

a touch-sensitive surface;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying on the display a plurality of user interface elements;

detecting a point of contact by a user on the touch-sensitive surface, wherein;

the point of contact on the touch-sensitive surface corresponds to a location on the display of one or more of the plurality of user interface elements, and,

the one or more of the plurality of user interface elements have a feature size;

while detecting the point of contact by the user on the touch-sensitive surface;

determining whether the feature size of the one or more of the plurality of user interface elements exceeds a first predefined size threshold;

when the feature size of the one or more of the plurality of user interface elements is greater than the first predefined size threshold, maintaining the display at a constant magnification; and

when the feature size of the one or more of the plurality of user interface elements is less than the first predefined size threshold, displaying on the display a loupe that depicts a magnified image of at least one of the one or more of the plurality of user interface elements, wherein the magnified image corresponds to the area of the display corresponding to the location surrounding the point of contact on the touch-sensitive surface,

while continuing to detect the point of contact by the user on the touch-sensitive surface;

displaying within the loupe a selection indicia in conjunction with at least one of the plurality of user interface elements displayed within the loupe, the selection indicia corresponding to a selected user interface element displayed on the display at a location corresponding to the point of contact on the touch-sensitive surface;

detecting an action gesture on the touch-sensitive surface; and

performing an action associated with the action gesture on the selected user interface element.

10. The computing device of claim 9, further comprising:

while continuing to detect the point of contact by the user on the touch-sensitive surface;

detecting a movement of the point of contact by the user on the touch-sensitive surface; and

in response to detecting the movement, continuously changing a respective displayed location of the loupe in accordance with the movement of the point of contact on the touch-sensitive surface.

11. The computing device of claim 9, further comprising:

detecting movement of the point of contact by the user on the touch-sensitive surface; and

in response to detecting the movement, updating the selection indicia to correspond to respective user interface elements in accordance with the movement of the point of contact when the point of contact on the touch-sensitive surface corresponds to respective locations of respective user interface elements displayed on the display.

12. The computing device of claim 9, wherein the loupe uses a magnification factor that scales in accordance with the feature size of the one or more of the plurality of user interface elements.

13. The computing device of claim 9, wherein the display and the touch-sensitive surface comprise a touch-screen display.

14. The computing device of claim 9, wherein the plurality of user interface elements includes displayed features within an electronic document.

15. The computing device of claim 9, wherein the magnified image is displayed at a location on the display corresponding to a location proximate to the point of contact by the user on the touch-sensitive surface.

16. The computing device of claim 9, wherein the magnified image is displayed at a respective location on the display corresponding to a location offset from the point of contact by the user on the touch-sensitive surface.

17. A graphical user interface on a computing device with a touch-sensitive surface and a display, the graphical user interface comprising:

a plurality of user interface elements;

wherein;

a point of contact by a user is detected on the touch-sensitive surface, wherein;

the point of contact on the touch-sensitive surface corresponds to a location on the display of one or more of the plurality of user interface elements, and,

the one or more of the plurality of user interface elements have a feature size;

while detecting the point of contact by the user on the touch-sensitive surface, and in response to detecting the point of contact;

the feature size of the one or more of the plurality of user interface elements is compared with a first predefined size threshold to determine whether the feature size of the one or more of the plurality of user interface elements exceeds the first predefined size threshold;

when the feature size of the one or more of the plurality of user interface elements is greater than the first predefined size threshold, the display is maintained at a constant magnification; and

when the feature size of the one or more of the plurality of user interface elements is less than the first predefined size threshold, a loupe is displayed on the display, the loupe depicting a magnified image of at least one of the one or more of the plurality of user interface elements, wherein the magnified image corresponds to the area of the display corresponding to the location surrounding the point of contact on the touch-sensitive surface,

while continuing to detect the point of contact by the user on the touch-sensitive surface;

displaying within the loupe a selection indicia in conjunction with at least one of the plurality of user interface elements displayed within the loupe, the selection indicia corresponding to a selected user interface element displayed on the display at a location corresponding to the point of contact on the touch-sensitive surface;

detecting an action gesture on the touch-sensitive surface; and

performing an action associated with the action gesture on the selected user interface element.

18. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a computing device with a touch-sensitive surface and a display, cause the device to:

display on the display a plurality of user interface elements;

detect a point of contact by a user on the touch-sensitive surface, wherein;

the point of contact on the touch-sensitive surface corresponds to a location on the display of one or more of the plurality of user interface elements, and,

the one or more of the plurality of user interface elements have a feature size;

while detecting the point of contact by the user on the touch-sensitive surface;

determine whether the feature size of the one or more of the plurality of user interface elements exceeds a first predefined size threshold;

when the feature size of the one or more of the plurality of user interface elements is greater than the first predefined size threshold, maintain the display at a constant magnification; and

when the feature size of the one or more of the plurality of user interface elements is less than the first predefined size threshold, display on the display a loupe that depicts a magnified image of at least one of the one or more of the plurality of user interface elements, wherein the magnified image corresponds to the area of the display corresponding to the location surrounding the point of contact on the touch-sensitive surface,

while continuing to detect the point of contact by the user on the touch-sensitive surface;

displaying within the loupe a selection indicia in conjunction with at least one of the plurality of user interface elements displayed within the loupe, the selection indicia corresponding to a selected user interface element displayed on the display at a location corresponding to the point of contact on the touch-sensitive surface;

detecting an action gesture on the touch-sensitive surface; and

performing an action associated with the action gesture on the selected user interface element.

19. A method, comprising:

at a computing device with a display and a touch-sensitive surface;

displaying on the display a plurality of user interface elements;

detecting a point of contact by a user on the touch-sensitive surface, wherein;

the point of contact on the touch-sensitive surface corresponds to a location on the display of one or more of the plurality of user interface elements, and

a smallest displayed feature size is associated with at least one of the plurality of user interface elements on the location of the display corresponding to the point of contact on the touch-sensitive surface;

while detecting the point of contact by the user on the touch-sensitive surface;

determining whether the smallest displayed feature size exceeds a first predefined size threshold;

when the smallest displayed feature size is less than the first predefined size threshold;

scaling a magnification factor in accordance with the feature size of the one or more of the plurality of user interface elements; and

displaying on the display a loupe that depicts a magnified image of at least one of the one or more of the plurality of user interface elements, wherein the magnified image is displayed in accordance with the scaled magnification factor.

20. The method of claim 19, when the feature size of the one or more of the plurality of user interface elements is greater than the first predefined size threshold, maintaining the display at a constant magnification.