Gesture-based touch screen magnification

• US 9,804,761 B2
• Filed: 09/11/2014
• Issued: 10/31/2017
• Est. Priority Date: 11/27/2013
• Status: Active Grant

• Current Assignee: Freedom Scientific Incorporated
• Original Assignee: Freedom Scientific Incorporated
• Inventors: Voorhees, Garald Lee, Steinberger, Robert
• Primary Examiner(s): BASHORE, WILLIAM L
• Assistant Examiner(s): Chowdhury, Rayeez
• Application Number:
  US14/483,614
• Publication Number:
  US 20150149958A1
• Time in Patent Office: 1,146 Days
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Screen magnification software on a touchscreen device detects when a low-vision user reaches the boundary of a magnified viewport. If additional canvas or menus lay on the other side of the boundary the present invention enables the low-vision user to maintain the same exploration gesture on the touchscreen while causing the underlying canvas to scroll into view in the direction of the gesture. This invention enables the low-vision user to navigate about the entire underlying canvas of a touchscreen graphic user interface with a single, intuitive touchscreen gesture even under magnification.

Claims

1. A method of navigating a touchscreen computing device under software magnification, the method comprising the steps of:

communicatively accessing the operating system of the computing device, the computing device displaying a canvas scrollable by touch gestures invoked by an end user, the canvas having a larger area than can be presented within screen edges of the touchscreen in a single viewing instance without reducing a default magnification level of the canvas, wherein the canvas is subdivided into a first canvas view and a second canvas view, the first canvas view enclosed by a conceptual boundary;

displaying the first canvas view within the screen edges;

invoking a magnification feature wherein a portion of the first canvas view is further enlarged to the screen edges of the touchscreen, a viewable area within the first canvas view defined by a magnification viewport, wherein the magnification feature requires a first directional gesture having a first quantity of digits in contact with the touchscreen to pan the first canvas view up to the boundary thereof, and requires a second directional gesture having a second quantity of digits different from the first quantity of digits in contact with the touchscreen to scroll the canvas across the boundary into the second canvas view;

panning the first canvas view under a first magnification level within the boundary of the first canvas view, the panning invoked by a first directional touchscreen gesture; and

responsive to detecting additional canvas laying beyond the boundary in the same direction as the first directional touchscreen gesture, automatically emulating the second directional gesture to enable panning the canvas beyond the boundary using the first directional gesture, thereby enabling navigation of the entire canvas using a single directional gesture without requiring changing to the second directional gesture to scroll the canvas beyond the boundary, whereby the second canvas view is presented on the touchscreen through the magnification viewport at the first magnification level.

2. The method of claim 1 wherein the first and second canvas views are first and second menu pages respectively and scrolling across the boundary using the predefined, directional touchscreen gesture displays the second menu page under the same magnification as invoked when viewing the first menu page.

3. The method of claim 1 wherein a constant magnification level is maintained within the magnification viewport while scrolling the canvas across the boundary.

4. The method of claim 1 further comprising the steps of:

invoking inertia with the predefined, directional touchscreen gesture;

detecting whether the boundary is within the magnification viewport at the time the touchscreen gesture was effected; and

scrolling the canvas into the magnification viewport if the boundary was within the magnification viewport and not scrolling the canvas if the boundary was not within the magnification viewport.

5. The method of claim 4 wherein the predefined, directional touchscreen gesture is a flick.

6. One or more non-transitory computer-readable media having computer-executable instructions for performing a method of running a software program on a touchscreen computing device, the computing device operating under an operating system, the method including issuing instructions from the software program comprising:

communicatively accessing the operating system of the computing device, the computing device displaying a canvas scrollable by touch gestures invoked by an end user, the canvas having a larger area than can be presented within screen edges of the touchscreen in a single viewing instance without reducing a default magnification level of the canvas, wherein the canvas is subdivided into a first canvas view and a second canvas view, the first canvas view enclosed by a conceptual boundary;

displaying the first canvas view within the screen edges;

invoking a magnification feature wherein a portion of the first canvas view is further enlarged to the screen edges of the touchscreen, a viewable area within the first canvas view defined by a magnification viewport, wherein the magnification feature requires a first directional gesture having a first quantity of digits in contact with the touchscreen to pan the first canvas view up to the boundary thereof, and requires a second directional gesture having a second quantity of digits different from the first quantity of digits in contact with the touchscreen to scroll the canvas across the boundary into the second canvas view;

panning the first canvas view under a first magnification level within the boundary of the first canvas, the panning invoked by a first directional touchscreen gesture; and

responsive to detecting additional canvas laying beyond the boundary in the same direction as the first directional touchscreen gesture, automatically emulating the second directional gesture to enable scrolling the canvas beyond the boundary using the first directional gesture, thereby enabling navigation of the entire canvas using a single directional gesture without requiring changing to the second directional gesture to scroll the canvas beyond the boundary, whereby the second canvas view is presented on the touchscreen through the magnification viewport at the first magnification level.

7. The media of claim 6 wherein the first and second canvas views are first and second menu pages respectively and scrolling across the boundary using the predefined, directional touchscreen gesture displays the second menu page under the same magnification as invoked when viewing the first menu page.

8. The media of claim 6 wherein a constant magnification level is maintained within the magnification viewport while scrolling the canvas across the boundary.

9. The media of claim 6 further comprising the steps of:

invoking inertia with the predefined, directional touchscreen gesture;

detecting whether the boundary is within the magnification viewport at the time the touchscreen gesture was effected; and

scrolling the canvas into the magnification viewport if the boundary was within the magnification viewport and not scrolling the canvas if the boundary was not within the magnification viewport.

10. The media of claim 9 wherein the predefined, directional touchscreen gesture is a flick.