USER INTERFACE PROGRAMMATIC SCALING

• US 20150103003A1
• Filed: 10/11/2013
• Published: 04/16/2015
• Est. Priority Date: 10/11/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Kerr, Bernard James, Venable, Morgan Kolya, Elliott, Edward
• Granted Patent: US 9,400,553 B2
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04805 Virtual magnifying lens, i.e. window or frame movable on top of displayed information to enlarge it for better reading or selection
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

Embodiments that relate to scaling a visual element displayed via a display device are disclosed. In one embodiment a method includes receiving and using gaze tracking data to determine gaze locations at which a user is gazing on the display device. Depth tracking data is received and used to determine that a user'"'"'s pointer is at a predetermined location. In response, a locked gaze location on the screen is locked, where the locked gaze location includes at least a portion of the visual element. In response to locking the locked gaze location, the visual element is programmatically scaled by a predetermined amount to an enlarged size. A user input selecting the visual element is then received.

Claims

1. A user interface system for scaling a visual element displayed via a display device, the user interface system comprising:

a computing device operatively connected to the display device, wherein the display device includes a gaze tracking system and a display system for presenting the visual element; and

a scaling module executed by a processor of the computing device, the scaling module configured to;

receive gaze tracking data from the gaze tracking system;

using the gaze tracking data, determine a plurality of gaze locations at which a user is gazing on a screen of the display device;

receive depth tracking data from a depth tracking system;

using the depth tracking data, determine that a user'"'"'s pointer is at a predetermined location;

in response to determining that the user'"'"'s pointer is at the predetermined location, lock a locked gaze location on the screen, wherein the locked gaze location includes at least a portion of the visual element;

in response to locking the locked gaze location, programmatically scale the visual element by a predetermined amount to an enlarged size; and

receive a user input selecting the visual element at the enlarged size.

2. The user interface system of claim 1, wherein the scaling module is further configured to, in response to determining that the user'"'"'s pointer is at the predetermined location, cease receiving the gaze tracking data from the gaze tracking system.

3. The user interface system of claim 1, wherein the scaling module is further configured to programmatically scale the visual element by animating the visual element to grow to the enlarged size independent of a distance of the user'"'"'s pointer from the screen.

4. The user interface system of claim 1, wherein the scaling module is further configured to programmatically scale the visual element either by a single step to the enlarged size or by progressive enlargements of the visual element through one or more increasing sizes that are each proportional to a distance of the user'"'"'s pointer from the screen.

5. The user interface system of claim 1, wherein the scaling module is further configured to:

monitor the user'"'"'s use of the user interface system;

based on the user'"'"'s use, modify the predetermined amount to a user-specific amount; and

programmatically scale the visual element by the user-specific amount to a user-specific size.

6. The user interface system of claim 5, wherein the scaling module is further configured to determine the user-specific amount by averaging a plurality of user adjustments to the enlarged size.

7. The user interface system of claim 1, wherein the scaling module is further configured to:

define a plane between the user and the screen of the display device;

using the depth tracking data, determine that the user'"'"'s pointer crosses the plane; and

in response to determining that the user'"'"'s pointer crosses the plane, lock the locked gaze location on the screen and programmatically scale the visual element.

8. The user interface system of claim 1, wherein the scaling module is further configured to:

define a first plane between the user and the screen of the display device;

define a second plane between the first plane and the screen of the display device;

using the depth tracking data, determine that the user'"'"'s pointer crosses the first plane;

in response to determining that the user'"'"'s pointer crosses the first plane, lock the locked gaze location on the screen;

using the depth tracking data, determine that the user'"'"'s pointer subsequently crosses the second plane; and

in response to determining that the user'"'"'s pointer crosses the second plane, select the visual element

9. The user interface system of claim 1, wherein the scaling module is further configured to provide feedback to the user via the display device comprising gaze lock feedback when the locked gaze location is locked and progressive feedback indicating a position of the user'"'"'s pointer relative to the display device.

10. A method for scaling a visual element displayed via a display device, the method comprising:

receiving gaze tracking data;

using the gaze tracking data, determining a plurality of gaze locations at which a user is gazing on a screen of the display device;

receiving depth tracking data;

using the depth tracking data, determining that a user'"'"'s pointer is at a predetermined location;

in response to determining that the user'"'"'s pointer is at the predetermined location, locking a locked gaze location on the screen, wherein the locked gaze location includes at least a portion of the visual element;

in response to locking the locked gaze location, programmatically scaling the visual element by a predetermined amount to an enlarged size; and

receiving a user input selecting the visual element at the enlarged size.

11. The method of claim 10, further comprising, in response to determining that the user'"'"'s pointer is at the predetermined location, ceasing to receive the gaze tracking data from the gaze tracking system.

12. The method of claim 10, wherein programmatically scaling the visual element further comprises either scaling the visual element by a single step to the enlarged size or scaling the visual element by progressive enlargements through one or more increasing sizes that are each proportional to a distance of the user'"'"'s pointer from the screen.

13. The method of claim 10, further comprising:

monitoring the user'"'"'s use of the user interface system;

based on the user'"'"'s use, modifying the predetermined amount to a user-specific amount; and

programmatically scaling the visual element by the user-specific amount to a user-specific size.

14. The method of claim 13, further comprising determining the user-specific amount by averaging a plurality of user adjustments to the enlarged size.

15. The method of claim 10, further comprising:

determining an identity of the user;

based on the user identity, modifying the predetermined amount to a user-specific amount; and

programmatically scaling the visual element by the user-specific amount to a user-specific size.

16. The method of claim 15, wherein determining the identity of the user is performed via user input of log in data or via user biometrics selected from the group consisting of eye information received from the gaze tracking system, voice recognition information and facial recognition information.

17. The method of claim 10, further comprising:

defining a plane between the user and the screen of the display device;

using the depth tracking data, determining that the user'"'"'s pointer crosses the plane; and

in response to determining that the user'"'"'s pointer crosses the plane, locking the locked gaze location on the screen and programmatically scaling the visual element.

18. The method of claim 10, further comprising providing feedback to the user via the display device comprising gaze lock feedback when the locked gaze location is locked and progressive feedback indicating a position of the user'"'"'s pointer relative to the display device.

19. A method for scaling a visual element displayed via a display device, the method comprising:

receiving gaze tracking data;

using the gaze tracking data, determining a plurality of gaze locations at which a user is gazing on a screen of the display device;

receiving depth tracking data;

using the depth tracking data, determining that a user'"'"'s pointer is at a predetermined location;

in response to determining that the user'"'"'s pointer is at the predetermined location, locking a locked gaze location on the screen, wherein the locked gaze location includes at least a portion of the visual element;

in response to locking the locked gaze location, programmatically scaling the visual element by a predetermined amount to an enlarged size;

receiving a first user input selecting the visual element at the enlarged size;

monitoring the user'"'"'s subsequent use of the user interface system;

based on the user'"'"'s subsequent use, modifying the predetermined amount to a user-specific amount;

programmatically scaling the visual element by the user-specific amount to a user-specific size; and

receiving a second user input selecting the visual element at the user-specific size.

20. The method of claim 19, further comprising determining the user-specific amount by averaging a plurality of user adjustments to the enlarged size.