NON-VISUAL FEEDBACK OF VISUAL CHANGE

• US 20150293587A1
• Filed: 04/10/2014
• Published: 10/15/2015
• Est. Priority Date: 04/10/2014
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Wilairat, Weerapan, Eden, Ibrahim, Thukral, Vaibhav, Nister, David, Pradeep, Vivek
• Granted Patent: US 9,342,147 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

Examples relating to using non-visual feedback to alert a viewer of a display that a visual change has been triggered are disclosed. One disclosed example provides a method comprising using gaze tracking data from a gaze tracking system to determine that a viewer changes a gaze location. Based on determining that the viewer changes the gaze location, a visual change is triggered and non-visual feedback indicating the triggering of the visual change is provided to the viewer. If a cancel change input is received within a predetermined timeframe, the visual change is not displayed. If a cancel change input is not received within the timeframe, the visual change is displayed via the display.

Claims

1. In a computing device, a method for using audio feedback to alert a viewer of a display device that a visual change in the display device has been triggered, the method comprising:

receiving gaze tracking data of the viewer from a gaze tracking system;

using the gaze tracking data, determining that the viewer changes a gaze location from a first gaze location to a second gaze location;

based on determining that the viewer changes the gaze location to the second gaze location, triggering the visual change;

based on determining that the viewer changes the gaze location to the second gaze location, providing the audio feedback to the viewer indicating that the visual change has been triggered;

if a cancel change input is not received within a predetermined timeframe, then controlling the display device to display the visual change; and

if the cancel change input is received within the predetermined timeframe, then controlling the display device to refrain from displaying the visual change.

2. The method of claim 1, wherein the visual change comprises switching from a first content stream comprising first content audio to a second content stream, and providing the audio feedback comprises decreasing a volume of the first content audio over the predetermined timeframe.

3. The method of claim 1, wherein a second content stream comprises second content audio, and providing the audio feedback further comprises increasing a volume of the second content audio over the predetermined timeframe.

4. The method of claim 1, wherein the audio feedback comprises an earcon.

5. The method of claim 1, wherein the first gaze location corresponds to a first content stream and the second gaze location corresponds to a second content stream.

6. The method of claim 1, wherein the cancel change input comprises the viewer changing the gaze location from the second gaze location to a third gaze location.

7. The method of claim 1, wherein the cancel change input is selected from the group consisting of a verbal command from the viewer, a plurality of eye blinks by the viewer, and a viewer gesture.

8. The method of claim 1, further comprising, based on determining that the viewer changes the gaze location to the second gaze location, providing haptic feedback to the viewer indicating that the visual change has been triggered.

9. The method of claim 8, wherein the haptic feedback is provided via a wearable computing device worn by the viewer.

10. A computing device for providing audio feedback to alert a viewer of a display device that a visual change in the display device has been triggered, the computing device comprising:

a context switching program executed by a processor of the computing device, the context switching program configured to;

receive gaze tracking data of the viewer from a gaze tracking system;

using the gaze tracking data, determine that the viewer changes a gaze location from a first gaze location to a second gaze location;

based on determining that the viewer changes the gaze location to the second gaze location, trigger the visual change;

based on determining that the viewer changes the gaze location to the second gaze location, provide the audio feedback to the viewer indicating that the visual change has been triggered;

if a cancel change input is not received within a predetermined timeframe, then control the display device to display the visual change; and

if the cancel change input is received within the predetermined timeframe, then control the display device to refrain from displaying the visual change.

11. The computing device of claim 10, wherein the visual change comprises switching from a first content stream comprising first content audio to a second content stream, and providing the audio feedback comprises decreasing a volume of the first content audio over the predetermined timeframe.

12. The computing device of claim 11, wherein the second content stream comprises second content audio, and providing the audio feedback further comprises increasing a volume of the second content audio over the predetermined timeframe.

13. The computing device of claim 10, wherein the audio feedback comprises an earcon.

14. The computing device of claim 10, wherein the first gaze location corresponds to a first content stream and the second gaze location corresponds to a second content stream.

15. The computing device of claim 10, wherein the cancel change input comprises the viewer changing the gaze location from the second gaze location to a third gaze location.

16. The computing device of claim 10, wherein the cancel change input is selected from the group consisting of a verbal command from the viewer, a plurality of eye blinks by the viewer, and a viewer gesture.

17. The computing device of claim 10, wherein the context switching program is further configured to, based on determining that the viewer changes the gaze location to the second gaze location, provide haptic feedback to the viewer indicating that the visual change has been triggered.

18. The computing device of claim 17, wherein the haptic feedback is provided via a wearable computing device worn by the viewer.

19. In a computing device, a method for using non-visual feedback to alert a viewer of a display device that a visual change in the display device has been triggered, the method comprising:

receiving gaze tracking data of the viewer from a gaze tracking system;

using the gaze tracking data, determining that the viewer changes a gaze location from a first gaze location to a second gaze location;

based on determining that the viewer changes the gaze location to the second gaze location, triggering the visual change;

based on determining that the viewer changes the gaze location to the second gaze location, providing the non-visual feedback to the viewer indicating that the visual change has been triggered;

if a cancel change input is not received within a predetermined timeframe, then controlling the display device to display the visual change; and

if the cancel change input is received within the predetermined timeframe, then controlling the display device to refrain from displaying the visual change.

20. The method of claim 19, wherein the non-visual feedback comprises haptic feedback.