Technique for implementing an on-demand display widget through controlled fading initiated by user contact with a touch sensitive input device

• US 6,333,753 B1
• Filed: 11/25/1998
• Issued: 12/25/2001
• Est. Priority Date: 09/14/1998
• Status: Expired due to Term

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Hinckley, Kenneth Paul
• Primary Examiner(s): Bayerl, Raymond J.
• Assistant Examiner(s): BAUTISTA, XIOMARA L
• Application Number:
  US09/200,325
• Time in Patent Office: 1,126 Days
• Field of Search: 345/145, 345/156, 345/157, 345/163, 345/173, 345/326, 345/339-340, 345/344, 345/348, 345/431-432, 345/435, 345/473
• US Class Current: 715/768
• CPC Class Codes: G06F 3/03543 Mice or pucks G06F3/03541 takes precedence
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance

Abstract

A technique, specifically apparatus and accompanying methods, for implementing an on-demand “Tool Glass” based desktop user interface. The interface uses at least one input device capable of detecting touch. A sensed touch transition reflective of a user then making or breaking contact with the device, such by touching the device with a finger of a non-preferred hand or lifting his(her) finger from the device, causes a Tool Glass sheet to be displayed or dismissed. To prevent user distraction, these detected transitions preferably initiate corresponding predefined animation sequences that occur over preset time intervals in which the Tool Glass sheet either begins to fade into view as soon as user contact begins and then begins to fade out from view as soon as user contact ends. Such touch sensing can readily be used to provide “on-demand” display and dismissal of substantially any display widget, e.g., a toolbar, based on sensed contact between each hand of a user and a corresponding input device, such as between a preferred hand and a touch sensitive mouse. Through use of this interface, display clutter can be reduced and displayed application screen area increased at appropriate times during program execution consistent with user action and without imposing any significant cognitive burden on the user to do so; thereby, advantageously improving a “user experience”.

Claims

1. Apparatus for use with a computer system for implementing a graphical user interface, the system having a processor and a memory, connected to the processor, for storing computer executable instructions therein, and a display connected to the system, the apparatus comprising:

a first input device, connected to the system, for being manipulated by a dominant hand of the user, the first input device having a first touch sensor for generating a first output signal responsive to and indicative of whether the user is touching the device or not, and wherein the first input device is a touch sensitive mouse comprising,

a palm support; and

a palm sensor, as the first touch sensor and situated directly on the palm support, for determining whether a palm of the dominant hand is abutting against the palm support so as to generate the first output signal;

a graphical display, rendered on the display and produced by the system in response to the executable instructions, having a first display widget situated thereon; and

wherein the system, in response to the first output signal, fades the first display widget into or out of view on the graphical display based on whether the dominant hand of the user has then established or broken physical contact, respectively, with the first input device by correspondingly touching or releasing the first input device.

2. The apparatus in claim 1 wherein the processor in response to the executable instructions, controls fading of the first display widget in response to the first output signal such that upon initiation of the physical contact the first display widget fades into view from a first state having a first predefined opacity to a second state having a second predefined opacity and upon cessation of the physical contact the first display widget fades out from view from the second state back to the first state.

3. The apparatus in claim 2 wherein the first and second predefined opacities are approximately full transparency and full opacity, respectively.

4. The apparatus in claim 2 wherein the first display widget comprises an icon, a tool, hover text, a scroll bar, a window frame, a window decoration, a title bar, a floating tool palette, a modal dialog box, a non-modal dialog box, a list box, a combo box, a button, or a text entry area.

5. The apparatus in claim 2 wherein

the processor, in response to the executable instructions, initiates fading of the first display widget into view and out of view in response to corresponding transitions in the first output signal indicative of the dominant hand of the user establishing and breaking physical contact with the first in input device; and wherein

the processor, in response to the executable instructions, fades the first display widget into and out of view over predefined first and second time intervals, respectively, and controls opacity of the first display widget while fading during each of the first and second intervals in response to predefined first and second functions, respectively.

6. The apparatus in claim 5 wherein either of the predefined first and second functions is a predefined non-linear function of opacity with respect to time.

7. The apparatus in claim 6 wherein the non-linear function provides slow-in/slow-out fading.

8. The apparatus in claim 5 wherein either of the first and second predefined functions is a linear function.

9. The apparatus in claim 5 wherein the first and second intervals are, in duration, approximately 0.5 seconds or less, and at least approximately 1 second, respectively.

10. The apparatus in claim 5 wherein the first and second predefined opacities are approximately full transparency and full opacity, respectively.

11. The apparatus in claim 5 wherein the first display widget comprises an icon, a tool, hover text, a scroll bar, a window frame, a window decoration, a title bar, a floating tool palette, a modal dialog box, a non-modal dialog box, a list box, a combo box, a button, or a text entry area.

12. The apparatus in claim 5 wherein the first function is different from the second function.

13. The apparatus in claim 5 further comprising graphics and output circuitry, connected to the processor and the display, capable of implementing alpha-transparent graphic operations wherein the processor, in response to the executable instructions, issues instructions to the circuitry so as to change an alpha-transparency value of the first display widget rendered on the display for successive display frames occurring during the first and second intervals and so implement a controlled animation sequence which, during the successive frames, fades the first display widget into or out of view, respectively.

14. The apparatus in claim 13 wherein the processor, in response to the executable instructions, varies coloration or luminance of the first display widget between successive ones of the frames during the animation sequence.

15. The apparatus in claim 14 wherein either of the first and second predefined functions is a linear function.

16. The apparatus in claim 14 wherein the first and second intervals are, in duration, approximately 0.5 seconds or less, and at least approximately 1 second, respectively.

17. The apparatus in claim 14 wherein the first display widget comprises an icon, a tool, hover text, a scroll bar, a window frame, a window decoration, a title bar, a floating tool palette, a modal dialog box, a non-modal dialog box, a list box, a combo box, a button, or a text entry area.

18. The apparatus in claim 13 wherein either of the predefined first and second functions is a predefined non-linear function of opacity with respect to time.

19. The apparatus in claim 18 wherein the non-linear function provides slow-in/slow-out fading.

20. Apparatus for use with a computer system for implementing a graphical user interface, the system having a processor and a memory, connected to the processor, for storing computer executable instructions therein, and a display connected to the system, the apparatus comprising:

a first input device, connected to the system, for being manipulated by a corresponding hand of the user, the first input device having a first touch sensor for generating a first output signal responsive to and indicative of whether the user is touching the device or not;

a graphical display, rendered on the display and produced by the system in response to the executable instructions, having a first display widget situated thereon;

wherein the system, in response to the first output signal, fades the first display widget into or out of view on the graphical display based on whether the hand of the user has then established or broken physical contact, respectively, with the first input device by correspondingly touching or releasing the first input device;

wherein the processor in response to the executable instructions, controls fading of the first display widget in response to the first output signal such that upon initiation of the physical contact the first display widget fades into view from a first state having a first predefined opacity to a second state having a second predefined opacity and upon cessation of the physical contact the first display widget fades out from view from the second state back to the first state; and

wherein the processor, in response to the executable instructions, fades the first display widget into and out of view over predefined first and second time intervals, respectively, and controls opacity of the first display widget while fading during each of the first and second intervals in response to predefined first and second functions, respectively, the first function being different from the second function.

21. The apparatus in claim 20 wherein the processor, in response to the executable instructions, initiates fading of the first display widget into view and out of view in response to corresponding transitions in the first output signal indicative of the non-preferred hand of the user establishing and breaking physical contact with the first device.

22. The apparatus in claim 21 wherein the first and second predefined opacities are approximately full transparency and full opacity, respectively.

23. The apparatus in claim 21 further comprising graphics and output circuitry, connected to the processor and the display, capable of implementing alpha-transparent graphic operations wherein the processor, in response to the executable instructions, issues instructions to the circuitry so as to change an alpha-transparency value of the first display widget rendered on the display for successive display frames during the first and second intervals and so implement a controlled animation sequence which, during the successive frames, fades the first display widget into or out of view, respectively.

24. The apparatus in claim 23 wherein the processor, in response to the executable instructions, varies coloration or luminance of the first display widget between successive ones of the frames during the animation sequence.

25. The apparatus in claim 24 wherein either of the first and second predefined functions is a linear function.

26. The apparatus in claim 24 wherein the first and second intervals are, in duration, approximately 0.5 seconds or less, and at least approximately 1 second, respectively.

27. The apparatus in claim 24 wherein the first and second predefined opacities are approximately full transparency and full opacity, respectively.

28. The apparatus in claim 24 wherein the first display widget comprises an icon, a tool, hover text, a scroll bar, a window frame, a window decoration, a title bar, a floating tool palette, a modal dialog box, a non-modal dialog box, a list box, a combo box, a button, or a text entry area.

29. The apparatus in claim 24 wherein the first input device is a touchpad, touch sensitive mouse, touch sensitive trackball or touch sensitive keyboard.

30. The apparatus in claim 23 wherein either of the predefined first and second functions is a predefined non-linear function of opacity with respect to time.

31. The apparatus in claim 30 wherein the non-linear function provides slow-in/slow-out fading.

32. The apparatus in claim 21, further comprising:

a second input device, wherein the first and second input devices are manipulated by preferred and non-preferred hands of the user, the second input device having a second touch sensor for generating a second output signal responsive to and indicative of the user touching the second input device or not; and

a Tool Glass appearing on the graphical display and produced by the system in response to the executable instructions; and

wherein the processor, in response to the second output signal, controls fading of the Tool Glass such that, when the non-preferred hand touches the second input device, the Tool Glass fades into view from a substantially invisible state having a third predefined opacity to a semi-transparent state having a fourth predefined opacity and, when the non-preferred hand releases the second input device, the Tool Glass fades out of view from the semi-transparent state back to the substantially invisible state.

33. The apparatus in claim 32 wherein each of the first and second touch sensors produces a one-bit output signal.

34. The apparatus in claim 32 wherein the second input device is a touchpad, touch sensitive mouse, touch sensitive trackball or other touch sensitive input pointing device.

35. The apparatus in claim 34 wherein the first input device is a touchpad, touch sensitive mouse, touch sensitive trackball or touch sensitive keyboard.

36. The apparatus in claim 34 wherein if both the Tool Glass and the first display widget are simultaneously being rendered on the display and the physical contact ceases between the preferred hand and the first input device, the processor, in response to the executable instructions and which specific widgets are then being displayed, an operation then occurring or a relative display prioritization among widgets that could be simultaneously displayed, does not fade the first display widget from view.

37. The apparatus in claim 34 wherein the processor, in response to the executable instructions, fades the Tool Glass into and out of view over predefined third and fourth time intervals, respectively, and controls opacity of the Tool Glass while fading during each of the third and fourth intervals in response to predefined third and fourth functions.

38. The apparatus in claim 37 wherein the processor, in response to the executable instructions, initiates fading of the Tool Glass into view and out of view in response to corresponding transitions in the second output signal indicative of the non-preferred hand of the user establishing and breaking physical contact with the second input device.

39. The apparatus in claim 38 wherein either of the predefined third and fourth functions is a predefined non-linear function of opacity with respect to time.

40. The apparatus in claim 39 wherein the non-linear function provides slow-in/slow-out fading.

41. The apparatus in claim 38 wherein either of the third and fourth predefined functions is a linear function.

42. The apparatus in claim 38 wherein the third and fourth intervals are, in duration, approximately 0.5 seconds or less, and at least approximately 1 second, respectively.

43. The apparatus in claim 38 wherein the third and fourth predefined opacities are approximately 0α

and at least approximately 0.7α

, respectively, where 0α and

1α

represent full transparency and full opacity, respectively.

44. The apparatus in claim 38 wherein the first display widget comprises an icon, a tool, hover text, a scroll bar, a window frame, a window decoration, a title bar, a floating tool palette, a modal dialog box, a non-modal dialog box, a list box, a combo box, a button, or a text entry area.

45. The apparatus in claim 38 wherein the first input device is a touchpad, touch sensitive mouse, touch sensitive trackball or touch sensitive keyboard.

46. The apparatus in claim 38 further comprising graphics and output circuitry, connected to the processor and the display, capable of implementing alpha-transparent graphic operations wherein the processor, in response to the executable instructions, issues instructions to the circuitry so as to change an alpha-transparency value of the Tool Glass rendered on the display for successive display frames occurring during the third and fourth intervals and so implement a controlled animation sequence which, during the successive frames, fades the Tool Glass into or out of view, respectively.

47. The apparatus in claim 46 wherein the processor, in response to the executable instructions, varies coloration or luminance of the Tool Glass between successive ones of the frames during the animation sequence.

48. The apparatus in claim 47 wherein either of the third and fourth predefined functions is a linear function.

49. The apparatus in claim 47 wherein the third and fourth intervals are, in duration, approximately 0.5 seconds or less, and at least approximately 1 second, respectively.

50. The apparatus in claim 47 wherein the third and fourth predefined opacities are approximately 0α

and at least approximately 0.7α

, respectively, where 0α and

1α

represent full transparency and full opacity, respectively.

51. The apparatus in claim 47 wherein the first display widget comprises an icon, a tool, hover text, a scroll bar, a window frame, a window decoration, a title bar, a floating tool palette, a modal dialog box, a non-modal dialog box, a list box, a combo box, a button, or a text entry area.

52. The apparatus in claim 47 wherein the first input device is a touchpad, touch sensitive mouse, touch sensitive trackball or touch sensitive keyboard.

53. The apparatus in claim 46 wherein either of the predefined third and fourth functions is a predefined non-linear function of opacity with respect to time.

54. The apparatus in claim 53 wherein the non-linear function provides slow-in/slow-out fading.

55. The apparatus in claim 20 wherein either of the predefined first and second functions is a predefined non-linear function of opacity with respect to time.

56. The apparatus in claim 55 wherein the non-linear function provides slow-in/slow-out fading.

57. The apparatus in claim 20 wherein either of the first and second predefined functions is a linear function.

58. The apparatus in claim 20, wherein the first and second intervals are, in duration, approximately 0.5 seconds or less, and at least approximately 1 second, respectively.

59. The apparatus in claim 20 wherein the first display widget comprises hover text or a text entry area.

60. The apparatus in claim 20 wherein the first input device is a touch sensitive keyboard.

61. A method for implementing a graphical user interface for use with a computer system, the system having a processor and a memory, connected to the processor, for storing computer executable instructions therein, and a display connected to the system, the method comprising the steps of:

manipulating a first input device, connected to the system, by a preferred hand of the

user, the first input device having a first touch sensor for generating a first output signal

responsive to and indicative of whether the user is touching the device or not;

rendering a graphical display, on the display and produced by the system in response to the executable instructions, having a first display widget situated thereon;

fading, in response to the first output signal, the first display widget into or out of view on the graphical display based on whether the hand of the user has then established or broken physical contact, respectively, with the first device by correspondingly touching or releasing the first device;

manipulating a second input device, by a non-preferred hand of the user, respectively, the second input device having a second touch sensor for generating a second output signal responsive to and indicative of the user touching the second input device or not;

rendering a Tool Glass on the graphical display and produced by the system in response to the executable instructions; and

in response to the second output signal, fading the Tool Glass such that, when the non-preferred hand touches the second input device, the Tool Glass fades into view from a substantially invisible state having a third predefined opacity to a semi-transparent state having a fourth predefined opacity and, when the non-preferred hand releases the second input device, fading the Tool Glass fades out of view from the semi-transparent state back to the substantially invisible state.

62. The method in claim 61 further comprising the step of controlling fading of the first display widget in response to the first output signal such that upon initiation of the physical contact the first display widget fades into view from a first state having a first predefined opacity to a second state having a second predefined opacity and upon cessation of the physical contact the first display widget fades out from view from the second state back to the first state.

63. The method in claim 62 wherein the first and second predefined opacities are approximately full transparency and full opacity, respectively.

64. The method in claim 62 further comprising the steps of:

fading the first display widget into and out of view over predefined first and second time intervals, respectively; and

controlling opacity of the first display widget while fading during each of the first and second intervals in response to predefined first and second functions, respectively.

65. The method in claim 64 further comprising the step of initiating fading of the first display widget into view and out of view in response to corresponding transitions in the first output signal indicative of the non-preferred hand of the user establishing and breaking physical contact with the first device.

66. The method in claim 65 wherein either of the predefined first and second functions is a predefined non-linear function of opacity with respect to time.

67. The method in claim 66 wherein the non-linear function provides slow-in/slow-out fading.

68. The method in claim 65 wherein either of the first and second predefined functions is a linear function.

69. The method in claim 65 wherein the first and second intervals are, in duration, approximately 0.5 seconds or less, and at least approximately 1 second, respectively.

70. The method in claim 65 wherein the first and second predefined opacities are approximately full transparency and full opacity, respectively.

71. The method in claim 65 further comprising the step of changing an alpha-transparency value of the first display widget rendered on the display for successive display frames during the first and second intervals and so implement a controlled animation sequence which, during the successive frames, fades the first display widget into or out of view, respectively.

72. The method in claim 71 further comprising the step of varying coloration or luminance of the first display widget between successive ones of the frames during the animation sequence.

73. The method in claim 72 wherein either of the first and second predefined functions is a linear function.

74. The method in claim 72 wherein the first and second intervals are, in duration, approximately 0.5 seconds or less, and at least approximately 1 second, respectively.

75. The method in claim 72 wherein the first and second predefined opacities are approximately full transparency and full opacity, respectively.

76. The method in claim 71 wherein either of the predefined first and second functions is a predefined non-linear function of opacity with respect to time.

77. The method in claim 76 wherein the non-linear function provides slow-in/slow-out fading.

78. The method in claim 65, further comprising the step, if both the Tool Glass and the first display widget are simultaneously being rendered on the display and the physical contact ceases between the preferred hand and the first input device, of not fading the first display widget from view in response to which specific widgets are then being displayed, an operation then occurring or a relative display prioritization among widgets that could be simultaneously displayed.

79. The method in claim 65 further comprising the steps of fading the Tool Glass into and out of view over predefined third and fourth time intervals, respectively, and controlling opacity of the Tool Glass while fading during each of the third and fourth intervals in response to predefined third and fourth functions.

80. The method in claim 79 further comprising the step of initiating fading of the Tool Glass into view and out of view in response to corresponding transitions in the second output signal indicative of the non-preferred hand of the user establishing and breaking physical contact with the second input device.

81. The method in claim 80 wherein either of the predefined third and fourth functions is a predefined non-linear function of opacity with respect to time.

82. The method in claim 81 wherein the non-linear function provides slow-in/slow-out fading.

83. The method in claim 80 wherein either of the third and fourth predefined functions is a linear function.

84. The method in claim 80 wherein the third and fourth intervals are, in duration, approximately 0.5 seconds or less, and at least approximately 1 second, respectively.

85. The method in claim 80 wherein the third and fourth predefined opacities are approximately 0α

and at least approximately 0.7α

, respectively, where 0α and

1α

represent full transparency and full opacity, respectively.

86. The method in claim 80 further comprising the step of changing an alpha-transparency value of the Tool Glass rendered on the display for successive display frames occurring during the third and fourth intervals and so implement a controlled animation sequence which, during the successive frames, fades the Tool Glass into or out of view, respectively.

87. The method in claim 86 further comprising the step of varying coloration or luminance of the Tool Glass between successive ones of the frames during the animation sequence.

88. The method in claim 87 wherein either of the third and fourth predefined functions is a linear function.

89. The method in claim 87 wherein the third and fourth intervals are, in duration, approximately 0.5 seconds or less, and at least approximately 1 second, respectively.

90. The method in claim 87 wherein the third and fourth predefined opacities are approximately 0α

and at least approximately 0.7α

, respectively, where 0α and

1α

represent full transparency and full opacity, respectively.

91. The method in claim 86 wherein either of the predefined third and fourth functions is a predefined non-linear function of opacity with respect to time.

92. The method in claim 91 wherein the non-linear function provides slow-in/slow-out fading.