Peel back user interface to show hidden functions

• US 7,676,767 B2
• Filed: 06/15/2005
• Issued: 03/09/2010
• Est. Priority Date: 06/15/2005
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Hofmeister, Nicholas M., Storrusten, Dane T.
• Primary Examiner(s): Vu; Kieu
• Assistant Examiner(s): Basom; Blaine T.
• Application Number:
  US11/154,402
• Publication Number:
  US 20060284852A1
• Time in Patent Office: 1,728 Days
• Field of Search: 715/797, 715/796, 715/795, 715/794, 715/782, 715/702, 715/776, 715/778, 715/766, 715/790, 715/863, 345/173
• US Class Current: 715/863
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor

Abstract

A user is able to access additional functions not represented in a current image displayed by a graphical user interface. At least one function not presented on the current image is represented by a symbol on an underlying image that is at least partially covered by the current image. When the user performs a predetermined user input (e.g., selecting a corner of the current image), the underlying image and the at least one function represented thereby become accessible. When the user input is performed, a visual effect depicts the current image being at least partially removed from over the underlying image, thereby revealing and permitting access to the at least one additional function. The user input is made by the user performing an action with the user'"'"'s hand or another object adjacent to a responsive display, or by using a pointing device to manipulate a displayed image.

Claims

1. A method for receiving input in a computing device having a graphical user interface to access functions related to a displayed window but which are obscured and on an underlying image, the method comprising the steps of:

(a) identifying at least one additional function of an application window displayed on the graphical user interface of the computing device, the at least one additional function being accessible on at least a portion of an underlying image that is not currently visible to a user, wherein the at least one additional function is inaccessible from a current image of the application window and relates directly to manipulation of the current image;

(b) presenting the current image to the user, the current image representing a current function of the application and covering at least a portion of the underlying image such that access to the at least one additional function is at least partially covered by the current image rendering the at least one additional function inaccessible from the current image;

(c) establishing a predetermined user input for providing access to the underlying image and the function accessible thereon; and

(d) upon receiving the predetermined user input from the user, initiating a visual effect depicting the current image representing the current function of the application being at least partially removed from over the underlying image to visually expose and enable access by the user to the at least one additional function of the application, which was previously visually hidden by the current image,

wherein steps (a)-(d) are performed on an interactive display table configured to recognize different objects and perform different visual effects to the current image based on which of the different objects is used to perform the predetermined user input, as well as to perform different visual effects for different predetermined user inputs;

wherein the current image does not include immediately visible functions for at least two of;

(A) minimizing the current image;

(B) maximizing the current image; and

(C) closing the current image; and

wherein initiating a visual effect depicting the current image representing the current function of the application being at least partially removed from over the underlying image to visually expose and enable access by the user to the at least one additional function of the application includes crumpling at least a portion of the current image and thereby exposing the at least two functions not immediately visible on the current image.

2. The method of claim 1, wherein the underlying image includes at least one of:

(a) an exit function for the current function represented by the current image;

or

(b) at least one additional menu associated with the application displayed on the current image including a plurality of additional functions not accessible via the current image.

3. The method of claim 1, wherein the display includes an input responsive display and the predetermined input includes positioning an external object adjacent to the input responsive display to interact with the current image, wherein adjacent includes objects that are near, but not actually touching the input responsive display.

4. The method of claim 3, further comprising the step of at least one of:

(a) responding to the user positioning the external object adjacent to a predetermined area of the current image on the input responsive display;

(b) responding to the user positioning the external object adjacent to the predetermined area of the input responsive display and lifting the external object away from the input responsive display;

(c) responding to the user positioning the external object adjacent to a predetermined portion of the input responsive display;

(d) responding to the user positioning the external object adjacent to a designated portion of the current image on the input responsive display and lifting the external object away from the input responsive display;

or

(e) responding to the user performing a predetermined gesture with the external object adjacent to the input responsive display, including one of;

(i) placing the external object adjacent to a corner of a predetermined area of the input responsive display, and moving the external object away from the corner of the predetermined area;

(ii) placing the external object adjacent to an edge of a predetermined area of the input responsive display, and moving the external object away from the edge of the predetermined area;

(iii) placing the external object adjacent to a corner of the current image, and moving the external object away from the corner of the current image;

(iv) placing the external object adjacent to an edge of the current image, and moving the object away from the edge of the current image;

(v) placing a plurality of external objects adjacent to the input responsive display and moving the plurality of external objects apart from each other;

(vi) placing the external object adjacent to a surface of the input responsive display and moving the external object toward an edge of the input responsive display;

or

(vii) placing the external object adjacent to a surface of the input responsive display and moving at least a portion of the external object in a direction generally parallel with the surface of the input responsive display.

5. The method of claim 3, wherein the external object includes at least one of:

(a) multiple portions of a user'"'"'s hand;

(b) a user manipulatable object, wherein the object has a shape that is recognized by the input responsive display;

or

(c) a user manipulatable object, wherein the object is coded to be recognized by the input responsive display.

6. The method of claim 5, wherein the external object is configured to be recognized by the input responsive display as being associated with providing access to the underlying image, and access is provided to the underlying image upon the configuration of the external object being recognized by the input responsive display.

7. The method of claim 5, wherein the user manipulatable object is a knife-shaped physical object having a blade portion.

8. The method of claim 1, wherein the predetermined action includes manipulating a pointing device to a position on the display and dragging one of corner and an edge of a displayed window generally inwardly into the displayed window.

9. The method of claim 1, wherein the visual effect depicting the current image being at least partially removed from over the underlying image includes one of:

(a) showing an opening forming in the current image, the opening including one of a hole, a rip, a cut, and a tear;

(b) showing the current image being split into a plurality of pieces;

or

(c) showing the current image being crumpled.

10. The method of claim 1, wherein after receiving the predetermined user input permits access to the at least one additional function, further comprising the step of initiating the at least one additional function upon one of the following occurring:

(a) while the predetermined user input is being maintained, responding to the user providing an additional user input to trigger execution of the at least one additional function;

(b) after the predetermined user input has been made, responding to the user making the additional user input to trigger execution of the at least one additional function within a predetermined interval of time interval after the predetermined user input has been made;

or

(c) after the predetermined user input has been made, responding to the user making the additional user input before any other user input is made.

11. A memory medium on which are stored machine instructions for carrying out the steps of claim 1.

12. A memory medium storing machine instructions for execution on a computing device having a graphical user interface presented on a display configured to be responsive to an input made by one of placing and moving external objects relative to a surface of the display, wherein relative to the surface of the display includes objects that are near, but not actually touching the surface of the display, said machine instructions when executed by the computer device, carrying out a plurality of functions, including:

(a) associating at least one additional function of an application of the computing device with at least a portion of an underlying image, the at least one additional function visually hidden and inaccessible from a current image associated with the application, and the at least one additional function being directly related to manipulation of the current image visually hiding the at least one additional function;

(b) presenting the current image to a user, the current image covering at least a portion of the underlying image such that access to the at least one additional function is at least partially covered by the current image rendering the at least one additional function inaccessible from the current image;

(c) detecting a type of external object adjacent to the surface of the display;

(d) detecting a predetermined user input made for accessing the additional function on the underlying image, the predetermined user input including at least one of;

(i) the user placing the external object adjacent to a surface of the display, wherein adjacent includes objects that are near, but not actually touching the input responsive display;

or

ii) the user performing a gesture with the external object adjacent to the surface of the display, wherein adjacent includes objects that are near, but not actually touching the input responsive display;

(e) upon detecting the external object and the predetermined user input, initiating a visual effect depicting the current image being at least partially removed from the underlying image, revealing the at least one additional function and enabling access of the at least one additional function by the user to manipulate the current image for which the visual effect has been initiated, wherein initiating the visual effect comprises selecting a visual effect from a plurality of different available visual effects, wherein the selected visual effect is dependent on the type of the external object and either location of placement of the external object or the gesture made with the external object, such that different combinations of external object types, placements and gestures produce different visual effects; and

(f) initiating the at least one additional function and manipulating the current image upon detecting one of;

(i) while the predetermined user input is being maintained, the user making an additional user input to trigger the at least one additional function;

(ii) after predetermined the user input has been made, the user making the additional user input to trigger the at least one additional function within a predetermined interval of time after the predetermined user input was made;

or

(iii) after the predetermined user input was made, the user making the additional user input before any other user input is made.

13. The memory medium of claim 12, wherein the underlying image includes at least one of:

(a) an exit function for a current function represented by the current image;

(b) at least one additional menu including a plurality of additional functions not accessible via the current image;

(c) an additional application;

or

(d) a control for accessing an operating system function.

14. The memory medium of claim 12, wherein the plurality of functions further include at least one of:

(a) responding to the user positioning the external object adjacent to a predetermined area of the display;

(b) responding to the user positioning the external object adjacent to the predetermined area of the display and lifting the external object away from the display;

(c) responding to the user positioning the external object adjacent to a designated portion of the current image;

(d) responding to the user positioning the external object adjacent to the display in the designated portion of the current image and lifting the external object away from the display;

or

(e) responding to the user performing a predetermined gesture with the external object adjacent to the display, including one of;

(i) placing the external object adjacent to a corner of the predetermined area of the display, and moving the external object away from the corner of the predetermined area;

(ii) placing the external object adjacent to an edge of the predetermined area of the display, and moving the external object away from the edge of the predetermined area;

(iii) placing the external object adjacent to a corner of the current image, and moving the external object away from the corner of the current image;

(iv) placing the external object adjacent to an edge of the current image, and moving the external object away from the edge of the current image;

(v) placing a plurality of external objects adjacent to the display and moving each of the plurality of external objects apart from each other;

(vi) placing the external object adjacent to a surface of the display and moving the external object toward an edge of the display;

or

(vii) placing the external object adjacent to the surface of the display and moving at least a portion of the external object in a direction generally parallel with the surface of the display.

15. The memory medium of claim 12, wherein the external object includes at least one of:

(a) a user'"'"'s hand;

or

(b) a shape of the external object that is recognized by the computing device using the display.

16. The memory medium of claim 15, wherein the external object is configured to be recognized by the computing device as being associated with providing access to the underlying image, and access is provided to the underlying image upon the shape of the external object being recognized by the computing device.

17. The memory medium of claim 12, wherein the visual effect depicting the current image being at least partially removed from over the underlying image includes one of:

(a) showing a corner of the current image being peeled back;

(b) showing an edge of the current image being peeled back;

(c) showing an opening forming in the current image, the opening including one of a hole, rip, cut, or tear;

(d) showing the current image being split into pieces;

(e) showing the current image being crumpled;

or

(f) showing the current image sliding within the display to at least partially visually reveal the at least the portion of the underlying image.

18. The memory medium of claim 12, wherein after receiving the predetermined user input, the machine instructions cause the computing device to permit access to the at least one additional function, initiating the at least one additional function upon one of:

(a) while the predetermined user input is being maintained, responding to the user making an additional user input to trigger execution of the at least one additional function;

(b) after the predetermined user input has been made, responding to the user making the additional user input to trigger execution of the at least one additional function within a predetermined interval of time interval after the predetermined user input has been made;

or

(c) after the predetermined user input has been made, responding to the user making the additional user input before any other user input is made.

19. A system for providing an input to an application that is being executed, comprising:

(a) an interactive display surface adjacent to which a plurality of non-electronic physical objects are manipulated, said interactive display surface presenting visual entities;

(b) a light sensor that optically detects a location of the non-electronic physical objects that are adjacent to the interactive display surface, wherein adjacent includes non-electronic physical objects that are near, but not actually touching the input responsive display, and wherein said light sensor detects the location of the physical objects near, but not actually touching the input responsive display;

(c) a processor in communication with the light sensor and the display device; and

(d) a memory in communication with the processor, the memory storing data and machine instructions that cause the processor to carry out a plurality of functions, including;

(i) associating at least one additional function of an application of the computing device with at least a portion of an underlying image that is initially at least partially hidden by a current image associated with the application, which at least one additional function is directly related to manipulation of the current image;

(ii) presenting the current image to a user, the current image being associated with a current function and covering at least a portion of the underlying image so that the at least one additional function is at least partially covered and obscured by the current image rendering the at least one additional function inaccessible from the current image;

(iii) detecting a type of external object adjacent to the surface of the display as well as a predetermined user input for providing access to the underlying image, wherein the detected predetermined user input includes at least one of;

(1) the user placing the external object adjacent to the interactive display surface, wherein adjacent includes objects that are near, but not actually touching input responsive display;

or

(2) the user performing a gesture with the external object adjacent to the interactive display surface, wherein adjacent includes objects that are near, but not actually touching the input responsive display; and

(iv) upon detecting the type of external object and the predetermined user input, initiating a visual effect depicting the current image being at least partially removed from over the underlying image to thereby visually expose and enable access by a user to the at least one additional function, which was previously at least partially hidden by the current image and which allows manipulation of the current image previously partially removed from over the at least one additional function, wherein initiating the visual effect comprises selecting a visual effect from a plurality of different available visual effects, wherein the selected visual effect is dependent on the type of the external object and the predetermined user input, such that different combinations of external object types and predetermined user inputs produces different visual effects.

20. The system of claim 19, further comprising at least one non-electronic external object, and wherein the predetermined user input includes at least one of:

(a) positioning the at least one non-electronic external object adjacent to a predetermined area of the display, wherein adjacent includes objects that are near, but not actually touching the input responsive display;

(b) positioning the at least one external object adjacent to the predetermined area of the display and lifting at least one external object away from the display, wherein adjacent includes objects that are near, but not actually touching the input responsive display;

(c) positioning the at least one external object adjacent to a designated portion of the current image, wherein adjacent includes objects that are near, but not actually touching the input responsive display;

(d) positioning the at least one external object adjacent to the designated portion of the current image and lifting at least one external object away from the display, wherein adjacent includes objects that are near, but not actually touching the input responsive display;

or

(e) performing a predetermined gesture with the external object adjacent to the display, including one of;

(i) placing the at least one external object adjacent to a corner of the predetermined area of the display, and moving at least one external object away from the corner of the predetermined area;

(ii) placing the at least one external object adjacent to an edge of the predetermined area of the display, and moving at least one external object away from the edge of the predetermined area;

(iii) placing the at least one external object adjacent to a corner of the current image, and moving at least one external object away from the corner of the current image;

(iv) placing the at least one external object adjacent to an edge of the current image, and moving at least one external object away from the edge of the current image;

(v) placing a plurality of external objects adjacent to the display and moving at least some of the plurality of external objects apart from each other;

(vi) placing the at least one external object adjacent to a surface of the display and moving at least one external object toward an edge of the display;

or

(vii) placing the external object adjacent to the surface of the display and moving at least a portion of at least one external object in a direction generally parallel with the surface of the display.

21. The system of claim 19, wherein the visual effect depicting the current image being at least partially removed from over the underlying image includes one of:

(a) showing the current image being split into a plurality of pieces;

or

(b) showing the current image being crumpled.