Orientation free user interface

• US 8,060,840 B2
• Filed: 12/29/2005
• Issued: 11/15/2011
• Est. Priority Date: 12/29/2005
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Billow, Charles R, Richter de Medeiros, Gretchen
• Primary Examiner(s): Sax; Steven
• Assistant Examiner(s): Kumar; Anil N
• Application Number:
  US11/321,551
• Publication Number:
  US 20070157095A1
• Time in Patent Office: 2,147 Days
• Field of Search: 715/825, 715/810, 715/827, 715/830, 715/834, 715/702, 715/750
• US Class Current: 715/825
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance

Abstract

Generation and display of a dynamically orientable graphical user interface (GUI) is described. The GUI can include user input controls that are configured to receive user input. In one exemplary embodiment, the GUI is displayed as a band around a perimeter of a horizontally oriented interactive display surface. The user input controls can be made to reorient in response to an application that provides control, or a user can selectively cause the GUI to move relative to the interactive display surface to enable the user to gain access to a specific that was previously disposed at a different point. The user input can be received directly from the orientable GUI in the form of finger movement detected by the interactive display surface and the reorientation of the GUI can be controlled according to the laws of physics, based on the user input.

Claims

1. A computer implemented method for controlling a user interface of an interactive display with dynamically orientable user input controls, comprising the steps of:

(a) selecting a portion of a primary graphical user interface (GUI) of an interactive display table to be readily orientable, the primary graphical user interface being arranged around the perimeter of the interactive display table;

(b) generating an orientable GUI within the portion selected, the orientable GUI extending around the interactive display table within the primary graphical user interface, the orientable GUI including a plurality of user input controls that are arranged around the interactive display table and can be dynamically reoriented within the portion selected, based on a user input to the orientable GUI wherein the orientable GUI is reoriented by being rotated around the perimeter of the interactive display table;

(c) receiving user input at the dynamically orientable GUI, the user input comprising the user'"'"'s finger touching a portion of the interactive display table above one of the plurality of user input controls of the orientable GUI such as to select one of the user input controls and sliding across the interactive display table, and in response, identifying a present position of the plurality of user input controls relative to a predetermined position within the portion selected;

(d) determining that the user input indicates a user invocation to rotate the plurality of user input controls relative to the present position; and

(e) dynamically rendering the orientable GUI to implement a reorientation of the plurality of user input controls within the portion selected relative to the predetermined position, wherein reorienting the at least one user control comprises;

(i) determining a speed and a direction that the user'"'"'s finger slides across the interactive display table;

(ii) calculating a speed and a direction of rotation to be applied to the plurality of user input controls as they are dynamically rendered, the calculated speed being equal to the determined speed of the user'"'"'s finger as it slides across the interactive display table;

(iii) applying the calculated speed and direction of rotation to the plurality of user input controls to dynamically control the speed and direction of rotation of the plurality of user input controls as the orientable GUI is dynamically rendered such that upon applying the calculated speed and direction of rotation, the plurality of user input controls commence to rotate at the calculated speed and in the calculated direction and continue to rotate at the calculated speed in the calculated direction after the user input is received and even when no other input is being received indicating a user invocation to rotate the plurality of user input controls; and

(iv) calculating a braking parameter that is proportional to the determined speed of the user input, the braking parameter defining a rate of decay in the calculated speed of rotation of the plurality of user input controls, and applying the braking parameter to the calculated speed of rotation of the plurality of user input controls such that the rotation is slowed by the braking parameter according to the rate of decay.

2. The method of claim 1, wherein the step of identifying when the user input is received at the orientable GUI further comprises the step of detecting an object at least proximate to the portion selected.

3. The method of claim 1, and further comprising the step of determining if the user input indicates an invocation of the at least one user control, and if so, implementing a predetermined function associated with the at least one user control.

4. The method of claim 1, wherein the portion selected at least partially extends around the primary GUI.

5. The method of claim 4, wherein the at least one user control is movable along a path extending within the portion selected.

6. The method of claim 4, wherein the portion selected is contiguous around a periphery of the primary GUI.

14. The method of claim 1 wherein the rotation is stopped by the braking parameter.

15. The method of claim 1 further comprising receiving further user input at the dynamically orientable GUI, and in response to the further user input, stopping the rotation of the plurality of user input controls.

7. A tangible computer readable storage media having computer executable instructions stored thereon for carrying out a plurality of functions for controlling a user interface of an interactive display with dynamically orientable user input controls, the functions including:

(a) selectively invoking an orientable graphical interface (GUI) as a secondary display field within a primary display field of an interactive display table, the primary display field being arranged around the perimeter of the interactive display table;

(b) in response to the invocation, generating the orientable GUI, the orientable GUI extending around the interactive display table within the primary display field, the orientable GUI including a plurality of user input fields arranged around the interactive display table and being configured to enable dynamic reorientation of at least a portion of the orientable GUI in response to a user input to the orientable GUI wherein the orientable GUI is reoriented by being rotated around the perimeter of the interactive display table;

(c) identifying when a user input is received at the orientable GUI, the user input touching a portion of the interactive display table above one of the plurality of user input fields of the orientable GUI such as to select one of the user input fields, the user input further comprising the user'"'"'s finger sliding across the interactive display table, and in response, determining that the user input indicates a user invocation to rotate the plurality of user input fields; and

(d) in response to the user input, dynamically rendering the orientable GUI to rotate the plurality of user input fields, wherein rendering the orientable GUI comprises;

(i) determining a speed and a direction that the user'"'"'s finger slides across the interactive display table;

(ii) calculating a speed and a direction of rotation to be applied to the plurality of user input fields as they are dynamically rendered, the calculated speed being equal to the determined speed of the user'"'"'s finger as it slides across the interactive display table;

(iii) applying the calculated speed and direction of rotation to the plurality of user input fields to dynamically control the speed and direction of rotation of the plurality of user input fields as the orientable GUI is dynamically rendered such that upon applying the calculated speed and direction of rotation, the plurality of user input fields commences to rotate at the calculated speed and in the calculated direction and continues to rotate at the calculated speed in the calculated direction after the user input is received and further user input indicating a user invocation to rotate the plurality of user input fields has ceased; and

(iv) calculating a braking parameter that is proportional to the determined speed of the user input, the braking parameter defining a rate of decay in the calculated speed of rotation of the plurality of user input fields, and applying the braking parameter to the speed of rotation of the plurality of user input fields such that the rotation is stopped by the braking parameter according to the rate of decay.

8. The computer readable storage medium of claim 7, wherein the functions further include identifying a present disposition of the orientable GUI relative to a predetermined position around a periphery of the primary display field.

9. The computer readable storage medium of claim 8, wherein the plurality of user input fields are rotated relative to the predetermined position.

10. The computer readable storage medium of claim 7, wherein the functions further include detecting an object proximate to at least one of the plurality of user input fields within the orientable GUI when the orientable GUI is displayed on the interactive display surface.

11. The computer readable storage medium of claim 7, wherein the functions further include determining if the user input indicates an invocation of one of the plurality of user input fields, and if so, implementing a predetermined function associated with the invoked user input field.

12. The computer readable storage medium of claim 11, wherein the predetermined function includes at least one of:

(a) invoking a process that is independent of a process employed for controlling the orientable GUI;

(b) providing a user control to a process that is independent of the process that is employed for controlling the orient able GUI;

(c) providing a user control to the process that is controlling the orientable GUI; and

(d) terminating a process.

13. An interactive display system for controlling a dynamically orientable user interface, comprising:

(a) an interactive display surface on which graphic images are displayable;

(b) an optical system for projecting the graphic images onto the interactive display surface and for detecting user input to the interactive display surface; and

(c) a computing system in communication with the optical system, the computing system including a processor, and a memory in communication with the processor, the memory storing machine instructions that cause the processor to carry out a plurality of interactive display functions, including;

(i) generating and displaying an orientable GUI on a selected portion of the interactive display surface, the orientable GUI extending around the interactive display table within a primary graphical user interface, the orientable GUI including a plurality of user input controls that are arranged around the interactive display table and that are independent of other graphic images displayed on the interactive display surface, and further, the orientable GUI being enabled to be dynamically reoriented within the selected portion in response to a user input to the orientable GUI wherein the orientable GUI is reoriented by being rotated around the perimeter of the interactive display table;

(ii) detecting a user input to the portion of the interactive display surface that is displaying the orientable GUI, the user input comprising touching a portion of the interactive display table above one of the plurality of user input controls of the orientable GUI such as to select one of the user input controls and further comprising the user'"'"'s finger sliding across the interactive display table, and in response, analyzing the user input; and

(iii) dynamically rendering the orientable GUI for display in a different orientation, based on the user input that was analyzed, the rendering comprising;

(1) determining a speed and a direction of rotation that the user'"'"'s finger slides across the interactive display table;

(2) calculating a speed and a direction of rotation to be applied to the plurality of user input controls as they are dynamically rendered, the calculated speed being equal to the determined speed of the user'"'"'s finger as it slides across the interactive display table;

(3) applying the calculated speed and direction of rotation to the plurality of user input controls to dynamically control the speed and direction of rotation of the plurality of user input controls as the orientable GUI is dynamically rendered such that upon applying the calculated speed and direction of rotation, the plurality of user input controls commence to rotate at the calculated speed and in the calculated direction and continue to rotate at the calculated speed in the calculated direction after the user input is received and further user input indicating a user invocation to rotate the plurality of user input controls has ceased; and

(3) calculating a braking parameter that is proportional to the determined speed of the user input, the braking parameter defining a rate of decay in the calculated speed of rotation of the plurality of user input controls, and applying the braking parameter to the calculated speed of rotation of the plurality of user input controls such that the rotation is stopped by the braking parameter according to the rate of decay.