Processing cursor movements in a graphical user interface of a multimedia application

• US 8,698,844 B1
• Filed: 04/16/2005
• Issued: 04/15/2014
• Est. Priority Date: 04/16/2005
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Middler, Mitchell Scott, Warner, Peter
• Primary Examiner(s): Wang, Claire X
• Assistant Examiner(s): Taylor, Jr., Duane N
• Application Number:
  US11/107,329
• Time in Patent Office: 3,286 Days
• Field of Search: 345650-680
• US Class Current: 345/650
• CPC Class Codes: G06F 3/023 Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object

Abstract

A method for processing a selected item in a GUI of a multimedia application is provided. The method includes receiving a hot key input that specifies a function that is to be applied to the selected item and displaying a set of control guidelines associated with the hot key input. The set of control guidelines indicates cursor movement inputs needed to specify particular aspects of the function. A method for transforming a received cursor movement in a first coordinate system to a transformed cursor movement in a second coordinate system is provided. The received cursor movement specifies a particular manner (e.g., aspect and extent) of a function to be applied to an item in a workspace of a multimedia application. The first coordinate system displays a particular view of the workspace.

Claims

1. A method for processing a selected item in a graphical user interface (“

GUI”

) of an application of a computer system comprising a display device, the method comprising;

from a plurality of user inputs that are associated with a plurality of different sets of control guidelines that relate to a plurality of motion and non-motion types of transform functions for applying to the selected item, receiving, at said computer system, a particular user input that specifies a particular set of control guidelines associated with a function to be applied to the selected item;

in response to receiving the user input, displaying, on said display device, the particular set of control guidelines associated with the user input, each control guideline specifying a particular potential cursor direction for a user to move a cursor while at any position on the display device, by moving a cursor controlling device, in order to apply a particular aspect of the function to the selected item, at least two different potential cursor directions relating to two different aspects of the function that is to be performed on the selected item;

receiving, through a movement of the cursor controlling device, an initial cursor movement input corresponding to a particular control guideline in the displayed set of control guidelines, the particular control guideline directly corresponding to an aspect of the function to be applied to the selected item;

identifying, based only on the received initial cursor movement input, one of the potential cursor directions specified by the particular control guideline; and

applying to the item the aspect of the function that is related to the identified potential cursor direction, said applying comprising;

(i) applying a motion transform that modifies a position of the selected item when the user input is associated with a motion type of transform function; and

(ii) applying a non-motion transform that does not modify the position of the selected item when the user input is associated with a non-motion type of transform function.

2. The method of claim 1, wherein the identified potential cursor direction of the cursor movement input specifies the aspect of the function and a distance of the cursor movement input specifies an extent to which the aspect of the function is to be applied to the selected item.

3. The method of claim 1, wherein the particular set of control guidelines comprises two or more guidelines, each guideline having a different appearance to visually indicate different potential cursor directions that specify different aspects of the function.

4. The method of claim 3 further comprising, in response to identifying the potential cursor direction that is related to the received cursor movement, removing from the display device other guidelines indicating other potential cursor directions in the particular set of control guidelines.

5. The method of claim 1, wherein the particular set of control guidelines comprises:

a first guideline that visually indicates a horizontal cursor movement input, through the cursor controlling device, that specifies an X-axis aspect of the function;

a second guideline that visually indicates a vertical cursor movement input, through the cursor controlling device, that specifies a Y-axis aspect of the function; and

a third guideline that visually indicates a diagonal cursor movement input, through the cursor controlling device, that specifies a Z-axis aspect of the function.

6. The method of claim 1, wherein said function is a first function, said user input is a first user input, said particular set of control guidelines is a first set of control guidelines, and said cursor movement is a first cursor movement, the method further comprising:

receiving a second user input that specifies a second function that is to be applied to the selected item;

in response to receiving the second user input, displaying a second set of control guidelines associated with the second user input, the second set of control guidelines specifying a plurality of potential cursor directions comprising at least two different potential cursor directions relating to two different aspects of the second function that is associated with the second set of control guidelines and that is to be performed on the selected item;

receiving a second cursor movement input through a movement of the cursor controlling device;

identifying a potential cursor direction that is related to the received second cursor movement; and

applying to the selected item an aspect of the second function that is related to the identified potential cursor direction of the second cursor movement input, wherein the second user input is different from the first user input and the second function is different from the first function.

21. The method of claim 1, wherein said particular set of control guidelines is not displayed before receiving said user input.

29. The method of claim 1, wherein the motion transform is one of a rotation transform or a translation transform.

30. The method of claim 1, wherein the non-motion transform is a scaling transform.

7. A non-transitory computer readable storage medium storing a computer program comprising a graphical user interface (GUI), the computer program comprising sets of instructions for:

receiving a particular user input from a plurality of user inputs, each user input associated with a plurality of control guidelines that relate to a plurality of transform functions for applying to a selected item, the plurality of functions comprising motion functions and non-motion functions, said particular user input specifying a particular plurality of control guidelines associated with a function to be applied to the selected item;

in response to receiving the user input, displaying on a display device, the particular plurality of control guidelines associated with the user input, each control guideline specifying a potential direction for a user to provide a directional input through the display device, by moving a user input device, in order to apply a particular aspect of the function to the selected item, at least two different potential directions relating to two different aspects of the function that is to be performed on the selected item;

receiving, through a movement of the user input device, an initial directional input corresponding to a particular control guideline in the displayed plurality of control guidelines, the particular control guideline directly corresponding to an aspect of the function to be applied to the selected item;

identifying, based only on the received initial directional input, a particular one of the potential directions specified by the particular control guideline;

in response to identifying the particular potential direction based on the received initial directional input, removing from display other guidelines indicating potential directions different from the identified potential direction in the particular plurality of control guidelines; and

applying to the selected item the aspect of the function that is related to the identified potential direction.

8. The non-transitory computer-readable physical storage medium of claim 7, wherein the particular plurality of control guidelines comprises two or more guidelines, each guideline having a different appearance to visually indicate different potential directions that specify different aspects of the function.

9. A non-transitory computer-readable storage medium storing a computer program for providing a graphical user interface (“

GUI”

), the GUI comprising;

a display area for displaying an item;

a plurality of control guidelines that is activated and simultaneously displayed in the GUI in response to a user input associated with a particular transform, each control guideline specifying a particular directional input for a user to provide through the display area by moving a user input device in order to apply a particular aspect of the transform to the item, the plurality of control guidelines comprising at least two non-orthogonal guideline directions relating to two different aspects of the particular transform to be performed on the item; and

a tool for said activation of the plurality of control guidelines,

wherein after the plurality of control guidelines is activated and an initial directional input corresponding to a particular control guideline that directly corresponds to an aspect of the particular transform to be applied to the item is received through a movement of the user input device, an aspect of the particular transform related to the received initial directional input is performed on the item.

10. The non-transitory computer-readable storage medium of claim 9, wherein the display area is for displaying the item in a multidimensional scene.

11. The non-transitory computer-readable storage medium of claim 10, wherein said multidimensional scene is a three dimensional scene.

12. The non-transitory computer-readable storage medium of claim 9, the GUI further comprising a set of tools for adding a set of items to the display area.

13. The non-transitory computer-readable storage medium of claim 12, the GUI further comprising a set of tools for modifying the set of items in the display area.

14. The non-transitory computer-readable storage medium of claim 9, the GUI further comprising a set of tools for compositing a multimedia content.

15. The non-transitory computer-readable storage medium of claim 9, wherein said item comprises at least one of an audio, a video, and a text.

31. The non-transitory computer-readable storage medium of claim 9, wherein the user input is a keyboard input.

32. The non-transitory computer-readable storage medium of claim 9, wherein the particular transform is performed on the item in a three-dimensional space that is defined by reference to three axes, the plurality of control guidelines comprising at least a first control guideline corresponding to an x-axis of the three-dimensional space, a second control guideline corresponding to a y-axis of the three-dimensional space, and a third control guideline corresponding to a z-axis of the three-dimensional space, the particular transform is performed on the item with respect to the axis that corresponds to the control guideline associated with the received user input device movement.

33. The non-transitory computer-readable storage medium of claim 9, wherein the plurality of control guidelines comprises at least five control guidelines.

16. A method of providing a graphical user interface (“

GUI”

) for a computer program that creates a composite presentation from a plurality of composite objects defined in a three-dimensional composite space that is defined by three axes, the method comprising;

in the GUI, providing a display area for providing a presentation of the plurality of composite objects in the three-dimensional space; and

providing at least three control guidelines for being activated and simultaneously displayed in the GUI in response to a user input associated with a particular transform for applying to a selected composite object, each control guideline specifying a potential cursor direction for a movement of a cursor while at any position on the display area, through a movement of a cursor controlling device, in order to apply a particular aspect of the particular transform to the selected composite objects, the control guidelines indicating at least three potential cursor directions that correspond to the three axes of the three-dimensional space,

wherein after the control guidelines is activated and an initial cursor movement corresponding to a particular control guideline that directly corresponds to an aspect of the particular transform to be applied to the selected item is detected through the movement of the cursor controlling device and associated with one of the potential cursor directions specified by the control guidelines, the particular transform is performed on the selected composite object with respect to an axis that corresponds to the potential cursor direction associated with the detected initial cursor movement.

17. The method of claim 16 further comprising providing a set of tools for adding a set of composite objects to the display area.

18. The method of claim 17 further comprising providing a set of tools for modifying the set of composite objects in the display area.

19. The method of claim 16 further comprising providing a set of tools for compositing a multimedia content.

20. The method of claim 16, wherein said selected composite object comprises at least one of an audio, a video, and a text.

22. A method for interacting with a graphical user interface (“

GUI”

) of a computer system in order to process a selected composite item in a three-dimensional space of an application of the computer system, the computer system comprising a display device, the method comprising;

receiving, at said computer system, a keyboard input that specifies a function that is to be applied to the selected composite item;

in response to receiving the keyboard input, simultaneously displaying, on said display device, a plurality of control guidelines associated with the function, each control guideline specifying a direction for a directional input received through the display device through a movement of a user input device, in order to apply a particular aspect of the function to the selected composite item, the plurality of control guidelines comprising at least two non-orthogonal guideline directions relating to two different aspects of the function to be performed on the selected composite item;

receiving, through a movement of the user input device, an initial directional input through the display device corresponding to a particular control guideline in the displayed plurality of control guidelines, the particular control guideline directly corresponding to an aspect of the function to be applied to the selected item;

associating the received initial directional input with a particular one of said directions specified by the particular control guideline;

receiving a subsequent directional input different from the initial directional input through the display device after the initial directional input is associated with the particular direction;

ignoring the subsequent directional input; and

processing the selected composite item by applying the aspect of the function specified by the particular direction to the selected composite item in order to modify a relative arrangement of the selected composite item in the three-dimensional space with respect to at least one other composite item.

23. The method of claim 22 further comprising identifying a distance of the initial directional input, wherein said processing comprises applying the aspect of the function specified by the particular direction to the selected composite item based on said identified distance.

24. The method of claim 22, wherein a horizontal direction of the directional input specifies a first aspect of the function, wherein a vertical direction of the directional input specifies a second aspect of the function, wherein a diagonal direction of the directional input specifies a third aspect of the function.

25. The method of claim 22, wherein the aspect is a selected aspect for applying to the selected item, wherein receiving the subsequent directional input does not cause the aspect to become deselected.

26. The method of claim 22 further comprising, in response to receiving the initial directional input in the particular direction indicated by a particular guideline of the plurality of control guidelines, removing from display other guidelines in the plurality of control guidelines.

27. The method of claim 22, wherein modifying the relative arrangement of the selected composite item in the three-dimensional space comprises changing a position of the selected composite item with respect to the other composite item.

28. The method of claim 22, wherein modifying the relative arrangement of the selected composite item in the three-dimensional space comprises changing a size of the selected composite item with respect to the other composite item.