Graphical user interface having sound effects for operating control elements and dragging objects

• US 6,297,818 B1
• Filed: 05/08/1998
• Issued: 10/02/2001
• Est. Priority Date: 05/08/1998
• Status: Expired due to Term

• Current Assignee: Apple Inc.
• Original Assignee: Apple Computer Incorporated (Apple Inc.)
• Inventors: Rose, Arlo, Ulrich, Robert
• Primary Examiner(s): Bayerl, Raymond J.
• Assistant Examiner(s): Thai, Cuong T.
• Application Number:
  US09/074,543
• Time in Patent Office: 1,243 Days
• Field of Search: 345/348, 345/977, 345/978, 345/326, 345/302, 345/339
• US Class Current: 715/202
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: Y10S 715/978 Audio interaction as part of an operator interface

Abstract

Systems and methods for providing an enhanced auditory behavior to a graphical user interface are described. Control elements portrayed by the graphical user interface on a display are associated with at least two states. When transitioning between states, a sound effect specified for that transition can be provided to provide further user or designer customization of the interface appearance. Movement of objects can be accompanied by a repeated sound effect. Characteristics of both sound effects can be easily adjusted in volume, pitch and frequency.

Claims

1. A method for providing a sound effect between a first display position associated with an object drawn on a graphical user interface of a computer system and a second display position associated with said object, the method comprising the steps of:

drawing said object in said first display position of a display space controlled by said graphical user interface;

receiving, at said graphical user interface, a user input invoking movement of said object;

retrieving a sustain sound segment; and

repeatedly reproducing said sustain sound segment until said graphical user interface receives a second user input indicating that said object has reached said second display position.

2. The method of claim 1, further comprising the step of:

panning said reproduced sustain sound segment between speakers as said object moves from said first display position to said second display position.

3. The method of claim 2, wherein said step of panning further comprises the steps of:

varying a volume between said speakers between 50 and 150 percent of a recorded volume depending upon a current display position.

4. The method of claim 1, wherein said step of reproducing further comprises the step of:

reproducing said sustain sound segment at a volume specified for movement of said object.

5. The method of claim 1, wherein said step of reproducing further comprises the step of:

reproducing said sustain sound segment at a pitch specified for movement of said object.

6. The method of claim 1, wherein said step of reproducing further comprises the step of:

reproducing said sustain sound segment after a delay specified for movement of said object.

7. The method of claim 1, further comprising the step of:

retrieving, prior to retrieving said sustain sound segment, an attack sound segment that is reproduced prior to repeatedly reproducing said sustain sound segment.

8. The method of claim 1, further comprising the step of:

retrieving and reproducing, after said second user input is received, a decay sound segment.

9. The method of claim 1, further comprising the step of:

selecting, from within a range of frequencies, a frequency for repeatedly reproducing said sustain sound segment.

10. The method of claim 9, wherein said step of selecting further comprises the step of:

setting said range of frequencies to an envelope of about plus/minus 2.5 percent of an original frequency at which said sustain sound segment was recorded.

11. The method of claim 10, wherein said step of selecting further comprises the step of weighting selection of said frequency from within said envelope.

12. The method of claim 1, wherein the sustain sound segment is retrieved in response to said user input invoking movement of said object.

13. In a computer having a display, a system for providing a sound effect between a first and a second display position of an object on said display, said system comprising:

an input device for controlling movement of a cursor on said display and for generating a user-controlled output when said cursor is positioned over a control element;

a graphical user interface for rendering said object on said display in said first display position and for receiving said user-controlled output; and

a storage device for storing said sound effect associated with movement of said object, wherein when said graphical user interface receives said user-controlled output, said graphical user interface outputs said sound effect until said object reaches said second display position.

14. The system of claim 13, further comprising:

at least two speakers for outputting said sound effect; and

means for panning said sound effect between speakers as said object moves from said first display position to said second display position.

15. The system of claim 14, wherein said means for panning further comprises:

means for varying a volume between said speakers between 50 and 150 percent of a recorded volume depending upon a current display position.

16. The system of claim 13, wherein a data structure associated with said sound effect includes a volume parameter specified for output of said sound effect.

17. The system of claim 13, wherein a data structure associated with said sound effect includes a pitch parameter specified for output of said sound effect.

18. The system of claim 13, wherein a data structure associated with said sound effect includes a volume gain parameter specified for output of said sound effect.

19. The system of claim 13, wherein a data structure associated with said sound effect includes an attack segment, a sustain segment and a decay segment.

20. The system of claim 19, further comprising:

means for retrieving, prior to retrieving said sustain sound segment, said attack sound segment that is reproduced prior to repeatedly reproducing said sustain sound segment.

21. The system of claim 20, wherein said means for retrieving further comprises:

means for retrieving and reproducing, after said second display position is reached, said decay sound segment.

22. The system of claim 13, further comprising:

means for selecting, from within a range of frequencies, a frequency for repeatedly reproducing said sound effect.

23. The system of claim 22, wherein said means for selecting further comprises:

means for setting said range of frequencies to an envelope of about plus/minus 2.5 percent of an original frequency at which said sound effect was recorded.

24. The system of claim 23, wherein said means for selecting further comprises:

means for weighting selection of said frequency from within said envelope.

25. The system of claim 13, further comprising:

means for initiating said sound effect outputted by said graphical user interface in response to the movement of said object.