Method and arrangement for providing an expanded desktop

• US 20020175933A1
• Filed: 05/07/2002
• Published: 11/28/2002
• Est. Priority Date: 05/08/2001
• Status: Active Grant

• Current Assignee: RPX Corporation
• Original Assignee: Nokia Corporation
• Inventors: Ronkainen, Sami, Paihonen, Sami
• Granted Patent: US 7,103,841 B2
• Time in Patent Office: Days
• US Class Current: 715/727
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: Y10S 715/978 Audio interaction as part of an operator interface

Abstract

The invention relates to a method and arrangement (300) for expanding a desktop. Especially the invention relates to a method and arrangement (300) for expanding a desktop virtually. The objects of the invention are fulfilled by relating an audible sound (220, 222) to the application, window or other user interface element (208, 210) as it is shifted (208, 210) out of the display (202). The sound (220, 222) related to the user interface element (208, 210) may also be characteristic for the element (208, 210) it is related to. In addition according to the invention the element (208, 210) can be located by only listening the sound (220, 222) related to the element (208, 210).

Claims

1. A method for providing an expanded desktop illustrating at least one user interface element, characterized in that

said user interface element is located outside a display area of the desktop,

a determined sound is related to said user interface element, and

said at least one user interface element is located on the basis of said determined sound related to the user interface element.

2. A method according to claim 1, characterized in that said sound related to the at least one user interface element is characteristic for the direction of the user interface element on the desktop.

3. A method according to claims 1, characterized in that said sound related to at least one user interface element located in a determined part of the desktop is characteristic for this part of the desktop.

4. A method according to claim 1, characterized in that said sound related to the user interface element is characteristic for said user interface element.

5. A method according to claim 1, characterized in that said sound is continuous.

6. A method according to claim 1, characterized in that a sound related to the user interface element is provided when there is an announcement in said element.

7. A method according to claim 1, characterized in that sounds related to at least two user interface elements are provided alternately.

8. A method according to claim 1, characterized in that providing a sound related to the user interface element is started/stopped when the user interface element is pointed by using a pointing device.

9. A method according to claim 1, characterized in that the sound related to the user interface element is activated and deactivated using a command.

10. A method according to claim 1, characterized in that a sound is provided relating to the user interface element, wherein said sound is provided as coming from the point in space where said element is located.

11. A method according to claim 1, characterized in that the user interface element is activated and brought back into the visual field of the desktop and shifted outside of the visual field of the desktop by a command or pointing device.

12. A method according to claim 1, characterized in that a desired user interface element is activated by a determined command if a sound is provided relating to the user interface element.

13. A method according to claim 8, characterized in that said pointing device is at least one of the following;

a mouse, 3D-mouse, arrow key, user'"'"'s arm, user'"'"'s finger and joystick.

14. A method according to claim 11, characterized in that said pointing device is at least one of the following;

a mouse, 3D-mouse, arrow key, user'"'"'s arm, user'"'"'s finger and joystick.

15. A method according to claim 9, characterized in that said command is at least one of the following;

a gesture, pointing and spoken command, mouse click and a pressing of a key and soft created button.

16. A method according to claim 11, characterized in that said command is at least one of the following;

a gesture, pointing and spoken command, mouse click and a pressing of a key and soft created button.

17. A method according to claim 12, characterized in that said command is at least one of the following;

a gesture, pointing and spoken command, mouse click and a pressing of a key and soft created button.

19. An arrangement according to claim 18, characterized in that said arrangement comprises means for providing the sound related to the user interface element located in a determined direction on the desktop wherein the sound is characteristic for this direction.

20. An arrangement according to claim 18, characterized in that said arrangement comprises means for providing the sound related to the user interface element located in a determined part of the desktop wherein the sound is characteristic for this part of the desktop.

21. An arrangement according to claim 18, characterized in that said arrangement comprises means for providing the characteristic sound for the specific user interface element.

22. An arrangement according to claim 18, characterized in that said arrangement comprises means for providing a sound related to the user interface element when there is an announcement in said user interface element.

23. An arrangement according to claim 18, characterized in that said arrangement comprises means for detecting a pointing device, and means for providing a sound related to the user interface element when the user interface element is pointed by a pointing device.

24. An arrangement according to claim 18, characterized in that said arrangement comprises means for detecting a user'"'"'s arm or finger, and means for providing a sound related to the user interface element when the user interface element is pointed by a user'"'"'s arm or finger.

25. An arrangement according to claim 18, characterized in that said arrangement comprises means for detecting a spoken command, and means for providing a sound related to the user interface element when user says a spoken command related to said element.

26. An arrangement according to claim 18, characterized in that said arrangement comprises at least one pointing device.

27. An arrangement according to claim 18, characterized in that said arrangement comprises at least one of the following;

button, arrow key, software created button, mouse, 3D-mouse, speech recognition means, gesture recognition means and recognition means for observation of motions or location of user'"'"'s arm or finger to do at least one of the following;

activate the element, shift the element, activate a sound of the element, deactivate a sound of the element and point the element.

28. An arrangement according to claim 18, characterized in that said arrangement comprises means for providing 3D-sound related to the user interface element as coming from the point in virtual space where the element is located.

29. An arrangement according to claim 18, characterized in that said means for providing the 3D-sound comprise a sound card and stereo headphones or at least two speakers.

30. An arrangement according to claim 18, characterized in that said arrangement comprises at least one microphone.

31. An arrangement according to claim 18, characterized in that said arrangement comprises display or screen wherein there is at least one touch sensitive area.

32. A personal digital assistant (PDA), characterized in that it comprises an arrangement according to claim 18.

33. A computer, characterized in that it comprises an arrangement according to claim 18.

34. A mobile station, characterized in that it comprises an arrangement according to claim 18.

35. A global positioning system (GPS), characterized in that it comprises an arrangement according to claim 18.

18. An arrangement for providing an expanded desktop illustrating at least one user interface element, characterized in that the arrangement comprises

means for providing the user interface element outside a display area of the desktop,

means for providing a determined sound related to the user interface element on the basis of said determined sound.

36. A digital television terminal, characterized in that it comprises an arrangement according to claim 18.