Manipulating an on-screen object using zones surrounding the object

• US 7,164,410 B2
• Filed: 07/28/2003
• Issued: 01/16/2007
• Est. Priority Date: 07/28/2003
• Status: Active Grant

• Current Assignee: RPX Corporation
• Original Assignee: Sig G. Kupka
• Inventors: Kupka, Sig G.
• Primary Examiner(s): CHOW, DOON Y
• Application Number:
  US10/629,129
• Publication Number:
  US 20050024322A1
• Time in Patent Office: 1,268 Days
• Field of Search: 345/156, 345/157, 345/163, 345/168, 345/173, 345/179, 345/172, 715/810, 715/834, 715/835, 715/840
• US Class Current: 345/156
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 2203/0384 Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices
• CPC Class Codes: G06F 2203/04803 Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 3/0231 Cordless keyboards
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

A user interface for manipulating objects of various types in a consistent manner. Each on-screen object is surrounded by a control region including a number of zones for performing various control operations on the object. Multiple input modes are available for interacting with the zones, allowing object manipulation commands to be initiated in several different ways, such as via stroke input, pressing a mouse button, double-clicking, menu selection, voice input, and the like. The user interface is operable using any of several different types of input devices.

Claims

1. A user interface for a device including a display, for manipulating an object displayed on the display, the device executing program instructions for providing the user interface, the user interface comprising:

a displayed representation of the object; and

a control region surrounding the displayed representation of the object and comprising a plurality of zones for accepting object manipulation commands via an input device and via at least two modes of user input;

wherein, for at least one of the zones, at least two commands are activatable within the zone, depending on the mode of user input received.

2. The user interface of claim 1, further comprising an input device for accepting user input in the zones.

3. The user interface of claim 2, wherein the input device comprises at least one selected from the group consisting of:

a tablet for detecting a stylus position;

a mouse;

a touchpad;

a pointing device;

a touch-sensitive screen;

a keyboard;

a microphone for accepting voice input; and

a remote controller.

4. The user interface of claim 1, wherein the input device comprises a keyboard including keys for activating commands associated with the zones.

5. The user interface of claim 1, wherein the input device comprises a keyboard, and wherein standard keys on the keyboard are selectively assigned to activate commands associated with the zones.

6. The user interface of claim 1, wherein the input device comprises a keyboard including additional keys for activating commands associated with the zones.

7. The user interface of claim 1, wherein the zones are arranged in a grid.

8. The user interface of claim 1, wherein the zones are arranged in a matrix comprising rows of cells, and wherein the object representation is located within a cell of the matrix.

9. The user interface of claim 1, wherein the zones are arranged in a matrix comprising three rows of three cells each, and wherein the object representation is located in the center cell of the center row.

10. The user interface of claim 1, wherein the user input modes comprise at least two selected from the group consisting of:

an activation command;

an activation command concurrent with a modifier key;

voice input;

keyboard input;

remote controller input;

mouse input;

stroke input; and

menu command selection.

11. The user interface of claim 1, further comprising:

a menu activatable by performing a menu activation command for a zone, the menu comprising commands, wherein the menu is displayed in proximity to the zone upon activation.

12. The user interface of claim 11, wherein at least one of the menu commands is also directly activatable by at least one of stroking, pressing a button, or double-clicking within the zone.

13. The user interface of claim 11, wherein performing the menu activation command comprises positioning an on-screen cursor within the zone and pressing a button.

14. The user interface of claim 11, wherein performing the menu activation command comprises issuing a voice command.

15. The user interface of claim 11, wherein the menu includes, for at least one command, an icon indicating a stroke direction for directly activating the command.

16. The user interface of claim 11, wherein a stroke command for a zone is activatable by positioning an on-screen cursor within the zone and stroking the cursor.

17. A computer-implemented method for manipulating an object, comprising:

displaying a representation of the object;

displaying a control region surrounding the object and comprising a plurality of zones for accepting object manipulation commands on the object via at least two modes of user input, wherein, for at least one of the zones, at least two commands are activatable within the zone, depending on the mode of user input received;

receiving user input in one of the zones; and

responsive to the user input and to the mode of the user input, changing a characteristic of the object.

18. The method of claim 17, wherein each mode of user input comprises one selected from the group consisting of:

stylus position input;

mouse input;

touchpad input;

pointing device input;

touch-sensitive screen input;

keyboard input;

voice input; and

remote controller input.

19. The method of claim 17, wherein one mode of user input comprises receiving keyboard input from a keyboard including keys for activating commands associated with the zones.

20. The method of claim 17, wherein one mode of user input comprises receiving keyboard input from a keyboard having standard keys on the keyboard selectively assigned to activate commands associated with the zones.

21. The method of claim 17, wherein one mode of user input comprises receiving keyboard input from a keyboard including additional keys for activating commands associated with the zones.

22. The method of claim 17, wherein the zones are arranged in a grid.

23. The method of claim 17, wherein the zones are arranged in a matrix comprising rows of cells, and wherein the object representation is located within a cell of the matrix.

24. The method of claim 17, wherein the zones are arranged in a matrix comprising three rows of three cells each, and wherein the object representation is located in the center cell of the center row.

25. The method of claim 17, further comprising:

responsive to a menu activation command, displaying a menu for a zone, the menu comprising commands, wherein the menu is displayed in proximity to the zone upon activation.

26. The method of claim 25, wherein at least one of the menu commands is also directly activatable by at least one of stroking, pressing a button, or double-clicking within the zone.

27. The method of claim 25, wherein the menu activation command comprises positioning an on-screen cursor within the zone and pressing a button.

28. The method of claim 25, wherein the menu activation command comprises a voice command.

29. The method of claim 25, wherein the menu includes, for at least one command, an icon indicating a stroke direction for directly activating the command.

30. The method of claim 25, wherein the menu indicates a double-click command for direct activation of each directly activatable command.

31. The method of claim 25, wherein a stroke command for a zone is activatable by positioning an on-screen cursor within the zone and stroking the cursor.

32. The method of claim 25, wherein a double-click command for a zone is activatable by positioning an on-screen cursor within the zone and double-clicking.

33. A computer program product for manipulating an object, comprising:

a computer-readable medium; and

computer program code, encoded on the medium, for;

displaying a representation of the object;

displaying a control region surrounding the object and comprising a plurality of zones for accepting object manipulation commands on the object via at least two modes of user input, wherein, for at least one of the zones, at least two commands are activatable within the zone, depending on the mode of user input received;

receiving user input in one of the zones; and

responsive to the user input and to the mode of the user input, changing a characteristic of the object.

34. The computer program product of claim 33, wherein each mode of user input comprises one selected from the group consisting of:

stylus position input;

mouse input;

touchpad input;

pointing device input;

touch-sensitive screen input;

keyboard input;

voice input; and

remote controller input.

35. The computer program product of claim 33, wherein one mode of user input comprises receiving keyboard input from a keyboard including keys for activating commands associated with the zones.

36. The computer program product of claim 33, further comprising computer program code for:

responsive to a menu activation command, displaying a menu for a zone, the menu comprising commands, wherein the menu is displayed in proximity to the zone upon activation.

37. The computer program product of claim 36, wherein at least one of the menu commands is also directly activatable by at least one of stroking, pressing a button, or double-clicking within the zone.

38. The computer program product of claim 36, wherein the menu includes, for at least one command, an icon indicating a stroke direction for directly activating the command.

39. A system for manipulating an object displayed on a display, comprising:

a display, for displaying a representation of the object and for displaying a control region surrounding the displayed representation of the object and comprising a plurality of zones for accepting object manipulation commads via an input device and via at least two modes of user in-put, wherein, for at least one of the zones, at least two commands are activatable within the zone, depending on the mode of user input received;

an input device for accepting user input in the zones; and

a processor, coupled to the display and to the input device, for executing an object manipulation command in response to the user input and to the mode of the user input.

40. The system of claim 39, wherein the input device comprises at least one selected from the group consisting of:

a tablet for detecting a stylus position;

a mouse;

a touchpad;

a pointing device;

a touch-sensitive screen;

a keyboard;

a microphone for accepting voice input; and

a remote controller.

41. The system of claim 39, wherein the input device comprises a keyboard including keys for activating commands associated with the zones.

42. The system of claim 39, wherein the input device comprises a keyboard, and wherein standard keys on the keyboard are selectively assigned to activate commands associated with the zones.

43. The system of claim 39, wherein the input device comprises a keyboard including additional keys for activating commands associated with the zones.

44. The system of claim 39, wherein the zones are arranged in a grid.

45. The system of claim 39, wherein the zones are arranged in a matrix comprising rows of cells, and wherein the object representation is located within a cell of the matrix.

46. The system of claim 39, wherein the zones are arranged in a matrix comprising three rows of three cells each, and wherein the object representation is located in the center cell of the center row.

47. The system of claim 39, wherein the user input modes comprise at least two selected from the group consisting of:

an activation command;

an activation command concurrent with a modifier key;

voice input;

keyboard input;

remote controller input;

mouse input;

stroke input; and

menu command selection.

48. The system of claim 39, wherein, responsive to the input device receiving a menu activation command for a zone, the display further displays, in proximity to the zone upon activation, a menu comprising commands.

49. The system of claim 48, wherein at least one of the menu commands is also directly activatable by at least one of stroking, pressing a button, or double-clicking within the zone.

50. The system of claim 48, wherein the menu includes, for at least one command, an icon indicating a stroke direction for directly activating the command.

51. The system of claim 48, wherein a stroke command for a zone is activatable by positioning an on-screen cursor within the zone and stroking the cursor.