Manipulating an on-screen object using zones surrounding the object

• US 20050024322A1
• Filed: 07/28/2003
• Published: 02/03/2005
• Est. Priority Date: 07/28/2003
• Status: Active Grant

• Current Assignee: RPX Corporation
• Original Assignee: Sig G. Kupka
• Inventors: Kupka, Sig G.
• Granted Patent: US 7,164,410 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 2203/0384 Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices
• CPC Class Codes: G06F 2203/04803 Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 3/0231 Cordless keyboards
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

A user interface for manipulating objects of various types in a consistent manner. Each on-screen object is surrounded by a control region including a number of zones for performing various control operations on the object. Multiple input modes are available for interacting with the zones, allowing object manipulation commands to be initiated in several different ways, such as via stroke input, pressing a mouse button, double-clicking, menu selection, voice input, and the like. The user interface is operable using any of several different types of input devices.

Claims

1. A user interface for a device including a display, for manipulating an object displayed on the display, the device executing program instructions for providing the user interface, the user interface comprising:

a displayed representation of the object; and

a control region surrounding the displayed representation of the object and comprising a plurality of zones for accepting object manipulation commands via an input device and via at least two modes of user input.

2. The user interface of claim 1, further comprising an input device for accepting user input in the zones.

3. The user interface of claim 2, wherein the input device comprises at least one selected from the group consisting of:

a tablet for detecting a stylus position;

a mouse;

a touchpad;

a pointing device;

a touch-sensitive screen;

a keyboard;

a microphone for accepting voice input; and

a remote controller.

4. The user interface of claim 1, wherein the input device comprises a keyboard including keys corresponding to the zones.

5. The user interface of claim 1, wherein the input device comprises a keyboard, and wherein standard keys on the keyboard are selectively assigned to zones.

6. The user interface of claim 1, wherein the input device comprises a keyboard including additional keys corresponding to the zones.

7. The user interface of claim 1, wherein the zones are arranged in a grid.

8. The user interface of claim 1, wherein the zones are arranged in a matrix comprising rows of cells, and wherein the object representation is located within a cell of the matrix.

9. The user interface of claim 1, wherein the zones are arranged in a matrix comprising three rows of three cells each, and wherein the object representation is located in the center cell of the center row.

10. The user interface of claim 1, wherein the user input modes comprise at least two selected from the group consisting of:

an activation command;

an activation command concurrent with a modifier key;

voice input;

keyboard input;

remote controller input;

mouse input;

stroke input; and

menu command selection.

11. The user interface of claim 1, further comprising:

a menu activatable by performing a menu activation command for a zone, the menu comprising commands, wherein the menu is displayed in proximity to the zone upon activation.

12. The user interface of claim 11, wherein at least one of the menu commands is also directly activatable by at least one of stroking, pressing a button, or double-clicking within the zone.

13. The user interface of claim 11, wherein performing the menu activation command comprises positioning an on-screen cursor within the zone and pressing a button.

14. The user interface of claim 11, wherein performing the menu activation command comprises issuing a voice command.

15. The user interface of claim 11, wherein the menu includes, for at least one command, an icon indicating a stroke direction for directly activating the command.

16. The user interface of claim 11, wherein a stroke command for a zone is activatable by positioning an on-screen cursor within the zone and stroking the cursor.

17. A computer-implemented method for manipulating an object, comprising:

displaying a representation of the object;

displaying a control region surrounding the object and comprising a plurality of zones for accepting object manipulation commands on the object via at least two modes of user input;

receiving user input in one of the zones; and

responsive to the user input, changing a characteristic of the object.

18. The method of claim 17, wherein each mode of user input comprises one selected from the group consisting of:

stylus position input;

mouse input;

touchpad input;

pointing device input;

touch-sensitive screen input;

keyboard input;

voice input; and

remote controller input.

19. The method of claim 17, wherein one mode of user input comprises receiving keyboard input from a keyboard including keys corresponding to the zones.

20. The method of claim 17, wherein one mode of user input comprises receiving keyboard input from a keyboard having standard keys on the keyboard selectively assigned to zones.

21. The method of claim 17, wherein one mode of user input comprises receiving keyboard input from a keyboard including additional keys corresponding to the zones.

22. The method of claim 17, wherein the zones are arranged in a grid.

23. The method of claim 17, wherein the zones are arranged in a matrix comprising rows of cells, and wherein the object representation is located within a cell of the matrix.

24. The method of claim 17, wherein the zones are arranged in a matrix comprising three rows of three cells each, and wherein the object representation is located in the center cell of the center row.

25. The method of claim 17, further comprising:

responsive to a menu activation command, displaying a menu for a zone, the menu comprising commands, wherein the menu is displayed in proximity to the zone upon activation;

26. The method of claim 25, wherein at least one of the menu commands is also directly activatable by at least one of stroking, pressing a button, or double-clicking within the zone.

27. The method of claim 25, wherein the menu activation command comprises positioning an on-screen cursor within the zone and pressing a button.

28. The method of claim 25, wherein the menu activation command comprises a voice command.

29. The method of claim 25, wherein the menu includes, for at least one command, an icon indicating a stroke direction for directly activating the command.

30. The method of claim 25, wherein the menu indicates a double-click command for direct activation of each directly activatable command.

31. The method of claim 25, wherein a stroke command for a zone is activatable by positioning an on-screen cursor within the zone and stroking the cursor.

32. The method of claim 25, wherein a double-click command for a zone is activatable by positioning an on-screen cursor within the zone and double-clicking.

33. In a user interface including a plurality of stroke commands for a zone, a computer-implemented method for manipulating an object, comprising:

responsive to a stroke along a first axis of a zone proximate the object, changing a characteristic of the object by a first increment; and

responsive a stroke along a second axis of the zone, changing the characteristic of the object by a second increment different from the first increment.

34. The method of claim 33, wherein the second increment is of smaller magnitude than the first increment.

35. The method of claim 33, wherein the second axis is perpendicular to the first axis.

36. The method of claim 35, wherein one axis is vertical, and the other axis is horizontal.

37. The method of claim 33, wherein the characteristic of the object is one selected from the group consisting of:

a start position;

an end position;

a duration;

a size;

a length;

a date;

a time;

a numeric value;

a width;

a height;

an image cropping specification;

a thickness;

a decimal place location;

playing speed;

playing position;

a leading character;

a terminating character;

a location;

an alignment;

a rotation;

a font;

a style;

a capitalization;

a color;

an opacity;

a brightness; and

a relative volume.

38. The method of claim 33, further comprising:

responsive to the user input comprising a menu activation command;

displaying a menu comprising commands;

accepting a second user input selecting a command from the menu; and

responsive to the menu command, changing a characteristic of the object.

39. A computer program product for manipulating an object, comprising:

a computer-readable medium; and

computer program code, encoded on the medium, for;

displaying a representation of the object;

displaying a control region surrounding the object and comprising a plurality of zones for accepting object manipulation commands on the object via at least two modes of user input;

receiving user input in one of the zones; and

responsive to the user input, changing a characteristic of the object.

40. The computer program product of claim 39, wherein each mode of user input comprises one selected from the group consisting of:

stylus position input;

mouse input;

touchpad input;

pointing device input;

touch-sensitive screen input;

keyboard input;

voice input; and

remote controller input.

41. The computer program product of claim 39, wherein one mode of user input comprises receiving keyboard input from a keyboard including keys corresponding to the zones.

42. The computer program product of claim 39, further comprising computer program code for:

responsive to a menu activation command, displaying a menu for a zone, the menu comprising commands, wherein the menu is displayed in proximity to the zone upon activation;

43. The computer program product of claim 42, wherein at least one of the menu commands is also directly activatable by at least one of stroking, pressing a button, or double-clicking within the zone.

44. The computer program product of claim 42, wherein the menu includes, for at least one command, an icon indicating a stroke direction for directly activating the command.

45. In a user interface including a plurality of stroke commands for a zone, a computer-implemented computer program product for manipulating an object, comprising:

a computer-readable medium; and

computer program code, encoded on the medium, for;

responsive to a stroke along a first axis of a zone proximate the object, changing a characteristic of the object by a first increment; and

responsive a stroke along a second axis of the zone, changing the characteristic of the object by a second increment different from the first increment.

46. The computer program product of claim 45, wherein the characteristic of the object is one selected from the group consisting of:

a start position;

an end position;

a duration;

a size;

a length;

a date;

a time;

a numeric value;

a width;

a height;

an image cropping specification;

a thickness;

a decimal place location;

playing speed;

playing position;

a leading character;

a terminating character;

a location;

an alignment;

a rotation;

a font;

a style;

a capitalization;

a color;

an opacity;

a brightness; and

a relative volume.

47. The computer program product of claim 45, further comprising:

responsive to the user input comprising a menu activation command;

displaying a menu comprising commands;

accepting a second user input selecting a command from the menu; and

responsive to the menu command, changing a characteristic of the object.

48. A system for manipulating an object displayed on a display, comprising:

a display, for displaying a representation of the object and for displaying a control region surrounding the displayed representation of the object and comprising a plurality of zones for accepting object manipulation commands via an input device and via at least two modes of user input;

an input device for accepting user input in the zones; and

a processor, coupled to the display and to the input device, for executing an object manipulation command in response to the user input.

49. The system of claim 48, wherein the input device comprises at least one selected from the group consisting of:

a tablet for detecting a stylus position;

a mouse;

a touchpad;

a pointing device;

a touch-sensitive screen;

a keyboard;

a microphone for accepting voice input; and

a remote controller.

50. The system of claim 48, wherein the input device comprises a keyboard including keys corresponding to the zones.

51. The system of claim 48, wherein the input device comprises a keyboard, and wherein standard keys on the keyboard are selectively assigned to zones.

52. The system of claim 48, wherein the input device comprises a keyboard including additional keys corresponding to the zones.

53. The system of claim 48, wherein the zones are arranged in a grid.

54. The system of claim 48, wherein the zones are arranged in a matrix comprising rows of cells, and wherein the object representation is located within a cell of the matrix.

55. The system of claim 48, wherein the zones are arranged in a matrix comprising three rows of three cells each, and wherein the object representation is located in the center cell of the center row.

56. The system of claim 48, wherein the user input modes comprise at least two selected from the group consisting of:

an activation command;

an activation command concurrent with a modifier key;

voice input;

keyboard input;

remote controller input;

mouse input;

stroke input; and

menu command selection.

57. The system of claim 48, wherein, responsive to the input device receiving a menu activation command for a zone, the display further displays, in proximity to the zone upon activation, a menu comprising commands.

58. The system of claim 57, wherein at least one of the menu commands is also directly activatable by at least one of stroking, pressing a button, or double-clicking within the zone.

59. The system of claim 57, wherein the menu includes, for at least one command, an icon indicating a stroke direction for directly activating the command.

60. The system of claim 57, wherein a stroke command for a zone is activatable by positioning an on-screen cursor within the zone and stroking the cursor.