Mouse-based user interface device providing multiple parameters and modalities

• US 7,557,797 B2
• Filed: 11/24/2004
• Issued: 07/07/2009
• Est. Priority Date: 02/13/2004
• Status: Active Grant

• Current Assignee: Chemtron Research LLC (Intellectual Ventures LLC)
• Original Assignee: Lester F. Ludwig
• Inventors: Ludwig, Lester F.
• Primary Examiner(s): Shalwala, Bipin
• Assistant Examiner(s): KOVALICK, VINCENT E
• Application Number:
  US10/997,650
• Publication Number:
  US 20050179651A1
• Time in Patent Office: 1,686 Days
• Field of Search: 345/156, 345/157, 345/158, 345/163, 345/164, 345/167, 345/173, 345/418, 348/569
• US Class Current: 345/163
• CPC Class Codes: G06F 1/266 Arrangements to supply power to external peripherals either directly from the computer or under computer control, e.g. supply of power through the communication port, computer controlled power-strips
• CPC Class Codes: G06F 2203/0384 Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04106 Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/03543 Mice or pucks G06F3/03541 takes precedence
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/03549 Trackballs G06F3/03541 takes precedence
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0383 Signal control means within the pointing device
• CPC Class Codes: G06F 3/04144 using an array of force sensing means position sensing using the local deformation of sensor cells G06F3/0447
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

The notion of a conventional mouse is extended to provide an extended number of simultaneously adjustable user interface parameters. In one family of realizations, one or more trackballs, touchpads, or other types of user interface sensors may be added to a traditional mouse to provide additional user interface parameters. These additional user interface sensors may be simultaneously adjusted along with any movement of the mouse. The overall physical configuration may provide mixed physical modalities for adjusting a common pair of user interface parameters to prevent or ease hand fatigue, or to provide alternate parameter adjustment offsets, warpings, or resolutions. The additional user interface sensors, particularly trackballs and touchpads, may also be specially configured to provide up to six or more simultaneously adjustable and widely-variable user interface parameters.

Claims

1. A user interface for controlling an external device, comprising:

a housing;

a first user interface sensor configured with said housing and generating a first plurality of signals responsive to movement of said housing relative to two orthogonal axes;

a second user interface sensor configured with said housing and generating a second plurality of signals responsive to user manipulation of said second user interface sensor;

an output providing an output signal responsive to signals generated by said first and second user interface sensors;

a visual display operatively coupled to said housing and adapted to display information associated with signals generated by at least one of said first and second user interface sensors,

at least one preprocessor mapping said signal generated by said second user interface sensor to said output signal; and

wherein said visual display is further adapted to display information relating to said mapping.

2. The user interface according to claim 1, wherein said second user interface sensor comprises a trackball.

3. The user interface according to claim 1, wherein said second user interface sensor comprises a touchpad.

4. The user interface according to claim 1, wherein said external device comprises a computing device.

5. The user interface according to claim 1,

wherein said at least one preprocessor receives said signals generated by said first and second user interface sensors and responsively generates said output signal.

6. The user interface according to claim 5, wherein said visual display is further adapted to display a current processing function of said preprocessor.

7. The user interface according to claim 5, wherein said visual display is further adapted to display a current routing function of said preprocessor.

8. The user interface according to claim 5, wherein said visual display is integrated with said external device.

9. The user interface according to claim 1, wherein said output signal comprises said signals generated by said first and second user interface sensors.

10. The user interface according to claim 1, wherein said information includes status of said outgoing signal.

11. The user interface according to claim 1, further comprising:

a wireless link providing said output signal to said external device.

12. The user interface according to claim 1, further comprising:

a wired link providing said output signal to said external device.

13. The user interface according to claim 1, further comprising:

a combining element for facilitating alternative resolution modalities provided by said first and second user interface sensors, wherein

said first plurality of signals generated by said first user interface sensor correspond to one level of parameter adjustment resolution provided to said external device, and

said second plurality of signals generated by said second user interface sensor correspond to another level of parameter adjustment resolution provided to said external device.

14. The user interface according claim 13, wherein said combining element merges said first plurality of signals and said second plurality of signals.

15. The user interface according claim 13, wherein said combining element provides a mutually-exclusive selection between said first plurality of signals and said second plurality of signals.

16. The user interface according to claim 1, wherein said visual display is further adapted to display information relating to present values of parameters adjusted by said first plurality of signals generated by said first user interface sensor.

17. The user interface according to claim 1, wherein said visual display is further adapted to display information relating to present values of parameters adjusted by said second plurality of signals generated by said second user interface sensor.

18. The user interface according to claim 1,

wherein said at least one preprocessor maps said signal generated by said first user interface sensor to said output signal;

and

wherein said visual display is further adapted to display information relating to said mapping.

19. A user interface for controlling an external device, comprising:

a housing;

a first user interface sensor configured with said housing and generating a first plurality of signals responsive to movement of said housing relative to two orthogonal axes;

a second user interface sensor configured with said housing and generating a second plurality of signals responsive to user manipulation of said second user interface sensor;

a sensor output providing an output signal responsive to signals generated by said first and second user interface sensors; and

an audio transducer at least partially contained within said housing and generating audio responsive to signals generated by at least one of said first and second user interface sensors, wherein said external device comprises a computing device.

20. The user interface according to claim 19, wherein said second user interface sensor comprises a trackball.

21. The user interface according to claim 19, wherein said second user interface sensor comprises a touchpad.

22. The user interface according to claim 19, wherein said user interface has a plurality of usage modalities, wherein said audio conveys a condition of consistent usage of one of said plurality of usage modalities.

23. The user interface according to claim 22, wherein said condition of consistent usage is determined according to usage of said first and second user interface sensors.

24. The user interface according to claim 19, wherein said user interface has a plurality of usage modalities, wherein said audio is generated after a period of elapsed time of consistent usage of one of said plurality of usage modalities.

25. The user interface according to claim 19, wherein said audio is generated responsive to a usage error.

26. The user interface according to claim 19, wherein said audio conveys information relating to values of said signals generated by said first and second user interface sensors.

27. The user interface according to claim 19, further comprising:

a wireless link providing said output signal to said external device.

28. The user interface according to claim 19, further comprising:

a combining element for facilitating alternative resolution modalities provided by said first and second user interface sensors, wherein

said first plurality of signals generated by said first user interface sensor correspond to one level of parameter adjustment resolution provided to said external device, and

said second plurality of signals generated by said second user interface sensor correspond to another level of parameter adjustment resolution provided to said external device.

29. The user interface according to claim 28, wherein said combining element merges said first plurality of signals and said second plurality of signal.

30. The user interface according to claim 28, wherein said combining element provides a mutually-exclusive selection between said first plurality of signals and said second plurality of signals.

31. A user interface for controlling an external device, comprising:

a housing;

a first user interface sensor configured with said housing and generating a first plurality of signals responsive to movement of said housing relative to two orthogonal axes;

a first pair of widely adjustable parameters, each generated responsive to at least one of said first plurality of signals generated by said first user interface sensor;

a second user interface sensor configured with said housing and generating a second plurality of signals responsive to user manipulation of said second user interface sensor;

a second pair of widely adjustable parameters, each generated responsive to at least one of said second plurality of signals generated by said second user interface sensor; and

an output providing an output signal comprising said first pair and said second pair of widely adjustable parameters, wherein each parameter of said output signal separately controls a unique attribute of an application present on said external device.

32. The user interface according to claim 31, wherein said second user interface sensor comprises a trackball.

33. The user interface according to claim 31, wherein said second user interface sensor comprises a touchpad.

34. The user interface according to claim 31, wherein said external device comprises a computing device.

35. The user interface according to claim 31, wherein at least three widely adjustable parameters are generated responsive to signals generated by said second user interface sensor.

36. The user interface according to claim 31, wherein at least four widely adjustable parameters are generated responsive to signals generated by said second user interface sensor.

37. The user interface according to claim 31, wherein at least five widely adjustable parameters are generated responsive to signals generated by said second user interface sensor.

38. The user interface according to claim 31, wherein at least six widely adjustable parameters are generated responsive to signals generated by said second user interface sensor.

39. The user interface according to claim 31, wherein said second plurality of signals generated by said second user interface sensor is responsive to user manipulation of said second user interface sensor over an entire operational measurement range of said second under interface sensor.

40. The user interface according to claim 31, wherein said second user interface sensor comprises two orthogonal measurement axes and is further configured to measure maximum spatial span of an area of contact with said second user interface sensor, wherein line direction defined by said maximum spatial span is at a non-orthogonal angle with respect to said two orthogonal measurement axes.

41. The user interface according to claim 31, wherein said second user interface sensor comprises two orthogonal measurement axes and is further configured to measure a non-orthogonal rotational angle of a principle axis defined by a maximum spatial span of an oblong contact area, said non-orthogonal rotational angle defined with respect to said two orthogonal measurement axes.

42. The user interface according to claim 31, wherein one parameter of said second pair of widely adjustable parameters is generated responsive to pressure applied to said second user interface sensor.

43. The user interface according to claim 31, wherein one parameter of said second pair of widely adjustable parameters is generated responsive to a rocking position of user contact with said second user interface sensor.

44. The user interface according to claim 31, wherein parameters of said second pair of widely adjustable parameters are individually generated responsive to each individual finger in contact with said second user interface sensor.

45. The user interface according to claim 31, wherein said second user interface sensor comprises a null-contact touchpad.

46. The user interface according to claim 31, wherein second user interface sensor comprises a null-contact touchpad having a pressure sensor.

47. The user interface according to claim 31, wherein said second user interface sensor comprises a pressure sensor array.

48. The user interface according to claim 31, wherein one parameter of said second pair of widely adjustable parameters is generated responsive to pressure applied to said second user interface sensor, and whenever a rate of change in said pressure exceeds a specific threshold, said output signal further includes a click event signal.

49. A user interface for controlling an external device, comprising:

a housing;

a trackball configured with said housing and generating a first plurality of signals responsive to movement of said trackball within said housing;

a touchpad configured with said with said housing and generating a second plurality of signals responsive to user manipulation of said touchpad;

an output providing an output signal responsive to signals generated by said trackball and said touchpad

a first pair of widely adjustable parameters, each generated responsive to at least one of said plurality of signals generated by said trackball; and

a second pair of widely adjustable parameters, each generated responsive to at least one of said second plurality of signals generated by said touchpad.

50. The user interface according to claim 49, further comprising:

a wireless link providing said output signal to said external device.

51. The user interface according to claim 49, wherein said external device comprises a computing device.

52. The user interface according to claim 49, wherein said output signal comprises third and fourth pairs of adjustable parameters, said user interface permitting a user to select which pair of said third and fourth pairs of adjustable parameters is generated by said trackball and which other pair of said third and fourth pairs of adjustable parameters is generated by said touchpad.

53. The user interface according to claim 49, wherein said output signal comprises first and second levels of parameter adjustment resolution, said user interface permitting a user to select which level of said first and second levels of parameter adjustment resolution is generated by said trackball and which other level of said first and second levels of parameter adjustment resolution is generated by said touchpad.

54. The user interface according to claim 49, wherein said output signal comprises first and second levels of scaling, said user interface permitting a user to select which level of said first and second levels of scaling is generated by said trackball and which other level of said first and second levels of scaling is generated by said touchpad.

55. The user interface according to claim 49, wherein said output signal comprises first and second offsets, said user interface permitting a user to select which offset of said first and second offsets is generated by said trackball and which other offset of said first and second offsets is generated by said touchpad.

56. The user interface according to claim 49, wherein:

said first plurality of signals adjusts a parameter, and

said second plurality of signals further adjust said parameter to create an offset in said parameter relative to said adjusting provided by said first plurality of signals.

57. The user interface according to claim 49, further comprising:

at least one additional widely adjustable parameter generated responsive to at least one of said second plurality of signals generated by said touchpad.

58. The user interface according to claim 49, wherein said touchpad comprises a null-contact touchpad.

59. The user interface according to claim 58, wherein said null-contact touchpad includes a pressure sensor.

60. The user interface according to claim 49, wherein said touchpad comprises a pressure sensor array.