Input for three dimensional navigation using two joysticks

• US 6,184,867 B1
• Filed: 11/30/1997
• Issued: 02/06/2001
• Est. Priority Date: 11/30/1997
• Status: Expired due to Fees

• Current Assignee: Lenovo Singapore Pte Limited (Lenovo Group Ltd.)
• Original Assignee: International Business Machines Corporation
• Inventors: Smith, Barton A., Kandogan, Eser, Zhai, Shumin
• Primary Examiner(s): Shankar, Vijay
• Application Number:
  US08/979,712
• Time in Patent Office: 1,164 Days
• Field of Search: 345/121, 345/161, 345/156, 345/429, 345/430, 345/157, 345/158, 345/167
• US Class Current: 345/161
• CPC Class Codes: G06F 3/0213 Arrangements providing an integrated pointing device in a keyboard, e.g. trackball, mini-joystick for pointing devices integrated in a laptop computer G06F1/169; joysticks G05G9/047; constructional details of pointing devices G06F3/033

Abstract

A two-joystick interface for use with an information processing system having a 3D virtual reality module implements a bulldozer control metaphor permitting movement in three orthogonal directions—forward-backward, up-down, left-right—and turning about a vertical axis. The pointing interface includes mode switching permitting use of the joysticks for the cursor positioning and page scrolling functions of the information processing system. The pointing system includes a frame-of-reference conversion module for transforming the pointing devices software interface to a four-degree-of-freedom three-dimensional interface, an interface with a virtual reality module including a display function. Ergonomic embodiments of the interface include locating the joysticks, e.g., two IBM TrackPoints™ along the bottom row of keys of a standard keyboard, and, alternatively, placing the joysticks and related momentary switches in a wristpad.

Claims

1. A three-dimensional pointing system for use with an information processing system, comprising:

a first computer pointing device for receiving first manual input commands with two degrees of freedom from an operator and for generating first output signals corresponding to the two degrees of freedom;

a second computer pointing device for receiving second manual input commands with the same two degrees of freedom from the same operator and for generating second output signals corresponding to the two degrees of freedom;

converting means for receiving the first and second output signals and for converting the first and second output signals into a single set of command signals having four degrees of freedom and representing navigation along three orthogonal axes of a three-dimensional space and rotation about one of the three axes.

2. The pointing system as set forth in claim 1, wherein the pointing devices are isometric devices.

3. The pointing system as set forth in claim 2, wherein the pointing devices are TrackPoint™

devices.

4. The pointing system as set forth in claim 1, wherein the pointing devices are elastic joysticks.

5. The pointing system as set forth in claim 1, wherein the pointing devices are incorporated into a keyboard.

6. The pointing system as set forth in claim 5, wherein the first pointing device is located below the C and the V keys of the keyboard, and the second pointing device is located below the N and the M keys.

7. The pointing system as set forth in claim 1, further including a wristpad having the first and second pointing devices located thereon.

8. The pointing system as set forth in claim 7, wherein the wristpad also includes at least one manually operated momentary switch defining a push button, the at least one push button providing an output signal.

9. The pointing system as set forth in claim 1, wherein the converting means includes threshold means connected for receiving the pointing device output signals and for providing an independently transformed signal for each pointing device output signal such that the transformed signal is proportional to the received signal which exceeds a predetermined bi-directional threshold, the transformed signals thereafter being converted to the set of command signals having four degrees of freedom.

10. The pointing system as set forth in claim 9, wherein the converting means also includes means for setting a predetermined level of sensitivity of each degree of freedom to the pointing device output signals.

11. The pointing system as set forth in claim 10, wherein the converting means includes compound motion constraint means for permitting and for disabling combined movements and rotation in predetermined degrees of freedom.

12. The pointing system as set forth in claim 1, further including display means for creating and displaying a three-dimensional virtual reality, the set of command signals having four degrees of freedom corresponding to the virtual reality.

13. The pointing system as set forth in claim 12, wherein the command signals of the converting means define a point-of-view in the displayed virtual reality.

14. The pointing system as set forth in claim 12, wherein the command signals correspond to left-right, forward-backward, up-down, and rotation clockwise and counter clockwise about an up-down axis.

15. The pointing system as set forth in claim 14, wherein moving both pointing devices in a forward direction causes a forward motion in the virtual reality, moving both pointing devices in a backward direction causes a backward motion in the virtual reality, moving both pointing devices to a left side causes a translation movement toward the left side in the virtual reality, moving both pointing devices to a right side causes a translation movement toward the right side in the virtual reality, moving both pointing devices sideways toward each other causes movement downward in the virtual reality, moving both pointing devices sideways away from each other causes movement upward in the virtual reality, moving a left pointing device forward and a right pointing device backward causes a clockwise rotation in the virtual reality, and moving a left pointing device backward and a right pointing device forward causes a counter clockwise rotation in the virtual reality.

16. The pointing system as set forth in claim 1 wherein the first and second pointing devices are joysticks which provide a bulldozer-like steering interface for navigating in a virtual three-dimensional space.

17. The pointing system as set forth in claim 1 wherein the first pointing device is a joystick for an operator'"'"'s left hand and the second pointing device is a joystick for an operator'"'"'s right hand, the two joysticks being manipulated at the same time by an operator and together controlling a single navigation path and orientation within a virtual three-dimensional space.

18. A multi-purpose pointing system for use with an information processing system that includes three-dimensional virtual reality software, the pointing system comprising:

first and second pointing devices for receiving respective first and second two-dimensional manual input commands from an operator, each of the pointing devices having a same two degrees of freedom;

software drivers for providing respective two-dimensional pointing device interfaces between the information processing system and the first and second pointing devices;

means responsive to the software drivers for transforming the two-dimensional pointing device interfaces into a single four-degree-of-freedom three-dimensional interface;

the virtual reality software being responsive to the four-degree-of-freedom interface for maneuvering a point-of-view in the three-dimensional virtual reality; and

display means for displaying the three-dimensional virtual reality.

19. The multi-purpose pointing system as set forth in claim 18, wherein the pointing devices are isometric.

20. The multi-purpose pointing system as set forth in claim 19, wherein the pointing devices are TrackPoints™

.

21. The multi-purpose pointing system as set forth in claim 18, wherein the pointing devices are elastic joysticks.

22. The multi-purpose pointing system as set forth in claim 18, wherein the pointing devices are incorporated into a keyboard.

23. The multi-purpose pointing system as set forth in claim 22, wherein the first pointing device is located below the C and the V keys of the keyboard, and the second pointing device is located below the N and the M keys.

24. The multi-purpose pointing system as set forth in claim 18, further including a wristpad having the first and second pointing devices located thereon.

25. The multi-purpose pointing system as set forth in claim 24, wherein the wristpad also includes at least one manually operated momentary switch defining a push button, the at least one momentary switch providing an output signal, and at least one software driver being responsive to the switch.

26. The multi-purpose pointing system as set forth in claim 18, wherein each output of the device drivers represents a rate of translation along an axis.

27. The multi-purpose pointing system as set forth in claim 18, further including a threshold function for providing an output proportional to the magnitude of the output signal of a device driver which exceeds a predetermined, bi-directional threshold, and for providing a zero output when the magnitude of the output signal is less than the threshold.

28. The multi-purpose pointing system as set forth in claim 27, further including a sensitivity function for setting a value for a ratio of a sensitivity function output signal to the output signal of a device driver.

29. The multi-purpose pointing system as set forth in claim 28, further including compound motion constraint means for enabling and for disabling predetermined combinations of movement and turning.

30. The multi-purpose pointing system as set forth in claim 18, further including cursor positioning means and page scrolling means responsive to the two-dimensional pointing device interfaces for positioning an information processing system cursor and for scrolling information processing pages respectively, and wherein the pointing devices are alternatively used for maneuvering in the virtual reality and positioning and scrolling.

31. A method for navigating with four degrees of freedom in a three-dimensional virtual reality, comprising the steps of:

providing a pair of joystick pointing devices and compatible device drivers each providing a pair of orthogonal outputs;

transforming the device driver outputs to a single three-dimensional, four-degree-of-freedom set of transformed outputs; and

using the set of transformed outputs for navigating within a three-dimensional virtual reality system.

32. The method as set forth in claim 31, including the step of defining a bi-directional threshold for each device driver output wherein an output of zero is provided to the transforming step if the driver output is less than the defined threshold, and an output proportional to the driver output is provided otherwise.

33. The method as set forth in claim 32, including the step of defining a predetermined gain for each threshold step output provided to the transforming step, and applying the predetermined gain to the threshold step output before providing the amplified output to the transforming step.

34. The method as set forth in claim 33, including the step of defining combinations of movement and turning, and for enabling and disabling predetermined combinations of movement and turning.

35. The method as set forth in claim 34, wherein the combination of side movement and turning is enabled.

36. The method as set forth in claim 31, wherein the outputs of the transforming step define a viewer point-of-view orientation within the three-dimensional virtual reality system.