Force feedback interface having isotonic and isometric functionality

• US 5,825,308 A
• Filed: 11/26/1996
• Issued: 10/20/1998
• Est. Priority Date: 11/26/1996
• Status: Expired due to Term

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Human Interface Corporation
• Inventors: Rosenberg, Louis B.
• Primary Examiner(s): Zimmerman, Brian
• Assistant Examiner(s): WONG, ALBERT KANG
• Application Number:
  US08/756,745
• Time in Patent Office: 693 Days
• Field of Search: 341/20, 341/34, 341/35, 341/27, 345/179, 345/161, 345/156, 345/157, 345/158, 345/163, 345/167, 345/164, 345/165, 345/166, 345/184, 74/471 XY
• US Class Current: 341/20
• CPC Class Codes: G05G 2009/0477 holding the member in a number of definite positions
• CPC Class Codes: G05G 9/047 the controlling member being movable by hand about orthogonal axes, e.g. joysticks for switches H01H25/04
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0354 with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
• CPC Class Codes: G06F 3/03543 Mice or pucks G06F3/03541 takes precedence
• CPC Class Codes: G06F 3/0362 with detection of 1D translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
• CPC Class Codes: G06F 3/0395 Mouse pads
• CPC Class Codes: H01H 2003/008 with a haptic or a tactile feedback controlled by electrical means, e.g. a motor or magnetofriction

Abstract

A force feedback interface having isotonic and isometric control capability coupled to a host computer that displays a graphical environment such as a GUI. The interface includes a user manipulatable physical object movable in physical space, such as a mouse or puck. A sensor detects the object'"'"'s movement and an actuator applies output force on the physical object. A mode selector selects isotonic and isometric control modes of the interface from an input device such as a physical button or from an interaction between graphical objects. Isotonic mode provides input to the host computer based on a position of the physical object and updates a position of a cursor, and force sensations can be applied to the physical object based on movement of the cursor. Isometric mode provides input to the host computer based on an input force applied by the user to the physical object, where the input force is determined from a sensed deviation of the physical object in space. The input force opposes an output force applied by the actuator and is used to control a function of an application program, such as scrolling a document or panning or zooming a displayed view. An overlay force, such as a jolt or vibration, can be added to the output force in isometric mode to indicate an event or condition in the graphical environment.

Claims

1. An interface device allowing isotonic and isometric interaction with a host computer system from a user, the interface device comprising:

a user manipulatable object physically contacted by a user and movable in physical space in at least two degrees of freedom with respect to a ground;

a sensor operative to detect said movement of said user manipulatable object in physical space in said two degree of freedom with respect to said ground;

an actuator coupled to said user manipulatable object operative to apply an output force in at least one degree of freedom of said user manipulatable object;

a mode selector for selecting an isotonic interaction mode and an isometric interaction mode of said interface device, wherein said isotonic mode provides input to said host computer system based on movement a position of said user manipulatable object in said physical space, and wherein said isometric mode provides input to said host computer system based on an input force applied by said user to said user manipulatable object, said input force being determined based on said movement detected by said sensor in a direction opposing said output force generated by said actuator.

2. An interface device as recited in claim 1 wherein said input force applied by said user is detected based on a measured deviation of said user manipulatable object in physical space from locally-defined origin.

3. An interface device as recited in claim 2 wherein said mode selector includes a physical button provided on said user manipulatable object.

4. An interface device as recited in claim 2 wherein said mode selector includes an interaction between a user-controlled graphical object and a different graphical object, said graphical objects being displayed on a display device of said host computer system.

5. An interface device as recited in claim 4 wherein said interaction includes moving said user-controlled graphical object against a surface of said different graphical object.

6. An interface device as recited in claim 5 wherein said surface is an edge of a graphical window displayed on said display device.

7. An interface device as recited in claim 6 wherein said input force controls a document scrolling in said window.

8. An interface device as recited in claim 2 wherein said user manipulatable object is a puck graspable by a user and usable similarly to a mouse input device.

9. An interface device as recited in claim 1 wherein said actuator applies said output force to said user object in said isotonic mode.

10. An interface device as recited in claim 8 further comprising a safety switch for deactivating said output force from said actuator when said safety switch is opened.

11. An interface device as recited in claim 10 wherein a mapping between said user-controlled graphical object and said puck provided in said isotonic mode is disabled when said safety switch is opened.

12. An interface device as recited in claim 10 wherein said safety switch is a contact switch opened when said user removes weight of his or her fingers from said puck.

13. An interface device as recited in claim 2 wherein said actuator is a voice coil actuator.

14. An interface device as recited in claim 2 wherein said user object is coupled to said actuator by a linkage having a plurality of members.

15. An interface device as recited in claim 2 wherein said interface device and said host computer communicate using a Universal Serial Bus (USB).

16. An interface device as recited in claim 15 wherein said actuators receive power from said USB.

17. A method of providing an isometric control mode for an interface device coupled to a host computer, the method comprising:

receiving an indication to engage an isometric control mode of said interface device;

determining a deviation of a user manipulable physical object in a provided plurality of degrees of freedom, said deviation indicative of an input force from said user on said user manipulable object;

applying a resistive force using an computer-controlled actuator to said user manipulable object opposing said input force; and

using said determined deviation to control an isometric function of an application program implemented by said host computer.

18. A method as recited in claim 17 further comprising a step of defining a local origin with reference to a current position of said user manipulable object in said provided plurality of degrees of freedom, wherein said deviation of said user manipulable object is determined from said local origin.

19. A method as recited in claim 18 wherein said indication to engage said isometric mode includes receiving an indication from a input device.

20. A method as recited in claim 19 wherein said input device includes a button.

21. A method as recited in claim 18 wherein said host computer is displaying a graphical environment including a user-controlled graphical object, and wherein said indication to engage said isometric control mode includes an interaction of said user-controlled graphical object with a different graphical object displayed in said graphical environment.

22. A method as recited in claim 21 wherein said interaction includes a movement of said user-controlled graphical object into a surface of said different graphical object.

23. A method as recited in claim 22 wherein said different graphical object is a window, and wherein said surface is an edge of said window.

24. A method as recited in claim 22 wherein said user-controlled graphical object includes a cursor and said graphical environment includes a graphical user interface.

25. A method as recited in claim 18 wherein said resistive force applied to said user manipulable object is a restoring force, said restoring force having a magnitude proportional to a magnitude of said deviation of said user manipulable object from said local origin and a direction towards said local origin.

26. A method as recited in claim 18 wherein said isometric function includes scrolling of a document displayed in said graphical environment.

27. A method as recited in claim 18 wherein said isometric function includes panning a view of said graphical environment.

28. A method as recited in claim 18 wherein said isometric function includes zooming a view of said graphical environment.

29. A method as recited in claim 20 further comprising displaying magnitude indicators indicating a magnitude of said deviation on said display device.

30. A method as recited in claim 22 wherein said host computer displays a deviation of said user-controlled graphical object corresponding to said deviation of said user manipulable object.

31. A method as recited in claim 30 wherein said surface of said different graphical object compresses in response to said movement of said user-controlled graphical object into said surface.

32. A method as recited in claim 18 wherein a magnitude of said deviation is indicated by a pitch of audio feedback to said user.

33. A method as recited in claim 27 wherein a visual-physical dichotomy is provided such that said host computer does not display a deviation of said user-controlled graphical object corresponding to said deviation of said user manipulable object.

34. A method as recited in claim 18 wherein said interface device is in an isotonic control mode when said isometric control mode is not active, said isotonic control mode providing input to said host computer to display said user-controlled graphical object at a position corresponding to said position of said user manipulable object.

35. A method as recited in claim 25 further comprising adding an overlay force to said restoring force applied to said user manipulable object.

36. A method as recited in claim 35 wherein said overlay force is a jolt force sensation applied to said user manipulable object to indicate to said user an event in said graphical environment.

37. A method as recited in claim 36 wherein said event in said graphical environment is a page break of a scrolling document or an end of said scrolling document reached.

38. A method as recited in claim 35 wherein said overlay force is a vibration force sensation applied to said user manipulable object to indicate to said user an event in said graphical environment.

39. A method for enabling isotonic and isometric control from a user utilizing a single interface device coupled to a host computer system displaying a graphical environment, the method comprising:

receiving a selection of a control mode of said interface device, wherein said control mode is either an isotonic control mode or an isometric control mode;

providing isotonic input to said host computer system if said interface device is in said isotonic mode, wherein said isotonic input is used by said host computer system to update a position of a user-controlled graphical object in said graphical environment to correspond to a position of a user-manipulated physical object in provided degrees of freedom; and

providing isometric input to said host computer system if said interface device is in said isometric mode, wherein said isometric input is used by said host computer system to control an isometric function of said graphical environment based on an input force applied by said user to said physical object, said isometric input being provided as input force from said user opposing an output force generated by computer-controlled actuators.

40. A method as recited in claim 39 wherein said input force is determined based on a user-imparted deviation of said physical object opposing said output force in one or more of said degrees of freedom.

41. A method as recited in claim 40 further comprising applying a resistive force to said physical object in said isometric mode, wherein said resistive force opposes said deviation of said physical object.

42. A method as recited in claim 41 further comprising applying a force to said physical object in said isotonic mode based on a position of said user-controlled graphical object in said graphical environment.

43. A method as recited in claim 42 wherein said user-controlled graphical object is a cursor and said graphical environment includes a graphical user interface.

44. A method as recited in claim 43 wherein said isometric function includes scrolling a displayed document, panning a displayed view, or zooming a displayed view.

45. A method as recited in claim 41 further comprising outputting an overlay force in addition to said resistive force to said physical object.

46. A method for providing isometric input from an interface device to a host computer displaying a graphical environment on a display device, said method comprising:

displaying a user-controlled graphical object at a position in said graphical environment displayed by said host computer;

receiving input to said host computer from said interface device indicating movement of a user manipulatable physical object of said interface device caused by a user;

implementing an isometric function of said graphical environment utilizing said input;

maintaining said user-controlled graphical object at said position in said graphical environment regardless of said movement of said user manipulable physical object.

47. A method as recited in claim 46 wherein said input is provided to said host computer when in an isometric mode of said interface device, and wherein said interface device may also be in an isotonic mode when not in said isometric mode.

48. A method as recited in claim 47 wherein said user-controlled graphical object is moved to positions in said graphical environment corresponding to positions of said user manipulable physical object in physical space.

49. A method as recited in claim 48 wherein said user manipulable physical object is a mouse, said graphical environment is a graphical user interface, and said user-controlled graphical object is a cursor in said graphical user interface.

50. A method as recited in claim 49 further comprising applying an output force to said mouse using a computer controlled actuator opposing said movement of said mouse.

51. A force feedback interface device for interfacing with a host computer implementing an application program, said interface device comprising:

a user manipulandum being physically contacted by a user of said interface device and moveable within a planar workspace;

mode selection means for selecting a control mode for said user manipulandum and said interface device, said control mode being either an isotonic control mode or an isometric control mode;

an actuator coupled to said user manipulandum for applying forces to said user manipulandum;

a sensor operative to detect a deviation of said user manipulandum from said local origin caused by said user and output sensor signals; and

a local microprocessor coupled to said actuator and to said sensor and being separate from said host computer, said local microprocessor receiving said sensor signals and providing actuator signals to said actuator, wherein said local microprocessor is coupled to said host computer by a communication bus.

52. A force feedback interface device as recited in claim 51 wherein in said isotonic control mode, said sensor signals are reported by said local microprocessor to said host computer over said communication bus to control a displayed position of a user-controlled graphical object on a display screen of said host computer.

53. A force feedback interface device as recited in claim 52 wherein, in said isotonic mode, said actuator is controlled to output forces on said manipulandum when said user-controlled graphical object interacts with other graphical objects displayed on said display screen.

54. A force feedback interface device as recited in claim 51 wherein in said isometric control mode, a restoring force is applied to said user manipulandum such that said user moves said manipulandum to oppose said restoring force, wherein a deviation of said manipulandum in said planar workspace is sensed and is used to determine an input force applied by said user.

55. A force feedback interface device as recited in claim 54 wherein said input force is determined by said local microprocessor and is reported by said local microprocessor to said host computer over said communication bus.

56. A force feedback interface device as recited in claim 54 wherein said deviation of said manipulandum is reported by said local microprocessor to said host computer such that said host computer determines said input force.

57. A force feedback interface device as recited in claim 51 wherein said mode selection means includes a physical input device coupled to said user manipulandum and selectable by said user.

58. A force feedback interface device as recited in claim 57 wherein said mode selection means includes an interaction between a user-controlled graphical object and a different graphical object displayed on a display screen of said host computer.

59. An apparatus for interfacing isotonic and isometric interactions between a user utilizing a single interface device and a host computer system displaying a graphical environment, the apparatus comprising:

means for receiving a selection of a control mode of said interface device, wherein said control mode is either an isotonic control mode or an isometric control mode;

means for providing isotonic input to said host computer system if said interface device is in said isotonic mode, wherein said isotonic input is used by said host computer system to update a position of a user-controlled graphical object in said graphical environment to correspond to a position of a user-manipulated physical object in provided degrees of freedom;

means for applying a force to said physical object in said isotonic mode; and

means for providing isometric input to said host computer system if said interface device is in said isometric mode, wherein said isometric input is used by said host computer system to control an isometric function of said graphical environment based on an input force applied by said user to said physical object, wherein said input force is determined based on a user-imparted physical deviation of said user manipulable object in one or more of said degrees of freedom.

60. An apparatus as recited in claim 59 further comprising means for applying an opposing force to said user object in said isometric mode, wherein said opposing force opposes said deviation of said user manipulable object.

61. An apparatus as recited in claim 60 wherein said user-controlled graphical object is a cursor and said graphical environment includes a graphical user interface.

62. An apparatus as recited in claim 61 wherein said force is determined, at least in part, by a location of said cursor in said graphical user interface with respect to targets located in said graphical user interface.

63. An apparatus as recited in claim 62 wherein a type of said force sensation applied to said physical object depends on a particular target of said graphical user interface into which said cursor is moved.

64. An apparatus as recited in claim 63 wherein said force sensation on said physical object assists said user to select said at least one program function associated with said force sensation or informs said user of other graphical objects in said graphical user interface which can be manipulated to perform said at least one program function.