Method and apparatus for designing force sensations in force feedback applications

• US 6,169,540 B1
• Filed: 06/17/1997
• Issued: 01/02/2001
• Est. Priority Date: 12/01/1995
• Status: Expired due to Term

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Rosenberg, Louis B., Chang, Dean C.
• Primary Examiner(s): BRIER, JEFFERY A
• Application Number:
  US08/877,114
• Time in Patent Office: 1,295 Days
• Field of Search: 345/146, 345/156, 345/157, 345/161, 345/163, 345/326, 345/333, 318/568.11, 318/568.25, 744/71.XY, 463/30, 463/37, 463/38, 434/45, 395/99, 244/233
• US Class Current: 715/701
• CPC Class Codes: A63F 2300/1025 details of the interface with the game device, e.g. USB version detection
• CPC Class Codes: A63F 2300/1037 being specially adapted for converting control signals received from the game device into a haptic signal, e.g. using force feedback
• CPC Class Codes: G05G 2009/04766 providing feel, e.g. indexing means, means to create counterforce
• CPC Class Codes: G05G 2009/04777 with additional push or pull action on the handle
• CPC Class Codes: G05G 9/047 the controlling member being movable by hand about orthogonal axes, e.g. joysticks for switches H01H25/04
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 2203/015 Force feedback applied to a joystick
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/03543 Mice or pucks G06F3/03541 takes precedence
• CPC Class Codes: G06F 3/0383 Signal control means within the pointing device
• CPC Class Codes: H01H 2003/008 with a haptic or a tactile feedback controlled by electrical means, e.g. a motor or magnetofriction

Abstract

A design interface tool for designing force sensations for use with a host computer and force feedback interface device. A force feedback device is connected to a host computer that displays the interface tool. Input from a user is received in the interface to select a type of force sensation to be commanded by a host computer and output by a force feedback interface device. Input, such as parameters, is then received from the user which designs and defines physical characteristics of the selected force sensation. A graphical representation of the characterized force sensation is displayed on the host computer which provides a visual demonstration of a feel of the characterized force sensation so that the user can view an effect of parameters on said force sensation. The characterized force sensation is output to a user manipulatable object of the force feedback device so that the user can feel the designed force sensation, where the graphical representation is updated in conjunction with the output of the force sensation. The user can iteratively modify force sensation characteristics and feel the results, and store the characterized force sensations.

Claims

1. A method for implementing a force sensation design interface, said method comprising:

displaying said force sensation design interface on a display device of a host computer;

receiving input from a user to said force sensation design interface, said input selecting a type of force sensation to be commanded by said host computer and output by a force feedback interface device, said force feedback interface device including a user manipulatable object graspable by a device user and moveable in a degree of freedom;

receiving input from said user defining physical characteristics of said selected force sensation;

displaying a graphical representation of said selected force sensation as characterized by said user, wherein said graphical representation provides said user with a visual demonstration of a feel of said characterized force sensation;

commanding said characterized force sensation to said force feedback interface device coupled to said host computer such that actuators of said force feedback interface device output said force sensation on said user manipulatable object in conjunction with said visual demonstration of said feel of said characterized force sensation; and

receiving additional changes to said characterized force sensation from said user after said force sensation is output and displaying said additional changes in said graphical representation, wherein a force sensation modified in accordance with said additional changes is output by said actuators on said user manipulatable object.

2. A method as recited in claim 1 further comprising storing a plurality of parameters characterizing said force sensation to a storage medium accessible to said host computer.

3. A method as recited in claim 2 further comprising accessing said stored plurality of parameters from an application program different than said design interface, said application program using said plurality of parameters to output said characterized force sensation during execution of said application program.

4. A method as recited in claim 3 wherein said application program is a game program.

5. A method as recited in claim 1 wherein a local microprocessor, included in said force feedback interface device and separate from said host computer, receives a command from said host computer to control said actuators to output said characterized force sensation.

6. A method as recited in claim 1 wherein a plurality of force sensations are selectable by said user, and wherein said selectable force sensations include conditions, effects, and dynamics.

7. A method as recited in claim 1 wherein said user may select an advanced mode or a simple mode of graphically representing said force sensation in said force sensation design interface.

8. A method as recited in claim 5 wherein in said advanced mode, a force versus user object motion profile is displayed, wherein said user may adjust parameters of said selected force sensation by dragging displayed control points of said profile.

9. A method as recited in claim 1 wherein said user may characterize said force sensation independently in different directions of a degree of freedom of said interface device.

10. A method as recited in claim 1 wherein said selected force sensation is a damping condition, and wherein said graphical representation includes an image of a column of liquid into which said user may move a controlled graphical object by moving said user manipulatable object such that said user feels said characterized damping force sensation.

11. A method as recited in claim 1 wherein said selected force sensation is a spring condition, and wherein said graphical representation is an image of said user manipulatable object and an image of a spring, wherein said user may adjust a thickness of said spring to adjust a stiffness of said spring condition.

12. A method as recited in claim 1 wherein said selected force sensation is a slope condition, and wherein said graphical representation includes an image of a hill on which a graphical object is positioned, wherein a position of said graphical object is controlled by a position of said user object, such that a force having a stiffness is applied to said user object when said graphical object is moved across said hill.

13. A method as recited in claim 12 wherein said graphical object controlled by said user manipulatable object is a ball that may be rolled across said hill.

14. A method as recited in claim 13 wherein said stiffness of said force is negative when said hill has a downward slope, and wherein said stiffness is positive when said hill has an upward slope.

15. A method as recited in claim 1 wherein said selected force sensation is a texture condition, and wherein said graphical representation includes images of a plurality of bumps representing a spacing and density of said texture.

16. A method as recited in claim 15 wherein a spacing and density of said bumps can be adjusted by said user by dragging at least one control point displayed in said design interface.

17. A method as recited in claim 1 wherein said selected force sensation is a periodic force sensation, and wherein said graphical representation is an image of a periodic waveform.

18. A method as recited in claim 17 wherein said characterization includes specifying an envelope for said periodic waveform, said envelope being displayed in said graphical representation.

19. A method as recited in claim 1 further comprising displaying a graphical representation of a second force sensation selected and characterized by said user, wherein both said selected force sensations are commanded to be simultaneously output on said user manipulatable object.

20. A method for implementing a force sensation design interface for designing a slope condition, the method comprising:

displaying said force sensation design interface on a display device of a host computer, said force sensation design interface including a graphical representation of a slope condition;

receiving input from a user to said force sensation design interface, said input defining physical characteristics of said slope condition to be commanded by said host computer and output by a force feedback interface device, said force feedback interface device including a user manipulatable object graspable by a device user and moveable in a degree of freedom;

adjusting said graphical representation of said slope condition in accordance with said input from said user; and

receiving input from said force feedback interface device indicating said user is moving said user manipulatable object, and commanding said characterized slope condition to said force feedback interface device such that actuators of said force feedback interface device output forces of said slope condition on said user manipulatable object in conjunction with updating said graphical representation to reflect a current position of said user manipulatable object, said graphical representation providing said user with a visual demonstration of a feel of said characterized slope condition.

21. A method as recited in claim 20 wherein said graphical representation of said slope condition includes an image of a hill and a graphical object positioned on said hill, wherein a position of said graphical object corresponds to a position of said user manipulatable object.

22. A method as recited in claim 21 wherein said graphical object is a ball that may be rolled up or down said hill.

23. A method as recited in claim 21 wherein said forces of said slope condition have a negative stiffness, wherein a side of said hill corresponding to said negative stiffness has a downward curvature.

24. A method as recited in claim 23 wherein the further said ball is moved down said side of said hill, the greater the force pushing said user manipulatable object away from a center position of said user manipulatable object.

25. A method as recited in claim 21 wherein said forces of said slope condition have a positive stiffness, wherein a side of said hill corresponding to said positive stiffness has an upward curvature.

26. A method as recited in claim 25 wherein the further said ball is moved up said side of said hill, the greater the force pushing said user manipulatable object toward a center position of said user manipulatable object.

27. A method as recited in claim 22 wherein one side of said hill has a downward slope indicating a force with a negative stiffness in one direction, and wherein the other side of said hill has an upward slope indicating a force with a positive stiffness in the other direction.

28. A system for allowing a user to intuitively design spatially varying force feedback sensations, said system comprising:

a host computer system displaying a force feedback design interface on a display device, said force feedback design interface displaying a graphical representation of a force sensation selected by a user, wherein said user can adjust characteristics of said selected force sensation by inputting information to said design interface, said characteristics including stiffness, deadband and offset parameters;

a force feedback interface device coupled to said host computer system, said force feedback interface device receiving said stiffness, deadband and offset parameters and outputting said selected force sensation on a user object of said interface device when commanded by said host computer system, wherein said interface device outputs a modified force sensation on said user object corresponding to adjustments to said force sensation made by said user; and

saving said stiffness, deadband, and offset parameters to a storage medium accessible by said host computer system, said parameters being provided with an identifier to identify said parameters as a set defining a particular force sensation.

29. A system as recited in claim 28 wherein said force feedback interface device includes a microprocessor separate from said host computer system, said microprocessor receiving commands from said host computer system, reading sensors of said interface device and reporting positions of said user object to said host computer system, and commanding actuators of said interface device to output said force sensation on said user object.

30. An apparatus providing a force sensation design interface for designing a force sensation to be output to a force feedback interface device, the apparatus comprising:

means for displaying said force sensation design interface on a display device of a host computer, said force sensation design interface including a graphical representation of a force sensation;

means for receiving input from a user to said force sensation design interface, said input defining physical characteristics of said force sensation to be commanded by said host computer and output by a force feedback interface device, said force feedback interface device including a user manipulatable object graspable by a device user and moveable in a degree of freedom;

means for adjusting said graphical representation of said force sensation in accordance with said input from said user;

means for receiving input from said force feedback interface device indicating said user is moving said user manipulatable object, and commanding said characterized force sensation to said force feedback interface device such that actuators of said force feedback interface device output said force sensation on said user manipulatable object in conjunction with updating said graphical representation to reflect a current position of said user manipulatable object, said graphical representation providing said user with a visual demonstration of a feel of said characterized force sensation; and

means for writing data describing said physical characteristics of said force sensation to a storage medium.

31. A computer readable medium including program instructions for providing a force sensation design interface implemented by a computer, said program instructions causing said computer to perform steps comprising:

displaying a design interface on a display device of said computer;

receiving input in said design interface from a user, said input selecting a type of force sensation to be commanded by said computer and output by a force feedback interface device coupled to said computer, said force feedback interface device including a user manipulatable object graspable by a device user and moveable in a degree of freedom;

receiving input from said user to specify parameters which define characteristics of said selected force sensation;

displaying a graphical representation of said characterized force sensation in said design interface, wherein said graphical representation includes visual representations of said parameters such that said user can view an effect of said parameters on said force sensation; and

commanding said characterized force sensation to said force feedback interface device coupled to said computer such that actuators of said force feedback interface device output said force sensation on said user manipulatable object in conjunction with a visual demonstration of said feel of said characterized force sensation.

32. A computer readable medium as recited in claim 31 including program instructions for causing said computer to write said parameters to a storage medium, said parameters being accessible to application programs implemented on said computer and controlling force feedback.

33. A computer readable medium as recited in claim 32 including program instructions for causing said computer to update said graphical representation in accordance with said force sensation being output on said user manipulatable object.

34. A computer readable medium as recited in claim 32 wherein said visual demonstration includes moving a graphical object in correspondence with said user manipulatable object, wherein when said force sensation is output on said user manipulatable object, said graphical object engages an image of said representation.

35. A computer readable medium as recited in claim 34 wherein said image of said representation includes an image of a spring displayed for a spring force sensation.

36. A computer readable medium as recited in claim 34 wherein said image of said representation includes an image of a column of liquid displayed for a damping force sensation.

37. A method for graphically allowing a user to design a feel of a simulated spring sensation to be displayed by a force feedback interface device coupled to a host computer, said method comprising:

displaying a graphical profile that is representative of a force output at different displacements of a user manipulatable object of said force feedback interface device, wherein said force provides said simulated spring sensation;

providing control points on said graphical profile that can be manipulated by said user to modify the feel of said simulated spring sensation; and

causing said simulated spring sensation to be output by actuators of said force feedback interface device coupled to said host computer such that said actuators of said force feedback interface device modify an output force as a function of displacement of said user manipulatable object of said force feedback interface device in accordance with requirements of said graphical profile of said simulated spring sensation.

38. A method as recited in claim 37 wherein said graphical profile includes visual representations of a center offset, a deadband, a positive stiffness, and a negative stiffness.

39. A method as recited in claim 38 wherein at least one of said control points allows said user to modify a size of said deadband of said simulated spring sensation.

40. A method as recited in claim 37 wherein a combination of two of said control points allows said user to modify said deadband and said center offset of said simulated spring sensation.

41. A method as recited in claim 37 wherein at least one of said control points allows said user to modify a saturation level of said simulated spring sensation.

42. A method as recited in claim 37 wherein at least two of said control points allow said user to modify a positive saturation level and a negative saturation level of said simulated spring sensation.

43. A method as recited in claim 37 wherein a manipulation of one of said control points affects a stiffness of said simulated spring sensation.

44. A method as recited in claim 37 wherein a manipulation of one of said control points affects a positive stiffness of said simulated spring sensation and a manipulation of another of said control points affects a negative stiffness of said simulated spring sensation.

45. A method as recited in claim 37 wherein a symmetry mode can be selected that causes said graphical profile to remain symmetrical about a center regardless of how said user manipulates said control points.

46. A method as recited in claim 45 wherein said symmetry mode allows said user to manipulate one of said control points to modify a positive stiffness of said simulated spring sensation and said host computer automatically updates a negative stiffness to maintain a symmetry of said graphical profile.

47. A method as recited in claim 43 wherein one of said control points can be pulled below a displayed horizon line to cause a stiffness parameter to become a negative value and therefore represent an unstable spring sensation.

48. A method as recited in claim 37 wherein said graphical profile is associated with a specific axis of motion of said user manipulatable object, wherein said user manipulatable object can be moved in a plurality of axes of motion.

49. A method as recited in claim 37 wherein a mode can be selected by said user that associates said graphical profile with a simulated spring sensation that is implemented on multiple axes of said force feedback interface device simultaneously.

50. A method as recited in claim 37 wherein said graphical profile can be displayed at a given angle in a two axis plane, said angle being selectable by said user.

51. A method for graphically allowing a user to design a feel of a simulated damper sensation to be displayed by a force feedback interface device coupled to a host computer, said method comprising:

displaying a graphical profile that is representative of a force output at different displacements of a user manipulatable object of said force feedback interface device, wherein said force provides said simulated damper sensation;

providing control points on said graphical profile that can be manipulated by said user to modify the feel of said simulated damper sensation; and

causing said simulated damper sensation to be output by actuators of said force feedback interface device coupled to said host computer such that said actuators of said force feedback interface device modify an output force as a function of velocity of said user manipulatable object of said force feedback interface device in accordance with requirements of said graphical profile of said simulated damper sensation.

52. A method as recited in claim 51 wherein said graphical profile includes visual representations of a deadband, a positive damping force, and a negative damping force.

53. A method as recited in claim 51 wherein at least one of said control points allows said user to modify a size of said deadband of said simulated damper sensation.

54. A method as recited in claim 51 wherein a combination of two of said control points allows said user to modify said deadband and said center offset of said simulated damper sensation.

55. A method as recited in claim 51 wherein at least one of said control points allows said user to modify a saturation level of said simulated damper sensation.

56. A method as recited in claim 51 wherein at least two of said control points allow said user to modify a positive saturation level and a negative saturation level of said simulated damper sensation.

57. A method as recited in claim 51 wherein a manipulation of one of said control points affects a damping magnitude of said simulated damper sensation.

58. A method as recited in claim 51 wherein a manipulation of one of said control points affects a positive damping of said simulated damper sensation and a manipulation of another of said control points affects a negative damping of said simulated damper sensation.

59. A method as recited in claim 51 wherein a symmetry mode can be selected that causes said graphical profile to remain symmetrical about a center regardless of how said user manipulates said control points.

60. A method as recited in claim 59 wherein said symmetry mode allows said user to manipulate one of said control points to modify a positive damping magnitude of said damper sensation and said host computer automatically updates a negative damping magnitude to maintain a symmetry of said graphical profile.

61. A method as recited in claim 58 wherein one of said control points can be pulled below a displayed horizon line to cause a damping parameter to become a negative value and therefore represent an unstable damper sensation.

62. A method as recited in claim 51 wherein said graphical profile is associated with a specific axis of motion of said user manipulatable object, wherein said user manipulatable object can be moved in a plurality of axes of motion.

63. A method as recited in claim 51 wherein a mode can be selected by said user that associates said graphical profile with a simulated damper sensation that is implemented on multiple axes of said force feedback interface device simultaneously.

64. A method as recited in claim 51 wherein said graphical profile can be displayed at a given angle in a two axis plane, said angle being selectable by said user.

65. A graphical method for allowing a user to design a feel of a simulated vibration sensation to be displayed by a force feedback interface device coupled to a host computer, said method comprising:

displaying a graphical profile that is representative of a force output over a time period, wherein said force provides said simulated vibration sensation;

providing control points on said graphical profile that can be manipulated by said user to modify the feel of said simulated vibration sensation; and

causing said simulated vibration sensation to be output to a user by actuators of said force feedback interface device coupled to said host computer such that said actuators of said force feedback interface device modify said output force as a function of time of said force feedback interface device in accordance with requirements of said graphical profile of said simulated vibration sensation.

66. A method as recited in claim 65 wherein said graphical profile includes a waveform fitted within an envelope.

67. A method as recited in claim 65 wherein said graphical profile includes a waveform, and wherein at least one of said control points allows said user to modify a magnitude of said waveform.

68. A method as recited in claim 65 wherein said graphical profile includes a waveform, and wherein at least one of said control points allows said user to modify an impulse level of said waveform.

69. A method as recited in claim 65 wherein said graphical profile includes a waveform, and wherein at least one of said control points allows said user to modify attack characteristics of said waveform.

70. A method as recited in claim 65 wherein said graphical profile includes a waveform, and wherein at least one of said control points allows said user to modify fade parameters of said waveform.

71. A method as recited in claim 65 wherein said graphical profile is associated with a specific axis of motion of a user manipulatable object of said force feedback interface device, wherein said user manipulatable object can be moved in a plurality of axes of motion.

72. A method as recited in claim 71 wherein a mode can be selected by said user that associates said graphical profile with a simulated vibration sensation that is implemented on multiple axes of said force feedback interface device simultaneously.

73. A method as recited in claim 71 wherein said graphical profile can be displayed at a given angle in a two axis plane, said angle being selectable by said user.

74. A method as recited in claim 65 wherein said graphical profile includes a waveform, and wherein a type of said waveform can be selected by said user from a set that includes a sine wave and a square wave.