Designing force sensations for computer applications including sounds

• US 6,285,351 B1
• Filed: 02/02/1999
• Issued: 09/04/2001
• Est. Priority Date: 04/25/1997
• Status: Expired due to Term

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Rosenberg, Louis B., Chang, Dean C., Mallett, Jeffrey R.
• Primary Examiner(s): Shalwala, Bipin
• Assistant Examiner(s): Nguyen, Jimmy H.
• Application Number:
  US09/243,209
• Time in Patent Office: 945 Days
• Field of Search: 345/156, 345/157, 345/161, 345/163, 345/167, 345/146, 345/326, 345/333, 318/568.11, 318/568.25, 744/71, 463/30, 463/37, 463/38, 434/45, 395/99, 244/233
• US Class Current: 345/156
• CPC Class Codes: A63F 2300/1037 being specially adapted for converting control signals received from the game device into a haptic signal, e.g. using force feedback
• CPC Class Codes: A63F 2300/6063 for sound processing
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 2203/015 Force feedback applied to a joystick
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/03543 Mice or pucks G06F3/03541 takes precedence

Abstract

A design interface tool for designing force sensations for use with a host computer and force feedback interface device. A force feedback device is connected to a host computer that displays the interface tool. The user selects a type of force sensation and designs and defines physical characteristics of the selected force sensation using the interface tool. A graphical representation of the characterized force sensation is displayed, which provides a visual demonstration of a feel of the characterized force sensation. The force sensation is output to a user manipulatable object of a force feedback device to be felt by the user, where the graphical representation is updated in conjunction with the output of the force sensation. The user can also associate a sound with the force sensation, such that the sound is output in conjunction with the output of the force sensation. The user can iteratively modify force sensation characteristics and feel the results, as well as synchronize force sensations with sounds.

Claims

1. A method for implementing a force sensation design interface, said method comprising:

causing a display of said force sensation design interface on a display device of a host computer;

receiving input from a user to said force sensation design interface, said input selecting a type of force sensation to be commanded by said host computer and output by a force feedback interface device, said force feedback interface device including a user manipulatable object graspable by a user and moveable in a degree of freedom;

receiving input from a user defining physical characteristics of said selected force sensation;

causing a display of a graphical representation of said selected force sensation as characterized by said user, wherein said graphical representation provides said user with a visual demonstration of a feel of said characterized force sensation;

receiving sound selection input from said user that selects a sound to be associated with said selected force sensation and associating said selected force sensation and said selected sound with each other;

causing said characterized force sensation to be output by said force feedback interface device coupled to said host computer, said force sensation being output in conjunction with an updating of said visual demonstration of said feel of said characterized force sensation and in conjunction with an output of said associated sound by a sound output device coupled to said host computer; and

receiving changes to said characterized force sensation from said user after said force sensation is output to synchronize said force sensation with said sound and causing a display of said additional changes in said graphical representation.

2. A method as recited in claim 1 further comprising storing a plurality of parameters characterizing said force sensation to a storage medium accessible to said host computer.

3. A method as recited in claim 2 further comprising accessing said stored plurality of parameters from an application program different than said design interface, said application program using said plurality of parameters to output said characterized force sensation during execution of said application program.

4. A method as recited in claim 3 wherein a start of said sound is synchronized with a start of said force sensation when said sound and force sensation are output.

5. A method as recited in claim 1 wherein said selected force sensation is associated with a control on said force feedback device, such that said force sensation, said visual demonstration, and said sound are output when said control is activated by said user.

6. A method as recited in claim 5 wherein said control is a button, and wherein said force sensation and said sound are associated with a graphical icon in said design interface that represents said button.

7. A method as recited in claim 6 wherein when said graphical icon is selected by said user, said user has an option to associate a sound with said icon, disassociate a sound with said icon, or test said icon.

8. A method as recited in claim 6 wherein said user can disassociate said sound from said control.

9. A method as recited in claim 1 wherein said user can select a plurality of sounds to be associated with said selected force sensation.

10. A method as recited in claim 1 wherein said user can test said sound before associating said force sensation with said sound.

11. A method as recited in claim 1 wherein a plurality of force sensations are selectable by said user, and wherein said selectable force sensations include conditions, effects, and dynamics.

12. A method as recited in claim 1 wherein said selected force sensation is a periodic force sensation, and wherein said graphical representation is an image of periodic waveform.

13. A method as recited in claim 1 wherein said sound is provided as data in a standard file format.

14. An apparatus for implementing a force sensation design interface, said apparatus comprising:

means for displaying a graphical representation of a selected force sensation as characterized by said user, wherein said graphical representation provides said user with a visual demonstration of a feel of said characterized force sensation and is displayed in said force sensation design interface on a display device of a host computer, wherein said force sensation design interface receives input from a user selecting a type of force sensation to be commanded by said host computer and output by a force feedback interface device, said force feedback interface device including a user manipulatable object graspable by a user and moveable in a degree of freedom;

means for receiving input from a user defining physical characteristics of said selected force sensation and selecting at least one of a plurality of sounds;

means for associating said selected force sensation and said at least one selected sound with each other;

means for providing said characterized force sensation to said force feedback interface device coupled to said host computer such that actuators of said force feedback interface device output said force sensation on said user object in conjunction with said visual demonstration of said feel of said characterized force sensation and in conjunction with the output of said at least one associated sound; and

means for changing characteristics of said force sensation based on input from said user to synchronize said force sensation with said sound and displaying said changed force sensation as said graphical representation, wherein a force sensation modified in accordance with said changes is output by said actuators on said user object.

15. An apparatus as recited in claim 14 wherein said associating said force sensation and said at least one sound with each other includes associating said force sensation with a physical button provided on said force feedback device, and associating said at least one sound with said button, such that said force sensation and said at least one sound are output in a synchronized fashion when said button is pressed by a user of said design interface.

16. An apparatus as recited in claim 15 wherein said force sensation and said at least one sound are associated with a graphical representation of a button displayed in said interface, wherein said graphical representation is associated with said physical button on said force feedback interface device.

17. An apparatus as recited in claim 14 further comprising means for writing data describing said physical characteristics of said force sensation to a storage medium.

18. A computer readable medium including program instructions implemented on a computer, said program instructions providing a force sensation design interface implemented by said computer, said program instructions performing acts comprising:

causing a display of said design interface on a display device of said computer;

receiving input in said design interface from a user, said input selecting a type of force sensation to be commanded by a host computer and output by a force feedback interface device, said force feedback interface device including a user manipulatable object graspable by a user and moveable in a degree of freedom;

receiving input from a user to specify parameters which define characteristics of said selected force sensation;

receiving sound selection input from said user that selects at least one sound to be associated with said selected force sensation;

causing a display of a graphical representation of said characterized force sensation in said design interface, wherein said graphical representation includes visual representations of said parameters such that said user can view an effect of said parameters on said force sensation;

associating said at least one selected sound with said selected force sensation, such that when said characterized force sensation is commanded to be output by said force feedback interface device coupled to said host computer, said at least one sound is output in conjunction with said output of said force sensation on said user object and in conjunction with a visual demonstration of said feel of said characterized force sensation.

19. A computer readable medium as recited in claim 18 wherein said characterized force sensation is commanded to be output by said force feedback interface device when said user selects a control in said design interface to test said force sensation.

20. A computer readable medium as recited in claim 18 including program instructions for receiving additional input from said user to change said characteristics of said force sensation to be in further synchronization with said at least one sound.

21. A computer readable medium as recited in claim 18 including program instructions for writing said parameters to a storage medium, said parameters being accessible to application programs implemented on said computer and controlling force feedback.

22. A computer readable medium as recited in claim 18 including program instructions for updating said graphical representation in accordance with said force sensation being output on said user object.

23. A computer readable medium as recited in claim 18 wherein a start of said at least one sound is synchronized with a start of said force sensation when said at least one sound and said force sensation are output.

24. A method for implementing a force sensation design interface, said method comprising:

enabling a display of said force sensation design interface on a display device of a host computer;

enabling a reception of input from a user to said force sensation design interface, said input selecting a type of force sensation to be commanded by said host computer and output by a force feedback interface device;

enabling a reception of input from a user defining physical characteristics of said selected force sensation and selecting sound data to be associated with said selected force sensation;

enabling a display of a graphical representation of said selected force sensation as characterized by said user, wherein said graphical representation provides said user with a visual demonstration of a feel of said characterized force sensation;

enabling an association of said selected force sensation and said selected sound data with each other;

enabling said characterized force sensation to be output by said force feedback interface device coupled to said host computer, said force sensation being output in conjunction with an updating of said visual demonstration of said feel of said characterized force sensation and in conjunction with an output of said associated sound data as at least one sound by a sound output device coupled to said host computer; and

enabling a reception of changes to said characterized force sensation in said force sensation design interface from said user after said force sensation is output to synchronize said force sensation with said output of said at least one sound and enabling a display of said additional changes in said graphical representation.

25. A method as recited in claim 24 further comprising enabling a storage of a plurality of parameters characterizing said force sensation to a storage medium accessible to said host computer, and further comprising enabling an access of said stored plurality of parameters by an application program different than said design interface, said application program using said plurality of parameters to output said characterized force sensation during execution of said application program.

26. A method as recited in claim 24 wherein said selected force sensation is associated with a control on said force feedback device, such that said force sensation, said visual demonstration, and said sound are output when said control is activated by said user.

27. A method as recited in claim 26 wherein said control is a button, and wherein said force sensation and said sound are associated with a graphical icon in said design interface that represents said button.

28. A method as recited in claim 27 wherein when said graphical icon is selected by said user, said user has an option to associate a sound with said icon, disassociate a sound with said icon, or test said icon.

29. A method as recited in claim 24 wherein a plurality of force sensations are selectable by said user, and wherein said selectable force sensations include conditions, effects, and dynamics.

30. A method as recited in claim 24 wherein said selected force sensation is a periodic force sensation, and wherein said graphical representation is an image of a periodic waveform.

31. A method as recited in claim 24 wherein a graph of magnitude versus time of said selected sound data is displayed in said design interface.

32. A method as recited in claim 31 wherein said user can select a portion of said graphical representation of said force sensation to cause a corresponding portion of said force sensation to be output, and to cause a corresponding portion of said selected sound data to be output.