Designing compound force sensations for computer applications

• US 6,292,170 B1
• Filed: 03/15/1999
• Issued: 09/18/2001
• Est. Priority Date: 04/25/1997
• Status: Expired due to Term

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Rosenberg, Louis B., Chang, Dean C., Mallett, Jeffrey R.
• Primary Examiner(s): Shalwala, Bipin
• Assistant Examiner(s): Nguyen, Jimmy H.
• Application Number:
  US09/270,223
• Time in Patent Office: 918 Days
• Field of Search: 345/156, 345/153, 345/161, 345/163, 345/146, 345/326, 345/333, 345/167, 318/568.11, 318/568.25, 744/71.XY, 463/30, 463/37, 463/38, 434/45, 395/99, 244/233
• US Class Current: 345/156
• CPC Class Codes: A63F 2300/1037 being specially adapted for converting control signals received from the game device into a haptic signal, e.g. using force feedback
• CPC Class Codes: A63F 2300/6063 for sound processing
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 2203/015 Force feedback applied to a joystick
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/03543 Mice or pucks G06F3/03541 takes precedence
• CPC Class Codes: G06T 11/206 Drawing of charts or graphs

Abstract

A design interface tool for designing force sensations for use with a host computer and force feedback interface device. A force feedback device is connected to a host computer that displays the interface tool. The user selects a type of force sensation and designs and defines physical characteristics of the selected force sensation using the interface tool. A graphical representation of the characterized force sensation is displayed. The user can include a plurality of force sensations in a compound force sensation, where the compound sensation is graphically displayed to indicate the relative start times and duration of each of the force sensations. The user can also easily adjust the start times and durations of the force sensations using the graphical representation. The force sensations are output to a user manipulandum of a force feedback device to be felt by the user, where the graphical representation is updated in conjunction with the output of the force sensation. The user can iteratively modify force sensation characteristics and feel the results. Sounds can also be graphically represented and synchronized with the designed compound forces.

Claims

1. A method for implementing a force sensation design interface, said method comprising:

causing a display of said force sensation design interface on a display device of a host computer;

receiving input from a user to said force sensation design interface, said input selecting a plurality of individual force sensations to be commanded by said host computer and output by a force feedback interface device, said force feedback interface device including a manipulandum physically engageable by a user and moveable in at least one degree of freedom, wherein each of said individual force sensations is provided with an edit display area displayed in said force sensation design interface;

including said plurality of selected force sensations in a compound force sensation based on input received from said user; and

causing a display of a time-based graphical representation of said compound force sensation, said representation displaying each of said individual force sensations included in said compound force sensation.

2. A method as recited in claim 1 further comprising commanding said compound force sensation to be output by said force feedback interface device coupled to said host computer such that said individual force sensations are output to said manipulandum in conjunction with updating said graphical demonstration of said compound force sensation, such that said graphical representation provides said user with a visual demonstration of said individual force sensations included in said compound force sensation.

3. A method as recited in claim 1 further comprising:

receiving changes from said user to at least one of said individual force sensations in said compound force sensation, said changes received in said edit display area of said changed individual force sensation, said changes provided after said compound force sensation is output; and

causing a display of said changes in said graphical representation of said compound force sensation.

4. A method as recited in claim 1 further comprising:

receiving changes from said user to said compound force sensation, said changes received in a display area of said compound force sensation, said changes provided after said compound force sensation is output; and

effecting said changes in said display area of said compound force sensation receiving said changes.

5. A method as recited in claim 1 further comprising storing said compound force sensation to a storage medium accessible to said host computer.

6. A method as recited in claim 1 further comprising accessing said stored compound force sensation from an application program different than said force sensation design interface.

7. A method as recited in claim 1 wherein said time-based graphical representation includes a bar graph for each of said individual force sensations in said compound force sensation indicating a start time and duration of each of said individual force sensations relative to each other.

8. A method as recited in claim 2 wherein said updating of said graphical demonstration includes moving a marker across a plurality of bar graphs, each indicating a time period during which one of said individual force sensations is output.

9. A method as recited in claim 2 wherein a sound is associated with said compound force sensation, wherein a start of a sound is synchronized with a start of said compound force sensation.

10. A method as recited in claim 9 wherein said sound is selected by said user in said force sensation design interface and said user associates said sound with said compound force sensation.

11. A method as recited in claim 1 wherein said compound force sensation also includes a lower-level compound force sensation, said lower-level compound force sensation including at least one individual force sensation.

12. A method as recited in claim 1 wherein said individual force sensations include conditions, effects, and dynamics.

13. An apparatus for implementing a force sensation design interface, said apparatus comprising:

means for causing a display of said force sensation design interface on a display device of a host computer, said means for displaying providing an edit window for each individual force sensation to be created or edited by said user in said force design interface;

means for receiving input from a user to said force sensation design interface, said input selecting a plurality of said individual force sensations to be commanded by said host computer and output by a force feedback interface device, said force feedback interface device including a manipulandum graspable by a user and moveable in a degree of freedom; and

means for including said selected force sensation with at least one other individual force sensation in a compound force sensation based on input received from said user, wherein said means for causing a display displays a time-based graphical representation of said compound force sensation.

14. An apparatus as recited in claim 13 wherein said time-based graphical representation includes a bar graph for each of said individual force sensations indicating a start time and duration of each of said individual force sensations relative to each other.

15. An apparatus as recited in claim 13 further comprising means for commanding said compound force sensation to be output by said force feedback interface device coupled to said host computer such that said compound force sensation is output to said manipulandum in conjunction with updating said graphical demonstration of said compound force sensation.

16. An apparatus as recited in claim 13 further comprising means for receiving changes to at least one of said individual force sensations from said user after said force sensation is output and causing a display of said changes in said graphical representation of said compound force sensation.

17. A computer readable medium including program instructions executable on a computer for providing a force sensation design interface implemented by said computer, said program instructions performing steps comprising:

causing a display of said force sensation design interface on a display device of a host computer;

receiving input from a user to said force sensation design interface, said input selecting an individual force sensation to be commanded by said host computer and output by a force feedback interface device, said force feedback interface device including a manipulandum graspable by a user and moveable in a degree of freedom;

including said selected force sensation with at least one other individual force sensation in a compound force sensation based on input received from said user; and

causing a display of a compound force sensation window in said design interface, said window including a time-based graphical representation of said individual force sensations; and

outputting said compound force sensation to said force feedback interface device to be felt by said user, wherein a marker moves across said time-based graphical representation to indicate a current point in time with respect to said individual force sensations.

18. A computer readable medium as recited in claim 17 including program instructions for receiving additional input from said user to change said characteristics of said individual force sensations and adjust the time period during which at least one of said individual force sensations is to be output.

19. A computer readable medium as recited in claim 17 including program instructions for writing said compound force sensation to a storage medium, said compound force sensation being accessible to application programs implemented on said computer and controlling force feedback.

20. A method for implementing a force sensation design interface, said method comprising:

enabling a display of said force sensation design interface on a display device of a host computer;

enabling a reception of input from a user to said force sensation design interface, said input selecting a plurality of individual force sensations to be commanded by said host computer and output by a force feedback interface device, said force feedback interface device including a manipulandum physically engageable by a user and moveable in at least one degree of freedom, wherein each of said individual force sensations is provided with an edit display area displayed in said force sensation design interface;

enabling an inclusion of said plurality of selected force sensations in a compound force sensation based on input received from said user; and

enabling a display of a time-based graphical representation of said compound force sensation, said representation displaying each of said individual force sensations included in said compound force sensation.

21. A method as recited in claim 20 further comprising enabling commanding of said compound force sensation to be output by said force feedback interface device coupled to said host computer such that said individual force sensations are output to said manipulandum in conjunction with updating said graphical demonstration of said compound force sensation, such that said graphical representation provides said user with a visual demonstration of said individual force sensations included in said compound force sensation.

22. A method as recited in claim 20 including program instructions for receiving additional input from said user to change said characteristics of said individual force sensations and adjust the time period during which at least one of said individual force sensations is to be output.

23. A method as recited in claim 20 further comprising:

enabling a reception of changes from said user to at least one of said individual force sensations in said compound force sensation, said changes received in said edit display area of said changed individual force sensation, said changes provided after said compound force sensation is output; and

enabling a display of said changes in said graphical representation of said compound force sensation.

24. A method as recited in claim 20 further comprising:

enabling a reception of changes from said user to said compound force sensation, said changes received in a display area of said compound force sensation, said changes provided after said compound force sensation is output; and

enabling said changes to take effect in said display area of said compound force sensation receiving said changes.

25. A method as recited in claim 20 wherein said time-based graphical representation includes a bar graph for each of said individual force sensations in said compound force sensation indicating a start time and duration of each of said individual force sensations relative to each other.

26. A method as recited in claim 21 wherein said updating of said graphical demonstration includes moving a marker across a plurality of bar graphs, each indicating a time period during which one of said individual force sensations is output.

27. A method as recited in claim 21 wherein a sound is associated with said compound force sensation, wherein a start of a sound is synchronized with a start of said compound force sensation.

28. A method as recited in claim 20 wherein said compound force sensation also includes a lower-level compound force sensation, said lower-level compound force sensation including at least one individual force sensation.

29. A method as recited in claim 24 further comprising enabling a storage of a plurality of parameters characterizing said force sensation to a storage medium accessible to said host computer, and further comprising enabling an access of said stored plurality of parameters by an application program different than said design interface, said application program using said plurality of parameters to output said characterized force sensation during execution of said application program.

30. A method as recited in claim 20 wherein at least one of said selected individual force sensations is a periodic force sensation, and wherein said graphical representation of said periodic force sensation is an image of a periodic waveform.