Interface device and method for providing enhanced cursor control with force feedback

• US 6,252,579 B1
• Filed: 08/23/1997
• Issued: 06/26/2001
• Est. Priority Date: 08/23/1997
• Status: Expired due to Term

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Rosenberg, Louis B., Braun, Adam C., Beamer, Jonathan L., Chang, Dean C.
• Primary Examiner(s): CHANG, KENT WU
• Application Number:
  US08/924,462
• Time in Patent Office: 1,403 Days
• Field of Search: 345/145, 345/156, 345/157, 345/159, 345/161
• US Class Current: 715/856
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 2203/015 Force feedback applied to a joystick
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0354 with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
• CPC Class Codes: G06F 3/03548 Sliders, in which the moving part moves in a plane
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry

Abstract

An interface device and method for providing enhanced cursor control with force feedback. A force feedback interface device includes a manipulandum, such as a mouse, that is moveable in a local workspace. The device is coupled to a host computer that displays a cursor in a graphical environment, such as a GUI, on a display screen. A scaled cursor position in the display frame is reported to the host computer derived from a reference position of the mouse in the local frame, and the host displays the cursor. For example, the cursor position may be scaled by a ballistics algorithm based on mouse velocity to allow fine positioning or coarse motion of the cursor. A force is output on the mouse based on interactions in the GUI, the force being determined based on mouse reference data or cursor ballistic data, depending on the type of force, to reduce distortion between visual and force outputs.

Claims

1. A method for providing enhanced cursor control using a force feedback interface device coupled to a host computer displaying a graphical environment and a cursor within said graphical environment on a display device, the method comprising:

(a) reading a position of a manipulandum in a device workspace as a reference position, said manipulandum being grasped by a user;

(b) reporting a cursor position to said host computer derived from said reference position, wherein said host computer displays said cursor within said graphical environment on said display device at a position corresponding to said cursor position, and wherein said reported cursor position is a ballistics position, said ballistics position being said reference position modified by a ballistics algorithm by which a position of said cursor is mapped to a position of said manipulandum based on a scaling derived from a velocity of said manipulandum in said device workspace;

(c) determining whether said cursor interacts with said graphical environment as to cause a force to be output on said manipulandum; and

(d) determining and outputting said force on said manipulandum if so determined in (c),

wherein said reported cursor position allows said user of said force feedback interface device to finely position said cursor within said graphical environment and coarsely move said cursor as desired in said graphical environment.

2. A method as recited in claim 1 wherein said cursor position reported to said host computer is said reference position that has been modified to allow said fine positioning and said coarse movement of said cursor.

3. A method as recited in claim 1 wherein said reported cursor position is said reference position modified by a constant mapping when said force output in (d) is a visual spring force.

4. A method as recited in claim 1 wherein said force is determined in (d) based on motion or position of said manipulandum with respect to said workspace while said cursor position is based on previous cursor positions on said display screen.

5. A method as recited in claim 1 wherein said force is determined in (d) using said reference position if a magnitude of said force is based on motion or position of said manipulandum and is not a visual spring force, using said ballistics position if said force is a visual spring force, and using neither reference nor ballistic position if a magnitude of said force is independent of said motion or position of said manipulandum.

6. A method as recited in claim 5 wherein a magnitude of said force is based on motion or position of said manipulandum if said force is a damping force or a friction force.

7. A method as recited in claim 1 wherein said ballistics position is determined by a device microprocessor local to said interface device and separate from said host computer.

8. A method as recited in claim 1 wherein said manipulandum is a mouse.

9. A method as recited in claim 1 further comprising determining if an indexing feature should be performed, said indexing feature allowing said user to control an offset between said position of said manipulandum in said workspace and said position of said cursor on said display screen.

10. A method as recited in claim 1 wherein said force is determined using said reference position if a magnitude of said force is based on motion or position of said manipulandum and is not a visual spring force, and wherein said force is determined using said ballistics position if said force is a visual spring force.

11. A method as recited in claim 1 wherein said scaling derived from said velocity of said manipulandum is based on at least one velocity threshold, wherein said scaling is greater when said velocity is over said threshold than when said velocity is under said threshold.

12. A method as recited in claim 1 wherein said scaling derived from said velocity of said manipulandum is based on a continuous function.

13. A method for providing enhanced cursor control using a force feedback interface device coupled to a host computer displaying a graphical environment and a cursor within said graphical environment on a display device, the method comprising:

(a) reading a position of a manipulandum in a device workspace as a reference position, said manipulandum being grasped by a user;

(b) reporting a cursor position to said host computer, wherein said cursor position is a ballistic position, said ballistic position being said reference position that has been modified according to a ballistics algorithm, said ballistics algorithm allowing fine positioning of said cursor at relatively slower movement of said manipulandum and allowing coarse movement of said cursor at relatively faster movement of said manipulandum to provide enhanced cursor control to said user when moving said manipulandum, and wherein said host computer displays said cursor within said graphical environment on said display device at a position corresponding to said cursor position;

(c) determining whether a force is to be output on said manipulandum based on an interaction of said cursor and said graphical environment;

(d) determining said force, wherein if said determination of said force is at least in part based on motion of said manipulandum, said reference position is used in said determination of said force; and

(e) outputting said determined force on said manipulandum.

14. A method as recited in claim 13 wherein said cursor position is based on a constant mapping and not a ballistic algorithm when said force is a visual spring force.

15. A method as recited in claim 13 wherein said force that is determined at least in part based on motion of said manipulandum is designated as one of two types, said two types being a manipulandum-based force sensation having a determination based on at least one reference position of said manipulandum, and a cursor-based force sensation having a determination based on at least one ballistic position of said cursor.

16. A method as recited in claim 15 wherein a visual spring force is said cursor-based force sensation type, and wherein a damping force, inertia force, and friction force are said manipulandum-based sensation type.

17. A method as recited in claim 13 wherein a local microprocessor, separate from said host computer and provided in said force feedback interface device, stores both reference positions and ballistic positions of said manipulandum over time for use in determining said manipulandum-based force sensations and said cursor based force sensations.

18. A method as recited in claim 17 wherein said local microprocessor performs said reporting and determining of forces.

19. A method as recited in claim 18 wherein said force having a determination not based on motion of said manipulandum includes a vibration, jolt or other force sensation based solely on time parameters.

20. A method as recited in claim 13 wherein said cursor position is further modified by indexing, said indexing allowing control over an offset between said position of said manipulandum in said workspace and said position of said cursor on said display screen.

21. A method as recited in claim 13 wherein if said output of said force is based on a location of said cursor in said graphical environment, said cursor position is used in said determination of whether said force is to be output.

22. A force feedback mouse interface device that provides enhanced cursor control over a cursor displayed on a display screen of a host computer coupled to said interface device, the force feedback interface device comprising:

a mouse object physically contacted by a user and movable in a planar workspace in at least two degrees of freedom with respect to a ground;

at least one sensor that reads a position of said mouse object as a reference position;

a plurality of actuators coupled to said mouse object that provide forces on said mouse object in said planar device workspace; and

a local microprocessor, separate from said host computer and coupled to said sensor and to said actuators, said local microprocessor storing said reference position in a local memory and

reporting a cursor position to said host computer, wherein said microprocessor modifies said reference position by a ballistics algorithm to determine said cursor position, said cursor position providing enhanced cursor control to said user when moving said mouse object, and wherein said host computer displays said cursor within said graphical environment on said display device at a position corresponding to said cursor position, and

outputting a force by controlling said actuators, said output of said force based on an interaction of said cursor with a graphical environment displayed by said host computer, wherein a determination of said force is based at least in part on motion of said mouse object, wherein said reference position is used in said determination of said force.

23. A force feedback mouse interface device as recited in claim 22 wherein said local microprocessor modifies said cursor position by a constant scale mapping instead of a ballistics algorithm when said force is a visual spring force and reports said modified cursor position to said host computer.

24. A force feedback mouse interface device as recited in claim 22 wherein said local microprocessor uses said cursor position to determine said force when said force is a visual spring force.

25. A force feedback mouse interface device as recited in claim 22 wherein said local microprocessor modifies said cursor position for indexing when said mouse position and said cursor position have become offset and when said mouse object is moved within a predetermined distance of a limit to said device workspace.

26. A method for providing enhanced cursor control using a force feedback interface device coupled to a host computer displaying a graphical environment and a cursor within said graphical environment on a display device, the method comprising:

providing a manipulandum to be grasped and moved by a user;

sensing the motion of said manipulandum with respect to a fixed local frame and determining a reference position and reference velocity of said manipulandum within said local frame;

deriving a scaled position from said reference position, wherein a relation between said scaled position and said reference position is influenced by said reference velocity in order to allow different scalings for fine positioning and coarse positioning of said cursor, thereby providing enhanced cursor control to said user when moving said manipulandum;

providing said scaled position for use in said display of said cursor within said graphical environment;

determining whether a force is to be output on said manipulandum using said scaled position, at least in part, in said determination;

computing a force magnitude of said force to be output on said manipulandum using said scaled position, at least in part, in said computation of said force magnitude; and

outputting said computed force to said user through said manipulandum.

27. A method as recited in claim 26 wherein said computing said force magnitude also uses, in part, said reference velocity.

28. A method as recited in claim 27 wherein said computation of said force magnitude includes using said reference velocity for a damping force or a friction force.

29. A method as recited in claim 26 wherein said scaled position is used to check whether said force is to be output by checking if a displayed cursor position causes said cursor to interact with a different graphical object or area in said graphical environment.

30. A method as recited in claim 26 wherein said scaled position is a ballistics position based on said reference velocity of said manipulandum in said local frame, wherein said ballistics position is determined using at least one velocity threshold.

31. A method as recited in claim 26 wherein said scaled position is provided for use in displaying said cursor when a fine positioning mode has been entered.

32. A method as recited in claim 31 wherein said fine positioning mode is entered when said cursor has moved within a predetermined region for a predetermined period pf time.

33. A force feedback interface device for providing enhanced cursor control, said interface device being coupled to a host computer displaying a graphical environment and a cursor within said graphical environment on a display device, the force feedback interface device comprising:

a manipulandum to be grasped and moved by a user;

a sensor that senses the motion of said manipulandum with respect to a fixed local frame and determines a reference position and reference velocity of said manipulandum within said local frame;

an actuator operative to output a force on said manipulandum;

a local microprocessor coupled to said sensor and to said actuator, said local microprocessor

deriving a scaled position from said reference position, wherein the relation between scaled position and reference position is influenced by said reference velocity in order to allow different scalings for fine motion and course motion of said cursor, thereby providing enhanced cursor control to said user when moving said manipulandum,

reporting said scaled position to said host computer, wherein said host computer uses said scaled position in said display of said cursor within said graphical environment;

determining whether a force is to be output on said manipulandum, said local processor using said scaled position, at least in part, in said determination;

computing a force magnitude of said force to be output on said manipulandum, said local microprocessor using said reference position or said reference velocity, at least in part, in said computation of said force magnitude; and

outputting said computed force to said user through said manipulandum by controlling said actuator.

34. A force feedback interface device as recited in claim 33 wherein said local microprocessor also uses said scaled position in the computation of said force magnitude.

35. A force feedback interface device as recited in claim 33 wherein said local microprocessor stores an index value which is the offset between the frame of the reference position and the frame of the scaled position.

36. A method as recited in claim 33 wherein said scaled position is a ballistics position based on said reference velocity of said manipulandum in said local frame, wherein said ballistics position is determined using at least one velocity threshold.

37. A method for providing enhanced cursor control using a force feedback interface device coupled to a host computer displaying a graphical environment and a cursor within said graphical environment on a display device, the method comprising:

(a) reading a position of a manipulandum in a device workspace as a reference position, said manipulandum being grasped by a user;

(b) reporting a cursor position to said host computer, wherein said cursor position is said reference position that has been modified to a position allowing fine positioning or coarse movement of said cursor to provide enhanced cursor control to said user when moving said manipulandum, wherein said host computer displays said cursor within said graphical environment on said display device at a position corresponding to said cursor position, and wherein said cursor position that has been modified is a scaled reference position that allows fine positioning of said cursor, said scaling of said reference position being performed only when fine positioning is determined to be necessary for positioning said cursor;

(c) determining whether a force is output on said manipulandum based on an interaction of said cursor and said graphical environment;

(d) determining a force, wherein if said force is at least in part based on motion of said manipulandum, said reference position is used in said determination of said force; and

(e) outputting said determined force on said manipulandum.

38. A method as recited in claim 37 wherein said fine positioning is determined to be necessary for positioning said cursor when said cursor moves within a region of predetermined size for longer than a predetermined time period.

39. A computer readable medium including program instructions for providing enhanced cursor control for an interface device, said interface device coupled to a host computer displaying a graphical environment and a cursor within said graphical environment on a display device, said program instructions performing the following:

reading a position of a manipulandum in a device workspace as a reference position, said manipulandum being grasped by a user;

reporting a cursor position to said host computer, wherein said cursor position is a ballistic position, said ballistic position being said reference position that has been modified according to a ballistics algorithm, said ballistics algorithm allowing fine positioning of said cursor at relatively slower movement of said manipulandum and allowing coarse movement of said cursor at relatively faster movement of said manipulandum, and wherein said host computer displays said cursor within said graphical environment on said display device at a position corresponding to said cursor position;

determining whether a force is to be output on said manipulandum based on an interaction of said cursor and said graphical environment;

determining said force, wherein if said determination of said force is at least in part based on motion of said manipulandum, said reference position is used in said determination of said force; and

outputting said determined force on said manipulandum.

40. A computer readable medium as recited in claim 39 wherein said program instructions determine said force using said cursor position instead of said reference position if said force is a visual spring force.

41. A computer readable medium as recited in claim 39 wherein said program instructions determine whether said force is to be output using said cursor position.