System and method for outputting haptic effects in a mouse device

• US 9,465,438 B2
• Filed: 08/04/2006
• Issued: 10/11/2016
• Est. Priority Date: 06/23/1998
• Status: Expired due to Fees

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Rosenberg, Louis B., Martin, Kenneth M.
• Primary Examiner(s): Yodichkas, Aneeta
• Assistant Examiner(s): FOX, JOSEPH PATRICK
• Application Number:
  US11/499,425
• Publication Number:
  US 20060267944A1
• Time in Patent Office: 3,721 Days
• Field of Search: 345163-166
• US Class Current: 1/1
• CPC Class Codes: A63F 13/24 Constructional details thereof, e.g. game controllers with detachable joystick handles
• CPC Class Codes: A63F 13/285 Generating tactile feedback signals via the game input device, e.g. force feedback
• CPC Class Codes: A63F 2300/1037 being specially adapted for converting control signals received from the game device into a haptic signal, e.g. using force feedback
• CPC Class Codes: A63F 2300/1062 being specially adapted to a type of game, e.g. steering wheel
• CPC Class Codes: A63F 2300/8017 Driving on land or water; Flying
• CPC Class Codes: G06F 2203/013 Force feedback applied to a game
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 2203/015 Force feedback applied to a joystick
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0338 with detection of limited linear or angular displacement of an operating part of the device from a neutral position, e.g. isotonic or isometric joysticks
• CPC Class Codes: G06F 3/03543 Mice or pucks G06F3/03541 takes precedence
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0362 with detection of 1D translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]

Abstract

A low-cost tactile feedback mouse device for providing haptic feedback to a user for enhancing interactions and manipulations in a graphical environment provided by a computer. The mouse device includes a sensor device able to detect the movement of the mouse in the planar workspace. An actuator is coupled to the housing of the mouse and applies an inertial force in a particular degree of freedom, preferably along an axis perpendicular to the planar workspace, where the inertial force is transmitted through the housing to the user. The actuator outputs the inertial force preferably by linearly moving an inertial mass along the Z-axis. The output force is correlated with interaction of a controlled graphical object, such as a cursor, with other graphical objects in a graphical environment displayed by the host computer. The inertial force can be a pulse, vibration, texture force, or other type of force.

Claims

1. A memory device readable by a machine, tangibly embodying a program of instructions executable by the machine to perform a method of outputting haptic effects to a computer mouse, the method comprising:

receiving a locative signal associated with sensed movement of the computer mouse along a plane associated with a surface, wherein the locative signal controls movement of a graphical object in a graphical user interface (GUI);

outputting a first force feedback signal to a first actuator of the computer mouse in response to an event independent of an input from the computer mouse, wherein the first force feedback signal is based at least in part on data stored in a lookup table of force values, wherein the first actuator is a linear actuator, and wherein the first actuator is mounted at substantially the center along both the X and Y axes of the computer mouse; and

outputting a second force feedback signal to a second actuator of the computer mouse;

wherein a first haptic effect associated with the first force feedback signal is output by the first actuator, the first haptic effect comprising a combination of at least two haptic effects output substantially simultaneously, and wherein the first actuator is configured to apply the first haptic effect in a direction substantially perpendicular to the plane;

wherein a second haptic effect associated with the second force feedback signal is output by the second actuator, the second actuator configured to apply the second haptic effect in a direction substantially parallel to the plane by frictional contact with a planar surface;

wherein the computer mouse comprises an optical mouse and wherein the first and second force feedback signals are determined by a processor that controls an optical sensor;

wherein the computer mouse comprises a housing having a first portion and a second portion, the first portion coupled to the second portion by a flexible coupling; and

wherein the computer mouse is configured to be moveable in an unbounded workspace.

2. The memory device of claim 1, wherein the first force feedback signal is output to the first actuator when a button of the computer mouse is sensed being depressed.

3. The memory device of claim 1, wherein the first haptic effect is a vibration output substantially continuously over a period of time and comprises a magnitude and a frequency, wherein at least one of the magnitude and frequency changes based on a sensed rate of movement of the computer mouse over the period of time.

4. The memory device of claim 1, wherein a designated location comprises a first designated location and a second designated location, and wherein the first haptic effect is associated with the graphical object at the first designated location and the second haptic effect associated with the graphical object at the second designated location, wherein the first haptic effect is greater than the second haptic effect.

5. The memory device of claim 4, wherein the first or second designated location is a border of an interactive item in the GUI.

6. The memory device of claim 4, wherein the first or second designated location is within borders of an interactive item in the GUI.

7. The memory device of claim 1, wherein the first actuator outputs a plurality of haptic effects when the graphical object is positioned in an area within perimeter borders of an interactive item in the GUI.

8. The memory device of claim 1, wherein a designated item is at a designated location in the GUI, the designated item being a graphical menu having a plurality of individual objects, wherein the first haptic effect is output by the first actuator when the graphical object is moved over a boundary position of the designated item.

9. The memory device of claim 1, wherein the flexible coupling comprises a flexible hinge.

10. A memory device readable by a machine, tangibly embodying a program of instructions executable by the machine to perform a method of outputting haptic effects to a computer mouse, the method comprising:

providing a graphical user interface (GUI) having a graphical object controllable by the computer mouse;

receiving a locative signal associated with a sensed movement of the computer mouse along a first plane;

updating a value associated with the graphical object in response to the received position signal;

outputting a first force feedback signal to a first actuator in the computer mouse device in response to an event independent of an input from the computer mouse, wherein the first force feedback signal is based at least in part on data stored in a lookup table of force values, the first actuator configured to output a first haptic effect associated with the first force feedback signal, wherein the first actuator is a linear actuator, and wherein the first actuator is mounted at substantially the center along both the X and Y axes of the computer mouse; and

outputting a second force feedback signal to a second actuator of the computer mouse, the second actuator configured to output a second haptic effect associated with the second force feedback signal;

wherein the first haptic effect comprises a combination of at least two haptic effects output substantially simultaneously and is in a direction substantially perpendicular to the first plane;

wherein the second haptic effect is in a direction substantially parallel to the plane by frictional contact with a planar surface;

wherein the computer mouse comprises a housing having a first portion and a second portion, the first portion coupled to the second portion by a flexible coupling;

wherein the computer mouse comprises an optical mouse and wherein the first and second force feedback signals are determined by a processor that controls an optical sensor; and

wherein the computer mouse is configured to be moveable in an unbounded workspace.

11. The memory device of claim 10, wherein the first force feedback signal is output to the first actuator when a button of the computer mouse is sensed being depressed.

12. The memory device of claim 10, wherein the first haptic effect is a vibration output substantially continuously over a period of time and comprises a magnitude and a frequency, wherein at least one of the magnitude and frequency changes based on a sensed rate of movement of the computer mouse over time.

13. The memory device of claim 10, wherein a designated location comprises a first designated location and a second designated location, and wherein the first haptic effect is associated with the graphical object at the first designated location and the second haptic effect is associated with the graphical object at the second designated location, wherein the first haptic effect is greater than the second haptic effect.

14. The memory device of claim 13, wherein the first or second designated location is a border of an interactive item in the GUI.

15. The memory device of claim 13, wherein the first or second designated location is within borders of an interactive item in the GUI.

16. The memory device of claim 10, wherein the first actuator outputs a plurality of haptic effects when the graphical object is positioned in an area within perimeter borders of an interactive item in the GUI.

17. The memory device of claim 10, wherein a designated item is at a designated location, the designated item being a graphical menu having a plurality of individual objects, wherein the first haptic effect is output by the first actuator when the graphical object is moved over a boundary position of the designated item.

18. Processor-executable code encoded on a memory device, the processor-executable code adapted to be run by a host computer coupled to a mouse device operated by a user, the code comprising:

code to receive a locative signal associated with sensed movement of the computer mouse along a plane associated with a surface, wherein the locative signal controls movement of a graphical object in a graphical user interface (GUI);

code to output a first force feedback signal to a first actuator of the computer mouse in response to an event independent of an input from the computer mouse, wherein the first force feedback signal is based at least in part on data stored in a lookup table of force values, wherein a first haptic effect associated with the first force feedback signal is output by the first actuator, wherein the first haptic effect comprises a combination of at least two different haptic effects output substantially simultaneously, the first actuator configured to apply the first haptic effect along an axis substantially perpendicular to the plane, wherein the first actuator is a linear actuator, and wherein the first actuator is mounted at substantially the center along both the X and Y axes of the computer mouse;

code to output a second force feedback signal to a second actuator of the computer mouse, the second actuator configured to output a second haptic effect in a direction substantially parallel to the first plane by frictional contact with a planar surface, the second haptic effect associated with the second force feedback signal,

wherein the computer mouse comprises a housing having a first portion and a second portion, the first portion coupled to the second portion by a flexible coupling,

wherein the computer mouse comprises an optical mouse and wherein the first and second force feedback signals are determined by a processor that controls an optical sensor; and

wherein the computer mouse is configured to be moveable in an unbounded workspace.

19. The memory device of claim 18, wherein the at least two different haptic effects comprise a pulse and a vibration.