Tactile feedback device providing tactile sensations from host commands

• US 6,580,417 B2
• Filed: 03/22/2001
• Issued: 06/17/2003
• Est. Priority Date: 07/16/1993
• Status: Expired due to Fees

• Current Assignee: Immersion Corporation Delaware
• Original Assignee: Immersion Corporation
• Inventors: Rosenberg, Louis B., Braun, Adam C., Levin, Mike D.
• Primary Examiner(s): BRIER, JEFFERY A
• Application Number:
  US09/815,872
• Publication Number:
  US 20010030658A1
• Time in Patent Office: 817 Days
• Field of Search: 345/156, 345/157, 345/161, 345/163, 345/184, 345/701, 463/30, 463/38, 434/45, 244/223, 318/568.1, 318/568.11
• US Class Current: 345/157
• CPC Class Codes: A63F 13/21 characterised by their sensors, purposes or types
• CPC Class Codes: A63F 13/23 for interfacing with the game device, e.g. specific interfaces between game controller and console
• CPC Class Codes: A63F 13/24 Constructional details thereof, e.g. game controllers with detachable joystick handles
• CPC Class Codes: A63F 13/285 Generating tactile feedback signals via the game input device, e.g. force feedback
• CPC Class Codes: A63F 13/57 Simulating properties, behaviour or motion of objects in the game world, e.g. computing tyre load in a car race game A63F13/56 takes precedence
• CPC Class Codes: A63F 13/803 Driving vehicles or craft, e.g. cars, airplanes, ships, robots or tanks
• CPC Class Codes: A63F 2300/1006 having additional degrees of freedom
• CPC Class Codes: A63F 2300/1025 details of the interface with the game device, e.g. USB version detection
• CPC Class Codes: A63F 2300/1037 being specially adapted for converting control signals received from the game device into a haptic signal, e.g. using force feedback
• CPC Class Codes: A63F 2300/1043 being characterized by constructional details
• CPC Class Codes: A63F 2300/64 for computing dynamical parameters of game objects, e.g. motion determination or computation of frictional forces for a virtual car
• CPC Class Codes: A63F 2300/8017 Driving on land or water; Flying
• CPC Class Codes: A63F 2300/8082 Virtual reality
• CPC Class Codes: B25J 9/1692 Calibration of manipulator
• CPC Class Codes: G01B 21/04 by measuring coordinates of points
• CPC Class Codes: G01B 5/008 using coordinate measuring machines
• CPC Class Codes: G01B 7/004 for measuring coordinates of points
• CPC Class Codes: G05B 19/4207 in which a model is traced or scanned and corresponding data recorded
• CPC Class Codes: G05G 2009/04766 providing feel, e.g. indexing means, means to create counterforce
• CPC Class Codes: G05G 2009/04777 with additional push or pull action on the handle
• CPC Class Codes: G05G 9/047 : the controlling member being movable by hand about orthogonal axes, e.g. joysticks for switches H01H25/04
• CPC Class Codes: G06F 2203/014 : Force feedback applied to GUI
• CPC Class Codes: G06F 2203/015 : Force feedback applied to a joystick
• CPC Class Codes: G06F 3/011 : Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 : Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/038 : Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0383 : Signal control means within the pointing device
• CPC Class Codes: H01H 2003/008 : with a haptic or a tactile feedback controlled by electrical means, e.g. a motor or magnetofriction

Abstract

A method and apparatus for controlling and providing force feedback using an interface device manipulated by a user. A microprocessor is provided local to the interface device and reads sensor data from sensors that describes the position and/or other information about a user object moved by the user, such as a joystick. The microprocessor controls actuators to provide forces on the user object and provides the sensor data to a host computer that is coupled to the interface device. The host computer sends high level host commands to the local microprocessor, and the microprocessor independently implements a local reflex process based on the high level command to provide force values to the actuators using sensor data and other parameters. A provided host command protocol includes a variety of different types of host commands and associated command parameters. By providing a relatively small set of high level host commands and parameters which are translated into a panoply of forces, the protocol further shifts the computational burden from the host computer to the local microprocessor and allows a software developer to easily create force feedback applications.

Claims

1. A tactile feedback computer peripheral device in communication with a host computer running a graphical environment, the peripheral device comprising:

a user manipulatable object on said tactile feedback computer peripheral device, said user manipulatable object moveable by said user in at least one degree of freedom;

at least one sensor within said tactile feedback computer peripheral device, said sensor detecting the position or motion of said user maniputable object;

at least one button on said tactile feedback computer peripheral device, said button depressible by a user;

at least one actuator within said tactile feedback computer peripheral device, said actuator operative to output forces based on a control signal; and

a controller local to said tactile peripheral device, said controller enabled to

repeatedly read signals from said at least one sensor,

repeatedly read signals from said at least one button,

repeatedly report data representing the state of said sensor and said button over a communication channel to a host computer,

receive over said communication channel a plurality of different host commands sent from said host computer, at least one of said host commands being a force command sent by said host computer in response to a collision between at least two objects in said graphical environment, and

control at least one actuator in response to said force command so as to create one or more forces felt by the user of said tactile feedback computer peripheral,

wherein said force command describes a tactile sensation to be associated with said collision and caused by said one or more forces, wherein said host command includes a command identifier for identifying said tactile sensation and at least one command parameter that characterizes said tactile sensation, wherein said at least one command parameter includes a deadband parameter that specifies a predetermined deadband region of one of said degrees of freedom in which a force output magnitude is to be approximately zero, and wherein said predetermined deadband region is centered at an origin position of said user manipulatable object in said degree of freedom.

2. A tactile feedback computer peripheral device as recited in claim 1 wherein said tactile sensation described by said host command is a restoring spring force having said deadband region.

3. A tactile feedback computer peripheral device as recited in claim 2 wherein said restoring spring force controls a rate control function of host software run by a host computer in communication with said tactile feedback computer peripheral device.

4. A tactile feedback computer peripheral device as recited in claim 1 wherein said tactile sensation described by said host command is a groove sensation having said deadband region.

5. A tactile feedback computer peripheral device in communication with a host computer running a graphical environment, the peripheral device comprising:

a user manipulatable object on said tactile feedback computer peripheral device, said user manipulatable object moveable by said user in at least one degree of freedom;

at least one sensor within said tactile feedback computer peripheral device, said sensor operative to detect the position or motion of said user maniputable object;

at least one actuator within said tactile feedback computer peripheral device, said actuator operative to output forces on said user manipulatable object based on a control signal; and

a controller local to said tactile peripheral device, said controller enabled to

repeatedly read signals from said at least one sensor,

repeatedly report data representing the state of said sensor over a communication channel to a host computer,

receive over said communication channel a plurality of different host commands sent from said host computer, at least one of said host commands being a force command sent by said host computer in response to a collision between at least two objects in said graphical environment, one of said objects being influenced by said data representing the state of said sensor, and

provide said control signal to said at least one actuator in response to said force command so as to create one or more forces felt by the user of said tactile feedback computer peripheral,

wherein said force command describes a tactile sensation to be associated with and correlated with said collision and caused by said one or more forces, wherein said host command includes a command identifier for identifying said tactile sensation and at least one command parameter that characterizes said tactile sensation, and wherein said force command also includes a deadband parameter indicating a size of a deadband region around an origin position of said user manipulatable object, wherein no forces are output when said user manipulatable object is in said deadband region.

6. A tactile feedback computer peripheral device as recited in claim 5 wherein said at least one command parameter includes a saturation parameter that specifies a maximum force output for said tactile sensation for one of said degrees of freedom.

7. A tactile feedback computer peripheral device as recited in claim 6 wherein said saturation parameter specifies said maximum force output for a displacement of said user manipulatable object, said tactile sensation being a spring force sensation.

8. A tactile feedback computer peripheral device as recited in claim 6 wherein said saturation parameter is expressed as a percentage of the maximum force output of said at least one actuator.

9. A tactile feedback computer peripheral device as recited in claim 6 wherein said tactile sensation is a condition force sensation.

10. A tactile feedback computer peripheral device as recited in claim 6 wherein said tactile sensation is a barrier tactile sensation that provides a resistive force applied to said user manipulatable object that increases linearly with motion of said user manipulatable object into a barrier region.

11. A tactile feedback computer peripheral device as recited in claim 10 wherein said host command also includes a hardness parameter that indicates a magnitude of resistance force applied to said user manipulatable object when said user manipulatable object is within said barrier region.

12. A tactile feedback computer peripheral device as recited in claim 10 wherein said host command also includes a location parameter that indicates a location of said barrier region in said degree of freedom of said user manipulatable object.

13. A tactile feedback computer peripheral device as recited in claim 10 wherein an assistive force is applied to said user manipulatable object immediately after said user manipulatable object moves through said barrier region.

14. A tactile feedback computer peripheral device in communication with a host computer running a graphical environment, the peripheral device comprising:

a user manipulatable object on said tactile feedback computer peripheral device, said user manipulatable object moveable by said user in at least one degree of freedom;

at least one sensor within said tactile feedback computer peripheral device, said sensor detecting the position or motion of said user maniputable object;

at least one actuator within said tactile feedback computer peripheral device, said actuator operative to output forces based on a control signal; and

a controller local to said tactile peripheral device, said controller enabled to

read signals from said at least one sensor and report data representing the state of said sensor over a communication channel to a host computer,

receive over said communication channel a plurality of different host commands sent from said host computer, at least one of said host commands being a force command sent by said host computer in response to an event or interaction in said graphical environment, and

control at least one actuator in response to said force command so as to create one or more forces felt by the user of said tactile feedback computer peripheral,

wherein said force command describes a tactile sensation to be associated with said event or interaction and caused by said one or more forces, wherein said host command includes a command identifier for identifying said tactile sensation and at least one command parameter that characterizes said tactile sensation, wherein said at least one command parameter includes a deadband parameter that specifies a size of a deadband region of one of said degrees of freedom, wherein force output magnitude is to be approximately zero while said user manipulatable object is in said deadband region, said deadband region being centered approximately around an origin position of said user manipulatable object.

15. A tactile feedback computer peripheral device as recited in claim 14 wherein said tactile sensation described by said host command is a groove sensation having said deadband region as a center region of said groove sensation.

16. A tactile feedback computer peripheral device as recited in claim 15 wherein a restoring force biases said user manipulatable object on either side of said center region, said bias being toward said center region.

17. A tactile feedback computer peripheral device as recited in claim 16 wherein said restoring force is applied only within a region determined by a predetermined snap-out distance from said center region.

18. A tactile feedback computer peripheral device as recited in claim 15 wherein a center of said center region is approximately aligned with a graphical object displayed in a graphical environment by a host computer in communication with said tactile feedback interface device.

19. A tactile feedback computer peripheral device as recited in claim 15 wherein said groove sensation is provided in a position control paradigm with host software run by said host computer.