Apparatus for providing vibrotactile sensory substitution of force feedback

• US 5,619,180 A
• Filed: 11/03/1993
• Issued: 04/08/1997
• Est. Priority Date: 01/14/1993
• Status: Expired due to Fees

• Current Assignee: Massachusetts Institute of Technology
• Original Assignee: Massachusetts Institute of Technology
• Inventors: Sheridan, Thomas B., Patrick, Nicholas J. M., Massimino, Michael J.
• Primary Examiner(s): Crosland, Donnie L.
• Application Number:
  US08/147,213
• Time in Patent Office: 1,252 Days
• Field of Search: 340/407.1, 340/407.2, 340/825.19, 340/680, 341/21, 434/112, 434/113, 434/116
• US Class Current: 340/407.1
• CPC Class Codes: B25J 9/1689 Teleoperation
• CPC Class Codes: G05B 2219/40134 Force sensation of slave converted to vibration for operator
• CPC Class Codes: G05B 2219/40145 Force sensation of slave converted to audio signal for operator
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves

Abstract

A feedback apparatus for an operator to control an effector that is remote from the operator to interact with a remote environment has a local input device to be manipulated by the operator. Sensors in the effector'"'"'s environment are capable of sensing the amplitude of forces arising between the effector and its environment, the direction of application of such forces, or both amplitude and direction. A feedback signal corresponding to such a component of the force, is generated and transmitted to the environment of the operator. The signal is transduced into a vibrotactile sensory substitution signal to which the operator is sensitive. Vibration producing apparatus present the vibrotactile signal to the operator. The full range of the force amplitude may be represented by a single, mechanical vibrator. Vibrotactile display elements can be located on the operator'"'"'s limbs, such as on the hand, fingers, arms, legs, feet, etc. The location of the application of the force may also be specified by the location of a vibrotactile display on the operator'"'"'s body. Alternatively, the location may be specified by the frequency of a vibrotactile signal.

Claims

1. An apparatus for an operator to control an effector that is remote from the operator to interact with an environment that is also remote from the operator by operator manipulation of an input device in an environment local to the operator, said apparatus comprising:

a. at least one means for sensing an amplitude of at least one force arising between the remote effector and the remote environment;

b. means for generating a force feedback signal that corresponds to the amplitude of said sensed force;

c. means for transmitting said force feedback signal from said remote environment to the location of said operator;

d. means for transducing said force feedback signal into a vibrotactile sensory substitution signal to which the operator is sensitive; and

e. means for presenting said transduced sensory substitution signal to a vibrotactile system of the operator that is receptive to said vibrotactile sensory substitution signal such that a full range of force amplitude may be represented by said means for presenting said transduced vibrotactile sensory substitution signal.

2. The apparatus of claim 1, said means for transducing comprising means for representing variations of a preselected component of said force feedback signal by variations of an amplitude of said vibrotactile sensory substitution signal.

3. The apparatus of claim 1, said means for transducing comprising means for representing variations of a preselected component of said force feedback signal by variations of a frequency of said vibrotactile sensory substitution signal.

4. The apparatus of claim 1, said means for presenting said transduced sensory substitution signal comprising means for presenting said vibration signal to a plurality of different receptive locations on the operator, each location corresponding to a different of said at least one forces arising between the remote effector and the remote environment.

5. The apparatus of claim 1, said means for presenting said transduced sensory substitution signal comprising at least one mechanical vibrator.

6. The apparatus of claim 5, said means for presenting said vibration signal comprising means for attaching said at least one vibrator to the operator'"'"'s hand.

7. The apparatus of claim 5, said means for presenting said vibration signal comprising means for attaching said at least one vibrator to the operator'"'"'s head.

8. The apparatus of claim 6, said means for attaching said at least one vibrator to the operator'"'"'s hand comprising means for attaching said at least one vibrator to at least one of the operator'"'"'s fingers.

9. The apparatus of claim 6, said means for attaching said at least one vibrator to the operator'"'"'s hand comprising means for attaching said at least one vibrator to the operator'"'"'s wrist.

10. The apparatus of claim 5, said means for presenting said vibration signal comprising means for attaching said at least one vibrator to the operator'"'"'s waist.

11. An apparatus for an operator to control an effector that is remote from the operator to interact with an environment that is also remote form the operator by operator manipulation of an input device in an environment local to the operator, said apparatus comprising:

a. with respect to at least one force arising between the remote effector and the remote environment, said force acting along a direction, at least one means for sensing said direction of said at least one force;

b. means for generating a force feedback signal that corresponds to the direction along which said sensed force acts, said feedback signal being characterized by at least one component having a frequency and amplitude;

c. means for transmitting said force feedback signal from said remote environment to the location of said operator;

d. means for transducing said force feedback signal into a vibrotactile sensory substitution signal to which the operator is sensitive; and

e. means for presenting said transduced vibrotactile sensory substitution signal to a vibrotactile sensory system of the operator that is receptive to said sensory substitution signal.

12. The apparatus of claim 11, said means for transducing comprising means for representing variations of a preselected component of said force feedback signal by variations of an amplitude of the vibrotactile sensory substitution signal.

13. The apparatus of claim 11, said means for transducing comprising means for representing variations of a preselected component of said force feedback signal by variations of a frequency of the vibrotactile sensory substitution signal.

14. The apparatus of claim 11, said means for presenting said transduced vibrotactile sensory substitution signal comprising means for presenting said vibration signal to a plurality of different receptive locations on the operator, each location corresponding to a different of said at least one forces arising between the remote effector and the remote environment.

15. The apparatus of claim 11, said means for presenting said transduced vibrotactile sensory substitution signal comprising at least one mechanical vibrator.

16. The apparatus of claim 15, said means for presenting said vibrotactile sensory substitution signal comprising means for attaching said at least one vibrator to the operator'"'"'s hand.

17. The apparatus of claim 15, said means for presenting said vibrotactile sensory substitution signal comprising means for attaching said at least one vibrator to the operator'"'"'s head.

18. The apparatus of claim 16, said means for attaching said at least one vibrator to the operator'"'"'s hand comprising means for attaching said at least one vibrator to at least one of the operator'"'"'s fingers.

19. The apparatus of claim 16, said means for attaching said at least one vibrator to the operator'"'"'s hand comprising means for attaching said at least one vibrator to the operator'"'"'s wrist.

20. The apparatus of claim 16, said means for attaching said at least one vibrator to the operator'"'"'s hand comprising means for attaching said at last one vibrator to the operator'"'"'s palm.

21. The apparatus of claim 15, said means for presenting said vibration signal comprising means for attaching said at least one vibrator to the operator'"'"'s waist.

22. The apparatus of claim 12, said vibrotactile sensory substitution signal being characterized by at least two components, each having a frequency and an amplitude, said means for representing variations of a preselected component of said force feedback signal by variations of an amplitude of the vibrotactile sensory substitution signal comprising means for combining variations of the amplitudes of said at least two components of the vibrotactile sensory substitution signal.

23. An apparatus for an operator to control an effector that is remote from the operator to interact with an environment that is also remote from the operator by operator manipulation of an input device in an environment local to the operator, said apparatus comprising:

a. with respect to at least one force arising between the remote effector and the remote environment, said force acting at a location of the effector, at least one means for sensing said location at which said force acts;

b. means for generating a force feedback signal that corresponds to the location of said sensed force;

c. means for transmitting said force feedback signal from said remote environment to the location of said operator;

d. means for transducing said force feedback signal into a vibrotactile sensory substitution signal to which the operator is sensitive; and

e. means for presenting said transduced vibrotactile sensory substitution signal to a vibrotactile system of the operator that is receptive to said sensory substitution signal.

24. An apparatus for an operator having a vibrotactile system to receive information regarding an environment remote from the operator, said apparatus comprising:

a. an input device located in an environment local to the operator;

b. an effector located in the remote environment;

c. means for generating a signal in response to manipulation of the input device;

d. means for manipulating said effector in response to said signal representative of manipulation of the input device;

e. at least one means for sensing a force arising between the effector and the remote environment;

f. means for generating a force feedback signal that corresponds to said sensed force;

g. means for transmitting said force feedback signal from said remote environment to the location of said operator;

h. means for transducing said force feedback signal into a vibrotactile sensory substitution signal to which the operator is sensitive; and

i. means for presenting said transduced sensory substitution signal to a vibrotactile system of the operator that is receptive to said vibrotactile sensory substitution signal.