Environment sensor that conveys information about objects in the vicinity of the visually impaired user

• US 7,755,744 B1
• Filed: 08/15/2007
• Issued: 07/13/2010
• Est. Priority Date: 08/15/2007
• Status: Active Grant

• Current Assignee: Thomas Leberer
• Original Assignee: Thomas Leberer
• Inventors: Leberer, Thomas
• Primary Examiner(s): ALSOMIRI, ISAM A
• Application Number:
  US11/893,579
• Time in Patent Office: 1,063 Days
• Field of Search: 356/4.01, 356/5.1, 367/116, 343/114
• US Class Current: 356/5.1
• CPC Class Codes: G01C 3/08 Use of electric radiation detectors
• CPC Class Codes: G09B 21/00 Teaching, or communicating with, the blind, deaf or mute audible presentation of material to be studied G09B5/04; devices or methods for replacing direct visual or auditory perception by another kind of perception A61F9/08, A61F11/04; audible indication of meter readings or of colour G01D7/12; watches for blind persons G04B25/02; speech analysis, speech recognition G10L; sound-recording or reproducing, per se G11B
• CPC Class Codes: G09B 21/003 using tactile presentation of the information, e.g. Braille displays

Abstract

The present invention relates generally to the field of virtual tactile sensing, specifically to the field of virtual extension of the senses of the fingertips. Specifically, the present invention is the tactile transfer of environment information to the fingertips of the operator in the form of a line. The present invention senses information regarding distance, thermal values and optical spectrum values and conveys this information to the operator by means of mechanical movements and/or thermal changes of the actuators. These actuators are the equivalent of placing the operator'"'"'s fingertips on the object. The device as a whole acts as an extension of the hand that senses information by placing virtual fingertips on an object and conveys that information to the operator'"'"'s fingertips.

Claims

1. An environment sensing device for a visually impaired user capable of real-time tactile transference of environmental information to a user to simulate touching an object with the fingertips, the environment sensing device comprising:

a. a single housing member having at least a handle and retaining all components of the environment sensing device;

b. an electro-opto modulator that generates a line of modulated light such that the light has a phase shift from 0°

to 90°

, the reflection of the modulated light from a scanned object is received by the environment sensing device and a distance of the object from the environment sensing device is determined;

c. a phase comparator having at least eight phase comparators, that determine a difference in phase between the light sent by the electro-opto modulator and light received by the environment sensing device;

d. a 3-D line sensor having at least eight photo-diodes, one each to correspond with a phase comparator, that detects, receives, and transmits signals regarding reflected light;

e. a single light source directed orthogonally from the environment sensing device and controlled, in part, by said electro-opto modulator;

f. a processing and control apparatus that determines the distance of the reflected light from an object and controls said electro-opto modulator system, said phase comparator, and an output apparatus;

g. the output apparatus having at least one column of tactile elements displaceable continuously along a path perpendicular to the handle of the housing as a two dimensional representation of the distances measured by said environment sensing device, which are displaced by mechanical actuators, said displacement conveying to the user the physical shape, contours and texture of the scanned object; and

h. a wireless, lightweight, power supply located in said housing member, which powers the environment and sensing device.

2. The environment sensing device in accordance with claim 1, wherein said output apparatus includes a piezo drive actuator.

3. The environment sensing device in accordance with claim 1, wherein said 3-D line sensor includes a temperature sensing apparatus.

4. The environment sensing device in accordance with claim 1, wherein said 3-D line sensor includes a color sensing apparatus.

5. The environment sensing device in accordance with claim 1, wherein said 3-D line sensor includes a magnetic field sensing apparatus.

6. The environment sensing device in accordance with claim 1, wherein said 3-D line sensor is waterproof.

7. The environment sensing device in accordance with claim 1, wherein said 3-D line sensor can operate effectively in a water medium.

8. An environment sensing device for a visually impaired user capable of real-time tactile transference of environmental information to a user to simulate touching an object with the fingertips, the environment sensing device comprising:

a. a single housing member having at least a handle and retaining all components of the sensing device;

b. an electro-opto modulator that generates a line of modulated light such that the light has a phase shift and reflection of the modulated light from a scanned object is received by the environment sensing device and from which the distance of the scanned object from the environment sensing device is determined;

c. a phase comparator having at least eight phase comparators, that determine a difference in phase between the light sent by the electro-opto modulator and light received by the environment sensing device;

d. 3-D line sensor having at least eight photo-diodes, one each to correspond with a phase comparator, that detects, receives, and transmits signals regarding reflected light;

e. a single light source directed orthogonally from the environment sensing device and controlled, in part, by said electro-opto modulator;

f. a processing and control apparatus that determines the distance of the light from reflected the scanned object and controls said electro-opto modulator, said phase comparator, and an output apparatus;

g. the output apparatus having at least one column of tactile elements displaceable continuously along a path perpendicular to the handle of the housing body as a two dimensional representation of the distances measured by said environment sensing device, said displacement of said tractile elements conveying to the user the physical shape, contours and texture of the scanned object; and

h. a wireless, lightweight, power supply located in said housing member which powers the environment sensing device.

9. The environment sensing device in accordance with claim 8, wherein said output apparatus includes a piezo drive actuator.

10. The environment sensing device in accordance with claim 8, wherein said 3-D line sensor includes a temperature sensing apparatus.

11. The environment sensing device in accordance with claim 8, wherein said 3-D line sensor includes a color sensing apparatus.

12. The environment sensing device in accordance with claim 8, wherein said 3-D line sensor includes a magnetic field sensing apparatus.

13. The environment sensing device in accordance with claim 8, wherein said 3-D line sensor is waterproof.

14. The environment sensing device in accordance with claim 8, wherein said 3-D line sensor can operate effectively in a water medium.

15. An environment sensing device for a visually impaired user capable of real-time tactile transference of environmental information to a user to simulate touching an object with the fingertips, the environment sensing device comprising:

a. a single housing member having at least a handle and retaining all components of the sensing device;

b. an electro-opto modulator that generates a line of modulated light, such that reflection of the modulated light from a scanned object is received by the environment sensing device and from which distance between the scanned object and the environment sensing device is determined;

c. a phase comparator having at least eight phase comparators, that determine a difference in phase between the light sent by the electro-opto modulator and light received by the environment sensing device;

d. 3-D line sensor having at least eight photo-diodes, one each to correspond with a phase comparator, that detects, receives, and transmits signals regarding reflected light;

e. a single light source directed orthogonally from the 3-D line sensor and controlled, in part, by said electro-opto modulator;

f. a processing and control apparatus that determines the distance of the reflected light from a scanned object and controls said electro-opto modulator, said phase comparator, and an output system apparatus;

g. the output apparatus having at least one column of tactile elements displaceable continuously along a path perpendicular to the handle of the housing as a two dimensional representation of the distances measured by said environment sensing device, which are displaced by mechanical actuators, said displacement conveying to the user the physical shape, contours and texture of the scanned object; and

h. a wireless, lightweight, power supply located in said housing member, which powers the environment sensing device.

16. The environment sensing device in accordance with claim 15, wherein said output apparatus includes a piezo drive actuator.

17. The environment sensing device in accordance with claim 15, wherein said 3-D line sensor includes a temperature sensing apparatus.

18. The environment sensing device in accordance with claim 15, wherein said 3-D line sensor includes a color sensing apparatus.

19. The environment sensing device in accordance with claim 15, wherein said 3-D line sensor includes a magnetic field sensing apparatus.

20. The environment sensing device in accordance with claim 15, wherein said 3-D line sensor is waterproof.

21. The environment sensing device in accordance with claim 15, wherein said 3-D line sensor can operate effectively in a water medium.

22. An environment sensing device capable of real-time tactile transference of environmental information to fingertips of a user, the environment sensing device comprising:

a. a single housing member having at least a handle and retaining all components of the sensing device;

b. an electro-opto modulator that generates a line of modulated light, such that reflection of the modulated light from a scanned object is received by the environment sensing device and from which distance between the scanned object and the environment sensing device is determined;

c. a phase comparator having at least eight phase comparators, that determine a difference in phase between the light sent by the electro-opto modulator and light received by the environment sensing device;

d. 3-D line sensor having at least eight photo-diodes, one each to correspond with a phase comparator, that detects, receives, and transmits signals regarding reflected light;

e. a processing and control apparatus that determines the distance of the reflected light from a scanned object and controls said electro-opto modulator, said phase comparator, and an output apparatus;

f. the output apparatus having at least one column of tactile elements displaceable continuously along a path perpendicular to the handle of the housing as a two dimensional representation of the distances measured by said environment sensing device, which are displaced by mechanical actuators, said displacement conveying to the user the physical shape, contours and texture of the scanned object; and

g. a wireless, lightweight, power supply system located in said housing member, which powers the environment sensing device.

23. The environment sensing device in accordance with claim 22, wherein a sweeping motion of the device causes the displacement of the pins in the output apparatus to convey to the user the shape, contours and texture of the object scanned.

24. The environment sensing device in accordance with claim 22, wherein said output apparatus includes a piezo drive actuator.

25. The environment sensing device in accordance with claim 22, wherein said 3-D line sensor includes a temperature sensing apparatus.

26. The environment sensing device in accordance with claim 22, wherein said 3-D line sensor includes a color sensing apparatus.

27. The environment sensing device in accordance with claim 22, wherein said 3-D line sensor includes a magnetic field sensing apparatus.

28. The environment sensing device in accordance with claim 22, wherein said 3-D line sensor is waterproof.

29. The environment sensing device in accordance with claim 22, wherein said 3-D line sensor can operate effectively in a water medium.

30. An environment sensing device capable of real-time tactile transference of environmental information to the fingertips, the environment sensing device comprising:

a. a single housing body member having at least a handle and containing all the components of the sensing device;

b. a phase comparator having at least eight phase comparators, that determine a difference in phase between the light sent by an electro-opto modulator and light received by the environment sensing device;

d. a 3-D line sensor comprising a distance measuring apparatus, which generates a modulated line of light, the reflection of the modulated line of light is received by the environment sensing device and from which distance between an object and the environment sensing device is determined, wherein the 3-D line sensor having at least eight photo-diodes, one each to correspond with a phase comparator, that detects, receives, and transmits signals regarding reflected light; and

d. an output apparatus having at least one column of tactile elements displaceable continuously along a path perpendicular to the handle of the housing body as a two dimensional representation of the distances measured by said environment sensing device.

31. The environment sensing device in accordance with claim 30, wherein a sweeping motion of the environment sensing device causes the displacement of the pins in the output apparatus to convey to the user the shape, contours and texture of the object scanned.

32. The environment sensing device in accordance with claim 30, wherein said output apparatus includes a piezo drive actuator.

33. The environment sensing device in accordance with claim 30, wherein said 3-D line sensor includes a temperature sensing apparatus.

34. The environment sensing device in accordance with claim 30, wherein said 3-D line sensor includes a color sensing apparatus.

35. The environment sensing device in accordance with claim 30, wherein said 3-D line sensor includes a magnetic field sensing apparatus.

36. The environment sensing device in accordance with claim 30, wherein said 3-D line sensor and said output apparatus are powered by a wireless, lightweight, power supply capable of powering the device as a whole and capable of being fully located in said housing body member.

37. The environment sensing device in accordance with claim 30, wherein said 3-D line sensor is waterproof.

38. The environment sensing device in accordance with claim 30, wherein said 3-D line sensor can operate effectively in a water medium.