Method and apparatus for sensory substitution, vision prosthesis, or low-vision enhancement utilizing thermal sensing

• US 20040030383A1
• Filed: 06/04/2003
• Published: 02/12/2004
• Est. Priority Date: 06/06/2002
• Status: Active Grant

• Current Assignee: Advanced Medical Electronics
• Original Assignee: Advanced Medical Electronics
• Inventors: Kalpin, Scott, Gibson, Paul Lorn, Seifert, Gregory John, Havey, Gary David
• Granted Patent: US 7,308,314 B2
• Time in Patent Office: Days
• US Class Current: 623/4.1
• CPC Class Codes: A61F 9/08 Devices or methods enabling eye-patients to replace direct visual perception by another kind of perception
• CPC Class Codes: A61N 1/36046 of the eye

Abstract

A sensory substitution device according to an embodiment of the invention includes a thermal imaging array for sensing thermal characteristics of an external scene. The device includes a visual prosthesis adapted to receive input based on the scene sensed by the thermal imaging array and to convey information based on the scene to a user of the sensing device. The visual prosthesis is adapted to simultaneously convey to the user different visual information corresponding to portions of the scene having different thermal characteristics. One type of thermal imaging array includes a microbolometer imaging array, and one type of visual prosthesis includes a retinal implant. According to additional embodiments, an apparatus for obtaining thermal data includes a thermal detector adapted to sense thermal characteristics of an environment using a plurality of pixels. The apparatus also includes a pixel translator, operably coupled with the thermal detector, adapted to translate pixel data of the thermal detector to a lower resolution. The apparatus also includes an interface, operably coupled with the pixel translator, adapted to communicate the thermal characteristics of the environment to a user of the apparatus at a lower resolution than sensed by the thermal detector.

Claims

1. A sensory substitution device, comprising:

an imaging device comprising a thermal imaging array for sensing thermal characteristics of a scene external to the sensory substitution device; and

a visual prosthesis, operably coupled with the imaging device, adapted to receive input based on the scene sensed by the thermal imaging array and to convey information based on the scene to a user of the sensory substitution device, wherein the visual prosthesis is adapted to simultaneously convey to the user different visual information corresponding to portions of the scene having different thermal characteristics.

2. The device of claim 1, wherein the thermal imaging array comprises a microbolometer imaging array.

3. The device of claim 1, wherein the visual prosthesis comprises a retinal implant.

4. The device of claim 1, further comprising a processor for receiving output from the imaging device and for generating said input to the visual prosthesis.

5. A thermal imager, comprising:

an imaging device comprising a thermal imaging array for sensing thermal characteristics of a scene external to the thermal imager; and

a tactile interface, operably coupled with the imaging device, adapted to receive input based on the scene sensed by the thermal imaging array and to convey tactile information based on the scene to a user of the thermal imager, wherein the tactile interface is adapted to simultaneously convey to the user different tactile information corresponding to portions of the scene having different thermal characteristics.

6. The imager of claim 5, wherein the tactile interface comprises an array of height-adjustable pins generally corresponding to the thermal imaging array;

further wherein the imager is adapted to change the height of the pins based on the thermal characteristics of the external scene.

7. The imager of claim 5, wherein the thermal imager is a handheld unit.

8. The imager of claim 5, wherein the thermal imaging array comprises a microbolometer imaging array.

9. The imager of claim 8, wherein the microbolometer imaging array and the tactile interface are supported by a common housing.

10. Apparatus for obtaining thermal data, the apparatus comprising:

a thermal detector adapted to sense thermal characteristics of an environment using a plurality of pixels;

a pixel translator, operably coupled with the thermal detector, adapted to translate pixel data of the thermal detector to a lower resolution; and

an interface, operably coupled with the pixel translator, adapted to communicate the thermal characteristics of the environment to a user of the apparatus at a lower resolution than sensed by the thermal detector.

11. The apparatus of claim 10, wherein the interface comprises a visual prosthesis.

12. The apparatus of claim 11, wherein the visual prosthesis comprises a retinal implant.

13. The apparatus of claim 10, wherein the interface is a haptic interface adapted to communicate the thermal characteristics of the environment to the user using the user'"'"'s sense of touch.

14. The apparatus of claim 10, wherein the pixel translator translates high-resolution pixel data from the thermal detector to low-resolution pixel data for the interface;

further wherein the interface comprises a plurality of tactile elements, each tactile element corresponding to a low-resolution pixel of the low-resolution pixel data.

15. The apparatus of claim 10, wherein the apparatus is at least partially supported on a cane;

further wherein the tactile interface is supported at a handgrip of the cane and is adapted to contact the hand of a user of the cane.

16. The apparatus of claim 10, wherein the apparatus is at least partially supported on at least one of a weapon and a helmet.

17. The apparatus of claim 10, wherein the apparatus is at least partially supported on a pair of eyeglasses.

18. The apparatus of claim 17, wherein the pair of eyeglasses comprises an eyeglass lens, further wherein the apparatus comprises a lens for thermal imaging mounted within the eyeglass lens.

19. The apparatus of claim 10, wherein the thermal detector comprises one or more thermal sensor arrays adapted to detect thermal radiation in a wavelength range of about 8 to about 14 μ

m.

20. At least one computer-readable medium having stored thereon a computer program that, when executed by a processor, causes operation of apparatus for obtaining thermal data, the apparatus including a thermal detector adapted to sense thermal characteristics of an environment using a plurality of pixels, the program comprising:

logic for translating pixel data generated by the thermal detection apparatus to a lower resolution; and

logic for communicating the thermal characteristics of the environment to a user of the apparatus at a lower resolution than sensed by the thermal detector.