CODING FOR VISUAL PROSTHESES

• US 20100036457A1
• Filed: 08/07/2009
• Published: 02/11/2010
• Est. Priority Date: 08/07/2008
• Status: Active Grant

• Current Assignee: Massachusetts Institute of Technology
• Original Assignee: Massachusetts Institute of Technology
• Inventors: Turicchia, Lorenzo, Mandal, Soumyajit, Sarpeshkar, Rahul
• Granted Patent: US 8,700,166 B2
• Time in Patent Office: Days
• US Class Current: 607/53
• CPC Class Codes: A61N 1/36017 with leads or electrodes penetrating the skin
• CPC Class Codes: A61N 1/36025 for treating a mental or cerebral condition
• CPC Class Codes: A61N 1/36046 of the eye
• CPC Class Codes: A61N 1/36082 Cognitive or psychiatric applications, e.g. dementia or Alzheimer's disease
• CPC Class Codes: G09B 21/008 using visual presentation of the information for the partially sighted

Abstract

A visual prostheses codes visual signals into electrical stimulation patterns for the creation of artificial vision. In some examples, coding of the information uses image compression techniques, temporal coding strategies, continuous interleaved sampling (CIS), and/or radar or sonar data. Examples of the approach are not limited to processing visual signals but can also be used to processing signals at other frequency ranges (e.g., infrared, radio frequency, and ultrasound), for instance, creating an augmented visual sensation.

Claims

1. A method for coding information for prosthetic visual presentation, the method comprising:

sequentially selecting portions of an image; and

for each selected portion,

forming a plurality of values to represent the portion, and

forming signals for presentation of the plurality of values representing the portion of the image on corresponding electrodes, including forming signals for sequential presentation of a plurality of disjoint subsets of the values in corresponding successive time intervals.

2. The method of claim 1 further comprising repeating the sequential selection of portions of the image, and forming the values and forming the signals for the selected portions, are repeated for successive images.

3. The method of claim 1 wherein forming the plurality of values to represent the selected portion of the image includes forming a plurality of subunits of the portion, and forming a subset of the values to represent each subunit.

4. The method of claim 3 wherein each of the disjoint subsets of values includes values used to represent multiple of the subunits of the selected portion.

5. The method of claim 1 wherein the image is represented as a plurality of scan lines of pixels, and each selected portion includes a corresponding subset of the scan lines of the image.

6. The method of claim 5 wherein forming the plurality of values to represent the selected portion of the image includes forming a plurality of blocks of pixels in the subset of scan lines, and forming a transform representation of each of the blocks of pixels.

7. The method of claim 6 wherein forming the transform representation includes forming values as Discrete Cosine Transform (DCT) coefficients of the block of pixels.

8. The method of claim 7 wherein forming the values as DCT coefficients includes disregarding at least some DCT coefficients of the block of pixels.

9. The method of claim 6 wherein each disjoint subset of values includes corresponding values of a DCT coefficient of multiple of the blocks of pixels.

10. The method of claim 1 wherein sequentially selecting the portions of the image comprises sequentially selecting the portions in a predetermined cycle.

11. The method of claim 1 wherein sequentially selecting the portions of the image comprises selecting portions of the image according to a control signal.

12. The method of claim 11 wherein the control signal represents at least one of a joystick signal and an eye tracking signal.

13. The method of claim 1 wherein sequentially selecting portions of the image comprises selecting processing of the image according to selected kernel functions.

14. The method of claim 13 wherein the kernel functions comprise a set of Gabor kernel functions, each characterized by at least some of scale, rotation, and scale parameters.

15. The method of claim 1 wherein forming the values representing the selected portion of the image comprises forming quantized values.

16. The method of claim 1 further comprising presenting the formed signals to a subject to elicit a perception of the image.

17. The method of claim 1 further comprising driving electrodes using the formed signals.

18. The method of claim 17 wherein for each selected portion of the image, driving the electrodes comprises driving a different subset of electrodes using each different disjoint subset of the values.

19. The method of claim 17 wherein driving the electrodes includes transmitting the formed signal to a region of one or more of a retina, an optic nerve, a thalamus, and a cortex of a brain.

20. The method of claim 1 further comprising acquiring the image from an imager that includes one or more of a video camera, a still-frame camera, a radar sensor, a sonar sensor, and an ultrasonic sensor.

21. The method of claim 20 further comprising controlling the imager using an external signal.

22. The method of claim 21 wherein the external signal is provided by one or more of an eye-tracking system, physiological measurements, a joystick, or a keyboard.

23. The method of claim 1 wherein the image comprises an image of one or more of a landscape, a face, or text.

24. The method of claim 1, further comprising adding a graphical element to the image that is indicative of a part of the image that is currently selected.

25. The method of claim 1 wherein the image includes a graphical representation of text, each portion of the image including at least one character of the text.

26. The method of claim 25 wherein the graphical representation of the text includes at least one of a graphical representation of a character glyph, a Braille code, a Morse code, and a user-defined code.

27. A visual prosthesis comprising:

an input for accepting a signal representing an input image;

a signal processor configured to sequentially select portions of the image, and for each selected portion, form a plurality of values to represent the portion, and form signals for presentation of the plurality of values representing the portion of the image on corresponding electrodes, including forming signals for sequential presentation of a plurality of disjoint subsets of the values in successive time intervals; and

an output for providing the formed signals for presenting the coded image via a plurality of electrodes.

28. The prosthesis for claim 27 further comprising:

an array of electrodes coupled to the output, for driving a different subset of electrodes using each different disjoint subset of the values.

29. The prosthesis for claim 27 further comprising:

an image acquisition device coupled to the input selected from a group consisting of a video camera, a still-frame camera, a radar sensor, a sonar sensor, and an ultrasonic sensor.

30. A visual prosthesis comprising:

an input for accepting a signal representing an input image;

a signal processor configured to

sequentially select subsets of scan lines of pixels of an image, and

for each selected subset of scan lines, form a plurality of blocks of pixels in the subset of scan lines, and for each of the blocks form a plurality of transform coefficients from the block of pixels, and form signals for presentation of the transform coefficients of the blocks on corresponding electrodes, including forming signal pulses for sequential presentation of a plurality of disjoint subsets of the values in successive time intervals; and

an array of electrodes coupled to the signal processor, for driving a different subset of electrodes using each different disjoint subset of the values.