Technique for providing simulated vision

• US 7,194,148 B2
• Filed: 09/07/2001
• Issued: 03/20/2007
• Est. Priority Date: 09/07/2001
• Status: Expired due to Term

• Current Assignee: Aperture In Motion LLC
• Original Assignee: The Edward Yavitz Educational Foundation, Inc.
• Inventors: Yavitz, Edward Q.
• Primary Examiner(s): Chawan; Sheela
• Application Number:
  US09/948,834
• Publication Number:
  US 20030048928A1
• Time in Patent Office: 2,020 Days
• Field of Search: 382/154, 382/131, 382/173, 382/236, 382/239, 382/240, 382/291, 382/305, 382/307, 704/271, 345/7, 345/419, 434/43, 434/44
• US Class Current: 382/305
• CPC Class Codes: G06F 40/20 Natural language analysis semantic analysis of natural language G06F40/30
• CPC Class Codes: G06V 20/20 in augmented reality scenes

Abstract

A visual simulation technique is provided to facilitate visual activities, such as reading and movement of a subject through surroundings, for sight-impaired persons. The technique obtains digital images of the surroundings via an image retrieval and sending device, and then provides a real-time audio interpretation of the images via an automated image identification and narration system. The automated system may have communication and computing circuitry, remote human interaction circuitry, and other components for either computer-based or human-based identification and narration of the acquired images.

Claims

1. An artificial sight system for use by an individual, comprising:

an artificial sight system for use by an individual, having;

an image retrieval device able to obtain an image of a surrounding, the image retrieval device

being configured for carrying on an individual;

a communication device coupled to the image retrieval device, wherein the communication device is configured to transmit the image to a remote processing system comprising an image identifier and an image describer; and

an audio device coupled to the communication device and configured to transmit an audio description of the surrounding to the individual carrying the image retrieval device.

2. The artificial sight system of claim 1, wherein the image retrieval device comprises a digital camera.

3. The artificial sight system of claim 1, wherein the image retrieval device comprises a plurality of image retrieval devices in multiple desired viewing orientations.

4. The artificial sight system of claim 1, wherein the image retrieval device, the communication device and the audio device comprise mounting structures for attachment to the individual.

5. The artificial sight system of claim 1, wherein the communication device comprises wireless communication circuitry.

6. The artificial sight system of claim 1, wherein the image identifier comprises an image processor configured to process an image obtained by the image retrieval device, an image characteristic database, and an image matcher configured to identify a best match from the image characteristic database with the image.

7. The artificial sight system of claim 6, wherein the image characteristic database comprises parameters for a plurality of images, the parameters comprising color and geometrical characteristics.

8. The artificial sight system of claim 1, wherein the image identifier and the image describer comprise a human interpreter.

9. A method of visualizing a surrounding environment, comprising:

providing an artificial sight system for use by an individual;

obtaining an image in a desired viewing orientation;

identifying the image via an image processor;

audibly describing the surrounding environment based on the image identified; and

wirelessly communicating image information between a communication device attached to the person and the image processor disposed remote from the person, wherein obtaining the image and audibly describing the surrounding environment are performed via an image retrieval device and an audio device, respectively, attached to the person, further wherein identifying and audibly describing are performed via an individual acting as the image processor.

10. The method of claim 9, wherein obtaining the image comprises obtaining a digital image of the surrounding environment.

11. The method of claim 9, wherein obtaining the image comprises electronically capturing the image of a field of view of a perimetry surrounding a user.

12. The method of claim 11, wherein electronically capturing the image comprises magnifying the image.

13. The method of claim 11, wherein electronically capturing the image comprises adapting to lightness levels in the field of view.

14. The method of claim 11, wherein electronically capturing the image comprises sensing distances to objects in the field of view.

15. The method of claim 9, wherein obtaining the image comprises obtaining a plurality of images in multiple desired viewing orientations.

16. The method of claim 9, wherein identifying the image comprises matching image characteristics of the image with a best match from an image characteristic database of environmental images.

17. The method of claim 16, wherein matching image characteristics comprises analyzing geometrical characteristics.

18. The method of claim 17, wherein matching image characteristics comprises analyzing color characteristics.

19. The method of claim 9, wherein obtaining the image and audibly describing the surrounding environment are performed via an image retrieval device and an audio device, respectively, attached to a person.

20. The method of claim 19, comprising wirelessly communicating image information between a communication device attached to the person and the image processor disposed remote from the person.

21. The method of claim 20, wherein identifying and audibly describing are performed via an individual acting as the image processor.

22. The method of claim 9, wherein identifying and audibly describing comprise:

wirelessly communicating the image from a user to a network;

displaying the image to an individual accessing the network; and

wirelessly communicating an audio narration of the image from the individual to the user.

23. The method of claim 22, wherein displaying the image comprises displaying the image through an Internet website.

24. The method of claim 23, comprising obtaining the audio narration from the individual.