Portable reading device with mode processing

• US 7,659,915 B2
• Filed: 04/01/2005
• Issued: 02/09/2010
• Est. Priority Date: 04/02/2004
• Status: Active Grant

• Current Assignee: National Federation of the Blind
• Original Assignee: K-NFB Reading Technology Inc.
• Inventors: Gibson, Lucy, Albrecht, Paul, Kurzweil, Raymond C., Gashel, James
• Primary Examiner(s): Dharia; Prabodh M
• Application Number:
  US11/097,956
• Publication Number:
  US 20050286743A1
• Time in Patent Office: 1,775 Days
• Field of Search: 345/177, 345/633, 345/660, 345/174, 345/698, 345/630, 345/667, 345/557, 345/646, 345/419, 345/156, 345/163, 345/581, 345/634, 455/411, 358/474, 358/1.9, 365/154, 707/512, 725/105, 348/232, 348/42, 348/207.1, 382/105, 382/154, 382/299, 382/114, 382/218, 382/298, 382/106, 382/100, 382/305, 382/313, 382/176, 382/209, 235/379, 235/454, 704/260, 704/235
• US Class Current: 345/698
• CPC Class Codes: G06F 2203/0331 Finger worn pointing device
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems

Abstract

A reading device includes a computing device and an image input device coupled to the computing device for capturing low resolution images and high resolution images. The reading machine also includes a computer program product residing on a computer readable medium. The medium is in communication with the computing device and includes instructions to operate in a plurality of modes to optimize performance for specific uses of the reading device and process low and high resolution images during operation of at least one of the plurality of modes.

Claims

1. A portable reading device for visually disabled individuals, the device comprising:

a computing device;

an image input device coupled to the computing device for capturing low resolution images and high resolution images; and

a computer program product residing on a computer readable medium, the medium in communication with the computing device and, comprising instructions for causing the computing device to;

operate in a plurality of modes corresponding to specific uses of the reading device;

process the low resolution images during at least one of the operational modes to recognize gestures of a user captured in the images, the gestures corresponding to commands to control processing of the higher resolution images; and

process the higher resolution images using optical character recognition to recognize text in the higher resolution images during the at least one operational mode.

2. The reading device of claim 1 wherein the image input device comprises:

a first camera coupled to the computing device for capturing the low resolution images; and

a second camera coupled to the computing device for capturing the high resolution images.

3. The reading device of claim 2 wherein the first camera supports the lower resolution for capturing gestures or commands in the operational modes and the second camera produces higher resolution images.

4. The reading device of claim 1 where the image input device is a single camera that provides the low and high resolutions when operating in two different image capture resolutions.

5. The reading device of claim 1 wherein the computer program product further comprises instructions for causing the reading device to:

process text provided from optical character recognition on the high resolution image to produce speech signals from the text.

6. The reading device of claim 1 wherein the reading device generates a multi-channel auditory signal, with a perceived directionality of the signal used to convey information about what is being read to the user.

7. The reading device of claim 1 further comprising:

a member configured to fit about a portion of a user'"'"'s head, with the image input device supported by the member and with the image input device having a communications link to feed data from the image input device to the computing device.

8. The reading device of claim 7 wherein the link is wireless or cable.

9. The reading device of claim 7 wherein the member further supports an integrated speaker or earphone to allow the user to hear speech that is produced from electrical signal produced by the reading device and uploaded to the integrated speaker or earphone through the link.

10. The reading device of claim 1 wherein the computing device is part of a tablet PC and wherein the image input device is integrated with the tablet PC.

11. The reading device of claim 10 wherein the tablet PC includes a screen and a stylus and the combination of the screen and stylus is used as the image device to capture gesturing by the user, with the image being mapped to the screen and the user causes the reading device to process different parts of the image by gesturing.

12. The reading device of claim 1 further comprising:

an audio output transducer to convey information to the user.

13. A method of operation for a portable reading device for visually disabled individuals, the method comprising:

capturing low resolution images and high resolution images using an image input device coupled to a computing device;

operating the reading device in a mode of operation selected from a plurality of modes corresponding to specific uses of the reading device;

processing the low resolution images during at least one of the operational modes to recognize gestures of a user captured in the images, the gestures corresponding to commands to control processing of the higher resolution images; and

processing the higher resolution images using optical character recognition to recognize text in the higher resolution images during the at least one operational mode.

14. The method of claim 13 further comprising:

processing text provided from optical character recognition on the high resolution image to produce speech signals from the text.

15. The method of claim 13 further comprising

generating an auditory signal, with a perceived directionality of the signal used to convey information about what is being read to the user.

16. The method of claim 13 further comprising:

positioning a member about a portion of a user'"'"'s head, with the member supporting an image input device that supplies the low resolution and high resolution images, allowing a user to direct the reading device to process a portion of a scene based on positioning of the user'"'"'s head.

17. A computer program product residing on a computer readable medium, for operating a portable reading device for visually disabled individuals, the computer program product comprising instructions for causing a computing device to:

capture low resolution images and high resolution images from an image input device coupled to the computing device;

operate the reading device in a plurality of modes corresponding to specific uses of the reading device;

process the low resolution images during at least one of the operational modes to recognize gestures of a user captured in the images, the gestures corresponding to commands to control processing of the higher resolution images; and

process the higher resolution images using optical character recognition to recognize text in the higher resolution images during the at least one operational mode.

18. The computer program product of claim 17 wherein instructions to process further comprise instructions to:

process text provided from optical character recognition on the high resolution image to produce speech signals from the text.

19. The computer program product of claim 18 further comprises instructions to:

generate an auditory signal and perceived directionality of the signal to convey information about what is being read to the user.