Portable reading device with mode processing

• US 8,711,188 B2
• Filed: 02/09/2010
• Issued: 04/29/2014
• Est. Priority Date: 04/02/2004
• Status: Expired due to Fees

• Current Assignee: National Federation of the Blind
• Original Assignee: K-NFB Reading Technology Inc.
• Inventors: Kurzweil, Raymond C., Albrecht, Paul, Gashel, James, Gibson, Lucy
• Primary Examiner(s): Dharia, Prabodh M
• Application Number:
  US12/702,915
• Publication Number:
  US 20100201793A1
• Time in Patent Office: 1,540 Days
• Field of Search: 345/419, 345/557, 345/581, 345/660, 345/667, 345156-177, 345589-593, 345630-646, 345693-698, 382/100, 382/105, 382/106, 382/114, 382/154, 382/176, 382/209, 382/218, 382/298, 382/299, 382/305, 382/313, 348/207.1, 235/379, 235/454, 704/235, 704/260
• US Class Current: 345/698
• CPC Class Codes: G06F 2203/0331 Finger worn pointing device
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems

Abstract

A reading device includes a computing device and an image input device coupled to the computing device for capturing low resolution images and high resolution images. The reading machine also includes a computer program product residing on a computer readable medium. The medium is in communication with the computing device and includes instructions to operate in a plurality of modes to optimize performance for specific uses of the reading device and process low and high resolution images during operation of at least one of the plurality of modes.

Claims

1. A reading device comprising:

a computing device;

an image input device coupled to the computing device for capturing low resolution images and high resolution images; and

a computer program product residing on a computer readable medium, the medium in communication with the computing device and, comprising instructions for causing the computing device to;

receive a user selection of an operational mode of the device, the selected operational mode includes applying optical character recognition, with the selected operational mode being one of a plurality of different, operational modes that correspond to different, specific operational uses of the reading device;

perform an operation that processes low resolution images from the image device to provided pre-processing information for the selected one of the operational modes of the reading device; and

process high resolution images for performing text recognition functions on the high resolution images based at least in part on the pre-processing information.

2. The reading device of claim 1 wherein the image input device comprises:

a first camera coupled to the computing device for capturing the low resolution images; and

a second camera coupled to the computing device for capturing the high resolution images.

3. The reading device of claim 2 wherein the selected operational mode is a directed reading mode, and the first camera supports lower resolution scanning for capturing gestures for the directed reading mode and the second camera produces higher resolution images on which relevant text is recognized by applying optical character recognition.

4. The reading device of claim 1 wherein the image input device is a single camera that provides the low and high resolutions when operating in the first operational recognition mode.

5. The reading device of claim 4 wherein the computer program product further comprises instructions for causing the reading device to:

process low resolution images for detecting gesture or user defined commands in gesture processing for directed reading modes; and

apply optical character recognition to the high resolution image for recognition of text in the high resolution image.

6. The reading device of claim 1 wherein the reading device generates a multi-channel auditory signal and the perceived directionality of the signal conveys information about what is being read to the user.

7. The reading device of claim 1 further comprising:

a member configured to fit about a portion of a user'"'"'s head, with the image input device supported by the member and with the image input device having a communications link to feed data from the image input device to the computing device.

8. The reading device of claim 7 wherein the member further supports an integrated speaker or earphone to allow the user to hear speech that is produced from the reading device and uploaded to the integrated speaker or earphone through the link.

9. The reading device of claim 1 wherein the operational mode is selected from the group consisting of a document processing mode, a transaction processing mode, and a directed reading mode, and with at least some of the different specific operational uses of the reading device including a clothing processing mode.

10. The reading device of claim 1 wherein the computing device is part of a tablet PC and wherein the image input device is integrated with the tablet PC.

11. The reading device of claim 10 wherein the tablet PC includes a screen and a stylus and the combination of the screen and stylus is used as the image device to capture gesturing by the user, with the image being mapped to the screen and the user causes the reading device to process different parts of the image by gesturing.

12. The reading device of claim 1 wherein the reading device is a mobile phone and further comprises:

an audio output transducer to convey information to the user.

13. A method of operation for a reading device that includes an image capture device, the method comprising:

capturing low resolution images and high resolution images with the image capture device;

receiving a user selection of an operational mode of the device, the selected operational mode includes applying optical character recognition, with the selected operational mode being one of a plurality of different, operational modes that correspond to different, specific operational uses of the reading device;

operating the reading device in the selected operational mode; and

processing by the reading device low resolution images from the image device to provided pre-processing information for a the selected one of the operational modes of the reading device; and

processing by the reading device high resolution images for performing text recognition functions on the high resolution images based at least in part on the pre-processing information.

14. The method of claim 13 wherein performing an operation further comprises:

processing low resolution images for detecting user gestures that correspond to user defined commands.

15. The method of claim 13 further comprising

generating an auditory signal and perceived directionality of the signal to convey information about what is being read to the user.

16. The method of claim 13 wherein the selected operational mode is selected from the group consisting of a document processing mode, a transaction processing mode, and a directed reading mode, and with at least some of the different specific operational uses of the reading device including a clothing processing mode.

17. A computer program product tangibly embodied on a computer readable storage device, for operating a reading device, the computer program product comprising instructions for causing a computing device to:

receive from an image input device capture low resolution images and high resolution images;

receive a user selection of an operational mode of the device, the selected operational mode includes applying optical character recognition, with the selected operational mode being one of a plurality of different, operational modes that correspond to different, specific operational uses of the reading device;

operate the reading device in the selected operational mode; and

process the low resolution images from the image device to provide pre-process information for a first the selected one of the operational recognition modes of the reading device; and

process the high resolution images to perform text recognition functions on the high resolution images based at least in part on the pre-process information.

18. The computer program product of claim 17 wherein instructions to process low resolution images comprises instructions to:

detect user gestures that correspond to user defined commands.

19. The computer program product of claim 17 further comprises instructions to:

generate an auditory signal and perceived directionality of the signal to convey information about what is being read to the user.

20. The computer program product of claim 17 wherein the operational mode is selected from the group consisting of a document processing mode, a transaction processing mode, and a directed reading mode, and with at least some of the different specific operational uses of the reading device including a clothing processing mode.