Reducing Processing Latency in Optical Character Recognition for Portable Reading Machine

• US 20100088099A1
• Filed: 12/08/2009
• Published: 04/08/2010
• Est. Priority Date: 04/02/2004
• Status: Active Grant

• Current Assignee: National Federation of the Blind
• Original Assignee: K-NFB Reading Technology Inc.
• Inventors: Gibson, Lucy, Albrecht, Paul, Kurzweil, Raymond C.
• Granted Patent: US 8,531,494 B2
• Time in Patent Office: Days
• US Class Current: 704/260
• CPC Class Codes: G06V 10/96 Management of image or video recognition tasks
• CPC Class Codes: G09B 21/001 Teaching or communicating with blind persons G09B21/02 - G09B21/06 take precedence
• CPC Class Codes: G09B 21/006 using audible presentation of the information

Abstract

A portable reading device includes a computing device and a computer readable medium storing a computer program product to receive an image and select a section of the image to process. The product processes the section of the image with a first process and when the first process is finished processing the section of the image, process a result of the first process with a second process. While the second process is processing, repeats the first process on another section of the image.

Claims

1. A computer program product residing on a computer readable medium comprising instructions for causing a portable reading device to:

receive an image;

select a section of the image to process;

apply optical character recognition to the section of the image and when finished processing at least a portion of the section of the image,

process a result of the optical character recognition with a different process, and while the different process is processing the result,

select a subsequent section of the image to process; and

apply optical character recognition on the subsequent section of the image after the section of the image is processed by the optical character recognition.

2. The computing program product of claim 1 further comprising instructions to:

parse the image into sections to detect regions of monochromatic and mixed content.

3. The computing program product of claim 2 wherein the different process is text to speech synthesis that uses as input a text output from the optical character recognition.

4. The computing program product of claim 1 wherein instructions to select are based on a user input corresponding to the user having the product in a directed reading mode.

5. The computing program product of claim 1 wherein instructions to select are based on selecting a first available portion of the image.

6. The computing program product of claim 1 wherein instructions to select are based on user-initiated input.

7. The computing program product of claim 1 wherein instructions to select are based on a default.

22. The computing program product of claim 1 further comprise instructions to:

determine if there are more sections in the image to process; and

select another section of the image to apply optical character recognition to until there are no more sections to apply optical character recognition to.

23. The computing program product of claim 1 further comprising instructions to:

search for characteristic text or marks in standardized areas of the document to determine regions.

24. The computing program product of claim 1 further comprising instructions to:

preprocess the image prior to optical character recognition to produce a binary or grayscale image for the optical character recognition processing.

25. The computing program product of claim 1 further comprising instructions to:

process the image using a template that is mapped to the image; and

apply voice recognition to a user'"'"'s verbal commands to select a part of the template that maps to the section of the image, causing the instructions to process that section of the image.

26. The computing program product of claim 1 further comprising instructions to:

determine whether the image is upside down, by determining that a relatively low number of words were recognized by the first process; and

change the orientation of the section of the image by 180 degrees and apply optical character recognition to the section of the image in the changed orientation; and

if changing the orientation produces enough words to surpass the threshold, then the instructions process all remaining sections of the image by changing the orientation of the remaining sections of the image.

8. A computer implemented method of operating a machine that processes an image, the method comprising:

receiving an image;

selecting by a computer a section of the image to process;

apply optical character recognition by the computer to the section of the image; and

when finished processing the section of the image,

processing by the computer a result of the optical character recognition with a different process, and while the different process is processing the result,

selecting a subsequent section of the image to process; and

applying optical character recognition on the subsequent section of the image.

9. The method of claim 8 further comprising:

parsing the image into sections to detect regions of monochromatic and mixed content.

10. The method of claim 9 wherein the different process is text to speech synthesis that uses as input a text output from the optical character recognition.

11. The method of claim 8 wherein selecting is based on a user input corresponding to the user having the product in a directed reading mode.

12. The method of claim 8 wherein selecting is based on selecting a first available portion of the image.

13. The method of claim 8 wherein selecting is based on user-initiated input.

14. The method of claim 8 wherein selecting is based on a default.

27. The method of claim 8 further comprising:

determining if there are more sections in the image to process; and

selecting another section of the image to apply optical character recognition to until there are no more sections to apply optical character recognition to.

28. The method of claim 8 further comprising:

searching for characteristic text or marks in standardized areas of the document to determine regions.

29. The method of claim 8 further comprising instructions to:

preprocess the image prior to optical character recognition to produce a binary or grayscale image for the optical character recognition processing.

30. The method of claim 8 further comprising:

processing the section image using a template that is mapped to the image; and

applying voice recognition to a user'"'"'s verbal commands to select a part of the template that maps to the section of the image, causing the instructions to process that section of the image.

31. The method of claim 8 further comprising:

determining whether the image is upside down, by determining that a relatively low number of words were recognized by the first process;

changing the orientation of the section of the image by 180 degrees while applying optical character recognition to the section of the image; and

determining if changing the orientation produced enough words to surpass the threshold, then processing all remaining sections of the image by changing the orientation.

15. A portable reading device comprising:

a computing device;

a computer readable medium storing a computer program product comprising instructions for causing the reading machine to;

receive an image;

select a section of the image to process;

apply optical character recognition to the section of the image and when finished processing the section of the image,

process a result of the optical character recognition with a different process; and

while the different process is processing the result,

select a subsequent section of the image to process; and

apply optical character recognition on the subsequent section of the image.

16. The portable reading device of claim 15 further comprising instructions to:

parse the image into sections to detect regions of monochromatic and mixed content.

17. The portable reading device of claim 15 wherein the different process is text to speech synthesis that uses as input a text output from the optical character recognition.

18. The portable reading device of claim 15 wherein instructions to select are based on a user input corresponding to the user having the portable reading device in a directed reading mode.

19. The portable reading device of claim 15 wherein instructions to select are based on selecting the first available portion of the image.

20. The portable reading device of claim 15 wherein instructions to select are based on user-initiated input.

21. The portable reading device of claim 15 wherein instructions to select are based on a default.

32. The portable reading device of claim 15 wherein instructions to process the section with a first process, further comprise instructions to:

determine if there are more sections in the image to process and if so select a next section of the image to apply optical character recognition to, until there are no more sections to apply optical character recognition to.

33. The portable reading device of claim 15 further comprising instructions to:

search for characteristic text or marks in standardized areas of the document to determine regions.

34. The portable reading device of claim 15 further comprising instructions to:

preprocess the image prior to optical character recognition to produce a binary or grayscale image for the optical character recognition processing.

35. The portable reading device of claim 15 further comprising instructions to:

process the image using a template that is mapped to the image; and

apply voice recognition to a user'"'"'s verbal commands to select a part of the template that maps to the section of the image, causing the instructions to process that section of the image.

36. The portable reading device of claim 15 further comprising instructions to:

determine whether the image is upside down, by determining that a relatively low number of words were recognized by the first process; and

change the orientation of the section of the image by 180 degrees and apply optical character recognition to the section of the image in the changed orientation; and

determine if changing the orientation produces enough words to surpass the threshold, then the instructions process all remaining sections of the image by changing the orientation.