Method and apparatus for capturing paper-based information on a mobile computing device

• US 7,245,765 B2
• Filed: 11/12/2004
• Issued: 07/17/2007
• Est. Priority Date: 11/11/2003
• Status: Active Grant

• Current Assignee: Bank Of America NA (Bank of America Corp.)
• Original Assignee: SRI International, Inc.
• Inventors: Myers, Gregory, Bercow, Douglas
• Primary Examiner(s): COUSO, YON JUNG
• Application Number:
  US10/988,110
• Publication Number:
  US 20050100216A1
• Time in Patent Office: 977 Days
• Field of Search: 382/164, 382/173, 382/179, 382/181, 382/187, 382/188, 382/190, 382/194, 382/276, 382/305, 382/195, 715/500, 715/530, 716/15, 716/20, 345/624, 345/629
• US Class Current: 382/181
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: G06V 30/262 using context analysis, e.g. lexical, syntactic or semantic context

Abstract

A method and apparatus are provided for capturing paper-based information on a mobile computing device. In one embodiment, the inventive method includes capturing a digital image of the paper-based information, where the digital image comprises text (and in some cases non-text) components of the paper-based information. At least a portion of the paper-based information is then categorized based on the content of the text components and stored accordingly in either a local or remote database.

Claims

1. A method for storing paper-based information on a mobile computing device, the method comprising:

capturing a digital image of said paper-based information, where said paper-based information comprises text components;

processing said digital image of said paper-based information to recognize at least some of said text components;

verifying an accuracy of said recognized text components;

categorizing at least a portion of said paper-based information based on content of said recognized text components; and

storing said at least a portion of said paper-based information.

2. The method of claim 1, wherein said capturing, processing, verifying, categorizing and storing are all performed on said mobile computing device.

3. The method of claim 1, wherein at least one of said capturing, processing, verifying, categorizing and storing is performed locally at said mobile computing device and at least one of said capturing, indexing and storing is performed at a remote server in communication with said mobile computing device.

4. The method of claim 1, wherein said verifying comprises:

comparing said recognized text components to an information source in order to refine said recognized text components.

5. The method of claim 4, wherein said information source is obtained from a remote server.

6. The method of claim 1, wherein said categorizing further comprises:

translating said recognized text components from a first language into a second language.

7. The method of claim 1, wherein said verifying comprises:

receiving user input indicating an accuracy of said recognized text components.

8. The method of claim 7, wherein said user input includes a correction to said recognized text components.

9. The method of claim 7, wherein said user input is a verbal signal.

10. The method of claim 7, wherein said user input is received from a physical interface located on said mobile computing device.

11. The method of claim 7, wherein the user input further indicates whether the paper-based information contained in said digital image should replace or augment information already stored.

12. The method of claim 1, wherein said storing comprises:

storing said at least a portion of said paper-based information in a local database.

13. The method of claim 1, wherein said storing comprises:

transmitting said at least a portion of said paper-based information to a remote database for storage.

14. A computer readable medium containing an executable program for storing paper-based information on a mobile computing device, where the program performs the steps of:

capturing a digital image of said paper-based information, where said paper-based information comprises text components;

processing said digital image of said paper-based information to recognize at feast some of said text components;

verifying an accuracy of said recognized text components;

categorizing at least a portion of said paper-based information based on content of said recognized text components; and

storing said at least a portion of said paper-based information.

15. The computer readable medium of claim 14, wherein said capturing, processing, verifying, categorizing and storing are all performed on said mobile computing device.

16. The computer readable medium of claim 14, wherein at least one of said capturing, processing, verifying, categorizing and storing is performed locally at said mobile computing device and at least one of said capturing, indexing and categorizing is performed at a remote server in communication with said mobile computing device.

17. The computer readable medium of claim 14, wherein said verifying comprises:

comparing said recognized text components to an information source in order to refine said recognized text components.

18. The computer readable medium of claim 14, wherein said categorizing comprises:

translating said recognized text components from a first language into a second language.

19. The computer readable medium of claim 14, wherein said information source is obtained from a remote server.

20. The computer readable medium of claim 14, wherein said verifying comprises:

receiving user input indicating an accuracy of said recognized text components.

21. The computer readable medium of claim 20, wherein said user input includes a correction to said recognized text components.

22. The computer readable medium of claim 20, wherein said user input is a verbal signal.

23. The computer readable medium of claim 20, wherein said user input is received from a physical interface located on said mobile computing device.

24. The computer readable medium of claim 20, wherein the user input further indicates whether the paper-based information contained in said digital image should replace or augment information already stored.

25. The computer readable medium of claim 14, wherein said storing comprises:

storing said at least a portion of said paper-based information in a local database.

26. The computer readable medium of claim 14, wherein said storing comprises:

transmitting said at least a portion of said paper-based information to a remote database for storage.

27. Apparatus for storing paper-based information on a mobile computing device, the apparatus comprising:

means for capturing a digital image of said paper-based information, where said paper-based information comprises text components;

means for processing said digital image of said paper-based information to recognize at least some of said text components;

means for verifying an accuracy of said recognized text components

means for categorizing at least a portion of said paper-based information based on content of said recognized text components; and

means for storing said at least a portion of said paper-based information.

28. A method for storing paper-based information on a mobile computing device, the method comprising:

capturing a digital image of said paper-based information, where said paper-based information comprises text components;

categorizing at least a portion of said paper-based information based on content of said text components, where said categorizing comprises;

processing said digital image of said paper-based information to recognize at least some of said text components; and

indexing said at least a portion of said paper-based information based on

said recognized text components;

receiving user input indicating an accuracy of said recognized text components; and

storing said at least a portion of said paper-based information.

29. A computer readable medium containing an executable program for storing paper-based information on a mobile computing device, where the program performs the steps of:

capturing a digital image of said paper-based information, where said paper-based information comprises text components;

categorizing at least a portion of said paper-based information based on content of said text components, where said categorizing comprises;

processing said digital image of said paper-based information to recognize at least some of said text components; and

indexing said at least a portion of said paper-based information based on said recognized text components;

receiving user input indicating an accuracy of said recognized text components; and

storing said at least a portion of said paper-based information.