DOCUMENT AND IMAGE PROCESSING

• US 20100331043A1
• Filed: 06/22/2010
• Published: 12/30/2010
• Est. Priority Date: 06/23/2009
• Status: Abandoned Application

• Current Assignee: KNFB Reader LLC
• Original Assignee: K-NFB Reading Technology Inc.
• Inventors: Albrecht, Paul, Chapman, Peter
• Application Number:
  US12/820,726
• Publication Number:
  US 20100331043A1
• Time in Patent Office: Days
• US Class Current: 455/556.1
• CPC Class Codes: G01C 21/20 Instruments for performing navigational calculations G01C21/24, G01C21/26 take precedence
• CPC Class Codes: G01C 21/3602 Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera
• CPC Class Codes: G06Q 20/047 using payment protocols involving electronic receipts
• CPC Class Codes: G06Q 20/102 Bill distribution or payments
• CPC Class Codes: G06Q 20/384 using social networks
• CPC Class Codes: G06T 2207/30176 Document
• CPC Class Codes: G06T 5/94 based on local image properties, e.g. for local contrast enhancement
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04M 1/72439 for image or video messaging
• CPC Class Codes: H04M 2250/52 including functional features of a camera constructional features concerning the integration of cameras in portable phones H04M1/0264
• CPC Class Codes: H04W 4/50 Service provisioning or reconfiguring

Abstract

Computer implemented methods, apparatus and computer program product are described that involve capturing images of a plurality of documents and performing specialized processing on the documents for generalized translation, menu translation, expense reporting, business card and social networking site updating, calendar updating and currency identification. Other specialized applications are also disclosed.

Claims

1. A computer implemented method, the method comprising:

capturing images of a plurality of receipts using an image capturing component of a portable electronic device;

performing, by one or more computing devices, optical character recognition to extract information from the plurality of receipts; and

storing in a storage device information extracted from each of the receipts as separate entries in an expenses summary; and

calculating, by the one or more computing devices, a total of expenses based on the information extracted from the plurality of receipts.

2. The method of claim 1, further comprising:

retrieving images from the plurality of receipts; and

uploading the images and the expenses summary to a computer system.

3. The method of claim 1, wherein the portable electronic device comprises a mobile telephone.

5. The method of claim 1, further comprising:

capturing an image of succeeding receipts using the image capturing component of the portable electronic device;

automatically extracting information from the succeeding receipts; and

storing information extracted from the succeeding receipts in the expenses summary.

6. The method of claim 5, further comprising:

generating a total of expenses based on the information extracted from the first and succeeding receipts.

4. A method comprising:

capturing an image of a first receipt using an image capturing component of a portable electronic device;

performing, by one or more computing devices, optical character recognition to extract information from the first receipt; and

storing information extracted from the first receipt in an expenses summary.

7. The method of claim 4, further comprising:

retrieving images from the first and all succeeding receipts;

bundling the images from the first and succeeding receipts into a file; and

uploading the bundled images and the expenses summary to a computer system.

8. The method of claim 7, wherein the computer system runs an accounts payable application that receives the bundled images and expenses summary.

9. A method comprising:

capturing an image of a business card using an image capturing component of a portable electronic device that includes one or more computing devices;

performing, by the one or more computing devices, optical character recognition to identify text included in the business card,

extracting, by the one or more computing devices, information from the business card satisfying one or more pre-defined categories of information, the extracted information including a name identified from the business card; and

automatically adding a contact to an electronic contact database based on the extracted information; and

automatically forming a contact with the name identified from the business card in a social networking website.

10. The method of claim 9, wherein the electronic contact database comprises a Microsoft Outlook database.

11. The method of claim 9, wherein the pre-defined categories comprise one or more of name, business, company, telephone, email, and address information.

12. The method of claim 9, further comprising verifying the contact in the social networking website based on additional information extracted from the business card.

13. A computer implemented method comprising:

capturing an image of a unit of currency using an image capturing component of a portable electronic device that includes one or more computing devices;

determining, by the one or more computing devices, the type of the currency;

determining, by the one or more computing devices, a denomination of the currency; and

converting a value of the currency to a different type of currency; and

displaying on a user interface of the portable electronic device a value of the piece of currency in the different type of currency.

14. The method of claim 13, further comprising displaying the type of currency and denomination.

15. A method comprising:

capturing an image using an image capturing component of a portable electronic device that includes one or more computing devices, the image including an address;

performing, by the one or more computing devices, optical character recognition to identify the address;

determining a current location of the portable electronic device; and

generating directions from the determined current location to the identified address.

16. The method of claim 15, wherein determining a current location comprises using GPS to identify a current location for the portable electronic device.

18. The method of claim 16, further comprising:

performing optical character recognition to identify a first street name from the image of the first street sign; and

performing optical character recognition to identify a second street name from the image of the second street sign.

17. A method comprising:

capturing an image of a first street sign at an intersection using an image capturing component of a portable electronic device;

capturing an image of a second street sign at the intersection using the image capturing component of the portable electronic device; and

determining, by one or more computing devices, a location of the portable electronic device based on the images of the first and second street signs.

19. A method comprising:

capturing an image using an image capturing component of a portable electronic device that includes one or more computing devices;

performing, by one or more computing devices, optical character recognition to identify text included in the image, the text being written in a first language;

automatically by the one or more computing devices, translating the text from the first language to a second language, the second language being different from the first language; and

presenting the translated text to the user on a user interface of the portable electronic device.

20. The method of claim 19, further comprising automatically determining the language of the text included in the image.

21. The method of claim 19, wherein the portable electronic device comprises a cellular telephone.

22. The method of claim 21, wherein the image capturing component comprises a camera included in the cellular telephone.

23. The method of claim 19, wherein capturing an image comprises capturing an image of a menu.

24. The method of claim 23, further comprising providing additional information about one or more words on the menu.

25. The method of claim 24, wherein the additional information comprises an explanation or definition of the one or more words on the menu.