Systems and methods for recognizing information in objects using a mobile device
First Claim
1. A method for recognizing information in an object using a mobile device, the method comprising:
- analyzing images of the object in an image data stream generated by an image capturing device of the mobile device;
capturing a first image from the image data stream;
transforming the first image to obtain a second image;
binarizing the second image to obtain a binarized image;
recognizing information in the binarized image; and
determining the validity of the recognized information,wherein determining the validity of the recognized information is selected from the group consisting of detecting the presence of mandatory fields in the binarized image, detecting code-line and payer'"'"'s signature in the binarized image, detecting payer'"'"'s address and bank logo in the binarized image, and detecting a difference between a numeric amount and a literal amount based on the recognized information, andwherein detecting a difference includes;
determining a score for recognition of the numeric amount,determining a score for recognition of the literal amount, anddetermining an overall recognition score by comparing the score for recognition of the numeric amount and the score for recognition of the literal amount.
1 Assignment
0 Petitions
Accused Products
Abstract
The systems and methods of the present disclosure use a mobile device equipped with a camera to capture and preprocess images of objects including financial documents, financial cards, and identification cards, and to recognize information in the images of the objects. The methods include detecting quadrangles in images of an object in an image data stream generated by the camera, capturing a first image, transforming the first image, binarizing the transformed image, recognizing information in the binarized image, and determining the validity of the recognized information. The method also includes communicating with a server of a financial institution or other organization to determine the validity of the recognized information. The mobile device may include a camera, a display to display an image data stream and captured images, a memory to store a configuration file including parameters for the preprocessing and recognition functions, captured images, and software, and a communication unit to communicate with a server of the financial institution or other organization.
64 Citations
25 Claims
-
1. A method for recognizing information in an object using a mobile device, the method comprising:
-
analyzing images of the object in an image data stream generated by an image capturing device of the mobile device; capturing a first image from the image data stream; transforming the first image to obtain a second image; binarizing the second image to obtain a binarized image; recognizing information in the binarized image; and determining the validity of the recognized information, wherein determining the validity of the recognized information is selected from the group consisting of detecting the presence of mandatory fields in the binarized image, detecting code-line and payer'"'"'s signature in the binarized image, detecting payer'"'"'s address and bank logo in the binarized image, and detecting a difference between a numeric amount and a literal amount based on the recognized information, and wherein detecting a difference includes; determining a score for recognition of the numeric amount, determining a score for recognition of the literal amount, and determining an overall recognition score by comparing the score for recognition of the numeric amount and the score for recognition of the literal amount. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17)
-
-
18. A mobile device for processing an image of an object and recognizing information in the processed image of the object, the mobile device comprising:
-
an image capturing device configured to generate an image data stream of images of the object and to capture a first image of the object; a memory coupled to the image capturing device and configured to store the captured first image; a display unit coupled to the image capturing device and configured to display the image data stream and the captured first image; and a processor coupled to the memory and the display unit, the processor configured to analyze images of the object in the image data stream prior to capturing the first image, to transform the first image to obtain a second image, to binarize the second image to obtain a binarized image, to recognize information in the binarized image, and to determine the validity of the recognized information, wherein the processor determines the validity of the recognized information by performing a function selected from the group consisting of detecting the presence of mandatory fields in the binarized image, detecting code-line and payer'"'"'s signature in the binarized image, detecting payer'"'"'s address and bank logo in the binarized image, and detecting a difference between a numeric amount and a literal amount based on the recognized information, and wherein detecting a difference includes; determining a score for recognition of the numeric amount, determining a score for recognition of the literal amount, and determining an overall recognition score by comparing the score for recognition of the numeric amount and the score for recognition of the literal amount. - View Dependent Claims (19, 20, 21, 22, 23, 25)
-
-
24. A mobile device for remotely recognizing information in an object, the mobile device comprising:
-
an image capturing device configured to generate an image data stream of images of the object and to capture a first image from the image data stream; a memory coupled to the image capturing device and configured to store the first image; a display unit coupled to the image capturing device and configured to display the image data stream and the first image; a processor coupled to the memory and the display unit, the processor configured to analyze images of the object in the image data stream prior to capturing the first image, to normalize the first image to obtain a normalized image, to binarize the normalized image, to recognize information in the binarized image, and to determine the validity of the recognized information; and a communication unit coupled to the processor and the memory, the communication unit configured to transmit the binarized image and the recognized information to a server of a financial institution to further process the binarized image and the recognized information, wherein the processor determines the validity of the recognized information by performing a function selected from the group consisting of detecting the presence of mandatory fields in the binarized image, detecting code-line and payer'"'"'s signature in the binarized image, detecting payer'"'"'s address and bank logo in the binarized image, and detecting a difference between a numeric amount and a literal amount based on the recognized information, and wherein detecting a difference includes; determining a score for recognition of the numeric amount, determining a score for recognition of the literal amount, and determining an overall recognition score by comparing the score for recognition of the numeric amount and the score for recognition of the literal amount.
-
Specification