Method and apparatus for processing images of receipts

• US 10,044,938 B2
• Filed: 02/08/2013
• Issued: 08/07/2018
• Est. Priority Date: 02/08/2012
• Status: Active Grant

• Current Assignee: Abukai, Inc.
• Original Assignee: Abukai, Inc.
• Inventors: Schloter, Philipp, Jacob, Matthias
• Primary Examiner(s): An, Ig T
• Application Number:
  US13/762,655
• Publication Number:
  US 20130201307A1
• Time in Patent Office: 2,006 Days
• CPC Class Codes: H04N 23/632 for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof

Abstract

Systems and methods of processing images of expense receipts are provided. Images of expense receipts are received from an image capture device and an image filter is used to process the images. The filtered images are displayed to the user in a real-time preview portion of a user interface.

Claims

1. A method comprising:

receiving, by a processing device, user input indicating an activation of an image filter;

receiving, by the processing device, image data for a receipt and contextual data for the receipt, wherein the image data is from an image capture device and the contextual data comprises data of a past receipt;

calculating, by the processing device, a distance to the receipt in view of one or more sensor devices of the image capture device;

determining, by the processing device, a size of the receipt in view of the distance to the receipt and the contextual data comprising the data of the past receipt;

processing, by the processing device, the image data in view of the image filter and the determined size of the receipt to obtain filtered image data;

determining, by the processing device, a resolution for storing the filtered image data based on the determined size of the receipt;

providing, by the processing device, a user interface presenting a preview of the filtered image data in real time; and

storing, by the processing device, the filtered image data using the determined resolution.

2. The method of claim 1, further comprising:

receiving a second user input indicating a user request to take a photograph of the receipt;

taking the photograph of the receipt;

applying the image filter to the photograph of the receipt to obtain a filtered photograph of the receipt; and

storing the filtered photograph of the receipt in a memory.

3. The method of claim 2, wherein the filtered photograph of the receipt is smaller in size than the photograph of the receipt.

4. The method of claim 2, further comprising:

generating additional contextual data associated with one or more of the photograph of the receipt or the filtered photograph of the receipt; and

transmitting one or more of the photograph of the receipt, the filtered photograph of the receipt, or the additional contextual data to a server device.

5. The method of claim 4, further comprising compressing one or more of the photograph of the receipt, the filtered photograph of the receipt, or the additional contextual data.

6. The method of claim 2, further comprising storing the photograph of the receipt in the memory.

7. The method of claim 2, wherein the filtered image data and the filtered photograph of the receipt emulate one or more of a black-and-white photocopy of the receipt or a grayscale photocopy of the receipt.

8. The method of claim 1, further comprising:

receiving second user input indicating a deactivation of the image filter; and

providing the user interface presenting a second preview of a second image of the receipt before the photograph of the receipt is taken, wherein the second preview is based on the image data.

9. The method of claim 1, wherein the user interface presents a second preview of the receipt simultaneously with the preview of the filtered image data, wherein the preview and the second preview are based on the image data and are presented before a photograph of the receipt is taken.

19. The method of claim 1, wherein the preview of the filtered image data of the receipt is provided before a photograph of the receipt is taken and allows a user to refrain from taking the photograph after reviewing the preview.

20. The method of claim 1, wherein the image data indicates a category of the receipt and wherein the calculating the size of the receipt is in view of the distance to the receipt, the contextual data, and the category of the receipt.

10. An apparatus comprising:

a memory to store a plurality of images;

a processing device coupled to the memory, the processing device to;

receive user input indicating an activation of an image filter;

receive image data for a receipt and contextual data for the receipt, wherein the image data is from an image capture device and the contextual data comprises data of a past receipt;

calculate a distance to the receipt in view of one or more sensor devices of the image capture device;

determine a size of the receipt in view of the distance to the receipt and the contextual data comprising the data of the past receipt;

process the image data in view of the image filter and the determined size of the receipt to obtain filtered image data;

determine a resolution for storing the filtered image data based on the determined size of the receipt;

provide a user interface presenting a preview of the filtered image data in real; and

store the filtered image data using the determined resolution.

11. The apparatus of claim 10, wherein the processing device is further to:

receive a second user input indicating a user request to take a photograph of the receipt;

take the photograph of the receipt;

apply the image filter to the photograph of the receipt to obtain a filtered photograph of the receipt; and

store the filtered photograph of the receipt in the memory.

12. The apparatus of claim 11, wherein the processing device is further to:

generate additional contextual data associated with one or more of the photograph of the receipt or the filtered photograph of the receipt; and

transmit one or more of the photograph of the receipt, the filtered photograph of the receipt, or the additional contextual data to a server device.

13. The apparatus of claim 10, wherein the processing device is further to:

receive second user input indicating a deactivation of the image filter; and

provide the user interface presenting a second preview of a second image of the receipt before the photograph of the receipt is taken, wherein the second preview is based on the image data.

14. The apparatus of claim 10, wherein the user interface presents a second preview of the receipt simultaneously with the preview of the filtered image data, wherein the preview and the second preview are based on the image data and are presented before a photograph of the receipt is taken.

15. A non-transitory computer readable storage medium having instructions that, when executed by a processing device, cause the processing device to perform operations comprising:

receiving user input indicating an activation of an image filter;

receiving image data for a receipt and contextual data for the receipt, wherein the image data is from an image capture device and the contextual data comprises data of a past receipt;

calculating a distance to the receipt in view of one or more sensor devices of the image capture device;

determining a size of the receipt in view of the distance to the receipt and the contextual data comprising the data of the past receipt;

processing the image data in view of the image filter and the determined size of the receipt to obtain filtered image data;

determining a resolution for storing the filtered image data based on the determined size of the receipt;

providing, by the processing device, a user interface presenting a preview of the filtered image data in real time; and

storing the filtered image data using the determined resolution.

16. The non-transitory computer readable storage medium of claim 15, wherein the processing device is further to:

receive a second user input indicating a user request to take a photograph of the receipt;

take the photograph of the receipt;

apply the image filter to the photograph of the receipt to obtain a filtered photograph of the receipt; and

store the filtered photograph of the receipt in a memory.

17. The non-transitory computer readable storage medium of claim 16, wherein the processing device is further to:

generate additional contextual data associated with one or more of the photograph of the receipt or the filtered photograph of the receipt; and

transmit one or more of the photograph of the receipt, the filtered photograph of the receipt, or the additional contextual data to a server device.

18. The non-transitory computer readable storage medium of claim 15, wherein the processing device is further to:

receive second user input indicating a deactivation of the image filter; and

provide the user interface presenting a second preview of a second image of the receipt before the photograph of the receipt is taken, wherein the second preview is based on the image data.