DIGITAL IMAGE MANIPULATION

• US 20160307034A1
• Filed: 04/14/2015
• Published: 10/20/2016
• Est. Priority Date: 04/14/2015
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Goyal, Ankur
• Granted Patent: US 9,684,825 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06Q 30/0623 Item investigation
• CPC Class Codes: G06Q 50/12 Hotels or restaurants
• CPC Class Codes: G06V 30/412 Layout analysis of documents structured with printed lines or input boxes, e.g. business forms or tables
• CPC Class Codes: G06V 30/416 Extracting the logical structure, e.g. chapters, sections or page numbers; Identifying elements of the document, e.g. authors

Abstract

Techniques for assigning context to a digitally captured image, and for manipulating recognized data fields within such image. In an exemplary embodiment, a context of an image may be assigned based on, e.g., user input or pattern recognition. Based on the assigned context, recognized data fields within the image may be manipulated according to context-specific processing. In an aspect, processing specific to a sales receipt context may automatically manipulate certain data, e.g., calculate updated sales tax and subtotals based on user-designated fields, and display the automatically calculated data in an output receipt. Fields not designated by the user may be selectively concealed in the output receipt for privacy. Further aspects disclose processing techniques specific to other contexts such as restaurant menu, store shelf, and fillable form contexts.

Claims

1. An apparatus for generating an output image from a digital image, the apparatus comprising:

a context assignment block configured to assign a context to the digital image, the context selected from a plurality of predetermined contexts;

a field recognition block configured to recognize one or more data fields in the digital image;

a user designation block configured to receive input from the user designating at least one of the one or more recognized data fields for manipulation;

a data manipulation block configured to manipulate the at least one user-designated data field based on the assigned context of the digital image; and

a post-processing block configured to generate the output image based on the at least one manipulated data field.

2. The apparatus of claim 1, the context assignment block configured to assign the context to the digital image based on user specification of the context.

3. The apparatus of claim 1, the context assignment block configured to assign the context to the digital image by applying pattern recognition techniques, said techniques comprising correlating text data recognized in the digital image with a plurality of predetermined context-specific templates.

4. The apparatus of claim 1, the field recognition block configured to recognize at least one data field in the digital image as corresponding to a data field specific to the assigned context.

5. The apparatus of claim 4, the plurality of predetermined contexts comprising a receipt context, the one or more recognized data fields in the digital image comprising a subtotal field, a sales tax field, and a total field.

6. The apparatus of claim 1, the input received from the user comprising a designation that a data field is to be displayed in the output image.

7. The apparatus of claim 1, the input received from the user comprising a designation that a corresponding data field is to be obscured in the output image.

8. The apparatus of claim 1, the data manipulation block configured to manipulate the at least one user-designated data field by obscuring the at least one user-designated field in the output image.

9. The apparatus of claim 1, the data manipulation block further configured to manipulate the at least one user-designated field by calculating the value of a total price field based on numerical price values corresponding to the at least one user-designated field.

10. The apparatus of claim 9, the data manipulation block further configured to calculate the value of the total price field by adding said numerical price values to obtain a subtotal, computing a sales tax based on the sub-total, and determining the value of the total price field as the sum of the sales tax and the subtotal.

11. The apparatus of claim 1, the data manipulation block further configured to superimpose at least one additional data field generated from the at least one user-designated field on the output image.

12. The apparatus of claim 1, the post-processing block further configured to generate the output image as a digital image file.

13. The apparatus of claim 1, the context assignment block configured to assign a location context to the digital image based on a geocoding of the digital image.

14. A method comprising:

assigning a context to the digital image, the context selected from a plurality of predetermined contexts;

recognizing one or more data fields in the digital image;

receiving input from the user designating at least one of the one or more recognized data fields for manipulation;

manipulating the at least one user-designated data field based on the assigned context of the digital image; and

generating the output image based on the at least one manipulated data field.

15. The method of claim 14, the assigning the context to the digital image comprising assigning the context to the digital image based on user specification of the context.

16. The method of claim 14, further comprising recognizing at least one data field in the digital image as corresponding to a data field specific to the assigned context.

17. The method of claim 14, the receiving the input from the user comprising receiving a designation that data field is to be displayed in the output image.

18. The method of claim 14, the receiving the input from the user comprising receiving a designation that a corresponding data field is to be obscured in the output image.

19. The method of claim 14, the manipulating comprising obscuring the at least one user-designated field in the output image.

20. A computing device including a processor and a memory holding instructions executable by the processor to:

assign a context to the digital image, the context selected from a plurality of predetermined contexts;

recognize one or more data fields in the digital image;

receive input from the user designating at least one of the one or more recognized data fields for manipulation;

manipulate the at least one user-designated data field based on the assigned context of the digital image; and

generate the output image based on the at least one manipulated data field.