GRAPHICAL USER INTERFACE CREATED VIA INPUTS FROM AN ELECTRONIC DOCUMENT

• US 20190197308A1
• Filed: 09/14/2018
• Published: 06/27/2019
• Est. Priority Date: 12/22/2017
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Yeh, Shih-Hao, Samadani-McQuirk, Navid, Dille, Jack Cameron, Hudgins, Joshua Curtis
• Granted Patent: US 10,915,747 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06Q 10/0875 Itemisation or classification of parts, supplies or services, e.g. bill of materials
• CPC Class Codes: G06Q 30/04 Billing or invoicing
• CPC Class Codes: G06Q 30/06 Buying, selling or leasing transactions
• CPC Class Codes: G06Q 30/0633 Lists, e.g. purchase orders, compilation or processing
• CPC Class Codes: G06Q 30/0641 Shopping interfaces
• CPC Class Codes: G06Q 40/12 Accounting
• CPC Class Codes: G06V 2201/09 Recognition of logos
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/1444 Selective acquisition, locating or processing of specific regions, e.g. highlighted text, fiducial marks or predetermined fields
• CPC Class Codes: G06V 30/416 Extracting the logical structure, e.g. chapters, sections or page numbers; Identifying elements of the document, e.g. authors
• CPC Class Codes: G06V 30/418 Document matching, e.g. of document images
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules

Abstract

A computing device receives a request to render a listing of item entries on a graphical user interface. The computing device receives an electronic image of the document, analyzes the electronic image, and determines a document type by performing an image recognition on a first portion the electronic image, comparing information extrapolated via the image recognition algorithm to a database of document types, and identifying a match between the extrapolated information a document type. The computing device applies an OCR algorithm that corresponds to the determined document type to a second portion of the electronic image, and identifies items extracted from the second portion. The computing device renders the listing of item entries on the graphical user interface of the user computing device, the listing of items comprising a listing of each item extracted from the second portion of the electronic image.

Claims

1. A computer-implemented method to render a display list on a graphical user interface, comprising:

receiving, by one or more computing devices, a request to render a new listing of item entries on a graphical user interface of a user computing device;

activating, by the one or more computing devices, an image capture device on the user computing device;

receiving, by the one or more computing devices, an electronic image of the document;

analyzing, by the one or more computing devices, the electronic image of the document by;

determining a document type by performing image recognition on a first portion the electronic image, comparing information extrapolated via the image recognition to a database of document types, and identifying a match between the extrapolated information a document type;

applying an optical character recognition algorithm that corresponds to the determined document type to a second portion of the electronic image, and

identifying items extracted from the second portion of the electronic image via the optical character recognition algorithm;

rendering, by the one or more computing devices, the listing of item entries on the graphical user interface of the user computing device, the listing of items comprising a listing of each item extracted from the second portion of the electronic image.

2. The computer-implemented method of claim 1, wherein activating the image capture device on the user computing device comprises transmitting an instructing to an application on the user computing device to activate a camera on the user computing device.

3. The computer-implemented method of claim 1, further comprising capturing, by the user computing device, the electronic image of the document.

4. The computer-implemented method of claim 3, wherein capturing the electronic image comprises photographing the document.

5. The computer-implemented method of claim 3, wherein capturing the electronic image comprises selecting an existing image from a file directory.

6. The computer-implemented method of claim 1, wherein receiving the electronic image of the document comprises receiving a selection of an existing image from a file directory.

7. The computer-implemented method of claim 1, wherein the first portion of the electronic image comprises a logo.

8. A system to render a display list on a graphical user interface, comprising:

a storage device; and

a processor communicatively coupled to the storage device, wherein the processor executes application code instructions that are stored in the storage device to cause the system to;

receive a request to render a new listing of item entries on a graphical user interface of a user computing device;

activate an image capture device on the user computing device;

receive an electronic image of the document;

analyze the electronic image of the document by;

determining a document type by performing image recognition on a first portion the electronic image, comparing information extrapolated via the image recognition to a database of document types, and identifying a match between the extrapolated information a document type;

applying an optical character recognition algorithm that corresponds to the determined document type to a second portion of the electronic image, and

identifying items extracted from the second portion of the electronic image via the optical character recognition algorithm,

render the listing of item entries on the graphical user interface of the user computing device, the listing of items comprising a listing of each item extracted from the second portion of the electronic image.

9. The system of claim 8, wherein activating the image capture device on the user computing device comprises transmitting an instructing to an application on the user computing device to activate a camera on the user computing device.

10. The system of claim 8, wherein the user computing device captures the electronic image of the document.

11. The system of claim 10, wherein capturing the electronic image comprises photographing the document.

12. The system of claim 10, wherein capturing the electronic image comprises selecting an existing image from a file directory.

13. The system of claim 8, wherein receiving the electronic image of the document comprises receiving a selection of an existing image from a file directory.

14. The system of claim 8, wherein the first portion of the electronic image comprises a logo

15. A computer program product, comprising:

a non-transitory computer-readable storage device having computer-executable program instructions embodied therein that when executed by a computer cause the computer to render a display list on a graphical user interface, the computer-readable program instructions comprising;

computer-readable program instructions to receive a request to render a lnew isting of item entries on a graphical user interface of a user computing device;

computer-readable program instructions to activate an image capture device on the user computing device;

computer-readable program instructions to receive an electronic image of the document;

computer-readable program instructions to analyze the electronic image of the document by;

determining a document type by performing image recognition on a first portion the electronic image, comparing information extrapolated via the image recognition to a database of document types, and identifying a match between the extrapolated information a document type;

applying an optical character recognition algorithm that corresponds to the determined document type to a second portion of the electronic image, and

identifying items extracted from the second portion of the electronic image via the optical character recognition algorithm;

computer-readable program instructions to render the listing of item entries on the graphical user interface of the user computing device, the listing of items comprising a listing of each item extracted from the second portion of the electronic image.

16. The computer program product of claim 15, wherein activating the image capture device on the user computing device comprises transmitting an instructing to an application on the user computing device to activate a camera on the user computing device.

17. The computer program product of claim 15, wherein the user computing device captures the electronic image of the document.

18. The computer program product of claim 17, wherein capturing the electronic image comprises photographing the document.

19. The computer program product of claim 17, wherein capturing the electronic image comprises selecting an existing image from a file directory.

20. The computer program product of claim 17, wherein receiving the electronic image of the document comprises receiving a selection of an existing image from a file directory.