Methods and systems for initiating application processes by data capture from rendered documents

• US 9,760,938 B2
• Filed: 12/30/2013
• Issued: 09/12/2017
• Est. Priority Date: 04/01/2004
• Status: Active Grant

• Current Assignee: Kyocera Corporation
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: King, Martin T., Grover, Dale L., Kushler, Clifford A., Stafford-Fraser, James Q.
• Primary Examiner(s): Garg, Yogesh C
• Application Number:
  US14/144,335
• Publication Number:
  US 20140236758A1
• Time in Patent Office: 1,352 Days
• Field of Search: 705 261, 705 271, 705 272
• CPC Class Codes: G06F 40/174 Form filling; Merging
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 30/0603 Catalogue ordering
• CPC Class Codes: G06Q 30/0633 Lists, e.g. purchase orders, compilation or processing
• CPC Class Codes: G06Q 30/0635 Processing of requisition or of purchase orders
• CPC Class Codes: G06Q 30/0641 Shopping interfaces
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: H04N 1/00204 with a digital computer or a digital computer system, e.g. an internet server programmed control between transmitter and receiver or between image input and image output device H04N1/32561
• CPC Class Codes: H04N 1/107 with manual scanning
• CPC Class Codes: H04N 2201/0039 Connection via a network
• CPC Class Codes: H04N 2201/0055 By radio

Abstract

Systems, apparatus and methods for implementing transaction applications using a handheld document data capture device are described herein. The handheld device captures information from a rendered document. The captured information is processed to identify an electronic document corresponding to the rendered document. Information captured from the rendered document by the handheld capture device is used to perform a transaction. In one embodiment, a portable scanner is used to select items from a catalog. Information scanned from the catalog is used to identify the catalog, the items to be purchased, and complete an order via the Internet.

Claims

1. A method implemented by data processing apparatus, the method comprising:

receiving, from a user device, an image depicting content including at least a portion of text within a rendered document;

determining, based on the content depicted in the image, that an electronic counterpart of the rendered document exists;

identifying, in the electronic counterpart of the rendered document and based on the portion of text, an object that corresponds to the portion of text, wherein identifying the object comprises performing an optical recognition of characters in the portion of text, the optical recognition of characters being performed based at least in part on one or more aspects of the electronic counterpart;

providing the user device with response data that causes display of at least a portion of the electronic counterpart at the user device, the portion of the electronic counterpart including the object, and wherein the response data further causes display of a menu for the object, the menu including one or more user-selectable options, each user-selectable option corresponding to a particular action to be taken with respect to the object.

2. The method of claim 1, wherein the electronic counterpart comprises an electronic catalog, the object is a product for sale in the electronic catalog, and the one or more user-selectable options includes an option to initiate a transaction for purchasing the object.

3. The method of claim 1, wherein:

the content depicted in the image includes a textual identifier; and

determining, based on the content depicted in the image, that an electronic counterpart of the rendered document exists comprises identifying the electronic counterpart based on the textual identifier.

4. The method of claim 1, wherein:

the content depicted in the image includes a graphical identifier; and

determining, based on the content depicted in the image, that an electronic counterpart of the rendered document exists comprises identifying the electronic counterpart based on the graphical identifier.

5. The method of claim 1, wherein the rendered document includes one of:

a magazine, a book, a catalog, a postcard, a dynamic display, a newspaper, an ad, a sign, or a paper document.

6. The method of claim 1, wherein the one or more aspects of the electronic counterpart includes a page layout.

7. The method of claim 1, wherein the one or more aspects of the electronic counterpart includes a font typeface.

8. A system comprising:

one or more data processing apparatus; and

a data storage device storing instructions that, when executed by the one or more data processing apparatus, cause the one or more data processing apparatus to perform operations comprising;

receiving, from a user device, an image depicting content including at least a portion of text within a rendered document;

determining, based on the content depicted in the image, that an electronic counterpart of the rendered document exists;

identifying, in the electronic counterpart of the rendered document and based on the portion of text, an object that corresponds to the portion of text, wherein identifying the object comprises performing an optical recognition of characters in the portion of text, the optical recognition of characters being performed based at least in part on one or more aspects of the electronic counterpart;

providing the user device with response data that causes display of at least a portion of the electronic counterpart at the user device, the portion of the electronic counterpart including the object, and wherein the response data further causes display of a menu for the object, the menu including one or more user-selectable options, each user-selectable option corresponding to a particular action to be taken with respect to the object.

9. The system of claim 8, wherein the electronic counterpart comprises an electronic catalog, the object is a product for sale in the electronic catalog, and the one or more user-selectable options includes an option to initiate a transaction for purchasing the object.

10. The system of claim 8, wherein:

the content depicted in the image includes a textual identifier; and

determining, based on the content depicted in the image, that an electronic counterpart of the rendered document exists comprises identifying the electronic counterpart based on the textual identifier.

11. The system of claim 8, wherein:

the content depicted in the image includes a graphical identifier; and

determining, based on the content depicted in the image, that an electronic counterpart of the rendered document exists comprises identifying the electronic counterpart based on the graphical identifier.

12. The system of claim 8, wherein the rendered document includes one of:

a magazine, a book, a catalog, a postcard, a dynamic display, a newspaper, an ad, a sign, or a paper document.

13. A non-transitory computer readable medium storing instructions that, when executed by one or more data processing apparatus, cause the one or more data processing apparatus to perform operations comprising:

receiving, from a user device, an image depicting content including at least a portion of text within a rendered document;

determining, based on the content depicted in the image, that an electronic counterpart of the rendered document exists;

identifying, in the electronic counterpart of the rendered document and based on the portion of text, an object that corresponds to the portion of text, wherein identifying the object comprises performing an optical recognition of characters in the portion of text, the optical recognition of characters being performed based at least in part on one or more aspects of the electronic counterpart;

providing the user device with response data that causes display of at least a portion of the electronic counterpart at the user device, the portion of the electronic counterpart including the object, and wherein the response data further causes display of a menu for the object, the menu including one or more user-selectable options, each user-selectable option corresponding to a particular action to be taken with respect to the object.

14. The non-transitory computer readable medium of claim 13, wherein the electronic counterpart comprises an electronic catalog, the object is a product for sale in the electronic catalog, and the one or more user-selectable options includes an option to initiate a transaction for purchasing the object.

15. The non-transitory computer readable medium of claim 13, wherein:

the content depicted in the image includes a textual identifier; and

determining, based on the content depicted in the image, that an electronic counterpart of the rendered document exists comprises identifying the electronic counterpart based on the textual identifier.

16. The non-transitory computer readable medium of claim 13, wherein:

the content depicted in the image includes a graphical identifier; and

determining, based on the content depicted in the image, that an electronic counterpart of the rendered document exists comprises identifying the electronic counterpart based on the graphical identifier.

17. The non-transitory computer readable medium of claim 13, wherein the rendered document includes one of:

a magazine, a book, a catalog, a postcard, a dynamic display, a newspaper, an ad, a sign, or a paper document.

18. A method implemented by data processing apparatus, the method comprising:

capturing, at a user device, an image of a rendered document, the image depicting content including at least a portion of text within the rendered document;

providing the image to a server device;

receiving, from the server device, an electronic counterpart of the rendered document;

causing display, at the user device, of at least a portion of the electronic counterpart, the portion of the electronic counterpart including an object that corresponds to the portion of text, wherein the object has been identified based at least in part on performing an optical recognition of characters in the portion of text, the optical recognition of characters being performed based at least in part on one or more aspects of the electronic counterpart; and

causing display of a menu for the object, the menu including one or more user-selectable options, each user-selectable option corresponding to a particular action to be taken with respect to the object.

19. The method of claim 18, wherein the electronic counterpart comprises an electronic catalog, the object is a product for sale in the electronic catalog, and the one or more user-selectable options includes an option to initiate a transaction for purchasing the object.