Processing techniques for text capture from a rendered document

• US 9,684,902 B2
• Filed: 07/10/2014
• Issued: 06/20/2017
• Est. Priority Date: 04/19/2004
• Status: Active Grant

• Current Assignee: Kyocera Corporation
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Grover, Dale L., Kushler, Clifford A., King, Martin T., Stafford-Fraser, James Q.
• Primary Examiner(s): Garg, Yogesh C
• Application Number:
  US14/328,015
• Publication Number:
  US 20150039474A1
• Time in Patent Office: 1,076 Days
• Field of Search: 705 261, 705 2661, 705 2662
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06Q 30/00 Commerce
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/262 using context analysis, e.g. lexical, syntactic or semantic context
• CPC Class Codes: G06V 30/40 Document-oriented image-based pattern recognition

Abstract

A facility for initiating a purchase is described. The facility receives a text sequence captured by a user from a rendered document using a handheld text capture device. The facility identifies in the received text sequence a reference to a distinguished product. In response to identifying the reference, the facility presents to the user an opportunity to place an order for the established product. If the user accepts the presented opportunity to order the distinct product, the facility orders the distinct product on behalf of the user.

Claims

1. A method implemented by data processing apparatus, the method comprising:

receiving, by a system server, from a wireless device including a camera, an image of text captured by the camera from a rendered document;

performing, by the system server, a recognition process on the image of text, and generating, by the recognition process, a corresponding representation of the text;

determining, by the system server, that the representation of the text includes a reference to a product;

providing, by the system server and for presentation on the wireless device, a purchase option for purchasing the product;

receiving, by the system server, from the wireless device, a response to the purchase option that indicates an instruction to purchase the product.

2. The method of claim 1, wherein the wireless device includes a display, and wherein the method further comprises:

presenting, on the display, the image of the text to be captured by the camera.

3. The method of claim 2, further comprising:

presenting, on the display, information about the quality of the image and its suitability for recognition.

4. The method of claim 2, further comprising:

presenting, on the display, information about one or more segments of text to be captured from the rendered document.

5. The method of claim 1, further comprising:

storing, by the system server, an identifier of the product;

providing, by the system server to the wireless device, information from a log of stored product identifiers; and

receiving, by the system server from the wireless device, the instruction to purchase the product.

6. The method of claim 1, wherein providing the purchase option for purchasing the product includes providing a context menu of actions comprising the purchase option for purchasing the product.

7. The method of claim 1, further comprising:

receiving, by the system server, from a seller server, availability and price information related to the product; and

providing, by the system server and for presentation on the wireless device, the availability and price information; and

providing, by the system server, to the seller server, the instruction to purchase the product.

8. The method of claim 7, further comprising:

storing, by the system server, account information corresponding to an account associated with the wireless device;

storing, by the system server, account information corresponding to an account associated with the seller server;

receiving, by the system server, from the wireless device, an identifier of the account associated with the wireless device;

negatively adjusting the account associated with the wireless device; and

positively adjusting the account associated with the seller server.

9. The method of claim 8, wherein the account information corresponding to the account associated with the wireless device comprises shipping preference information, and wherein the method further comprises providing the shipping preference information from the system server to the seller server.

10. A system comprising:

one or more computing devices; and

a memory storage apparatus in data communication with the one or more computing devices and storing instructions executable by the one or more computing devices and that upon such execution cause the one or more computing devices to perform operations comprising;

receiving, by a system server, from a wireless device including a camera, an image of text captured by the camera from a rendered document;

performing, by the system server, a recognition process on the image of text, and generating, by the recognition process, a corresponding representation of the text;

determining, by the system server, that the representation of the text includes a reference to a product;

providing, by the system server and for presentation on the wireless device, a purchase option for purchasing the product;

receiving, by the system server, from the wireless device, a response to the purchase option that indicates an instruction to purchase the product.

11. The system of claim 10, wherein the wireless device includes a display, and wherein the operations further comprise:

presenting, on the display, the image of the text to be captured by the camera.

12. The system of claim 11, wherein the operations further comprise:

presenting, on the display, information about the quality of the image and its suitability for recognition.

13. The system of claim 11, wherein the operations further comprise:

presenting, on the display, information about one or more segments of text to be captured from the rendered document.

14. The system of claim 10, wherein the operations further comprise:

storing, by the system server, an identifier of the product;

providing, by the system server to the wireless device, information from a log of stored product identifiers; and

receiving, by the system server from the wireless device, the instruction to purchase the product.

15. The system of claim 10, wherein providing the purchase option for purchasing the product includes providing a context menu of actions comprising the purchase option for purchasing the product.

16. The system of claim 10, wherein the operations further comprise:

receiving, by the system server, from a seller server, availability and price information related to the product; and

providing, by the system server and for presentation on the wireless device, the availability and price information; and

providing, by the system server, to the seller server, the instruction to purchase the product.

17. The system of claim 16, wherein the operations further comprise:

storing, by the system server, account information corresponding to an account associated with the wireless device;

storing, by the system server, account information corresponding to an account associated with the seller server;

receiving, by the system server, from the wireless device, an identifier of the account associated with the wireless device;

negatively adjusting the account associated with the wireless device; and

positively adjusting the account associated with the seller server.

18. The system of claim 17, wherein the account information corresponding to the account associated with the wireless device comprises shipping preference information, and wherein the operations further comprise providing the shipping preference information from the system server to the seller server.

19. A non-transitory computer readable medium storing instructions executable by one or more computing devices and that upon such execution cause the one or more computing devices to perform operations comprising:

receiving, by a system server, from a wireless device including a camera, an image of text captured by the camera from a rendered document;

performing, by the system server, a recognition process on the image of text, and generating, by the recognition process, a corresponding representation of the text;

determining, by the system server, that the representation of the text includes a reference to a product;

providing, by the system server and for presentation on the wireless device, a purchase option for purchasing the product;

receiving, by the system server, from the wireless device, a response to the purchase option that indicates an instruction to purchase the product.

20. The non-transitory computer readable medium of claim 19, wherein the operations further comprise:

storing, by the system server, an identifier of the product;

providing, by the system server to the wireless device, information from a log of stored product identifiers; and

receiving, by the system server from the wireless device, the instruction to purchase the product.