AUTOMATED USER INFORMATION PROVISION USING IMAGES

• US 20170111493A1
• Filed: 12/30/2016
• Published: 04/20/2017
• Est. Priority Date: 05/27/2011
• Status: Active Grant

• Current Assignee: PayPal, Inc. (PayPal Holdings, Inc.)
• Original Assignee: PayPal, Inc. (PayPal Holdings, Inc.)
• Inventors: Stone, Carl Bingham
• Granted Patent: US 10,798,236 B2
• Time in Patent Office: Days
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 20/322 Aspects of commerce using mobile devices [M-devices]
• CPC Class Codes: G06Q 30/0281 Customer communication at a business location, e.g. providing product or service information, consulting
• CPC Class Codes: G06Q 30/0601 Electronic shopping [e-shopping]
• CPC Class Codes: G06V 30/412 Layout analysis of documents structured with printed lines or input boxes, e.g. business forms or tables
• CPC Class Codes: G06V 30/413 Classification of content, e.g. text, photographs or tables
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality

Abstract

A method for automated user information provision using an image includes requesting at least one user information image in response to receiving a user information form from a requesting entity over a network. The at least one user information image is received from a camera. The at least one user information image is analyzed using a processor to determine that the at least one user information image includes requested user information in at least one request section of the user information form. The requested user information is automatically provided into the at least one request section of the user information form. The user information form including the requested user information in the at least one request section is displayed on a display. The user information form may then be sent over the network to provide the requested user information to the requesting entity.

Claims

1. A mobile phone, comprising:

a chassis;

a camera included on the chassis;

a display device included on the chassis;

an input device included on the chassis;

a communication device included in the chassis;

a non-transitory memory included in the chassis; and

one or more hardware processors that are included in the chassis and that are coupled to the camera, the display device, the input device, the communication device, and the non-transitory memory, wherein the one or more hardware processors are configured to read instructions from the non-transitory memory to perform operations comprising;

providing, for display using the display device, a request for an image, wherein the request identifies a type of documentation that is to be included in the image and that includes documentation information;

receiving, from the camera, a documentation information image that includes documentation that is the type of documentation that was identified in the request and that includes the documentation information;

analyzing the documentation information image to recognize the documentation information in the documentation included in the documentation information image; and

providing, for storage, the documentation information that was recognized in the documentation included in the user information image.

2. The mobile phone of claim 1, wherein the operations further comprise:

automatically providing, in an information form, the documentation information that that was recognized in the documentation included in the documentation information image.

3. The mobile phone of claim 1, wherein the providing the request for the image includes:

providing, for display using the display device, an image frame.

4. The mobile phone of claim 3, wherein the operations further comprise:

providing, for display using the display device, an image of the documentation positioned within the image frame in response to the documentation being positioned relative to the chassis and in view of the camera.

5. The mobile phone of claim 1, wherein the operations further comprise:

capturing, using the camera, the documentation information image; and

storing the documentation information image.

6. The mobile phone of claim 1, wherein the operations further comprise:

providing, for display using the display device, a plurality of different documentation type identifiers; and

receiving, from the input device, a selection of a first of the plurality of documentation type identifiers, wherein the selection of the first of the plurality of documentation type identifiers identifies the type of documentation that is to be included in the image.

7. The mobile phone of claim 1, wherein the providing the documentation information for storage includes:

providing, using the communication device, the documentation information through a network for storage.

8. A documentation information recognition and storage system, comprising:

a non-transitory memory; and

one or more hardware processors coupled to the non-transitory memory and configured to read instructions from the non-transitory memory to perform operations comprising;

identifying, using a display device, a type of documentation that is to be included in an image and that includes documentation information;

receiving, from a camera, a documentation information image;

analyzing the documentation information image to recognize the documentation information in documentation that is included in the documentation information image; and

providing, for storage, the documentation information that was recognized in the documentation included in the user information image.

9. The documentation information recognition and storage system of claim 8, wherein the operations further comprise:

automatically filling an information form using at least some of the documentation information that that was recognized in the documentation included in the documentation information image.

10. The documentation information recognition and storage system of claim 8, wherein the providing the request for the image includes:

generating, for display on the display device, an image frame.

11. The documentation information recognition and storage system of claim 10, wherein the operations further comprise:

providing, for display on the display device, an image of the documentation positioned within the image frame in response to the documentation being oriented relative to the camera.

12. The documentation information recognition and storage system of claim 8, wherein the operations further comprise:

capturing, using the camera, the documentation information image; and

storing the documentation information image.

13. The documentation information recognition and storage system of claim 8, wherein the operations further comprise:

displaying, on the display device, a plurality of different documentation type identifiers; and

receiving a selection of a first documentation type identifiers of the plurality of documentation type identifiers, wherein the first documentation type identifier identifies the type of documentation that is to be included in the image.

14. The documentation information recognition and storage system of claim 8, wherein the providing the documentation information for storage includes:

sending, using a communication device, the documentation information through a network.

15. A method for recognizing and storing documentation information, comprising:

providing, for display using at least one processor, an identification of a type of documentation that includes documentation information;

receiving, using the at least one processor, a documentation information image that includes documentation that was identified in the request and that includes the documentation information;

recognizing, using the at least one processor, the documentation information in the documentation included in the documentation information image; and

storing, using the at least one processor, the documentation information that was recognized in the documentation included in the user information image.

16. The method of claim 15, further comprising:

automatically providing, in each of a plurality of sections in an information form using the at least one processor, respective elements of the documentation information that that was recognized in the documentation included in the documentation information image.

17. The method of claim 15, further comprising:

providing, for display using the at least one processor, an image of the documentation positioned within an image frame that has been generated and displayed on the display device.

18. The method of claim 15, further comprising:

capturing, using the at least one processor, the documentation information image; and

storing, using the at least one processor, the documentation information image.

19. The method of claim 15, further comprising:

receiving, using the at least one processor, a selection of a first documentation type identifier that is provided for display by the at least one processor, wherein the first documentation type identifier identifies the type of documentation that includes the documentation information.

20. The method of claim 15, further comprising:

transmitting, using the at least one processor, the documentation information through a network.

21. A non-transitory machine-readable medium having stored thereon machine-readable instructions executable to cause at least one processor to perform operations comprising:

providing, for display on a display device, a request for an image, wherein the request identifies a type of documentation that is to be included in the image and that includes documentation information;

receiving, from a camera, a documentation information image that includes documentation that is the type of documentation that was identified in the request and that includes the documentation information;

analyzing the documentation information image to recognize the documentation information in the documentation included in the documentation information image; and

providing, for storage, the documentation information that was recognized in the documentation included in the user information image.

22. The non-transitory machine-readable medium of claim 21, wherein the operations further comprise:

automatically providing, in an information form, the documentation information that that was recognized in the documentation included in the documentation information image.

23. The non-transitory machine-readable medium of claim 21, wherein the operations further comprise:

providing, for display on the display device, an image frame; and

providing, for display on the display device, an image of the documentation positioned within the image frame in response to the documentation being positioned relative to the camera.

24. The non-transitory machine-readable medium of claim 21, wherein the operations further comprise:

providing, for display on the display device, a plurality of different documentation type identifiers; and

receiving, from an input device, a selection of a first of the plurality of documentation type identifiers, wherein the selection of the first of the plurality of documentation type identifiers identifies the type of documentation that is to be included in the image.