Enhanced data transfer initiation using image recognition

• US 10,275,744 B2
• Filed: 02/10/2016
• Issued: 04/30/2019
• Est. Priority Date: 02/10/2016
• Status: Active Grant

• Current Assignee: PayPal, Inc. (PayPal Holdings, Inc.)
• Original Assignee: PayPal, Inc. (PayPal Holdings, Inc.)
• Inventors: Studnicka, Todd Murray
• Primary Examiner(s): Werner, Brian
• Application Number:
  US15/040,715
• Publication Number:
  US 20170228584A1
• Time in Patent Office: 1,175 Days
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06Q 20/10 specially adapted for electronic funds transfer [EFT] systems; specially adapted for home banking systems
• CPC Class Codes: G06V 40/113 Recognition of static hand signs
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: H04L 61/4594 Address books, i.e. directories containing contact information about correspondents telephone directories in user terminals H04M1/27453
• CPC Class Codes: H04W 76/14 Direct-mode setup

Abstract

Systems, methods, and computer program products are disclosed for improving ease in initiating information transfers between devices. A user of a communications device accesses an image of a target recipient. With that recipient in view in the image, the user selects the portion of the screen where the recipient is displayed in the image. Pattern recognition is performed to extract one or more features of the selected portion of the screen as a recognized pattern. That recognized pattern is compared against multiple stored patterns that are associated with contacts in contact lists and/or other types of databases. Once a match is found, the user is prompted to confirm the identified recipient corresponding to the matching pattern and the data to transfer. Once confirmed, the data transfer is initiated based on the automatically determined recipient information.

Claims

1. A system, comprising:

a non-transitory memory storing instructions;

a display configured to display information comprising an image to a user of the system; and

one or more hardware processors coupled to the non-transitory memory and configured to read the instructions from the non-transitory memory to cause the system to perform operations comprising;

receiving a selection of a portion of the image from the user;

determining a first pattern from the selected portion of the image;

in response to determining that the first pattern corresponds to one or more stored patterns of a plurality of stored patterns;

determining a confidence level associated with the correspondence between the first pattern and the one or more stored patterns; and

identifying contact information of a recipient associated with the one or more stored patterns; and

in response to determining that the confidence level is above a first threshold level and a monetary amount associated with data to be transmitted being below a second threshold level, automatically initiating a transmission of the data to the recipient based on the identified contact information.

2. The system of claim 1, wherein the operations further comprise:

performing pattern recognition on the selected portion of the image to obtain the first pattern; and

prompting the user to confirm the recipient as a target for the data prior to initiating the transmission in response to the confidence level indicating there is no match.

3. The system of claim 1, further comprising:

a location determination device configured to determine a location of the system, the operations further comprising narrowing the plurality of stored patterns to a subset of stored patterns based on the determined location of the system.

4. The system of claim 1, wherein the operations further comprise:

as part of the selection of the portion of the image, detecting a gesture from the user on the display;

determining whether the gesture is a first gesture type comprising a first number of approximately simultaneous gesture inputs that corresponds to a first composition of data, or a second gesture type comprising a second number of approximately simultaneous gesture inputs that corresponds to a second composition of data, the first and second compositions of data being different from each other and the second number of inputs being different from the first number of inputs; and

in response to the gesture type comprising the first gesture type, using the first composition of data as the data.

5. The system of claim 1, wherein:

the selected portion of the image comprises a plurality of portions corresponding to a plurality of entities in the image,

the determining comprises determining a plurality of patterns for each of the plurality of portions,

the identifying comprises identifying contact information for a plurality of recipients associated with the plurality of patterns, and

the initiating comprises initiating the transmission to the plurality of recipients based on the identified contact information for the plurality of recipients.

17. The system of claim 1, wherein the operations further comprise:

determining a second pattern from a new selected portion;

in response to determining that the second pattern corresponds to another one or more stored patterns of the plurality of stored patterns, determining a second confidence level associated with the correspondence; and

in response to the second confidence level being below the first threshold level that corresponds to a less than 100 percent value, prompting the user to confirm a result.

6. A non-transitory machine-readable medium having stored thereon machine-readable instructions executable to cause a machine to perform operations comprising:

receiving a selection of a portion of an image displayed on a screen of the machine by a user;

transmitting the selected portion of the image to a processing server, wherein the transmitting the image to the processing server triggers the processing server to determine a recognized pattern from the selected portion of the image and to determine a correspondence between the recognized pattern and one or more patterns;

receiving, from the processing server, a message identifying the correspondence between the recognized pattern and the one or more patterns;

in response to the message identifying the correspondence, determining a confidence level associated with the correspondence; and

in response to determining that the confidence level is above a first threshold level and a monetary amount associated with data to be transmitted being below a second threshold level, automatically initiating a transmission of the data to a recipient identified by contact information associated with the one or more patterns.

7. The non-transitory machine-readable medium of claim 6, wherein the operations further comprise:

prompting the user to add a new entry to a contact information list in response to the confidence level indicating there is no match.

8. The non-transitory machine-readable medium of claim 6, wherein the operations further comprise:

determining, by a location determination device of the machine, a location of the machine;

selecting an item of information to transmit as the data from among a plurality of items based on the determined location of the machine; and

in response to the selecting based on the determined location, prompting the user to confirm or edit the item of information before initiating the transmission.

9. The non-transitory machine-readable medium of claim 6, wherein the operations further comprise:

providing, by an image detection device of the machine, a live stream of images to the screen for the selection by the user.

10. The non-transitory machine-readable medium of claim 6, wherein the operations further comprise:

displaying a static image on the screen for the selection by the user.

11. The non-transitory machine-readable medium of claim 6, wherein the data comprises at least one of:

a monetary amount in payment;

or

an invoice identifying a monetary amount for the recipient to pay.

18. The non-transitory machine-readable medium of claim 6, wherein the operations further comprise:

determining a second pattern from a new selected portion;

in response to determining that the second pattern corresponds to another one or more patterns of a plurality of stored patterns, determining a second confidence level associated with the correspondence; and

in response to the second confidence level being below the first threshold level that corresponds to a less than 100 percent value, prompting the user to confirm a result.

12. A method, comprising:

receiving a selection of a portion of an image displayed on a screen of a mobile communications device;

performing pattern recognition on the selected portion of the image to obtain a recognized pattern;

determining that the recognized pattern corresponds to one or more stored patterns of a plurality of stored patterns at the mobile communications device;

determining a confidence level associated with the correspondence of the recognized pattern to the one or more stored patterns;

determining the confidence level is above a first threshold level and a monetary amount associated with data to be transmitted is below a second threshold level; and

automatically initiating a transmission of the data to a recipient identified by contact information associated with the one or more patterns.

13. The method of claim 12, further comprising:

transmitting the recognized pattern to a processing server in response to determining there is not a correspondence between the recognized pattern and the one or more stored patterns at the mobile communications device, wherein the transmitting the image to the processing server triggers the processing server to compare the recognized pattern to one or more patterns at the processing server to determine if there is a correspondence; and

receiving, from the processing server, a message identifying a corresponding pattern as a stored pattern from among the one or more patterns at the processing server.

14. The method of claim 13, further comprising:

prompting a user to add a new entry to a contact information list in response to the confidence level indicating there is no match.

15. The method of claim 12, further comprising:

determining, by a location determination device of the mobile communications device, a location of the mobile communications device;

narrowing, by the mobile communications device, the one or more stored patterns to a subset of stored patterns based on the determined location; and

selecting, by the mobile communications device, an item of information to transmit as the data from among a plurality of items based on the determined location of the mobile communications device.

16. The method of claim 12, further comprising:

establishing the first threshold level, corresponding to a less than 100 percent value below which a user will be prompted to confirm a result, and above which the transmission of the data will be automatically initiated in response to the monetary amount being less than the second threshold level; and

prompting, in response to the confidence level being below the first threshold level, the user to confirm the result.

19. The method of claim 12, further comprising:

as part of the selection of the portion of the image, detecting a gesture from a user on a region of the screen;

in response to the gesture on the region of the screen being on a first region of the screen, using a first composition of data as the data; and

in response to the gesture on the region of the screen being on a second region of the screen, using a second composition of data as the data,

wherein the first region and the second region are located at different portions of the screen, and the first composition of data is different from the second composition of data.