Augmented reality systems for facilitating real-time charity donations

• US 10,636,062 B1
• Filed: 02/28/2019
• Issued: 04/28/2020
• Est. Priority Date: 02/28/2019
• Status: Active Grant

• Current Assignee: Capital One Services LLC (Capital One Financial Corporation)
• Original Assignee: Capital One Services LLC (Capital One Financial Corporation)
• Inventors: Mossoba, Michael, Shah, Salik, Edwards, Joshua
• Primary Examiner(s): Abrahamson, Amanda C
• Application Number:
  US16/288,830
• Time in Patent Office: 425 Days
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06Q 30/0279 Fundraising management
• CPC Class Codes: G06V 20/20 in augmented reality scenes

Abstract

Disclosed systems and methods provide an augmented environment that facilitates a donation to a charity. A system may receive organization data including data associated with a plurality of charitable organizations. The system may also receive (i) environmental data including an image of an object, and (ii) location data indicating the image location. Further, the system may identify the object and determine one or more qualifying charities associated with the object. The system may augment the environmental data by adding enhanced content such as an identification of the qualifying charity, transmit the enhanced content to a mobile device for display, and initiate a transfer of funds from a user account to a charity financial account associated with the qualifying charity.

Claims

1. A method comprising:

receiving organizational data associated with a plurality of charitable organizations, the organizational data comprising, for each charity of the plurality of charities;

a charity name;

associated subject matter comprising data representing one or more items that are associated with the charity;

a charity financial account; and

a charity location representing a location of an office of the charity;

receiving, from a mobile device associated with a user;

environmental data comprising an image of an object, the environmental data representing a physical environment of the mobile device; and

location data indicative of an image location at which the environmental data was obtained;

identifying, based on applying image recognition techniques to the image, the object;

determining, based on the identification of the object and the organizational data, one or more qualifying charities, wherein each qualifying charity of the one or more qualifying charities has associated subject matter that corresponds to the identification of the object;

identifying, from among the one or more qualifying charities and based on the location data and respective charity location of each of the one or more qualifying charities, a first one or more highest priority qualifying charities by prioritizing the one or more qualifying charities based on a proximity of each of the one or more qualifying charities to the image location and a degree of correspondence between the identification of the object and the associated subject matter of each respective qualifying charity, wherein prioritizing the one or more qualifying charities comprises;

receiving an indication of a preference as between the proximity and the degree of correspondence;

determining a priority score for each of the one or more qualifying charities by;

assigning a first value to the proximity based on a distance between the image location and the charity location;

assigning a second value to the correspondence based on the degree of correspondence;

modifying the first and second values based on the indication of the preference; and

summing the modified first and second values; and

ordering the one or more qualifying charities in order of their respective priority scores; and

selecting a predetermined number of highest priority qualifying charities;

augmenting the environmental data by adding virtual environmental data comprising enhanced content associated with the identified object, wherein the enhanced content is unrepresented in the physical environment and the enhanced content represents each of the selected one or more highest priority qualifying charities;

transmitting, to the mobile device, the virtual environmental data for creation of an augmented environment in combination with a display of a portion of the physical environment; and

receiving, from the mobile device that provides the environmental data and the location data, user input data indicative of a selection of a first qualifying charity from the selected one or more highest priority qualifying charities and a donation amount;

initiating, based on the received user input data, a transfer of funds from a financial account associated with the user to the charity financial account associated with the first qualifying charity.

2. The method of claim 1, wherein the identifying the first qualifying charity further comprises determining which respective charity location of each of the one or more qualifying charities has a closest proximity to the image location.

3. The method of claim 1, wherein determining an identification of the object comprises:

identifying, in the environmental data using image recognition techniques, a user gesture that indicates a selection of the object.

4. The method of claim 1 further comprising:

prioritizing, based on the location data and respective charity location of each of the one or more qualifying charities, the qualifying charities based on their proximity to the image location; and

selecting a predetermined number of highest priority qualifying charities,

wherein the enhanced content represents each of the selected highest priority qualifying charities.

5. The method of claim 1, wherein determining one or more qualifying charities comprises:

for each charity of the plurality of charities, comparing the identified object to the one or more items that are associated with the charity; and

identifying one or more charities of the plurality of charities in which the identified object matches an item of the respective one or more items.

6. The method of claim 1, wherein determining one or more qualifying charities comprises:

for each charity of the plurality of charities, comparing the identified object to the one or more items that are associated with the charity; and

determining, based on machine learning techniques, that the identified object corresponds to an item of the respective one or more items.

7. A method comprising:

receiving organizational data associated with a plurality of charitable organizations, the organizational data comprising, for each charity of the plurality of charities;

a charity name;

associated subject matter comprising data representing one or more items that are associated with the charity;

a charity financial account; and

a charity location representing a location of an office of the charity;

receiving, from a mobile device associated with a user;

an image including at least a portion of an object; and

location data indicative of an image location at which the image was obtained;

identifying, based on applying image recognition techniques to the image, the object;

determining, based on the identification of the object and the organizational data, one or more qualifying charities, wherein each qualifying charity of the one or more qualifying charities has associated subject matter that corresponds to the identification of the object;

identifying, from among the one or more qualifying charities and based on the location data and respective charity location of each of the one or more qualifying charities, one or more highest priority qualifying charities by prioritizing the one or more qualifying charities based on a proximity of each of the qualifying charities to the image location and a degree of correspondence between the identification of the object and the associated subject matter of each respective qualifying charity, wherein prioritizing the qualifying charities comprises;

receiving an indication of a preference as between the proximity and the degree of correspondence;

determining a priority score for each of the qualifying charities by;

assigning a first value to the proximity based on a distance between the image location and the charity location;

assigning a second value to the correspondence based on the degree of correspondence;

modifying the first and second values based on the indication of the preference; and

summing the modified first and second values; and

ordering the qualifying charities in order of their respective priority scores;

transmitting, to the mobile device, an indication of the one or more highest priority qualifying charities;

receiving, from the mobile device that provides the image and location data, user input data indicative of a selection of a first qualifying charity from the one or more highest priority qualifying charities and a donation amount; and

initiating, based on the received user input data, a transfer of funds from a financial account associated with the user to the charity financial account associated with the first qualifying charity.

8. The method of claim 7, wherein determining the identification of the object comprises:

identifying at least one from among symbols, words, letters, and characters associated with the object; and

determining that the at least one identified symbols, words, letters, and characters are associated with a known object.

9. The method of claim 7, further comprising:

receiving, from the mobile device, an indication of an electronic identifier associated with the object;

wherein determining the identification of the object further comprises identifying the object based on the electronic identifier.

10. The method of claim 9, wherein the electronic identifier comprises one of an RFID tag or beacon that is detected by the mobile device.

11. The method of claim 7, wherein determining one or more qualifying charities comprises:

for each charity of the plurality of charities, comparing the identified object to the one or more items that are associated with the charity; and

identifying one or more charities of the plurality of charities in which the identified object matches an item of the respective one or more items.

12. The method of claim 7, wherein determining one or more qualifying charities comprises:

for each charity of the plurality of charities, comparing the identified object to the one or more items that are associated with the charity; and

determining, based on machine learning techniques, that the identified object corresponds to an item of the respective one or more items.

13. The method of claim 7, further comprising:

storing, on a remotely viewable electronic map, a pin at the image location, wherein the pin represents one or more of the donation amount, the first qualifying charity, and an identification of a donor.

14. The method of claim 7, further comprising:

receiving user credentials associated with a social media account;

accessing the social media account with the user credentials; and

responsive to initiating a transfer of funds, posting content to the social media account, wherein the content comprises a representation of the donation to the first qualifying charity.

15. A method comprising:

obtaining, by one or more sensors of a mobile device;

environmental data representative of a physical environment of the mobile device, the environmental data comprising one or more images of an object, and

location data representative of a location of the mobile device;

transmitting, to a server, the environmental data and the location data;

receiving, from the server, an augmented environment signal comprising enhanced content associated with the object, the enhanced content not being present in the physical reality and being representative of an identification of one or more highest priority qualifying charities from among one or more qualifying charities, wherein the server is configured to identify the one or more highest priority qualifying charities based on a proximity of each of the one or more qualifying charities to an image location associated with the one or more images and a degree of correspondence between an identification of the object and the associated subject matter of each respective qualifying charity, wherein identifying the one or more highest qualifying charities comprises;

receiving an indication of a preference as between the proximity and the degree of correspondence;

determining a priority score for each of the one or more qualifying charities by;

assigning a first value to the proximity based on a distance between the image location and the charity location;

assigning a second value to the correspondence based on the degree of correspondence;

modifying the first and second values based on the indication of the preference; and

summing the modified first and second values; and

ordering the one or more qualifying charities in order of their respective priority scores; and

displaying, on a display of the mobile device, the enhanced content in association with the object, the enhanced content being representative of the identification of the one or more highest priority qualifying charities from the one or more qualifying charities;

receiving, by the mobile device that transmits the environmental data and location data to the server, a user input indicative of a command to make a donation to a first qualifying charity of the one or more highest priority qualifying charities;

generating, by the mobile device and in response to receiving the user input, a donation request, the donation request being representative of an instruction to transfer a donation amount from a financial account associated with a user of the mobile device to a financial account associated with the first qualifying charity; and

transmitting, to the server, the donation request for execution.

16. The method of claim 15, wherein receiving a user input comprises:

detecting a gesture performed by a user of the mobile device; and

determining that the gesture indicates a selection of the enhanced content displayed by the mobile device in association with the object.

17. The method of claim 15, wherein displaying the enhanced content in association with the object comprises superimposing the enhanced content over a portion of the object in an augmented reality display.

18. The method of claim 15, wherein the enhanced content represents a virtual button that initiates a donation transaction to the charitable organization when selected.