Systems and methods for augmented reality payments

• US 10,078,863 B2
• Filed: 12/26/2013
• Issued: 09/18/2018
• Est. Priority Date: 12/26/2013
• Status: Active Grant

• Current Assignee: PayPal, Inc. (PayPal Holdings, Inc.)
• Original Assignee: PayPal, Inc. (PayPal Holdings, Inc.)
• Inventors: Loganathan, Balu Epalapalli
• Primary Examiner(s): Najarian, Lena
• Application Number:
  US14/141,362
• Publication Number:
  US 20150186984A1
• Time in Patent Office: 1,727 Days
• CPC Class Codes: G06Q 20/12 specially adapted for electronic shopping systems
• CPC Class Codes: G06Q 20/321 using wearable devices
• CPC Class Codes: G06Q 20/322 Aspects of commerce using mobile devices [M-devices]
• CPC Class Codes: G06Q 30/0639 Item locations
• CPC Class Codes: G06Q 30/0641 Shopping interfaces
• CPC Class Codes: G07F 9/001 Interfacing with vending machines using mobile or wearable devices
• CPC Class Codes: G07F 9/0235 the arrangements being full-front touchscreens
• CPC Class Codes: G07G 1/01 Details for indicating displaying information in general G09F, G09G

Abstract

Systems and methods are provided for augmented reality payments. An augmented reality display may include product information and/or payment information images displayed over an image of one or more real world background objects. The augmented reality display may be displayed on a display of a mobile user device such as a smartphone or tablet or on a structure of a vehicle such as a vehicle windshield. The real world background objects may include a merchant store. The product information and/or the payment information may be overlaid on the merchant store as viewed through a vehicle windshield or as viewed in an image of the merchant store captured by a camera of the user device. The user may be provided with the ability to select one or more items for purchase, make one or more payments, or execute other transactions by interacting with the augmented reality display.

Claims

1. An augmented reality system of a vehicle, comprising:

a non-transitory memory storing account information of a user;

a location determination device configured to determine location information of the vehicle;

a display structure of the vehicle comprising at least one of a mirror, a windshield, a side window, or a vehicle seat; and

one or more hardware processors configured to execute instructions to perform operations comprising;

receiving product information in response to a second user selecting a product associated with the product information;

receiving payment information;

receiving the location information for the vehicle from the location determination device;

displaying the product information and the payment information on the display structure of the vehicle in an augmented reality display to the user in response to the location information identifying the vehicle as being parked at a location of a merchant, the displaying being such that the product information and the payment information are overlaid on an image associated with the merchant as viewed through the augmented reality display;

receiving payment instructions responsive to a touch selection from the user through the display structure; and

sending a payment to the merchant responsive to the payment instructions.

2. The system of claim 1, wherein the display structure is configured to display the product information and the payment information in the augmented reality display to the user.

3. The system of claim 1, wherein the display structure comprises the mirror.

4. The system of claim 1, wherein the display structure comprises the windshield.

5. The system of claim 1, wherein the display structure comprises the side window.

6. The system of claim 1, wherein the display structure comprises the vehicle seat.

7. The system of claim 1 wherein the operations further comprise:

determining a speed of the vehicle; and

removing display of the product information and the payment information in the augmented reality display when the speed is above a threshold speed.

8. A method, comprising:

receiving, electronically by one or more processors, product information for a user in a vehicle, in response to a second user selecting a product associated with the product information;

receiving, electronically by the one or more processors, payment information;

receiving, electronically by the one or more processors, location information for the vehicle from a location determination device;

displaying, electronically by the one or more processors on a display structure of the vehicle, the product information and the payment information in an augmented reality display to the user in response to the location information identifying the vehicle as being parked at a location of a merchant, the displaying being such that the product information and the payment information are overlaid on an image associated with the merchant as viewed through the augmented reality display, wherein the display structure comprises at least one of a mirror, a windshield, a side window of the vehicle, or a vehicle seat;

receiving, electronically by the one or more processors, payment instructions responsive to a touch selection from the user through the display structure; and

sending, electronically by the one or more processors, a payment to the merchant responsive to the payment instructions.

9. The method defined in claim 8, wherein the displaying comprises moving a location of the product information and/or the payment information to stay overlaid on the image associated with the merchant in response to the vehicle moving.

10. The method defined in claim 9, further comprising:

capturing an image of a background object; and

displaying the image of the background object on a display of a user device.

11. The method defined in claim 9, wherein the display structure comprises a transparent structure, the method further comprising:

displaying, for the payment information overlaid on the image associated with the merchant, images corresponding to the product information and the payment information on the transparent structure that allows the user to view a background object directly through the transparent structure and through a portion of the product information and the payment information.

12. The method defined in claim 11, wherein the transparent structure comprises the side window of the vehicle.

13. The method defined in claim 12, further comprising:

determining the location information of the vehicle;

determining a relative location of the merchant with respect to the vehicle; and

displaying images corresponding to the product information and the payment information at a time that depends on the location information of the vehicle and the relative location of the merchant.

14. The method defined in claim 12, wherein the receiving of the product information comprises receiving the product information from the merchant.

15. The method defined in claim 12, wherein the receiving of the product information comprises receiving product selections from a contact of the user.

16. The method defined in claim 15, further comprising providing products corresponding to the product selections to the user at a location of the merchant.