USING AUGMENTED REALITY TO DETERMINE INFORMATION

• US 20170132823A1
• Filed: 01/13/2017
• Published: 05/11/2017
• Est. Priority Date: 03/14/2013
• Status: Active Grant

• Current Assignee: PayPal, Inc. (PayPal Holdings, Inc.)
• Original Assignee: PayPal, Inc. (PayPal Holdings, Inc.)
• Inventors: Zamer, Kamal
• Granted Patent: US 9,886,786 B2
• Time in Patent Office: Days
• CPC Class Codes: G06Q 20/12 specially adapted for electronic shopping systems
• CPC Class Codes: G06Q 20/321 using wearable devices
• CPC Class Codes: G06Q 20/322 Aspects of commerce using mobile devices [M-devices]
• CPC Class Codes: G06Q 20/40 Authorisation, e.g. identification of payer or payee, verification of customer or shop credentials; Review and approval of payers, e.g. check credit lines or negative lists
• CPC Class Codes: G06Q 30/0609 Buyer or seller confidence or verification
• CPC Class Codes: G06Q 30/0623 Item investigation
• CPC Class Codes: G06Q 30/0635 Processing of requisition or of purchase orders
• CPC Class Codes: G06Q 30/0641 Shopping interfaces
• CPC Class Codes: G06Q 30/0643 Graphical representation of items or shoppers
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04L 67/53 using third party service providers

Abstract

Systems, methods, and computer program products for identifying objects of interest and providing relevant information about the objects of interest using augmented reality devices are disclosed. For example, a computer-implemented method may include identifying an object of interest among a plurality of objects present in an image view, determining real-time information for the object of interest based on the identifying, presenting the determined real-time information for the object of interest as part of the image view, and processing a transaction involving the object of interest based on a user selection associated with the image view.

Claims

1. A system comprising:

a hardware device for capturing an image view;

a non-transitory memory storing the image view; and

one or more hardware processors coupled to the non-transitory memory and configured to read the image view from the non-transitory memory and cause the system to perform operations comprising;

identifying an object of interest among a plurality of objects present in the image view;

determining real-time information for the object of interest based on the identifying;

presenting the determined real-time information for the object of interest as part of the image view; and

processing an action involving the object of interest based on a user selection associated with the image view.

2. The system of claim 1, wherein the determined real-time information is based on a location of the hardware device and a location of the object of interest.

3. The system of claim 1, wherein the determined real-time information is based on a location of the hardware device, a location of the object of interest, and one or more identified visual characteristics of the object of interest.

4. The system of claim 1, wherein the determined real-time information is based on a location of the hardware device and a user purchase history.

5. The system of claim 1, wherein the object of interest is a vehicle and the determined real-time information comprises a current availability of the vehicle.

6. The system of claim 5, wherein the determined real-time information further comprises fuel data associated with the vehicle.

7. The system of claim 1, wherein the action is for a purchase of an item associated with the object of interest.

8. The system of claim 1, wherein the object of interest is a vehicle and the action is for a purchase of an item determined to be available on the vehicle.

9. A computer-implemented method comprising:

identifying, by an augmented reality (AR) device, an object of interest among a plurality of objects present in the image view;

determining, by the AR device, status information for the object of interest in association with the identifying;

obtaining, by the AR device, pricing information associated with the object of interest as part of the determining;

presenting, by the AR device, the determined status information for the object of interest and the obtained pricing information as part of the image view; and

processing, by the AR device, a transaction associated with the object of interest based on a user confirmation associated with the presenting.

10. The computer-implemented method of claim 9, wherein the determined status information is based on the location of the AR device and a user appointment.

11. The computer-implemented method of claim 9, wherein the object of interest is a vehicle and the pricing information is for a fare associated with the vehicle.

12. The computer-implemented method of claim 11, wherein the transaction is for a purchase of a ticket to use the vehicle.

13. The computer-implemented method of claim 9, wherein the determined status information comprises route information associated with the object of interest.

14. The computer-implemented method of claim 9, wherein the object of interest is in transit and the determined status information comprises a destination for the object of interest.

15. The computer-implemented method of claim 9, wherein the determining is based on a location of the AR device, the determined status information, and one or more user preferences.

16. The computer-implemented method of claim 9, wherein the object of interest is a vehicle and the determined status information comprises a description, a current location, a destination, and a route for the vehicle.

17. A non-transitory machine-readable medium having stored thereon machine-readable instructions executable to cause a machine to perform operations comprising:

capturing a streaming image view via a mobile device;

identifying a first object among a plurality of objects present in the image view;

identifying a second object associated with the first object, the second object being absent from the image view;

determining real-time status information for the second object based on the identifying; and

presenting the determined real-time information for the second object as augmented-reality data in the image view.

18. The non-transitory machine-readable medium of claim 17, wherein the first object is a first vehicle and the second object is a second vehicle.

19. The non-transitory machine-readable medium of claim 17, wherein the first object is a zone and the second object is a vehicle.

20. The non-transitory machine-readable medium of claim 17, wherein the first object is a vehicle and the second object is an item available on the vehicle.