System for curation and display of location-dependent augmented reality content in an augmented estate system

• US 11,044,393 B1
• Filed: 10/22/2018
• Issued: 06/22/2021
• Est. Priority Date: 06/20/2016
• Status: Active Grant

• Current Assignee: Pipbin, Inc.
• Original Assignee: Pipbin, Inc.
• Inventors: Suiter, Maximillian John, Suiter, Sean Patrick, Suiter, Ian Padraic, Morrison, Scott David, Morrison, Valerie Michele
• Primary Examiner(s): Cutler, Albert H
• Application Number:
  US16/167,256
• Time in Patent Office: 974 Days
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/06 Buying, selling or leasing transactions
• CPC Class Codes: G06Q 30/0639 Item locations
• CPC Class Codes: G06Q 30/08 Auctions
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering
• CPC Class Codes: G06T 2219/004 Annotating, labelling
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: H04N 1/00244 with a server, e.g. an internet server fax-servers or the like for store and forward H04N1/324
• CPC Class Codes: H04N 1/212 Motion video recording combined with still video recording television signal recording H04N5/76
• CPC Class Codes: H04N 1/2125 Display of information relating to the still picture recording
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/633 for displaying additional information relating to control or operation of the camera
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04W 4/185 by embedding added-value information into content, e.g. geo-tagging

Abstract

A device for recording filterable content in the form of an augmented reality moment file which is represented by an augmented reality icon recordable and readable by a device having a processor in proximity to the locus of a recorded moment file configured to receive an augmented reality moment file. The content of the augmented reality moment file is preferably assessable via a user selectable icon either representative of a user, location, and/or theme. The icon assessable content moment file preferably includes a location, a product or a service purchase fact, a coupon, an advertisement, a promotional offer, a public transportation advisement, a travel advisement, a review, a moment proximity alert, a monetary amount, a map of locations where moments were created by a specific user, a time certification, a resume, a biography, a headshot, a moment “like” notification, a riddle, or a challenge.

Claims

1. An enrolled device for reading recorded moments, comprising:

one or more processors;

at least one wireless interface configured to wirelessly connect to one or more of a server or a cloud-based data storage;

at least one image capture device associated with at least one field of view (FOV);

at least one position sensor coupled to the one or more processors and configured to determine a device position;

a memory capable of storing one or more reader attributes corresponding to a user, the one or more reader attributes selected from a reader interest, a reader identifier, or a reader permission;

and

at least one display unit in communication with the at least one image capture device and configured for displaying to the user the at least one FOV;

the device configured to;

determine at least one of a reader location and a locus associated with a moment file based on the device position or at least one image element identified within the FOV, the at least one image element including at least one target object incorporating at least one moment symbol detectable by the image capture device;

receive from the server at least one notification when the reader location is proximate to the locus, the notification configured for announcing at least one moment icon corresponding to the moment file;

determine whether the user is an accessing user based on the one or more reader attributes;

provide the accessing user with at least one prompt for accessing the moment file via the moment icon;

and

direct the at least one display unit to

     1) present to the accessing user one or more first filterably selected content elements or

     2) withhold from the accessing user one or more second filterably selected content elements corresponding to the moment file.

2. The enrolled device of claim 1, wherein:

the moment file is a first moment file;

and

the one or more filterable selected content elements include one or more instructions for accessing at least one second moment file.

3. The enrolled device of claim 1, wherein the at least one prompt includes:

a challenge answerable by the accessing user via at least one response.

4. The enrolled device of claim 3, wherein the one or more filterably selected content elements include at least one reward associated with a successful response to the challenge.

5. The enrolled device of claim 1, wherein the at least one position sensor includes:

an absolute position sensor configured to determine an absolute device position based on one or more received position signals;

and

an inertial measurement unit (IMU) configured to;

determine a relative device position relative to the absolute device position;

and

determine a device orientation corresponding to the device.

6. The enrolled device of claim 1, wherein:

the moment file is associated with a moment location within the locus;

and

the at least one prompt includes instructions for locating the moment location based on the reader location.

7. The enrolled device of claim 6, wherein:

the one or more processors are configured to map at least one of the reader location and the moment location to a mapping layer selected from a two-dimensional (2D) map and a three-dimensional (3D) map;

and

the at least one display unit is configured to present the mapping layer to the accessing user.

8. The enrolled device of claim 7, wherein the at least one display unit is configured to fuse the mapping layer and the at least one FOV.

9. The enrolled device of claim 7, wherein the moment file is a first moment file, the moment icon is a first at least one moment icon, and the mapping layer is configured to identify within the at least one FOV one or more auxiliary loci selected from:

a first auxiliary location not associated with the first moment file;

or

a second auxiliary location associated with at least one second moment file, the at least one display unit configured to display at least one second moment icon corresponding to the second moment file.

10. The enrolled device of claim 7, wherein the moment file is a first moment file, and:

the moment file is associated with at least one creator;

and

the mapping layer is configured to display one or more second moment files associated with the creator.

11. The enrolled device of claim 1, wherein:

the at least one display unit is configured to display to the accessing user at least one hypertext document including the moment symbol;

and

the moment file is accessible by the accessing user via the hypertext document.

12. The enrolled device of claim 1, wherein the one or more filterably selected content elements are selected from:

an employee time clock capable of generating a time record corresponding to a reader interaction;

a resume;

a biography;

or

a portfolio.

13. The enrolled device of claim 1, wherein the one or more filterably selected content elements include at least one transaction selected from:

a payment collectible by the accessing user;

a reward collectible by the accessing user;

a purchase executable by the accessing user;

a coupon redeemable by the accessing user;

or

a cryptocurrency transaction executable by the accessing user.

14. The enrolled device of claim 1, wherein the one or more filterably selected content elements include one or more augmentations selected from:

an augmented pet;

an augmented plant;

an augmented fictional character;

an augmented vehicle;

an augmented currency transaction associated with a purchase of the one or more augmentations;

or

an augmented environment.