System for distribution and display of mobile targeted augmented reality content

• US 10,638,256 B1
• Filed: 10/09/2018
• Issued: 04/28/2020
• Est. Priority Date: 06/20/2016
• Status: Active Grant

• Current Assignee: Pipbin, Inc.
• Original Assignee: Pipbin, Inc.
• Inventors: Suiter, Maximillian John
• Primary Examiner(s): Cutler, Albert H
• Application Number:
  US16/155,727
• Time in Patent Office: 567 Days
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: H04M 1/72439 for image or video messaging
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/021 Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
• CPC Class Codes: H04W 4/027 using movement velocity, acceleration information
• CPC Class Codes: H04W 4/08 User group management
• CPC Class Codes: H04W 4/185 by embedding added-value information into content, e.g. geo-tagging
• CPC Class Codes: H04W 4/46 for vehicle-to-vehicle communication [V2V]
• CPC Class Codes: H04W 4/80 Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication

Abstract

A handy for recording filterable content includes a pose system with absolute and relative position sensors for determining a position and orientation of the handy. The handy may refine the determined pose by resolving position ambiguities between the absolute and relative position sensors. Augmented reality moment files represented by augmented reality icons may be recorded and read by the handy based on the pose associated with the file, the current pose of a reading handy and filtering on both the recorder and reader sides. Icon-assessable moment files may include recorded media and other content; moment files may expire after a particular timespan or drift, whereby the location or orientation associated with the augmented reality moment file may update.

Claims

1. A recording handy for recording filterable content, comprising:

a pose system comprising at least one of an absolute position sensor and a relative position sensor, the pose system configured to determine an initial pose comprising an initial orientation of the handy and an initial position of the handy;

at least one processor coupled to the pose system and configured to;

(1) determine at least one refined pose based on the initial pose by resolving at least one position ambiguity associated with one or more of the absolute position sensor and the relative position sensor;

(2) generate at least one moment file comprising;

(a) a moment pose corresponding to the moment file and including at least a moment position and a moment orientation;

(b) one or more recorder attributes associated with at least one of the recording handy and the moment file, the recorder attributes chosen from a recorder identifier and a recorder filter;

(c) one or more filterable content elements chosen from an image, a video clip, a sound recording, a text file, a mood, a place, and an activity; and

(d) at least one augmented reality icon corresponding to one or more of the moment file and the filterable content elements;

(3) transmit the moment file to at least one server, the moment file accessible via the at least one augmented reality icon by at least one reading handy based on one or more of a reader pose and a reader attribute associated with the reading handy, the reader pose including one or more of a reader position and a reader orientation of the reading handy; and

(4) at least one beacon attachable to a mobile target, the mobile target associated with at least one of a current position and a current orientation, the at least one beacon configured to update the moment pose based on at least one of the current position and the current orientation.

2. The recording handy of claim 1, wherein the moment pose is based on the refined pose.

3. The recording handy of claim 1, wherein the moment pose corresponds to a relative position.

4. The recording handy of claim 1, wherein the moment location includes a locus associated with the moment position.

5. The recording handy of claim 1, wherein:

the at least one augmented reality icon includes encoded information associated with the at least one beacon, the encoded information decodable by the reading handy to access the moment file.

6. The recording handy of claim 1, wherein the recording handy is a first recording handy, the at least one augmented reality icon is a first augmented reality icon, the moment file is a recorder moment file and:

the at least one processor is configured to retrieve from the at least one server at least one second augmented reality icon associated with a reader moment file based on one or more of;

a) the proximity of one or more of the initial pose and the refined pose to the moment pose corresponding to the reader moment file;

b) the one or more recorder attributes; and

c) one or more reader attributes associated with at least one of the reader moment file and a second recording handy generating the reader moment file, the reader attributes including at least one of a reader identifier and a reader filter.

7. The recording handy of claim 6, further comprising:

at least one display unit coupled to the at least one processor and configured to display one or more of;

at least one image associated with an environment proximate to at least one of the initial pose and the refined pose;

the at least one second augmented reality icon; and

the one or more filterable content elements associated with the reader moment file.

8. The recording handy of claim 6, wherein the one or more filterable content elements associated with the recorder moment file include at least one response to the reader moment file.

9. A recorder device for recording filterable content, comprising:

at least one processor configured to;

(1) generate at least one moment file comprising;

(a) a moment pose corresponding to the moment file and including at least a moment position and a moment orientation;

(b) one or more recorder attributes associated with at least one of the recorder and the moment file, the one or more recorder attributes chosen from a recorder identifier and a recorder filter;

(c) one or more filterable content elements chosen from an image, a video clip, a sound recording, a text file, a mood, a place, and an activity; and

(d) at least one augmented reality icon corresponding to one or more of the moment file and the filterable content elements;

(2) transmit the moment file to at least one server, the moment file accessible via the at least one augmented reality icon by at least one reader device based on one or more of a reader pose and a reader attribute associated with the reader device, the reader pose including one or more of a reader position and a reader orientation of the reader device; and

(3) at least one beacon attachable to a mobile target, the mobile target associated with at least one of a current position and a current orientation, the at least one beacon configured to update the moment pose based on at least one of the current position and the current orientation.

10. The recorder device of claim 9, wherein the at least one augmented reality icon includes encoded information associated with the at least one beacon, the encoded information decodable by the reading handy to access the moment file.

11. The recorder device of claim 9, wherein the recorder device is a first recorder device, the at least one augmented reality icon is a first augmented reality icon, and the moment file is a recorder moment file, further comprising:

a pose system comprising at least one of an absolute position sensor and a relative position sensor, the pose system configured to determine an initial pose comprising an initial orientation of the recorder device and an initial position of the recorder device;

the at least one processor configured to;

(1) determine at least one refined pose based on the initial pose by resolving at least one position ambiguity associated with one or more of the absolute position sensor and the relative position sensor;

(2) retrieve from the at least one server at least one second augmented reality icon associated with a reader moment file based on one or more of;

a) the proximity of one or more of the initial pose and the refined pose to the moment pose corresponding to the reader moment file;

b) the one or more recorder attributes; and

c) one or more reader attributes associated with at least one of the reader moment file and a second recorder device generating the reader moment file, the reader attributes including at least one of a reader identifier and a reader filter.

12. The recorder device of claim 11, further comprising:

at least one display unit coupled to the at least one processor and configured to display one or more of;

at least one image associated with an environment proximate to at least one of the initial pose and the refined pose;

the at least one second augmented reality icon; and

the one or more filterable content elements associated with the reader moment file.

13. The recording device of claim 11, wherein the one or more filterable content elements associated with the recorder moment file include at least one response to the reader moment file.

14. A reader device for reading filterable content, comprising:

a pose system comprising at least one of an absolute position sensor and a relative position sensor, the pose system configured to determine an initial pose comprising an initial orientation of the reader device and an initial position of the reader device;

at least one processor coupled to the pose system and configured to;

(1) determine at least one refined pose based on the initial pose by resolving at least one position ambiguity associated with one or more of the absolute position sensor and the relative position sensor; and

(2) retrieve from at least one server at least one augmented reality icon associated with a reader moment file based on one or more of;

a) the proximity of one or more of the initial pose and the refined pose to a moment pose corresponding to the reader moment file; and

b) one or more reader attributes associated with at least one of the reader moment file and a recorder device generating the reader moment file, the reader attributes including at least one of a reader identifier and a reader filter; and

at least one beacon attachable to a mobile target, the mobile target associated with at least one of a current position and a current orientation, the at least one beacon configured to update the moment pose based on at least one of the current position and the current orientation.

15. The reader device of claim 14, wherein:

the at least one augmented reality icon includes encoded information associated with the at least one beacon, the encoded information decodable by the reader device to access the moment file.

16. The reader device of claim 14, wherein the reader device is a first reader device, the at least one augmented reality icon is a first augmented reality icon, the moment file is a reader moment file generated by a first recorder device, the moment pose is a reader moment pose, and:

the at least one processor is configured to;

(1) generate at least one recorder moment file comprising;

(a) a recorder moment pose corresponding to the recorder moment file and including at least a recorder position and a recorder orientation;

(b) one or more recorder attributes associated with at least one of the first reader device and the moment file, the one or more recorder attributes chosen from a recorder identifier and a recorder filter;

(c) one or more filterable content elements chosen from an image, a video clip, a sound recording, a text file, a mood, a place, and an activity; and

(d) at least one second augmented reality icon corresponding to one or more of the recorder moment file and the filterable content elements; and

(2) transmit the recorder moment file to the at least one server, the recorder moment file accessible via the at least one second augmented reality icon by at least one second reader device based on one or more of a reader pose and a reader attribute associated with the second reader device, the reader pose including one or more of a reader position and a reader orientation of the second reader device.

17. The reader device of claim 16, further comprising:

at least one display unit coupled to the at least one processor and configured to display one or more of;

at least one image associated with an environment proximate to at least one of the initial pose and the refined pose;

the at least one second augmented reality icon; and

the one or more filterable content elements associated with the reader moment file.

18. The reader of claim 16, wherein the one or more filterable content elements associated with the recorder moment file include at least one response to the reader moment file.

19. The reader device of claim 16, wherein the at least one beacon is a first beacon and the mobile target is a first mobile target, further comprising:

at least one second beacon attachable to a second mobile target, the second mobile target associated with at least one of a current position and a current orientation, the at least one second beacon configured to update the recorder pose based on at least one of the current position and the current orientation of the second mobile target.

20. The reader device of claim 14, wherein the reader moment file is a first reader moment file including one or more instructions for accessing at least one second reader moment file.

21. The reader device of claim 20, wherein the at least one processor is configured to access the one or more instructions based on the proximity of one or more of the initial pose and the refined pose to the moment pose.

22. The reader device of claim 20, wherein the one or more instructions include at least one of a condition and a challenge.

23. The reader device of claim 22, wherein the one or more instructions include at least one reward associated with a successful response to the condition or the challenge.

24. The reader device of claim 20, wherein the one or more instructions include one or more guidance elements capable of directing the reading handy to adjust the initial pose or the refined pose based on the moment pose.