Telelocation: location sharing for users in augmented and virtual reality environments

• US 10,403,044 B2
• Filed: 07/21/2017
• Issued: 09/03/2019
• Est. Priority Date: 07/26/2016
• Status: Active Grant

• Current Assignee: tagSpace Pty., Ltd.
• Original Assignee: tagSpace Pty., Ltd.
• Inventors: Martin, Paul Simon
• Primary Examiner(s): Mushambo, Martin
• Application Number:
  US15/656,956
• Publication Number:
  US 20180033208A1
• Time in Patent Office: 774 Days
• Field of Search: None
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 1/00244 with a server, e.g. an internet server fax-servers or the like for store and forward H04N1/324
• CPC Class Codes: H04N 1/32128 attached to the image data, e.g. file header, transmitted message header, information on the same page or in the same computer file as the image for information embedded in the image H04N1/32144
• CPC Class Codes: H04N 2201/0084 Digital still camera
• CPC Class Codes: H04N 2201/0089 Image display device
• CPC Class Codes: H04N 2201/3253 Position information, e.g. geographical position at time of capture, GPS data
• CPC Class Codes: H04N 2201/3254 Orientation, e.g. landscape or portrait; Location or order of the image data, e.g. in memory

Abstract

Provided herein are exemplary embodiments for generating a telelocation, including capturing visual content representing a real world location by a device associated with a user, automatically associating a geographic location with the captured visual content, automatically associating orientation data with the captured visual content, transmitting a data bundle comprising the captured visual content, the geographic location and the orientation data to a server, notifying a remote user about the data bundle on the server, in response to receiving an acceptance from the remote user, transmitting the data bundle from the server to a device associated with the remote user to create a virtual rendering of the real world location.

Claims

1. A method for generating a telelocation, the method comprising:

capturing visual content representing a real world location by a device associated with a user;

automatically associating a geographic location with the captured visual content;

automatically associating orientation data with the captured visual content;

transmitting a data bundle comprising the captured visual content, the geographic location and the orientation data to a server;

notifying a remote user about the data bundle on the server;

in response to receiving an acceptance from the remote user, transmitting the data bundle from the server to a device associated with the remote user to create a virtual rendering of the real world location;

further comprising the remote user placing augmented reality graphics content in the virtual rendering or in the real world location.

2. The method of claim 1, further comprising the visual content including any of a virtual reality 360-180 degree panorama or a virtual reality 360 degree movie.

3. The method of claim 1, further comprising the geographic location including a longitude, a latitude and an altitude.

4. The method of claim 1, further comprising the orientation data including a current azimuth angle relative to True North.

5. The method of claim 4, further comprising the remote user viewing the virtual rendering relative to an actual position of the visual content using the orientation data including the current angle relative to the True North.

6. The method of claim 1, further comprising the user updating in real time the virtual rendering of the real world location.

7. The method of claim 1, further comprising the user placing augmented reality graphics content in the virtual rendering.

8. The method of claim 7, further comprising the remote user viewing in real time the augmented reality graphics content in the virtual rendering.

9. The method of claim 1, further comprising the user viewing in real time the augmented reality graphics content from the virtual rendering or in the real world location.

10. The method of claim 1, further comprising capturing the geographic location with GPS hardware of the device.

11. The method of claim 1, further comprising capturing the orientation data using any of a sensor on the device, or EXIF information from the visual content.

12. The method of claim 1, the orientation data further comprising one or more parameters stored when the visual content is captured, the one or more parameters representing a reference for future virtual rendering of the real world location.

13. The method of claim 12, further comprising the device associated with the remote user displaying the virtual rendering of the real world location when the remote user device reads the reference.

14. The method of claim 1, further comprising the orientation data including a current elevation angle relative to a horizon.

15. A method for generating a telelocation, the method comprising:

capturing visual content and related data representing a virtual reality location by a device associated with a user;

automatically associating a location with the captured visual content;

automatically associating orientation data with the captured visual content;

transmitting a data bundle comprising the captured visual content, the location and the orientation data to a server;

notifying a remote user about the data bundle on the server;

in response to receiving an acceptance from the remote user, transmitting the data bundle from the server to a device associated with the remote user to create a rendering of the virtual reality location; and

the orientation data further comprising one or more parameters stored when the visual content is captured, the one or more parameters representing a reference for future rendering of the virtual reality location.

16. The method of claim 15, further comprising the device associated with the remote user rendering of the virtual reality location when the remote user device reads the reference.

17. The method of claim 15, further comprising using the reference to position or orientation of the virtual reality location within a telelocation.

18. The method of claim 15, further comprising the user updating in real time the rendering of the virtual reality location.

19. The method of claim 15, further comprising the user placing augmented reality graphics content in the rendering of the virtual reality location.

20. The method of claim 19, further comprising the remote user viewing in real time the augmented reality graphics content in the rendering of the virtual reality location.

21. The method of claim 15, further comprising the remote user placing augmented reality graphics content in the rendering of the virtual reality location.

22. The method of claim 21, further comprising the user viewing in real time the augmented reality graphics content from the rendering of the virtual reality location.

23. A method for generating a telelocation, the method comprising:

capturing visual content and related data representing a virtual reality location by a device associated with a user;

automatically associating a location with the captured visual content;

automatically associating orientation data with the captured visual content;

transmitting a data bundle comprising the captured visual content, the location and the orientation data to a server;

notifying a remote user about the data bundle on the server;

in response to receiving an acceptance from the remote user, transmitting the data bundle from the server to a device associated with the remote user to create a rendering of the virtual reality location in a real world location; and

further comprising the user updating in real time the rendering of the virtual reality location in the real world location.

24. The method of claim 23, further comprising the user placing augmented reality graphics content in the rendering of the virtual reality location in the real world location.

25. The method of claim 24, further comprising the remote user viewing in real time the augmented reality graphics content in the rendering of the virtual reality location in the real world location.

26. The method of claim 23, further comprising the remote user placing augmented reality graphics content in the rendering of the virtual reality location in the real world location.

27. The method of claim 26, further comprising the user viewing in real time the augmented reality graphics content from the rendering of the virtual reality location in the real world location.