AUTHORING VIRTUAL AND AUGMENTED REALITY ENVIRONMENTS VIA AN XR COLLABORATION APPLICATION

• US 20200134925A1
• Filed: 12/23/2019
• Published: 04/30/2020
• Est. Priority Date: 08/03/2017
• Status: Active Application

• Current Assignee: Taqtile, Inc.
• Original Assignee: Taqtile, Inc.
• Inventors: TOMIZUKA, John
• Application Number:
  US16/726,116
• Publication Number:
  US 20200134925A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34

Abstract

This disclosure describes techniques that facilitate generating or modifying a template application that provides an application user with interactive experience within a Virtual Reality (VR) environment, an Augmented Reality (AR) environment, or a combination of both (i.e. MR environment). Moreover, this disclosure describes an XR collaboration system that permits an XR author to generate or modify an XR template that is presented to an application user via XR environment-enabled client device. Specifically, an XR author may use the XR collaboration application to add, change, or remove markers within an XR template along with associated virtual content. Further, the XR author may configure appearance criteria associated with markers to control the criteria and sequential order that markers may appear within an XR environment. Similarly, activation criteria may control the appearance and sequential order of virtual content that is associated with markers within the XR environment.

Claims

1. A computer-implemented method, comprising:

executing an XR collaboration application to provide a virtual reality experience within an XR environment representing a real-world environment on a client device;

recording virtual content within an XR template generated via the XR collaboration application as the virtual content is viewed by an XR author of the XR template on the client device;

receiving an input from the XR author to modify the virtual content within the XR template;

in response to receiving the input, rendering a modified virtual content within the XR template on the client device; and

storing the XR template in a data repository.

2. The computer-implemented method of claim 1, further comprising:

assigning a marker associated with the virtual content within the XR template;

receiving, via the client device, an additional input to generate an appearance criterion that controls a display of the marker within the XR template;

updating the XR template to create an updated XR template, the updated XR template including the marker, the appearance criterion, and the virtual content; and

storing the updated XR template in the data repository.

3. The computer-implemented method of claim 2, wherein the updated XR template is configured to display the virtual content in response to the display of the marker on the client device.

4. The computer-implemented method of claim 1, further comprising:

receiving, via the client device, an additional input to generate an activation criterion that controls display of the virtual content within the XR template, the activation criterion corresponding to the additional input;

updating the XR template to create an updated XR template, the updated XR template including the activation criterion and the virtual content; and

rendering the virtual content within the updated XR template on the client device based at least on fulfillment of the activation criterion.

5. The computer-implemented method of claim 1, wherein the input comprises a gesture that corresponds to one or more stored gestures.

6. The computer-implemented method of claim 1, wherein the modified virtual content is rendered corresponding to a location of the client device in the real-world environment relative to the XR environment.

7. The computer-implemented method of claim 1, wherein the modified virtual content is rendered based on a file type associated with the modified virtual content.

8. One or more non-transitory computer-readable media storing computer-executable instructions that, when executed on one or more processors, cause the one or more processors to perform acts comprising:

executing an XR collaboration application to provide a virtual reality experience within an XR environment representing a real-world environment on a client device;

recording virtual content within an XR template generated via the XR collaboration application as the virtual content is viewed by an XR author of the XR template on the client device;

receiving an input from the XR author to modify the virtual content within the XR template;

in response to receiving the input, rendering a modified virtual content within the XR template on the client device; and

storing the XR template in a data repository.

9. The one or more non-transitory computer-readable media of claim 8, further comprising:

assigning a marker associated with the virtual content within the XR template;

receiving, via the client device, an additional input to generate an appearance criterion that controls a display of the marker within the XR template;

updating the XR template to create an updated XR template, the updated XR template including the marker, the appearance criterion, and the virtual content; and

storing the updated XR template in the data repository.

10. The one or more non-transitory computer-readable media of claim 9, wherein the updated XR template is configured to display the virtual content in response to the display of the marker on the client device.

11. The one or more non-transitory computer-readable media of claim 8, receiving, via the client device, an additional input to generate an activation criterion that controls display of the virtual content within the XR template, the activation criterion corresponding to the additional input;

updating the XR template to create an updated XR template, the updated XR template including the activation criterion and the virtual content; and

rendering the virtual content within the updated XR template on the client device based at least on fulfillment of the activation criterion.

12. The one or more non-transitory computer-readable media of claim 8, wherein the input comprises a gesture that corresponds to one or more stored gestures.

13. The one or more non-transitory computer-readable media of claim 8, wherein the modified virtual content is rendered corresponding to a location of the client device in the real-world environment relative to the XR environment.

14. The one or more non-transitory computer-readable media of claim 8, wherein the modified virtual content is rendered based on a file type associated with the modified virtual content.

15. A system comprising:

One or more non-transitory storage mediums configured to provide stored computer-readable instructions, the one or more non-transitory storage mediums coupled to one or more processors, the one or more processors configured to execute the computer-readable instructions to cause the one or more processors to;

execute an XR collaboration application to provide a virtual reality experience within an XR environment representing a real-world environment on a client device;

capture an input, from the client device, wherein the input corresponds to an activation criterion that controls display of virtual content; and

display of the virtual content on the client device, based at least on the input.

16. The system of claim 15, wherein the one or more processors are configured to:

assign a marker associated with the virtual content within an XR template generated via the XR collaboration application;

receive, via the client device, an additional input to generate an appearance criterion that controls a display of the marker within the XR template;

update the XR template to create an updated XR template, the updated XR template including the marker, the appearance criterion, and the virtual content; and

storing the updated XR template in the data repository.

17. The system of claim 16, wherein the updated XR template is configured to display the virtual content in response to the display of the marker on the client device.

18. The system of claim 15, wherein the one or more processors are configured to:

receive, via the client device, an additional input to generate an activation criterion that controls display of the virtual content within the XR template, the activation criterion corresponding to the additional input;

update the XR template to create an updated XR template, the updated XR template including the activation criterion and the virtual content; and

render the virtual content within the updated XR template on the client device based at least on fulfillment of the activation criterion.

19. The system of claim 15, wherein the one or more processors are configured to:

capture an additional input from an additional client device, wherein the additional input corresponds to the activation criterion that controls the display of the virtual content; and

display the virtual content on the additional client device, based at least on the additional input.

20. The system of claim 15, wherein the one or more processors are configured to:

recording the virtual content within the XR template generated via the XR collaboration application as the virtual content is viewed by an XR author of the XR template on the client device.