AUGMENTED REALITY COMPUTING ENVIRONMENTS - IMMERSIVE MEDIA BROWSER

• US 20190310758A1
• Filed: 04/03/2019
• Published: 10/10/2019
• Est. Priority Date: 04/09/2018
• Status: Active Grant

• Current Assignee: Spatial Systems Inc.
• Original Assignee: Spatial Systems Inc.
• Inventors: AGARAWALA, Anand, LEE, Jinha, NG, Peter, FIERER, Mischa, PJECHA, Elliot
• Granted Patent: US 10,908,769 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 2203/04803 Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2219/2004 Aligning objects, relative positioning of parts
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04L 67/142 Managing session states for stateless protocols; Signalling session states; State transitions; Keeping-state mechanisms
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04N 7/157 defining a virtual conference space and using avatars or agents computer conference optimisation or adaptation H04L12/1827

Abstract

Disclosed herein are system, method, and computer program product embodiments for displaying a three-dimensional representation of a media source in an augmented reality meeting space. The augmented reality meeting space receives structured data from the media source, for example, via an RSS feed, and translates the structured data into a three-dimensional representation using an application adapter. The application adapter can be enhanced by including additional information about the structure of the data that is specific to the media source. Users can view, manipulate, and otherwise interact the three-dimensional representation within a shared, collaborative, augmented reality meeting space.

Claims

1. A computer-implemented method, comprising:

building an augmented reality (AR) meeting space comprising a media source;

receiving structured data from the media source;

translating the structured data into a three-dimensional representation of the structured data using an application adapter,

wherein the application adapter parses the structured data to determine content and organizes the content into sections; and

rendering the three-dimensional representation in the AR meeting space,

wherein the three-dimensional representation displays the content in a three-dimensional structure organized by the sections, and

wherein the three-dimensional representation receives inputs from a user in the AR meeting space to manipulate and view the content and sections.

2. The method of claim 1, further comprising:

enhancing the application adapter to determine additional information in the structured data that is specific to the media source; and

including the additional information in the three-dimensional representation along with the content and sections.

3. The method of claim 1, wherein the three-dimensional representation displays the sections in scrollable tiles.

4. The method of claim 1, wherein the media source provides an RSS feed comprising the structured data.

5. The method of claim 1, wherein the media source is a social media stream.

6. The method of claim 1, wherein the media source is a web page.

7. The method of claim 1, wherein the media source is an email feed.

8. The method of claim 1, wherein the media source is search results.

9. A system, comprising:

a memory; and

at least one processor coupled to the memory and configured to;

build an augmented reality (AR) meeting space comprising a media source;

receive structured data from the media source;

translate the structured data into a three-dimensional representation of the structured data using an application adapter,

wherein the application adapter parses the structured data to determine content and organizes the content into sections; and

render the three-dimensional representation in the AR meeting space,

wherein the three-dimensional representation displays the content in a three-dimensional structure organized by the sections, and

wherein the three-dimensional representation receives inputs from a user in the AR meeting space to manipulate and view the content and sections.

10. The system of claim 9, the at least one processor further configured to:

enhance the application adapter to determine additional information in the structured data that is specific to the media source; and

include the additional information in the three-dimensional representation along with the content and sections.

11. The system of claim 9, wherein the three-dimensional representation displays the sections in scrollable tiles.

12. The system of claim 9, wherein the media source provides an RSS feed comprising the structured data.

13. The system of claim 9, wherein the media source is a social media stream.

14. The system of claim 9, wherein the media source is a web page.

15. The system of claim 9, wherein the media source is an email feed.

16. The system of claim 9, wherein the media source is search results.

17. A non-transitory computer-readable device having instructions stored thereon that, when executed by at least one computing device, cause the at least one computing device to perform operations comprising:

building an augmented reality (AR) meeting space comprising a media source;

receiving structured data from the media source;

translating the structured data into a three-dimensional representation of the structured data using an application adapter,

wherein the application adapter parses the structured data to determine content and organizes the content into sections; and

rendering the three-dimensional representation in the AR meeting space,

wherein the three-dimensional representation displays the content in a three-dimensional structure organized by the sections, and

wherein the three-dimensional representation receives inputs from a user in the AR meeting space to manipulate and view the content and sections.

18. The non-transitory computer-readable device of claim 17, the operations further comprising:

enhancing the application adapter to determine additional information in the structured data that is specific to the media source; and

including the additional information in the three-dimensional representation along with the content and sections.

19. The non-transitory computer-readable device of claim 17, wherein the three-dimensional representation displays the sections in scrollable tiles.

20. The non-transitory computer-readable device of claim 17, wherein the media source provides an RSS feed comprising the structured data.