SYSTEM AND METHOD FOR EMBEDDING AND VIEWING MEDIA FILES WITHIN A VIRTUAL AND AUGMENTED REALITY SCENE

• US 20120236029A1
• Filed: 03/02/2012
• Published: 09/20/2012
• Est. Priority Date: 03/02/2011
• Status: Active Grant

• Current Assignee: Aria Glassworks, Inc. (Dropbox, Inc.)
• Original Assignee: Aria Glassworks, Inc. (Dropbox, Inc.)
• Inventors: NEWHOUSE, BENJAMIN ZEIS, MCARDLE, TERRENCE EDWARD
• Granted Patent: US 9,118,970 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/42202 environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4725 using interactive regions of the image, e.g. hot spots details of information retrieval from the Internet by using URLs G06F16/955; processing chained hypermedia data for information retrieval G06F16/94

Abstract

A preferred method for viewing embedded media in a virtual and augmented reality (VAR) scene can include at a viewer device, defining a real orientation of the viewer device relative to a projection matrix; and orienting a VAR scene on the viewer device in response to the real orientation in block, in which the VAR scene includes one or both of visual data and orientation data. The preferred method can further include selecting a media file in the VAR scene, wherein the media file is selected at a media location correlated at least to the real orientation of the viewer device; and activating the media file in the VAR scene at the media location. The preferred method and variations thereof functions to allow a viewer to interact with media that is embedded, tagged, linked, and/or associated with a VAR scene viewable on the viewer device.

Claims

1. A method comprising:

at a user device, defining a real orientation of the user device relative to a projection matrix;

orienting a VAR scene on the user device in response to the real orientation, wherein the VAR scene comprises visual data and orientation data;

selecting a media location in the VAR scene, wherein the media location is correlated at least to the real orientation of the user device; and

embedding a media file in the VAR scene at the media location.

2. The method of claim 1, further comprising defining a user orientation of the user device relative to a nodal point.

3. The method of claim 1, wherein the media location is further correlated to a depth value within the VAR scene.

4. The method of claim 1, wherein the depth value is determined in response to a user input.

5. The method of claim 1, wherein the depth value is determined in response to the real orientation of the user device while selecting the media location.

6. The method of claim 1, wherein the media file comprises one of:

an image file, a video file, an audio file, a second VAR scene, a second rendering of the VAR scene, or a hyperlink.

7. The method of claim 6, wherein activation of the hyperlink directs the user device to the second VAR scene.

8. The method of claim 6, wherein selecting the media location of the second VAR scene comprises determining a location of the second VAR scene and locating the second VAR scene at its location within the VAR scene.

9. The method of claim 1, further comprising associating a media activation parameter with the media file.

10. The method of claim 9, wherein the media activation parameter comprises an activation area such that within the VAR scene overlap between the activation area and the media file causes activation of the media file.

11. A method comprising:

at a viewer device, defining a real orientation of the viewer device relative to a projection matrix;

orienting a VAR scene on the viewer device in response to the real orientation, wherein the VAR scene comprises visual data and orientation data;

selecting a media file in the VAR scene, wherein the media file is selected at a media location correlated at least to the real orientation of the viewer device; and

activating the media file in the VAR scene at the media location.

12. The method of claim 11, further comprising defining a user orientation of the viewer device relative to a nodal point.

13. The method of claim 11, wherein the media location is further correlated to a depth value within the VAR scene.

14. The method of claim 11, wherein the media file comprises one of:

an image file, a video file, an audio file, a second VAR scene, a second rendering of the VAR scene, or a hyperlink.

15. The method of claim 14, wherein activation of the hyperlink directs the viewer device to the second VAR scene.

16. The method of claim 14, wherein the media location of the second VAR scene comprises a representation of the second VAR scene at its real location within the VAR scene.

17. The method of claim 11, wherein activation of the media file comprises activating the media file in response to an orientation of the viewer device such that an activation area in the VAR scene overlaps the media file.