SYSTEMS AND METHODS FOR AUGMENTED REALITY ART CREATION

• US 20180276882A1
• Filed: 12/30/2015
• Published: 09/27/2018
• Est. Priority Date: 01/12/2015
• Status: Active Application

• Current Assignee: PCMS Holdings Incorporated (InterDigital, Inc.)
• Original Assignee: PCMS Holdings Incorporated (InterDigital, Inc.)
• Inventors: Harviainen, Tatu V. J., Woodward, Charles
• Application Number:
  US15/542,748
• Publication Number:
  US 20180276882A1
• Time in Patent Office: Days
• CPC Class Codes: G06T 17/10 Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

Systems and methods are described for generating and displaying augmented reality (AR) content. In an embodiment, a user captures a reference image of a scene using an AR device such as a headset or a tablet computer. The AR device automatically identifies 2D geometric features, such as edges, in the reference image. The user selects a 2D geometric feature and operates the AR device to generate a 3D geometric element by extrapolating the selected 2D feature into three dimensions using, for example, extrusion and lathe operations. The generated elements may be displayed by the AR device as an augmented reality overlay on the scene. The AR device may upload the generated elements to a networked content manager for sharing and viewing on the AR devices of other users.

Claims

1. A method comprising:

operating a camera to capture a reference image of a scene in a user'"'"'s environment;

automatically identifying at least one 2D geometric feature in the reference image of the user'"'"'s environment;

receiving a user selection of at least one of the automatically identified 2D geometric features;

generating a 3D geometric element by extrapolating the selected 2D feature into three dimensions; and

displaying the 3D geometric element as an augmented reality overlay on the captured scene in the user'"'"'s environment and extrapolated from the selected 2D feature.

2. The method of claim 1, wherein automatically identifying at least one 2D geometric feature includes performing edge detection.

3. The method of claim 1, wherein extrapolating the 2D feature includes performing a lathe operation.

4. The method of claim 1, wherein extrapolating the 2D feature includes performing an extrusion operation.

5. The method of claim 1, wherein the extrapolation of the 2D feature into three dimensions is performed in response to user input.

6. The method of claim 5, wherein the user input is a gesture input.

7. The method of claim 5, wherein the user input is a touch screen input.

8. The method of claim 1, further comprising modulating the generated 3D geometric element.

9. The method of claim 8, wherein modulating the generated 3D geometric element includes resizing the 3D geometric element in response to user input.

10. A method performed at a first user device, the method comprising:

capturing a reference image of a scene in a user'"'"'s environment;

automatically identifying at least one 2D geometric feature in the reference image;

receiving a user selection of at least one of the automatically identified 2D geometric features;

generating a 3D geometric element by extrapolating the selected 2D feature into three dimensions; and

transmitting the generated 3D geometric element and the reference image to a content manager.

11. The method of claim 10, further comprising:

determining a location at which the reference image was captured; and

transmitting the determined location to the content manager.

12. The method of claim 11, further comprising, at a second user device:

capturing an index image of a scene;

determining a location of the second user device;

downloading at least one 3D geometric element corresponding to the index image and the determined location; and

rendering the at least one 3D geometric element as an augmented reality overlay on the scene.

13. The method of claim 10, further comprising, at a second user device:

capturing an index image of a scene;

downloading at least one 3D geometric element corresponding to the index image;

and rendering the at least one 3D geometric element as an augmented reality overlay on the scene.

14. The method of claim 10, wherein automatically identifying at least one 2D geometric feature includes performing edge detection.

15. The method of claim 10, wherein extrapolating the 2D feature includes performing a lathe operation.

16. The method of claim 10, wherein extrapolating the 2D feature includes performing an extrusion operation.

17. The method of claim 10, wherein the extrapolation of the 2D feature into three dimensions is performed in response to user input.

18. The method of claim 17, wherein the user input is a gesture input.

19. The method of claim 17, wherein the user input is a touch screen input.

20. An augmented reality device comprising a processor, a camera, a display, and a non-transitory computer storage medium operative storing instructions operative, when executed on the processor, to perform functions including:

operating a camera to capture a reference image of a scene in a user'"'"'s environment;

automatically identifying at least one 2D geometric feature in the reference image of the user'"'"'s environment;

receiving a user selection of at least one of the automatically identified 2D geometric features;

generating a 3D geometric element by extrapolating the selected 2D feature into three dimensions; and

displaying the 3D geometric element as an augmented reality overlay on the captured scene in the user'"'"'s environment and extrapolated from the selected 2D feature.