Scene Modification for Augmented Reality using Markers with Parameters

• US 20160247320A1
• Filed: 02/25/2015
• Published: 08/25/2016
• Est. Priority Date: 02/25/2015
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Glen J. Anderson, Kathy Yuen
• Inventors: YUEN, Kathy, ANDERSON, Glen J.
• Granted Patent: US 10,026,228 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 17/10 Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2219/2012 Colour editing, changing, or manipulating; Use of colour codes
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling
• CPC Class Codes: G06T 2219/2021 Shape modification
• CPC Class Codes: G11B 27/00 Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
• CPC Class Codes: G11B 27/036 Insert-editing
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence

Abstract

Scene modification is described for augmented reality using markers with parameters. In one example, a method includes capturing a scene by a camera, the scene having a marker, analyzing the captured scene to identify the marker, determining a location of the marker in the captured scene, determining an augmented reality parameter associated with the identified marker, modifying the captured scene at the marker location based on the augmented reality parameter, and rendering the modified scene.

Claims

1. A method comprising:

capturing a scene by a camera, the scene having a marker;

analyzing the captured scene to identify the marker;

determining a location of the marker in the captured scene;

determining an augmented reality parameter associated with the identified marker;

modifying the captured scene at the marker location based on the augmented reality parameter; and

rendering the modified scene.

2. The method of claim 1, wherein the captured scene has a texture.

3. The method of claim 1, wherein the augmented reality parameter is an elevation and wherein modifying comprises applying the elevation to the captured scene at the marker location.

4. The method of claim 1, wherein the parameter is a boundary and wherein modifying comprises applying a video sequence to the captured scene and positioning and scaling the video so that the video is within a boundary as determined by the location of the marker in the captured scene.

5. The method of claim 1, wherein the parameter is a boundary of the captured scene and wherein modifying comprises scaling the captured scene to move a three-dimensional position of the captured scene at the marker location.

6. The method of claim 5, wherein moving a three dimensional position comprises moving an edge of the captured scene closer to a viewing position in a 3D space.

7. The method of claim 5, further comprising cropping the captured scene after moving the captured scene in the 3D space.

8. A method comprising:

associating a parameter with a fiducial marker;

applying the fiducial marker to a location in an image of a scene; and

modifying the image to apply the parameter to the image.

9. The method of claim 8, wherein applying a marker comprises placing a marker at a location in a real scene, the real scene corresponding to the scene of the image.

10. The method of claim 8, wherein applying the parameter comprises applying an elevation to a feature of the image, the feature being at the location of the fiducial marker.

11. The method of claim 8, wherein applying the parameter comprises applying a depth to a feature of the image, the feature at the location of the fiducial marker.

12. The method of claim 8, wherein applying the parameter comprises applying a non-visual augmented reality effect to the location of the fiducial marker.

13. The method of claim 8, wherein modifying the image comprises applying a video to the image.

14. The method of claim 8, wherein applying a video comprises superimposing a video over the image.

15. The method of claim 14, wherein the marker parameter is a time frame of a video sequence and wherein applying a video comprises aligning a subject of the video sequence at the time frame with the location in the image.

16. A machine-readable medium having instructions that when operated on by the machine cause the machine to perform operations comprising:

associating a parameter with a fiducial marker;

applying the fiducial marker to a location in an image of a scene; and

modifying the image to apply the parameter to the image.

17. The medium of claim 16, wherein modifying the image comprises placing a virtual object in the scene at the location of the fiducial marker, the parameter identifying the virtual object, the operations further comprising scaling the virtual object using depth information of the image.

18. An apparatus comprising:

a memory to store an image of a scene captured by a camera, the scene having a fiducial marker applied to a location in the image, and the memory to store a parameter associated with the fiducial marker; and

a processor having a rendering module to identify the fiducial marker, to retrieve the stored parameter, and to modify the image to apply the retrieved parameter to the image.

19. The apparatus of claim 18, wherein the memory further stores a second image of a scene captured by a second camera and wherein the processor further comprises a coordination module to combine the first and the second images before being modified by the rendering module.

20. The apparatus of claim 18, wherein the second image is part of a video sequence and wherein the coordination module applies the video sequence to the first image using the first image as a backdrop.