Saving augmented realities

• US 10,169,915 B2
• Filed: 06/24/2015
• Issued: 01/01/2019
• Est. Priority Date: 06/28/2012
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Teegan, Hugh
• Primary Examiner(s): Amini, Javid A
• Application Number:
  US14/749,184
• Publication Number:
  US 20150294507A1
• Time in Patent Office: 1,287 Days
• Field of Search: 345633
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering

Abstract

Saving augmented realities includes collecting, with an augmented reality device, observation information of a physical space, and obtaining, with the augmented reality device, an augmentation associated with the physical space. An augmented view of the physical space including a visual representation of the augmentation is visually presented with the augmented reality device, and the augmented view is saved for subsequent playback.

Claims

1. A method for saving augmented realities, comprising:

collecting, with a visible-light camera of an augmented reality device, a visible-light image of a physical space;

visually presenting, on an at least partially transparent display of the augmented reality device, an augmentation image while light from the physical space passes through the at least partially transparent display to a user eye;

at least based on a user request while the augmentation image is visually presented on the at least partially transparent display, saving a combined augmented image that includes the augmentation image overlaid on the visible-light image; and

outputting the combined augmented image as a digital image, the digital image displayable on a display device not communicatively coupled with a camera, wherein the combined augmented image simulates an augmented view the user had through the at least partially transparent display when the combined augmented image was previously saved.

2. The method of claim 1, wherein augmentation information for displaying the augmentation image is obtained from an object in the physical space.

3. The method of claim 1, wherein augmentation information for displaying the augmentation image is obtained from an augmentation index stored on the augmented reality device.

4. The method of claim 1, wherein augmentation information for displaying the augmentation image is obtained from a remote service.

5. The method of claim 4, wherein augmentation information for displaying the augmentation image is obtained from the remote service in response to sending the remote service at least a portion of the visible light image.

6. The method of claim 1, wherein the augmentation image augments an aspect of an object when overlaid on the visible-light image.

7. The method of claim 6, wherein the object is a person, and wherein the augmentation is textual information indicating an identity of the person.

8. The method of claim 1, wherein the augmentation image is chosen based on the visible-light image.

9. The method of claim 1, wherein the augmentation image is chosen based on observation information from the visible-light camera.

10. The method of claim 1, wherein the augmentation image is chosen based on observation information from a motion sensor.

11. The method of claim 1, wherein the augmentation image is chosen based on observation information from a microphone.

12. The method of claim 1, wherein the augmentation image is chosen based on observation information from a compass.

13. The method of claim 1, wherein the augmentation image is chosen based on observation information from a GPS.

14. An augmented reality device, comprising:

one or more visible-light cameras to capture a visible-light image of a physical space;

an augmentation engine to obtain an augmentation image for the physical space, the augmentation image including an augmentation comprising information relating to the physical space;

an at least partially transparent display to present the augmentation image while light from the physical space passes through the at least partially transparent display to a user eye; and

a capture engine to, at least based on a user request while the augmentation image is visually presented on the at least partially transparent display, save a combined augmented image that includes the augmentation image overlaid on the visible-light image, and output the combined augmented image as a digital image, the digital image displayable on a display device not communicatively coupled with a camera, wherein the combined augmented image simulates an augmented view the user had through the at least partially transparent display when the combined augmented image was previously saved.

15. The augmented reality device of claim 14, wherein the physical space includes an object, and wherein the object is identified by the augmented reality device from image information collected from the one or more visible-light cameras.

16. The augmented reality device of claim 14, wherein the physical space includes an object, and wherein the object is identified by a remote service from image information collected from the one or more visible-light cameras.

17. The augmented reality device of claim 14, wherein the augmentation engine obtains the augmentation from a remote service.

18. The augmented reality device of claim 14, wherein the augmentation engine obtains the augmentation from a device located within the physical space.

19. A method for saving augmented realities, comprising:

collecting, with a visible-light camera of an augmented reality device, a visible-light video of a physical space;

visually presenting, on an at least partially transparent display of the augmented reality device, an augmentation video while light from the physical space passes through the partially transparent display to a user eye;

at least based on a user request while the augmentation video is visually presented on the at least partially transparent display, saving a combined augmented video that includes the augmentation video overlaid on the visible-light video; and

outputting the combined augmented video as a digital video, the digital video displayable on a display device not communicatively coupled with a camera, wherein the combined augmented video simulates an augmented view the user had through the at least partially transparent display when the combined augmented video was previously saved.