Saving augmented realities

• US 10,176,635 B2
• Filed: 06/28/2012
• Issued: 01/08/2019
• Est. Priority Date: 06/28/2012
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Teegan, Hugh
• Primary Examiner(s): Amini, Javid A
• Application Number:
  US13/536,708
• Publication Number:
  US 20140002490A1
• Time in Patent Office: 2,385 Days
• Field of Search: 345633
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering

Abstract

Saving augmented realities includes collecting, with an augmented reality device, observation information of a physical space including an object, and obtaining, with the augmented reality device, an augmentation associated with the object. An augmented view of the physical space including a visual representation of the augmentation is visually presented with the augmented reality device, and the augmented view is saved for subsequent playback.

Claims

1. A method for saving augmented realities, comprising:

obtaining, with an augmented reality device, a virtual augmentation;

displaying the virtual augmentation with a display of the augmented reality device, the virtual augmentation augmenting a live view of a physical space;

sighting the physical space with a camera of the augmented reality device as the virtual augmentation augments the live view of the physical space;

in response to a user request during use of the augmented reality device, saving an augmented reality recreation having a beginning determined by the user request and having an ending determined by the user request or a subsequent user request, the augmented reality recreation including the virtual augmentation visually embedded within video of the live view captured by the camera; and

outputting the augmented reality recreation as a digital video, the digital video displayable on a display device not communicatively coupled with a camera, wherein the augmented reality recreation simulates an augmented view the user had through the display when the augmented reality recreation was previously saved.

2. The method of claim 1, wherein obtaining the virtual augmentation further comprises receiving the virtual augmentation from an object in the physical space.

3. The method of claim 1, wherein the virtual augmentation augments an object in the physical space.

4. The method of claim 1, wherein obtaining the virtual augmentation further comprises retrieving the virtual augmentation from an augmentation index stored on the augmented reality device.

5. The method of claim 1, wherein obtaining the virtual augmentation further comprises retrieving the virtual augmentation from a remote service.

6. The method of claim 1, wherein obtaining the virtual augmentation further comprises sending observation information including video captured by the camera to a remote service, and receiving the virtual augmentation from the remote service.

7. The method of claim 2, wherein the object is a person, and wherein the augmentation is textual information indicating an identity of the person.

8. The method of claim 6, wherein the observation information comprises image information, audio information, and location information of the physical space.

9. The method of claim 6, wherein the observation information is collected by one or more of an outward facing image sensor, motion sensor, microphone, compass, and GPS.

10. An augmented reality device, comprising:

one or more cameras to sight a physical space;

an augmentation engine to obtain a virtual augmentation for an identified object in the physical space, the virtual augmentation comprising information indicating an identity of the identified object, the virtual augmentation obtained from a device located within the physical space;

a display to present a visual representation of the virtual augmentation, the virtual augmentation augmenting a live view of the physical space; and

a capture engine to save an augmented reality recreation having a user-controlled beginning and ending, the augmented reality recreation including the virtual augmentation visually embedded within video of the live view captured by the one or more cameras and output the augmented reality recreation as a digital video, the digital video displayable on a display device not communicatively coupled with a camera, wherein the augmented reality recreation simulates an augmented view the user had through the display when the augmented reality recreation was previously saved.

11. The augmented reality device of claim 10, wherein the identified object is identified by the augmented reality device from image information collected from the one or more cameras.

12. The augmented reality device of claim 10, wherein the identified object is identified by a remote service from image information collected from the one or more cameras.

13. The augmented reality device of claim 10, wherein the capture engine receives an image of the physical space from the one or more cameras and is configured to overlay the visual representation of the virtual augmentation on the image of the physical space.

14. The augmented reality device of claim 10, wherein the display is a see-through display.

18. The method of claim 14, wherein the augmented reality device is a head-mounted see-through display device.

15. A method for saving augmented realities, comprising:

collecting, with an augmented reality device, observation information of a physical space including an object;

sending, with the augmented reality device, the observation information to a remote service via a network;

receiving, with the augmented reality device, an identification of the object and a virtual augmentation associated with the object from the remote service;

displaying the virtual augmentation with a display of the augmented reality device, the virtual augmentation augmenting a live view of the physical space;

in response to a user request during use of the augmented reality device, saving an augmented reality recreation having a beginning determined by the user request and having an ending determined by the user request or a subsequent user request, the augmented reality recreation including the virtual augmentation visually embedded within video of the live view of the physical space; and

outputting the augmented reality recreation as a digital video, the digital video displayable on a display device not communicatively coupled with a camera, wherein the augmented reality recreation simulates an augmented view the user had through the display when the augmented reality recreation was previously saved.

16. The method of claim 15, wherein the object is a person, and wherein the virtual augmentation is textual information indicating an identity of the person.

17. The method of claim 15, wherein the observation information comprises image information, audio information, and location information of the physical space collected by one or more of a camera, motion sensor, microphone, compass, and GPS.