Adjusted location hologram display

• US 10,025,099 B2
• Filed: 06/10/2015
• Issued: 07/17/2018
• Est. Priority Date: 06/10/2015
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Osborn, Dan, Gavriliuc, Anatolie, Heijster, Stephen
• Primary Examiner(s): HICKS, CHARLES V
• Application Number:
  US14/736,038
• Publication Number:
  US 20160363767A1
• Time in Patent Office: 1,133 Days
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0174 holographic
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G03H 1/0005 Adaptation of holography to specific applications holographic optical element G02B5/32; holographic scanner G02B26/106; recognition using holographic mask G06V10/88; holographic memories G11B7/0065, G11C13/042
• CPC Class Codes: G03H 1/0891 Processes or apparatus adapted to convert digital holographic data into a hologram G03H1/2294 takes precedence
• CPC Class Codes: G03H 1/30 discrete holograms only
• CPC Class Codes: G03H 2001/262 not in optical contact G03H1/30 takes precedence
• CPC Class Codes: G09G 3/001 using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background slide projectors per se G03B23/00 = 42 HP

Abstract

A method for displaying holograms may include displaying an initial hologram via a display device comprising an at least partially see-through display, the initial hologram located on a virtual surface at an initial virtual location. Subsequently, an instruction is received to display a subsequent hologram on the virtual surface at a subsequent virtual location. Collision detection is performed to determine that the subsequent hologram would collide with the initial hologram. In response, the subsequent hologram is displayed at an adjusted virtual location that is closer to the display device than the initial virtual location of the initial hologram.

Claims

1. A method for displaying holograms in an augmented reality environment, the method comprising:

displaying an initial hologram via a display device comprising an at least partially see-through display configured to visually augment a view of a real world three dimensional environment through the display, the initial hologram located on a virtual surface at an initial virtual location in a three dimensional coordinate space overlaid upon the real world three dimensional environment;

subsequently receiving an instruction to display a subsequent hologram on the virtual surface at a subsequent virtual location in the three dimensional coordinate space;

performing collision detection to determine that the subsequent hologram at the subsequent virtual location would collide with the initial hologram at the initial virtual location;

in response, displaying the subsequent hologram at an adjusted virtual location that is closer to the display device than the initial virtual location of the initial hologram in the three dimensional coordinate space;

displaying a markup hologram comprising a first portion that overlaps the virtual surface at a markup location and a second portion that overlaps the initial hologram;

world-locking the first portion to the virtual surface and the second portion to the initial hologram; and

when the initial hologram is moved to another virtual location, moving the second portion of the markup hologram with the initial hologram while maintaining the first portion of the markup hologram at the markup location overlapping the virtual surface.

2. The method of claim 1, wherein at least a portion of the subsequent hologram at the adjusted virtual location overlaps the initial hologram, the method further comprising displaying the subsequent hologram tilted toward the display device.

3. The method of claim 1, further comprising displaying the subsequent hologram at an initial z-axis coordinate of the initial virtual location.

4. The method of claim 1, wherein the instruction to display the subsequent hologram comprises an instruction to change one or more of a size and an orientation of the subsequent hologram in the three dimensional coordinate space.

5. The method of claim 1, further comprising, in response to receiving an undo instruction:

rejoining the second portion of the markup hologram with the first portion of the markup hologram; and

maintaining the initial hologram at the other virtual location.

6. The method of claim 1, wherein the adjusted virtual location is a predetermined distance from the initial virtual location toward the display device.

7. The method of claim 1, wherein the virtual surface is world-locked.

8. The method of claim 1, further comprising:

receiving an instruction to move the subsequent hologram from the adjusted virtual location; and

while moving the subsequent hologram, animating an edge of the subsequent hologram to simulate the edge bending.

17. The method of claim 1, further comprising:

receiving a selection of the initial hologram; and

in response, displaying the initial hologram at a moved virtual location having a moved z-axis coordinate of the three dimensional coordinate space that is closer to the display device than an initial z-axis coordinate of the initial virtual location.

9. A head-mounted display device, comprising:

an at least partially see-through display;

a processor; and

a non-volatile storage device holding instructions executable by the processor to;

display an initial hologram via a display device comprising an at least partially see-through display configured to visually augment a view of a real world three dimensional environment through the display, the initial hologram located on a virtual surface at an initial virtual location in a three dimensional coordinate space overlaid upon the real world three dimensional environment;

subsequently receive an instruction to display a subsequent hologram on the virtual surface at a subsequent virtual location in the three dimensional coordinate space;

perform collision detection to determine that the subsequent hologram at the subsequent virtual location would collide with the initial hologram at the initial virtual location;

in response, display the subsequent hologram at an adjusted virtual location that is closer to the display device than the initial virtual location of the initial hologram in the three dimensional coordinate space;

display a markup hologram comprising a first portion that overlaps the virtual surface at a markup location and a second portion that overlaps the initial hologram;

world-lock the first portion to the virtual surface and the second portion to the initial hologram; and

when the initial hologram is moved to another virtual location, move the second portion of the markup hologram with the initial hologram while maintaining the first portion of the markup hologram at the markup location overlapping the virtual surface.

10. The head-mounted display device of claim 9, wherein at least a portion of the subsequent hologram overlaps the initial hologram, and the instructions are executable by the processor to display the subsequent hologram tilted toward the display device.

11. The head-mounted display device of claim 9, wherein the instructions are executable to display the subsequent hologram at the initial z-axis coordinate of the initial virtual location.

12. The head-mounted display device of claim 9, wherein the instruction to display the subsequent hologram comprises an instruction to change one or more of a size and an orientation of the subsequent hologram in the three dimensional coordinate space.

13. The head-mounted display device of claim 9, wherein the instructions are executable to, in response to receiving an undo instruction:

rejoin the second portion of the markup hologram with the first portion of the markup hologram; and

maintain the initial hologram at the other virtual location.

14. The head-mounted display device of claim 9, wherein the adjusted virtual location is a predetermined distance from the initial virtual location toward the display device.

15. The head-mounted display device of claim 9, wherein the virtual surface is world-locked.

18. The head-mounted display device of claim 9, wherein the instructions are executable by the processor to:

receive a selection of the initial hologram; and

in response, display the initial hologram at a moved virtual location having a moved z-axis coordinate of the three dimensional coordinate space that is closer to the display device than an initial z-axis coordinate of the initial virtual location.

16. A head-mounted display device, comprising:

an at least partially see-through display;

a processor; and

a non-volatile storage device holding instructions executable by the processor to;

display an initial hologram via a display device comprising an at least partially see-through display configured to visually augment a view of a real world three dimensional environment through the display, the initial hologram located on a virtual surface at an initial virtual location in a three dimensional coordinate space overlaid upon the real world three dimensional environment;

subsequently receive an instruction to display a subsequent hologram on the virtual surface at a subsequent virtual location in the three dimensional coordinate space;

perform collision detection to determine that the subsequent hologram at the subsequent virtual location would collide with the initial hologram at the initial virtual location;

in response, display the subsequent hologram at an adjusted virtual location that is closer to the display device than the initial virtual location of the initial hologram in the three dimensional coordinate space;

display a markup hologram comprising a first portion that overlaps the virtual surface at a markup location and a second portion that overlaps the initial hologram;

world-lock the first portion to the virtual surface and the second portion to the initial hologram; and

when the initial hologram is moved to another virtual location, move the second portion of the markup hologram with the initial hologram while maintaining the first portion of the markup hologram at the markup location overlapping the virtual surface; and

while moving the subsequent hologram, animate an edge of the subsequent hologram to simulate the edge bending.