Third party holographic portal

• US 10,304,247 B2
• Filed: 12/09/2015
• Issued: 05/28/2019
• Est. Priority Date: 12/09/2015
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: King, Jeffrey Benjamin Dvorsky
• Primary Examiner(s): Guo, Xilin
• Application Number:
  US14/964,312
• Publication Number:
  US 20170169610A1
• Time in Patent Office: 1,266 Days
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G03H 1/0005 Adaptation of holography to specific applications holographic optical element G02B5/32; holographic scanner G02B26/106; recognition using holographic mask G06V10/88; holographic memories G11B7/0065, G11C13/042
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/157 defining a virtual conference space and using avatars or agents computer conference optimisation or adaptation H04L12/1827

Abstract

A method for displaying via a head-mounted display device a third party holographic portal in a user real world environment is disclosed. The method may include receiving a permission specifying a condition under which a third party is authorized to display the holographic portal in the user real world environment. A request may be received from the third party to display the third party holographic portal in the user real world environment. If the condition is satisfied and in response to the request, the head-mounted display device may display the holographic portal in the user real world environment, with the holographic portal comprising a visual representation of activity in a third party real world environment that is associated with the third party.

Claims

1. A method for displaying via a head-mounted display device a third party holographic portal in a user real world three dimensional environment, the method comprising:

receiving via input from a user of the head-mounted display device a permission specifying a condition under which a third party is authorized to cause the head-mounted display device to display the third party holographic portal in the user real world three dimensional environment;

receiving image data from a third party real world three dimensional environment that is associated with the third party;

receiving a request from the third party to display via the head-mounted display device the third party holographic portal in the user real world three dimensional environment;

determining if the condition is satisfied;

if the condition is satisfied and in response to the request, causing the head-mounted display device to display the third party holographic portal in the user real world three dimensional environment at a world-locked location, wherein the third party holographic portal comprises a visual representation of activity in the third party real world three dimensional environment, wherein the visual representation of activity comprises a holographic avatar of the third party, a holographic avatar of at least one person other than the third party who is present in the third party real world three dimensional environment, and identification data that identifies the at least one person;

using the image data received from the third party real world three dimensional environment, geo-locating and orienting the holographic avatar of the third party and the holographic avatar of the at least one person other than the third party in a manner that reproduces relative geo-locations and orientations of the third party and the at least one other person in the third party real world three dimensional environment; and

prior to displaying the visual representation of activity, outputting via the head-mounted display device a notification of the activity in the third party real world three dimensional environment.

2. The method of claim 1, wherein the condition comprises that the third party is linked to the user via a social network.

3. The method of claim 1, wherein the notification comprises a notification that content of the third party real world three dimensional environment has been updated since the user last visited the third party real world three dimensional environment.

4. The method of claim 1, wherein the notification comprises a notification that the third party is currently present in their third party real world three dimensional environment.

5. The method of claim 4, wherein the notification that the third party is currently present comprises an avatar corresponding to the third party.

6. The method of claim 1, wherein the visual representation of activity in the third party real world three dimensional environment comprises a current preview of at least a portion of the third party real world three dimensional environment.

7. The method of claim 1, further comprising displaying the visual representation of activity in the third party real world three dimensional environment without notifying the third party that the user is viewing the visual representation.

8. The method of claim 1, further comprising:

receiving scaling input from the user; and

in response to the scaling input, increasing or decreasing a size of the third party holographic portal in the user real world three dimensional environment.

9. A head-mounted display device, comprising:

an at least partially see-through display;

a processor; and

a memory holding instructions executable by the processor to;

receive from a user a permission specifying a condition under which a third party is authorized to cause the head-mounted display device to display a third party holographic portal in a user real world three dimensional environment;

receive image data from a third party real world three dimensional environment that is associated with the third party;

receive a request from the third party to display the third party holographic portal in the user real world three dimensional environment;

determine if the condition is satisfied;

if the condition is satisfied and in response to the request, cause the at least partially see-through display to display the third party holographic portal in the user real world three dimensional environment at a world-locked location, wherein the third party holographic portal comprises a visual representation of activity in the third party real world three dimensional environment, wherein the visual representation of activity comprises a holographic avatar of the third party, a holographic avatar of at least one person other than the third party who is present in the third party real world three dimensional environment, and identification data that identifies the at least one person;

using the image data received from the third party real world three dimensional environment, geo-locate and orient the holographic avatar of the third party and the holographic avatar of the at least one person other than the third party in a manner that reproduces relative geo-locations and orientations of the third party and the at least one other person in the third party real world three dimensional environment; and

prior to displaying the visual representation of activity, outputting via the head-mounted display device a notification of the activity in the third party real world three dimensional environment.

10. The head-mounted display device of claim 9, wherein the condition comprises that the third party is linked to the user via a social network.

11. The head-mounted display device of claim 9, wherein the notification comprises a notification that content of the third party real world three dimensional environment has been updated since the user last visited the third party real world three dimensional environment.

12. The head-mounted display device of claim 9, wherein the notification comprises a notification that the third party is currently present in their third party real world three dimensional environment.

13. The head-mounted display device of claim 12, wherein the notification that the third party is currently present comprises an avatar corresponding to the third party.

14. The head-mounted display device of claim 9, wherein the visual representation of activity in the third party real world three dimensional environment comprises a current preview of at least a portion of the third party real world three dimensional environment.

15. The head-mounted display device of claim 9, wherein the instructions are executable by the processor to display the visual representation of activity in the third party real world three dimensional environment without notifying the third party that the user is viewing the visual representation.

16. A head-mounted display device, comprising:

an at least partially see-through display;

a processor; and

a memory holding instructions executable by the processor to;

receive from a user a permission specifying a condition that a third party is linked to the user via a social network;

receive image data from a third party real world three dimensional environment that is associated with the third party

receive a request from the third party to cause the at least partially see-through display to display a third party holographic portal in a user real world three dimensional environment;

determine if the third party is linked to the user via the social network; and

if the third party is linked to the user via the social network and in response to the request, cause the at least partially see-through display to display the third party holographic portal in the user real world three dimensional environment at a world-locked location, wherein the third party holographic portal comprises a visual representation of activity in the third party real world three dimensional environment, wherein the visual representation of activity comprises a holographic avatar of the third party, a holographic avatar of at least one person other than the third party who is present in the third party real world three dimensional environment, and identification data that identifies the at least one person;

using the image data received from the third party real world three dimensional environment, geo-locate and orient the holographic avatar of the third party and the holographic avatar of the at least one person other than the third party in a manner that reproduces relative geo-locations and orientations of the third party and the at least one other person in the third party real world three dimensional environment; and

prior to displaying the visual representation of activity, outputting via the head-mounted display device a notification of the activity in the third party real world three dimensional environment.