Method and system for providing an object in virtual or semi-virtual space based on a user characteristic

• US 10,453,273 B2
• Filed: 06/28/2017
• Issued: 10/22/2019
• Est. Priority Date: 04/25/2017
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Perez, Carlos G., Srinivasan, Vidya, Marshall, Colton B., Handa, Aniket, Martinez Molina, Harold Anthony
• Primary Examiner(s): Liu, Zhengxi
• Application Number:
  US15/636,321
• Publication Number:
  US 20180308290A1
• Time in Patent Office: 846 Days
• Field of Search: None
• CPC Class Codes: A63F 13/63 by the player, e.g. authoring using a level editor
• CPC Class Codes: G06F 16/122 using management policies backup systems G06F11/1446; file migration policies for HSM systems G06F16/185
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling

Abstract

A method, system, and computer program, for providing the virtual object in the virtual or semi-virtual environment, based on a characteristic associated with the user. In one example embodiment, the system comprises at least one computer processor, and a memory storing instructions that, when executed by the at least one computer processor, perform a set of operations comprising determining the characteristic associated with the user in the virtual or semi-virtual environment with respect to a predetermined reference location in the environment, and providing a virtual object based on the characteristic.

Claims

1. A method for controlling a virtual user interface in a virtual or semi-virtual 3D environment, comprising:

providing, the virtual user interface in the 3D environment, the virtual user interface being interactive to enable remote control of an electronic device;

identifying, in the virtual user interface, content that is interesting to a user, based on a history of user interactions with the content;

determining a distance in the 3D environment between the user and a predetermined reference location in the 3D environment, wherein the electronic device is situated at the predetermined reference location; and

altering the virtual user interface based on the distance,

wherein the altering alters the virtual user interface so that, as the distance increases, a layout of the virtual user interface is reconfigured and the content identified as being interesting to the user increases in size.

2. The method of claim 1, wherein other content is altered to be de-emphasized in the altering as the distance increases.

3. The method of claim 2, wherein, after the altering, the content identified as being interesting to the user enables the user to do at least one of perceive or interact with the virtual user interface.

4. The method of claim 2, wherein the altering comprises:

determining prioritized features included in the virtual user interface; and

including the prioritized features in an emphasized manner in the virtual user interface.

5. The method of claim 1, wherein the electronic device is a media player.

6. The method of claim 1, wherein in the altering, the layout of the virtual user interface is reconfigured to remove other content of the virtual user interface.

7. The method of claim 1, wherein the providing provides the virtual user interface in a manner that attracts the user'"'"'s attention.

8. A system comprising:

at least one computer processor; and

a memory storing instructions that, when executed by the at least one computer processor, perform a set of operations comprising;

providing a virtual user interface in a 3D environment that is virtual or semi-virtual, the virtual user interface being interactive to enable remote control of an electronic device;

identifying, in the virtual user interface, content that is interesting to a user, based on a history of user interactions with the content;

determining a distance in the 3D environment between the user and a predetermined reference location in the 3D environment, wherein the electronic device is situated at the predetermined reference location; and

altering the virtual user interface based on the distance,

wherein the altering alters the virtual user interface so that, as the distance increases, in a layout of the virtual user interface is reconfigured and the content identified as being interesting to the user increases in size.

9. The system of claim 8, further comprising:

a head mounted display (HMD), wherein the at least one computer processor is operatively connected to the HMD.

10. The system of claim 9, wherein the providing comprises presenting the virtual user interface on a display of the HMD.

11. The system of claim 8, wherein other content is altered in the altering as the distance increases.

12. The system of claim 11, wherein in the altering, the layout of the virtual interface is reconfigured to remove other content of the virtual user interface.

13. The system of claim 12, wherein the altering comprises:

determining prioritized features associated with the virtual user interface; and

displaying the prioritized features in an emphasized manner in the virtual user interface.

14. The system of claim 13, wherein the 3D environment is one of a virtual reality environment, an augmented reality environment, and a mixed reality environment.

15. The system of claim 8, wherein the user is one of a virtual user or a non-virtual user.

16. A computer storage non-transitory medium encoding computer executable instructions that, when executed by at least one processor, performs a method comprising:

determining a first distance between a user in the 3D environment and a predetermined reference location in the 3D environment, wherein an electronic device is situated at the predetermined reference location;

providing a first representation of a virtual object based on the first distance, wherein the virtual object includes a virtual user interface that is interactive to enable remote control of the electronic device, and wherein the first representation comprises a first set of user interface components;

identifying, in the virtual user interface, content that is interesting to a user, based on a history of user interactions with the content;

determining a second distance between the user in the 3D environment and the predetermined reference location in the 3D environment, wherein the second distance is greater than the first distance; and

providing a second representation of the virtual object based on the second distance, wherein the second representation comprises a second set of user interface components, the second set comprising at least one new component that is not included in the first set,

wherein at least one feature of the virtual object in the second representation is larger in size than a corresponding at least one feature of the virtual object in the first representation.

17. The computer storage medium of claim 16, wherein the electronic device is a media player.

18. The computer storage medium of claim 16, wherein the first set comprises at least one component that is not included in the second set.

19. The computer storage medium of claim 16, wherein the second representation enables a user to do at least one of perceive or interact with the virtual object in the second representation.