Transitioning views of a virtual model

• US 10,373,392 B2
• Filed: 08/26/2015
• Issued: 08/06/2019
• Est. Priority Date: 08/26/2015
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Christen, Jonathan R., Memmott, Robert Courtney, Sugden, Benjamin John, Nance, James L., Tanner, Marcus, McCulloch, Daniel Joseph
• Primary Examiner(s): Wu, Chong
• Application Number:
  US14/836,818
• Publication Number:
  US 20170061702A1
• Time in Patent Office: 1,441 Days
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling
• CPC Class Codes: G06T 7/73 using feature-based methods

Abstract

Embodiments are disclosed for transitioning views presented via a head-mounted display device. One example method for operating a head-mounted display device includes displaying a virtual model at a first position in a coordinate frame of the head-mounted display device, receiving sensor data from one or more sensors of the head-mounted display device, and determining a line of sight of the user that intersects the virtual model to identify a location the user is viewing. The example method further includes, responsive to a trigger, moving the virtual model to a second position in the coordinate frame of the head-mounted display device corresponding to the location the user is viewing and simultaneously scaling the virtual model.

Claims

1. A method for operating a head-mounted display device, the method comprising:

displaying via the head-mounted display device a virtual model at a first position in a coordinate frame of the head-mounted display device;

receiving sensor data from one or more sensors of the head-mounted display device;

determining a line of sight of a user that intersects the virtual model to identify a location the user is viewing; and

responsive to a trigger, moving the virtual model to a second position in the coordinate frame of the head-mounted display device corresponding to the location the user is viewing and simultaneously scaling a size of the virtual model relative to a field of view of the head-mounted display device, and adjusting a speed of the movement and scaling by moving and scaling the virtual model more quickly while the virtual model is smaller relative to the field of view of the head-mounted display device and more slowly as the virtual model grows larger relative to the field of view of the head-mounted display device, such that the virtual model appears to move and scale in size at a consistent rate relative to the field of view of the head-mounted display device.

2. The method of claim 1, wherein moving the virtual model comprises performing one or more of the scaling and the moving of the virtual model progressively non-linearly.

3. The method of claim 1, where determining a line of sight of the user that intersects the virtual model comprises determining a ray along an eyeline of the user and determining where the ray intersects the virtual model.

4. The method of claim 1, wherein scaling the virtual model comprises scaling the virtual model from a smaller size to a larger size.

5. The method of claim 4, wherein moving the virtual model to the second position comprises moving from an overhead view of the model to a first person view within the model, and wherein the location the user is viewing is maintained within the line of sight of the user while scaling and moving the virtual model.

6. The method of claim 4, wherein moving the virtual model to the second position comprises moving a surface of the model to an estimated location of a foot of the wearer of the head-mounted display device.

7. The method of claim 6, further comprising determining the estimated location of the foot of the wearer based upon one or more of head pose data and user profile data.

8. The method of claim 1, further comprising adjusting one or more of a volume and a perceived location of audio associated with the virtual model that is output during moving of the virtual model.

9. The method of claim 1, further comprising fading out an appearance of the virtual model at the first position and fading in an appearance of the virtual model at the second position while moving the virtual model to the second position.

10. The method of claim 1, wherein the trigger includes a detected gesture.

11. The method of claim 1, wherein the trigger includes detection of an actuation of a physical input device in communication with the head-mounted display device.

12. A head-mounted display device, comprising:

a display;

a logic device; and

a storage device storing instructions executable by the logic device to

display via the display of the head-mounted display device a virtual model at a first position in a coordinate frame of the head-mounted display device; and

responsive to a trigger, display an animation representing a movement of the virtual model from the first position to a second position in the coordinate frame of the head-mounted display device and simultaneously scale a size of the virtual model relative to a field of view of the head-mounted display device based on the movement such that the movement and scaling occurs at a variable rate progression in which the virtual model moves and scales more quickly while the virtual model is smaller relative to the field of view of the head-mounted display device and more slowly as the virtual model grows larger relative to the field of view of the head-mounted display device, such that the virtual model appears to move and scale in size at a consistent rate relative to the field of view of the head-mounted display device.

13. The head-mounted display device of claim 12, further comprising one or more sensors, wherein the instructions are further executable to receive sensor data from the one or more sensors, determine a head pose of a user based on the sensor data, and determine a line of sight of the user that intersects the virtual model to identify a location the user is viewing, the second position corresponding to the location the user is viewing.

14. The head-mounted display device of claim 12, wherein the instructions to scale the virtual model comprise instructions executable to scale the virtual model from a smaller size to a larger size.

15. The head-mounted display device of claim 14, wherein the instructions executable to move the virtual model to the second position comprise instructions executable to move from an overhead view of the model to a first person view within the model.

16. The head-mounted display device of claim 14, wherein the instructions executable to move the virtual model to the second position comprise instructions executable to move a surface of the model to an estimated location of a foot of the wearer of the head-mounted display device.

17. A head-mounted display device comprising:

a display;

one or more sensors;

a logic device; and

a storage device storing instructions executable by the logic device to

display via the display of the head-mounted display device a virtual model at a first position in a coordinate frame of the head-mounted display device;

determine a head pose of a user based on sensor data acquired via the one or more sensors;

determine a line of sight of the user that intersects the virtual model to identify a location the user is viewing; and

responsive to a trigger, displaying, via the display, an animation representing a movement of the virtual model to a second position in the coordinate frame of the head-mounted display device, the second position corresponding to the location the user is viewing, and simultaneously scaling a size of the virtual model relative to a field of view of the head-mounted display device based on the movement such that the movement and the scaling occurs at a variable rate progression in which the virtual model moves and scales more quickly while the virtual model is smaller relative to the field of view of the head-mounted display device and more slowly as the virtual model grows larger relative to the field of view of the head-mounted display device, such that the virtual model appears to move and scale in size at a consistent rate relative to the field of view of the head-mounted display device.

18. The head-mounted display device of claim 17, wherein scaling the virtual model comprises scaling the virtual model from a smaller size to a larger size and wherein moving the virtual model to the second position comprises moving from an overhead view of the model to a first person view within the model.

19. The head-mounted display device of claim 17, wherein moving the virtual model to the second position comprises moving a surface of the model to an estimated location of a foot of the wearer of the head-mounted display device.