VIRTUAL OBJECT ORIENTATION AND VISUALIZATION

• US 20140368532A1
• Filed: 06/18/2013
• Published: 12/18/2014
• Est. Priority Date: 06/18/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Robert L. Crocco Jr
• Inventors: Keane, Brian E., Sugden, Ben J., Crocco, Robert L. Jr., Deptford, Daniel, Salter, Tom G., Massey, Laura K., Kipman, Alex Aben-Athar, Kinnebrew, Peter Tobias, Kamuda, Nicholas Ferianc
• Granted Patent: US 10,139,623 B2
• Time in Patent Office: Days
• US Class Current: 345/619
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

A method and apparatus for the creation of a perspective-locked virtual object having in world space. The virtual object may be consumed) by another user with a consumption device at a location, position, and orientation which is the same as, or proximate to, the location, position, and orientation where the virtual object is created. Objects may have one, few or many allowable consumption locations, positions, and orientations defined by its creator

Claims

1. A method for selecting a virtual object rendered in a see-through head mounted display, comprising:

receiving a shared virtual object including rendering location data for the shared virtual object, the rendering location data including at least a global coordinate location, and at least one position and at least one orientation for the virtual object with respect to a local coordinate system within a field of view of a consumption device;

determining a location, a position and an orientation of the consumption device;

positioning the consumption device proximate to the global coordinate location, position and orientation of the shared virtual object; and

displaying the shared virtual object in the consumption device if the consumption device is at a location, position and orientation determined match to match the rendering location data.

2. The method of claim 1 wherein said positioning includes positioning the consumption device at a same global location, position and orientation defined in the shared virtual object.

3. The method of claim 2 wherein the consumption device renders the virtual object at said same global location, position and orientation such that the object has a perspective to the consumption device as to a capture device used to create it.

4. The method of claim 1 wherein said positioning includes positioning the consumption device proximate the shared virtual object such that a rendering location defined by the global coordinate location, at least one position and orientation of the shared virtual object are within the field of view of the consumption device.

5. The method of claim 4 wherein the method further includes positioning a plurality of markers in an environment, each marker displayed in the field of view of a consumption device, each marker denoting a shared virtual object is may be rendered near the marker.

6. The method of claim 1 wherein the shared virtual object may be any one or more of a sound, visually displayed data, a picture, and a video.

7. The method of claim 1 wherein said consumption device is a first type of processing device and the shared virtual object was created by a second type of processing device.

8. A see though head mounted display apparatus, comprising:

a see through head mounted display; and

a processor coupled to the head mounted display, the processor programmed to

receive rendering location data for a perspective-locked shared virtual object created by a capture device, the rendering location data including at least one of each of an allowable location, an allowable position, and an allowable orientation, the allowable location, allowable position, and allowable orientation permitting rendering of the shared virtual object in the head mounted display, the rendering location data matching that of a capture device used to create the shared virtual object;

determine a location, a position and an orientation of the see through head mounted display device; and

if the location, position and orientation of the head mounted display device are proximate to the allowable location, allowable position, and allowable orientation, render the shared virtual object in the see through head mounted display.

9. The apparatus of claim 8 wherein said processor, responsive to the perspective-locked shared virtual object, is programmed to render the perspective-locked shared virtual object when the see through head mounted display is at the same global location, position and orientation defined in the shared virtual object.

10. The apparatus of claim 8 wherein said processor is further programmed to capture perspective-locked shared virtual object rendering data, the data including rendering location data for perspective-locked shared virtual object, the rendering location data including at least a global coordinate location, and at least one position and at least one orientation for the virtual object with respect to a local coordinate system within a field of view of a consumption device.

11. The apparatus of claim 10 wherein the apparatus includes at least an audio sensor and a video camera, and said processor is further programmed to capture perspective-locked shared virtual object rendering data using said audio sensor and video camera.

12. The apparatus of claim 11 wherein said processor is further programmed to determine positions of a plurality of markers in an environment, each marker displayed in a field of view of a display, each marker denoting a perspective-locked object may be rendered near the marker.

13. The apparatus of claim 12 wherein said processor is further programmed to determine a difference between rendering location data and the apparatus, and provide directions on movement for the apparatus to reach the location, position and orientation of the head mounted display device proximate to the allowable location.

14. An apparatus for creating a shared virtual object, comprising:

a capture device;

a processing device coupled to the capture device, the processing device programmed to perform a method comprising the steps of;

determining a position of the capture device;

determining a global coordinate location, position and orientation of the capture device;

capturing a shared perspective-locked virtual object including creating shared virtual object rendering data, the data including rendering location data for the shared virtual object, the rendering location data including at least a global coordinate location, and at least one position and at least one orientation for the virtual object with respect to a local coordinate system within a field of view of a consumption device; and

sharing the shared perspective-locked virtual object.

15. The apparatus of claim 14 wherein the apparatus further includes code programming the processing device to assign a marker to a global coordinate location associated with the shared perspective-locked virtual object.

16. The apparatus of claim 14 wherein the apparatus further includes code programming the processing device to assign a world-locked or local-locked status to the shared perspective-locked virtual object.

17. The apparatus of claim 16 wherein the apparatus further includes code programming the processing device to assign a world locked object to a location, and determine a plurality of allowable global coordinate locations, allowable positions and allowable orientations for a consumption device to render the shared perspective-locked virtual object.

18. The apparatus of claim 16 wherein the apparatus further includes code programming the processing device to determine one allowable global coordinate location, position and orientation for a consumption device to render the shared perspective-locked virtual object as a local locked object.

19. The apparatus of claim 14 wherein the capture device includes at least an audio sensor and a video camera, and wherein the apparatus further includes code programming the processing device to capture perspective-locked shared virtual object rendering data using said audio sensor and video camera.

20. The apparatus of claim 14 further including a display, wherein the apparatus further includes code programming the processing device to

receive rendering location data for a second perspective-locked shared virtual object created by another capture device, the rendering location data including at least one of each of an allowable location, allowable position, and allowable orientation;

determine a location, a position and an orientation of the apparatus;

if the location, position and orientation of the apparatus is proximate to the allowable location, allowable position, and allowable orientation, rendering the shared virtual object in the see through head mounted display.