COORDINATE-SYSTEM SHARING FOR AUGMENTED REALITY

• US 20130194304A1
• Filed: 02/01/2012
• Published: 08/01/2013
• Est. Priority Date: 02/01/2012
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Latta, Stephen, Bennett, Darren, Kinnebrew, Peter Tobias, Geisner, Kevin, Mount, Brian, Tomlin, Arthur, Scavezze, Mike, McCulloch, Daniel, Nister, David, Steedly, Drew, Kohler, Jeffrey Alan, Sugden, Ben, Sylvan, Sebastian
• Application Number:
  US13/364,211
• Publication Number:
  US 20130194304A1
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G09G 3/003 to produce spatial visual effects

Abstract

A method for presenting real and virtual images correctly positioned with respect to each other. The method includes, in a first field of view, receiving a first real image of an object and displaying a first virtual image. The method also includes, in a second field of view oriented independently relative to the first field of view, receiving a second real image of the object and displaying a second virtual image, the first and second virtual images positioned coincidently within a coordinate system.

Claims

1. A method for presenting real and virtual images correctly positioned with respect to each other, the method comprising:

in a first field of view, receiving a first real image of an object and displaying a first virtual image, the object defining at least an origin of a coordinate system; and

in a second field of view oriented independently relative to the first field of view, receiving a second real image of the object and displaying a second virtual image, the first and second virtual images positioned coincidently within the coordinate system.

2. The method of claim 1 wherein the first field of view is a field of view of an augmented-reality participant, wherein the first virtual image is displayed via a see-through, head-mounted display device worn by the participant, and wherein the participant sights the object through the HMD device.

3. The method of claim 1 wherein the object also defines an orientation of the coordinate system.

4. The method of claim 1 wherein the first and second fields of view exclude at least some space between them.

5. The method of claim 1 wherein the object is stationary with respect to the coordinate system.

6. The method of claim 1 further comprising:

acquiring video of the object;

locating the object in the video; and

in one frame of the video, mapping coordinates to the object that define its position and orientation within the coordinate system.

7. The method of claim 6 further comprising assigning metadata to the object.

8. The method of claim 6 further comprising attaching a virtual object to the object.

9. The method of claim 6 wherein the video of the object together with the coordinates mapped to the object define the position and orientation of the first field of view within the coordinate system, the method further comprising:

transforming desired coordinates of the first virtual image to coordinates relative to the first field of view, wherein displaying the first virtual image comprises displaying the first virtual image at the transformed coordinates.

10. The method of claim 6 further comprising tracking the object through a sequence of frames of the video.

11. The method of claim 6 wherein the object is a first object, the method further comprising:

determining coordinates within the coordinate system of a second object also sighted by the participant based on the mapped coordinates of the first object and on the displacement of the first real image relative to a real image of the second object received in the first field of view.

12. The method of claim 6 wherein mapping the coordinates to the object includes receiving the coordinates of the object as sighted in the second field of view.

13. The method of claim 6 further comprising:

maintaining the coordinates of the object on a network-accessible computer; and

downloading the coordinates from the network-accessible computer in real time.

14. An augmented-reality system comprising:

an optic through which an object is sighted in a first field of view;

a camera configured to acquire video of the object;

a sensor configured to bracket a position and/or orientation of the first field of view within a coordinate system shared by a second, independently oriented field of view; and

a projector configured to display a first virtual image in the first field of view, the first virtual image positioned within the coordinate system coincident with a second virtual image displayed in the second field of view, the optic, camera, sensor, and projector coupled in a see-through, head-mounted display (HMD) device.

15. The system of claim 14 wherein the first and second fields of view are non-overlapping.

16. The system of claim 14 wherein the sensor includes a global positioning system receiver.

17. The system of claim 14 wherein the sensor includes a receiver configured to sense proximity to another HMD device.

18. The system of claim 14 wherein the sensor includes a receiver configured to read data from a circuit embedded in the object that transmits the object'"'"'s coordinates and/or identity.

19. The system of claim 14 further comprising a computer external to the HMD device and configured to maintain a mapping of an environment for access by the HMD device.

20. An augmented-reality system comprising:

a first head-mounted display device, including;

a first optic in which an object is sighted in a first field of view,

a first camera configured to acquire video of the object,

a first projector configured to display a first virtual image, the object defining at least an origin of a coordinate system; and

a communication subsystem configured to communicate with a remote computer, the remote computer configured to communicate with a second head-mounted display device having a second optic in which the object is sighted in a second field of view oriented independently relative to the first field of view, a second camera configured to acquire video of the object, and a second projector configured to display a second virtual image, the first and second virtual images positioned coincidently within the coordinate system;

the remote computer configured to maintain, for access by the first head-mounted display device and the second head-mounted display device, a mapping of an environment in which the augmented-reality system is used.