System and method to display maintenance and operational instructions of an apparatus using augmented reality
First Claim
1. A framework comprising:
- a head-mounted display constructed and adapted to provide a user with an augmented view of an object being viewed;
a tracking mechanism constructed and adapted to repeatedly determine the position and orientation of the head-mounted display relative the object being viewed, wherein the tracking system is constructed and adapted to determine its position using a plurality markers located on the object being viewed; and
a computer system constructed and adapted to provide information for the augmented view and to repeatedly update the augmented view of the object being viewed based, at least in part, on the determined position and orientation of the display,wherein the augmented view presents the information so as to appear at a specific location relative to a specific part of the object,wherein the object being viewed is selected from;
an apparatus, a device, an instrument panel and a machine; and
wherein the information for the augmented view is selected from;
maintenance and repair information for the object, and wherein the augmented view of the object presents the information at particular locations relative to the object being viewed.
3 Assignments
0 Petitions
Accused Products
Abstract
A head-mounted display provides a user with an augmented view of an object being viewed; a tracking mechanism such as a camera repeatedly determine the position and orientation of the head-mounted display relative the object being viewed; and a computer system provides information for the augmented view and repeatedly updates the augmented view of the object being viewed based on the determined position and orientation of the display. The head-mounted display may be a see-through display; it may be video-based or optical-based, and it may be monoscopic and stereoscopic. The tracking mechanism determines its position using one or more markers or beacons on the object being viewed. The markers may be active or passive, including light-emitting diodes (LEDs) that emit invisible light.
355 Citations
27 Claims
-
1. A framework comprising:
-
a head-mounted display constructed and adapted to provide a user with an augmented view of an object being viewed; a tracking mechanism constructed and adapted to repeatedly determine the position and orientation of the head-mounted display relative the object being viewed, wherein the tracking system is constructed and adapted to determine its position using a plurality markers located on the object being viewed; and a computer system constructed and adapted to provide information for the augmented view and to repeatedly update the augmented view of the object being viewed based, at least in part, on the determined position and orientation of the display, wherein the augmented view presents the information so as to appear at a specific location relative to a specific part of the object, wherein the object being viewed is selected from;
an apparatus, a device, an instrument panel and a machine; and
wherein the information for the augmented view is selected from;
maintenance and repair information for the object, and wherein the augmented view of the object presents the information at particular locations relative to the object being viewed. - View Dependent Claims (2, 3, 4, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21)
-
-
5. (canceled)
-
22. A method comprising:
-
repeatedly determining a relative position and orientation of a user with respect to a object being viewed by the user, wherein the object has a plurality of markers located thereon, and wherein said determining is based at least in part on at least some of the markers; and based on said determined position and orientation, repeatedly providing the user with an augmented view of the object being viewed, wherein the augmented view presents the information so as to appear at a specific location relative to a specific part of the object, wherein the object being viewed is selected from;
an apparatus, a device, an instrument panel and a machine; and
wherein the information for the augmented view is selected from;
maintenance and repair information for the object, and wherein the augmented view of the object presents the information at particular locations relative to the object being viewed. - View Dependent Claims (23, 24, 25)
-
-
26. A method, in a system having a plurality of actual objects, each of said plurality of actual objects having at least one distinct identification marker associated therewith and having a plurality of position markers associated therewith, the method comprising:
-
(a) obtaining an image, said image including a representation of an actual object, said image corresponding substantially with a user'"'"'s view of the actual object; (b) identifying said actual object represented in said image, said identifying being based, at least in part, on at least one distinct identification marker associated with the actual object; (c) determining a relative position and orientation of said user with respect to the identified actual object, said determining being based at least in part on at least some of said position markers; and (d) providing the user with an augmented view of the actual object; wherein the augmented view presents the information so as to appear at a specific location relative to a specific part of the actual object. - View Dependent Claims (27)
-
Specification