AUGMENTED REALITY SYSTEM

• US 20130010068A1
• Filed: 04/12/2012
• Published: 01/10/2013
• Est. Priority Date: 04/12/2011
• Status: Abandoned Application

• Current Assignee: Radiation Monitoring Devices, Inc. (Dynasil Corp. of America)
• Original Assignee: Radiation Monitoring Devices, Inc. (Dynasil Corp. of America)
• Inventors: Tiernan, Timothy C., Osborn, Kevin Grant, Keemon, Thomas Anthony Jr., Vinci, Robert
• Application Number:
  US13/445,448
• Publication Number:
  US 20130010068A1
• Time in Patent Office: Days
• US Class Current: 348/46
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments

Abstract

Methods and systems for providing an augmented reality system are disclosed. In one instance, an augmented reality system may: identify a feature within a three-dimensional environment; project information into the three-dimensional environment; collect an image of the three-dimensional environment and the projected information; determine at least one of distance and orientation of the feature from the projected information; identify an object within the three-dimensional environment; and perform markerless tracking of the object.

Claims

1. A method for providing an augmented reality, the method comprising:

identifying a feature within a three-dimensional environment;

projecting first information into the three-dimensional environment;

collecting an image of the three-dimensional environment and the projected information;

determining at least one of distance and orientation of the feature from the projected first information in the collected image;

identifying an object within the three-dimensional environment; and

performing markerless tracking of the object.

2. The method of claim 1 further comprising moving at least one of a camera and the object to get three-dimensional information related to the object.

3. The method of claim 1 further comprising projecting second information onto the object.

4. The method of claim 3 further comprising maintaining the projected second information on the object while moving.

5. The method of claim 1 wherein markerless tracking comprises SLAM techniques.

6. The method of claim 1 further comprising determining the distance from the size of the projected first information in the image.

7. The method of claim 1 further comprising determining the orientation from the shape of the projected first information in the image.

8. The method of claim 1 further comprising providing a single camera to collect the image.

9. The method of claim 1 further comprising performing at least one of a condition-based maintenance, training, planning, operations, manufacturing, and educational process.

10. The method of claim 1, wherein the first information is light.

11. A method for providing augmented reality, the method comprising:

collecting visual information of a three-dimensional environment;

identifying a plurality of features within the three-dimensional environment;

comparing the plurality of features to a visual signature to identify a situation;

performing markerless tracking of the plurality of features; and

providing a visual prompt to a user regarding the identified situation.

12. The method of claim 11, wherein the visual prompt is information projected into the three-dimensional environment.

13. The method of claim 11 further comprising selecting how much information is provided by the visual prompt.

14. The method of claim 11, wherein the visual signature comprises a subset of the plurality of features.

15. The method of claim 11 further comprising locating and providing information regarding the identified situation to the user.

16. The method of claim 11 further comprising tracking a user within the environment.

17. The method of claim 11 wherein the situation is at least one of a repair, training, planning, operations, manufacturing, and educational process.

18. The method of claim 17 further comprising monitoring the user'"'"'s time on task to evaluate a performance of the user.

19. The method of claim 17 further comprising detecting errors by the user.

20. The method of claim 11, wherein the situation is a condition-based maintenance procedure.

21. The method of claim 20 further comprising automatically tracking at least one of parts usage and frequency of failure modes.

22. The method of claim 21 further comprising analyzing at least one of the parts usage and frequency of failure modes to identify components for reengineering.

23. The method of claim 21 further comprising analyzing at least one of the parts usage and frequency of failure modes to optimize a repair procedure sequence.

24. A method for providing augmented reality authoring, the method comprising:

using markerless identification to identify an object;

providing a user interface for labeling features on the identified object in an augmented reality; and

tracking the labeled features on the identified object.

25. The method of claim 24, further comprising projecting information onto the object.

26. The method of claim 25, wherein the projected information is light.

27. The method of claim 24, wherein markerless identification comprises SLAM techniques.

28. The method of claim 24 further comprising using the user interface to input instructions regarding the labeled features.

29. The method of claim 28 wherein the instructions regard a repair process.

30. The method of claim 24 wherein labeling features further comprises labeling features with at least one of text, icons, shapes, and arrows.

31. The method of claim 24 further comprising selecting a feature on the object to label with the user interface using a light source.

32. The method of claim 31, wherein the light source comprises a laser.

33. The method of claim 24 further comprising determining at least one of a three-dimensional position and orientation of the object within a three-dimensional environment.

34. A method for providing augmented reality, the method comprising:

providing a light source;

projecting information into a three-dimensional environment with the light source;

collecting an image with a camera, wherein the image comprises the information projected into the environment;

determining a first coordinate system of the camera from the information projected into the three-dimensional environment;

determining a second coordinate system of the light source from the information projected into the three-dimensional environment; and

determining a relative offset between the first and second coordinate systems.

35. The method of claim 34, wherein a relative offset is at least one of an angle and distance.

36. A method for providing augmented reality, the method comprising:

providing a camera;

collecting a first image of a three-dimensional environment with the camera;

automatically identifying a situation;

automatically determining an action to be performed from the identified situation;

performing the determined action;

collecting a second image of the three-dimensional environment with the camera; and

determining a response to the performed action.

37. The method of claim 36, wherein the identified situation is at least one of an aviation, manufacturing process, maintenance procedure, train, ship, and control room situation.

38. The method of claim 36, wherein the determined action comprises adjusting a system setting.

39. An augmented reality system comprising:

a camera;

a light source; and

a controller adapted to send a signal to the light source to project first information into a three-dimensional environment, receive a signal from the camera, identify a feature in the environment, determine at least one of distance and orientation of the feature using the first information, determine at least one of distance and orientation of a feature in the environment from the signal from the camera, identify an object within the three-dimensional environment, and track the object using markerless tracking.

40. The augmented reality system of claim 39 further comprising at least one of an infrared sensor, a high resolution camera, a curve tracer, an oscilloscope, a current probe, a voltage probe, and an ohmmeter.

41. The augmented reality system of claim 40, wherein the controller receives information from the at least one of the infrared sensor, the high resolution camera, the curve tracer, the oscilloscope, the current probe, the voltage probe, and the ohmmeter.

42. The augmented reality system of claim 39 further comprising an audio input device for receiving commands from a user.

43. The augmented reality system of claim 39 further comprising an audio output device for providing audible prompts to a user.

44. The augmented reality system of claim 39, wherein the controller tracks the feature using markerless tracking.

45. The augmented reality system of claim 39, wherein at least one of the camera, the projector, and the controller is worn by a user.

46. The augmented reality system of claim 39, wherein at least one of the camera, the projector, and the controller is integrated into a workbench.