Methods and Systems for Providing Procedures in Real-Time

• US 20150302650A1
• Filed: 04/01/2015
• Published: 10/22/2015
• Est. Priority Date: 04/16/2014
• Status: Abandoned Application

• Current Assignee: Dennis Cafiero, Eng Tat Khoo, Hazem M. Abdelmoati, Ying-Chieh Huang
• Original Assignee: Dennis Cafiero, Eng Tat Khoo, Hazem M. Abdelmoati, Ying-Chieh Huang
• Inventors: Abdelmoati, Hazem M., Khoo, Eng Tat, Cafiero, Dennis, Huang, Ying-Chieh
• Application Number:
  US14/676,299
• Publication Number:
  US 20150302650A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06Q 10/00 Administration; Management
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

Systems and methods for providing users with an augmented view of a work environment are provided. The method includes downloading data relevant to a component in the work environment onto a mobile device. The work environment is navigated to locate the component based on prompts provided by the mobile device. An augmented reality (AR) marker located proximate to the component is scanned with the mobile device to access interactive procedures relevant to the component. One or more of the interactive procedures are performed.

Claims

1. A method of providing users with an augmented view of a work environment in a facility, comprising:

downloading data relevant to a component in the work environment onto a mobile device;

navigating the work environment to locate the component based on prompts provided by the mobile device;

scanning, with the mobile device, an augmented reality (AR) marker located proximate to the component to access interactive procedures relevant to the component; and

performing one or more of the interactive procedures.

2. The method of claim 1, comprising downloading an augmented reality system to the mobile device.

3. The method of claim 1, comprising accessing data on the component based, at least in part, on location data.

4. The method of claim 1, comprising providing an overlay over a real-time image of the work environment, wherein the overlay comprises interactive procedures relevant to the component in the real-time image.

5. The method of claim 1, comprising displaying a step in one of the interactive procedures, wherein the step is confirmed as completed before another step is provided.

6. The method of claim 1, comprising verifying a location within the work environment after locating the component.

7. The method of claim 1, wherein scanning the AR marker comprises decoding information in the AR marker.

8. The method of claim 1, comprising:

identifying the location of the mobile device; and

determining the orientation of the mobile device relative to the component.

9. The method of claim 1, wherein the data comprises operation procedures, manuals, checklists, animations of plant components, or any combinations thereof.

10. The method of claim 1, comprising recording observations, wherein the observations comprise notes, images, operating parameters, or any combinations thereof.

11. The method of claim 1, comprising logging a work flow during completion of one or more of the interactive procedures.

12. A system for providing a real-time view of a work environment on a display, comprising:

a mobile device, comprising;

a processor;

a camera;

a touch screen display; and

a storage system, comprising;

an augmented reality (AR) system;

a location module configured to direct the processor to determine a location for the mobile device in the work environment;

a context awareness module configured to confirm that the location is correct; and

a graphical user interface (GUI) configured to display a real-time image of the work environment on the touch screen display and overlay augmented reality (AR) graphics over the real-time image utilizing the AR system.

13. The system of claim 12, comprising a server, which server comprises a database, wherein the database comprises operating procedures, manuals, checklists, photographs, process flow diagrams, or operating parameters, or any combinations thereof.

14. The system of claim 13, wherein the database comprises three-dimensional (3D) graphics.

15. The system of claim 13, comprising a wireless local area network (WLAN), wherein the mobile device is configured to download information from the server over the WLAN.

16. The system of claim 13, comprising a network interface card (NIC) configured to download information from the server over a wired connection.

17. The system of claim 12, comprising a note-taking module configured to record observations.

18. The system of claim 12, comprising an augmented reality (AR) marker located proximate to a component in a facility, wherein the AR marker comprises information related to the component.

19. The system of claim 12, comprising interactive procedures, wherein the interactive procedures comprise operating procedures, computer aided design (CAD) models, images, videos, animations, or any combinations thereof.

20. The system of claim 12, comprising a work log module configured to record actions of a work flow during the operation of the mobile device.

21. A mobile device, comprising:

a processor;

a camera;

a touch screen display; and

a storage system, comprising;

an augmented reality (AR) system;

a location module configured to direct the processor to determine a location and orientation for the mobile device in a work environment;

a context awareness module configured to confirm that the location is correct and identify interactive procedures for the location; and

a graphical user interface (GUI) configured to display a real-time image of the work environment on the touch screen display and overlay the interactive procedures over the real-time image utilizing the AR system.

22. The mobile device of claim 21, wherein the location module accesses a global positioning system receiver and an accelerometer.